2024-09-19T13:25:05.146 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T13:25:05.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T13:25:05.257 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478 branch: wip-yuval-test description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7912478' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuval-test ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 rgw: compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuval-test sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 owner: scheduled_yuvalif@teuthology priority: 50 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4251 sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 sleep_before_teardown: 0 subset: 1/3 suite: rgw suite_branch: wip-yuval-test suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 targets: smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFf4C2A7mt0ArQ9ClcK4cffcTlaPzVzvOzZYfqliVkjbpGnxE0TpqWNpQe2vKNqa4pTyu7OsVIc9ckX0HMAFWzI= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKOt28hbj9297lfXWcM1RMO3nRi1HjEfiAUBCSIv9qSI3Gw7D0EeDzfXEFSUgV/miHJeMWwso6SaCg1Q7g8XWw= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-19_13:09:30 tube: smithi user: yuvalif verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T13:25:05.257 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa; will attempt to use it 2024-09-19T13:25:05.258 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa/tasks 2024-09-19T13:25:05.258 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T13:25:05.260 INFO:teuthology.task.internal:Checking packages... 2024-09-19T13:25:05.280 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '08af21e0d16078b88ddf808fe9ba2ab84dbe6754' 2024-09-19T13:25:05.280 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T13:25:05.280 INFO:teuthology.packaging:ref: None 2024-09-19T13:25:05.280 INFO:teuthology.packaging:tag: None 2024-09-19T13:25:05.280 INFO:teuthology.packaging:branch: wip-yuval-test 2024-09-19T13:25:05.280 INFO:teuthology.packaging:sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:25:05.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuval-test 2024-09-19T13:25:05.427 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5012.g08af21e0 2024-09-19T13:25:05.428 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T13:25:05.438 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T13:25:05.438 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T13:25:05.445 INFO:teuthology.task.internal:Saving configuration 2024-09-19T13:25:05.461 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T13:25:05.468 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T13:25:05.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 13:20:07.800673', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFf4C2A7mt0ArQ9ClcK4cffcTlaPzVzvOzZYfqliVkjbpGnxE0TpqWNpQe2vKNqa4pTyu7OsVIc9ckX0HMAFWzI='} 2024-09-19T13:25:05.531 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 13:20:07.798637', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKOt28hbj9297lfXWcM1RMO3nRi1HjEfiAUBCSIv9qSI3Gw7D0EeDzfXEFSUgV/miHJeMWwso6SaCg1Q7g8XWw='} 2024-09-19T13:25:05.531 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T13:25:05.538 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-19T13:25:05.538 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-19T13:25:05.538 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T13:25:05.640 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f17e3dd7ac0>, signals=[15]) 2024-09-19T13:25:05.640 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T13:25:05.646 INFO:teuthology.task.internal:Opening connections... 2024-09-19T13:25:05.646 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T13:25:05.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:25:05.731 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T13:25:05.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:25:05.813 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T13:25:05.819 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-09-19T13:25:05.837 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-09-19T13:25:05.837 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-09-19T13:25:05.895 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-09-19T13:25:05.896 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T13:25:05.896 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-09-19T13:25:05.896 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T13:25:05.896 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T13:25:05.896 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T13:25:05.896 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-09-19T13:25:05.930 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-19T13:25:05.948 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-19T13:25:05.949 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T13:25:06.007 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-09-19T13:25:06.008 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-09-19T13:25:06.008 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T13:25:06.008 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-09-19T13:25:06.008 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T13:25:06.008 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T13:25:06.008 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T13:25:06.008 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-19T13:25:06.038 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T13:25:06.047 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T13:25:06.052 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T13:25:06.052 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-09-19T13:25:06.055 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-19T13:25:06.071 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T13:25:06.077 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T13:25:06.077 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-09-19T13:25:06.112 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-19T13:25:06.139 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T13:25:06.213 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T13:25:06.227 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T13:25:06.227 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T13:25:06.228 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T13:25:06.228 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T13:25:06.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:25:06.245 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-19T13:25:06.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:25:06.246 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-19T13:25:06.303 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-503.el9.x86_64 2024-09-19T13:25:06.304 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.14.0-503.el9.x86_64 2024-09-19T13:25:06.304 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum install -y kernel 2024-09-19T13:25:06.305 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-503.el9.x86_64 2024-09-19T13:25:06.305 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-503.el9.x86_64 2024-09-19T13:25:06.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-09-19T13:25:08.744 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T13:25:11.806 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.3 MB 00:03 2024-09-19T13:25:11.862 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-19T13:25:17.029 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-19T13:25:17.415 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-19T13:25:18.529 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-19T13:25:19.458 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T13:25:21.666 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T13:25:23.883 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-19T13:25:24.779 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T13:25:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T13:25:26.812 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T13:25:26.813 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T13:25:26.905 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-19T13:25:26.910 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-09-19T13:25:26.911 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:25:26.912 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 79 M 2024-09-19T13:25:26.912 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 126 M 2024-09-19T13:25:26.912 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-19T13:25:27.240 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 435 kB/s | 36 kB 00:00 2024-09-19T13:25:27.715 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-19T13:25:28.341 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-19T13:25:28.658 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-19T13:25:28.658 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-19T13:25:28.658 INFO:teuthology.orchestra.run.smithi149.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-19T13:25:29.346 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-19T13:25:29.723 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-19T13:25:29.723 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-19T13:25:30.202 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T13:25:30.676 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-19T13:25:30.676 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-19T13:25:32.109 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T13:25:32.109 INFO:teuthology.orchestra.run.smithi094.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T13:25:32.205 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout: Package Architecture Version Repository Size 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T13:25:32.212 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout:Install 4 Packages 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 79 M 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 126 M 2024-09-19T13:25:32.213 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-19T13:25:32.595 INFO:teuthology.orchestra.run.smithi094.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 278 kB/s | 36 kB 00:00 2024-09-19T13:25:33.117 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-19T13:25:33.852 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T13:25:33.941 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T13:25:36.717 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T13:25:36.861 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T13:25:39.520 INFO:teuthology.orchestra.run.smithi094.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-19T13:25:41.673 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T13:25:41.761 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:25:45.736 INFO:teuthology.orchestra.run.smithi094.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-19T13:25:46.649 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:25:47.745 INFO:teuthology.orchestra.run.smithi094.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.3 MB/s | 35 MB 00:15 2024-09-19T13:25:47.745 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-19T13:25:47.745 INFO:teuthology.orchestra.run.smithi094.stdout:Total 5.1 MB/s | 79 MB 00:15 2024-09-19T13:25:48.430 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-19T13:25:48.787 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-19T13:25:48.788 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-19T13:25:49.746 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-19T13:25:49.747 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-19T13:25:52.177 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-19T13:25:52.835 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T13:25:52.928 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T13:25:55.675 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T13:25:55.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T13:26:00.603 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T13:26:00.703 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:05.543 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:24.541 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:24.580 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T13:26:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T13:26:24.969 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:26:25.810 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-19T13:26:26.160 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T13:26:26.257 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T13:26:26.257 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T13:26:26.257 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T13:26:26.257 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T13:26:26.257 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T13:26:26.258 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T13:26:26.258 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T13:26:26.258 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T13:26:26.317 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T13:26:26.318 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T13:26:26.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-09-19T13:26:26.350 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 82.el9 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8274670 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T13:26:26.351 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-09-19T13:26:26.352 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:26:26.353 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T13:26:26.353 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T13:26:26.354 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-508.el9.x86_64 2024-09-19T13:26:26.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T13:26:27.030 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-19T13:26:28.430 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22675: grub2-probe 2024-09-19T13:26:28.430 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22675: grub2-probe 2024-09-19T13:26:28.463 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22675: grub2-probe 2024-09-19T13:26:28.463 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22675: grub2-probe 2024-09-19T13:26:28.628 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22723: grub2-probe 2024-09-19T13:26:28.628 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22723: grub2-probe 2024-09-19T13:26:28.662 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22723: grub2-probe 2024-09-19T13:26:28.662 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22723: grub2-probe 2024-09-19T13:26:28.799 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22771: grub2-probe 2024-09-19T13:26:28.799 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22771: grub2-probe 2024-09-19T13:26:28.832 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22771: grub2-probe 2024-09-19T13:26:28.832 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22771: grub2-probe 2024-09-19T13:26:28.978 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22819: grub2-probe 2024-09-19T13:26:28.978 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22819: grub2-probe 2024-09-19T13:26:29.010 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22819: grub2-probe 2024-09-19T13:26:29.010 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22819: grub2-probe 2024-09-19T13:26:29.162 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22867: grub2-probe 2024-09-19T13:26:29.162 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22867: grub2-probe 2024-09-19T13:26:29.202 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 3 (pipe:[36488]) leaked on vgs invocation. Parent PID 22867: grub2-probe 2024-09-19T13:26:29.202 INFO:teuthology.orchestra.run.smithi149.stderr:File descriptor 9 (pipe:[51168]) leaked on vgs invocation. Parent PID 22867: grub2-probe 2024-09-19T13:26:29.354 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T13:26:29.376 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-19T13:26:29.378 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-19T13:26:29.394 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.gJp1bWUbYw 2024-09-19T13:26:29.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gJp1bWUbYw 2024-09-19T13:26:29.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.gJp1bWUbYw 2024-09-19T13:26:29.596 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.gJp1bWUbYw is 6KB 2024-09-19T13:26:29.617 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.gJp1bWUbYw 2024-09-19T13:26:29.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T13:26:29.694 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T13:26:29.695 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T13:26:29.695 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T13:26:29.695 INFO:teuthology.orchestra.run.smithi149.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T13:26:29.696 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T13:26:29.837 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-09-19T13:26:43.876 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:43.916 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:44.280 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:44.280 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T13:26:44.280 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T13:26:44.280 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T13:26:45.108 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T13:26:45.108 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:26:45.108 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-19T13:26:45.108 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T13:26:45.108 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T13:26:45.109 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T13:26:45.109 INFO:teuthology.orchestra.run.smithi094.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T13:26:45.109 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:26:45.109 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-19T13:26:45.484 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T13:26:45.560 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T13:26:45.560 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T13:26:45.560 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T13:26:45.560 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T13:26:45.561 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T13:26:45.564 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T13:26:45.564 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T13:26:45.564 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T13:26:45.622 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T13:26:45.622 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T13:26:45.623 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2024-09-19T13:26:45.660 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2024-09-19T13:26:45.660 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2024-09-19T13:26:45.660 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.06 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 82.el9 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Group : Unspecified 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 8274670 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T13:26:45.661 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : builder@centos.org 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2024-09-19T13:26:45.662 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:26:45.663 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T13:26:45.663 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T13:26:45.664 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 5.14.0-508.el9.x86_64 2024-09-19T13:26:45.664 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T13:26:46.289 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-09-19T13:26:47.631 INFO:teuthology.orchestra.run.smithi094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T13:26:47.660 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-09-19T13:26:47.662 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-19T13:26:47.677 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.jVb9CvPADv 2024-09-19T13:26:47.677 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jVb9CvPADv 2024-09-19T13:26:47.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.jVb9CvPADv 2024-09-19T13:26:47.875 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.jVb9CvPADv is 6KB 2024-09-19T13:26:47.923 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.jVb9CvPADv 2024-09-19T13:26:47.938 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T13:26:48.005 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T13:26:48.005 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T13:26:48.005 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T13:26:48.006 INFO:teuthology.orchestra.run.smithi094.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T13:26:48.007 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T13:26:48.145 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-09-19T13:26:59.852 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T13:26:59.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:26:59.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:27:18.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T13:27:18.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-19T13:27:18.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:27:18.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-19T13:27:27.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:27:27.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:27:30.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-19T13:27:36.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-09-19T13:27:42.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:27:42.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:27:45.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-19T13:27:45.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:27:48.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-09-19T13:28:00.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-19T13:28:00.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:28:00.833 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-19T13:28:15.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:28:15.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:28:16.348 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-19T13:28:16.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:28:16.882 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T13:28:16.882 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-19T13:28:16.897 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-508.el9.x86_64 2024-09-19T13:28:16.897 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T13:28:16.897 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T13:28:16.898 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T13:28:17.899 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T13:28:17.899 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T13:28:17.977 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-09-19T13:28:18.015 DEBUG:teuthology.parallel:result is None 2024-09-19T13:28:32.447 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-19T13:28:32.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-19T13:28:32.824 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T13:28:32.824 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-19T13:28:32.839 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-508.el9.x86_64 2024-09-19T13:28:32.839 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T13:28:32.839 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T13:28:32.839 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T13:28:33.840 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T13:28:33.840 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T13:28:33.983 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-09-19T13:28:34.005 DEBUG:teuthology.parallel:result is None 2024-09-19T13:28:34.005 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T13:28:34.012 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T13:28:34.012 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T13:28:34.014 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T13:28:34.034 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T13:28:34.042 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T13:28:34.050 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T13:28:34.050 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T13:28:34.077 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T13:28:34.181 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T13:28:34.188 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T13:28:34.188 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T13:28:34.194 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T13:28:34.225 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:28:34.237 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:28:34.375 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:28:34.395 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:28:34.397 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T13:28:34.404 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T13:28:34.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T13:28:34.407 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T13:28:34.468 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T13:28:34.477 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T13:28:34.478 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T13:28:34.480 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T13:28:34.516 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T13:28:34.631 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T13:28:34.700 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T13:28:34.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T13:28:34.842 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:28:34.842 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T13:28:34.900 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T13:28:34.954 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T13:28:35.008 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T13:28:35.076 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T13:28:35.103 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:28:35.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T13:28:35.169 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-09-19T13:28:35.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-19T13:28:35.224 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T13:28:35.258 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T13:28:35.801 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T13:28:35.809 INFO:teuthology.task.internal:Starting timer... 2024-09-19T13:28:35.809 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T13:28:35.820 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T13:28:35.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-09-19T13:28:35.951 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-09-19T13:28:35.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-09-19T13:28:36.042 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-09-19T13:28:36.044 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T13:28:36.044 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-09-19T13:28:36.078 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-09-19T13:28:36.079 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-09-19T13:28:36.103 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-09-19T13:28:36.103 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi094.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2024-09-19T13:28:36.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T13:28:36.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:28:36.140 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T13:28:36.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:28:36.170 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T13:28:36.170 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-09-19T13:28:36.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-09-19T13:28:36.245 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T13:28:36.255 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T13:28:36.258 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T13:28:36.383 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T13:28:36.393 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T13:28:36.394 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi094.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T13:32:25.680 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi094.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-19T13:32:25.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-19T13:32:25.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:32:25.787 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-19T13:32:25.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-19T13:32:25.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:32:25.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:32:25.967 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-19T13:32:26.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-19T13:32:26.050 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T13:32:26.060 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T13:32:26.060 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T13:32:26.061 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T13:32:26.063 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T13:32:26.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T13:32:26.090 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T13:32:26.105 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T13:32:26.119 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T13:32:26.129 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-09-19T13:32:26.133 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T13:32:26.140 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-09-19T13:32:26.154 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T13:32:26.158 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-09-19T13:32:26.168 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T13:32:26.169 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-09-19T13:32:26.184 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T13:32:26.198 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T13:32:26.225 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-19T13:32:26.226 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T13:32:26.227 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-19T13:32:26.227 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.227 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.227 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.227 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.256 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-19T13:32:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T13:32:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-19T13:32:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.260 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T13:32:26.261 INFO:teuthology.run_tasks:Running task install... 2024-09-19T13:32:26.269 DEBUG:teuthology.task.install:project ceph 2024-09-19T13:32:26.269 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}} 2024-09-19T13:32:26.269 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'} 2024-09-19T13:32:26.269 INFO:teuthology.task.install:Using flavor: default 2024-09-19T13:32:26.275 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T13:32:26.275 INFO:teuthology.task.install:extra packages: [] 2024-09-19T13:32:26.275 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'tag': None, 'wait_for_package': False} 2024-09-19T13:32:26.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:32:26.278 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'tag': None, 'wait_for_package': False} 2024-09-19T13:32:26.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:32:26.430 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/ 2024-09-19T13:32:26.431 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5012.g08af21e0 2024-09-19T13:32:26.449 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/ 2024-09-19T13:32:26.449 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5012.g08af21e0 2024-09-19T13:32:26.555 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T13:32:26.555 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:32:26.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T13:32:26.568 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T13:32:26.568 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:32:26.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T13:32:26.581 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-19T13:32:26.581 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T13:32:26.595 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-19T13:32:26.595 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T13:32:26.646 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T13:32:26.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T13:32:26.721 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T13:32:26.736 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T13:32:26.786 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-09-19T13:32:26.787 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-09-19T13:32:26.800 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-09-19T13:32:26.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-09-19T13:32:27.007 INFO:teuthology.orchestra.run.smithi094.stdout:45 files removed 2024-09-19T13:32:27.032 INFO:teuthology.orchestra.run.smithi149.stdout:45 files removed 2024-09-19T13:32:27.034 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-19T13:32:27.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-19T13:32:27.580 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 328 kB/s | 84 kB 00:00 2024-09-19T13:32:27.626 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-19T13:32:27.864 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-19T13:32:27.910 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-19T13:32:28.124 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-19T13:32:28.185 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T13:32:28.885 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T13:32:28.915 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T13:32:30.908 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-19T13:32:35.276 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T13:32:36.860 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-19T13:32:38.173 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-19T13:32:43.529 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-19T13:32:45.714 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T13:32:45.714 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T13:32:45.806 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 6.6 k 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 900 k 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 145 k 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 1.5 M 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 154 k 2024-09-19T13:32:45.823 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 14 M 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 7.4 M 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 49 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 11 M 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 46 M 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 285 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 784 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 32 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 755 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 127 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-19T13:32:45.824 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 321 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 307 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 99 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 85 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 171 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.5 M 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-19T13:32:45.825 INFO:teuthology.orchestra.run.smithi094.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-19T13:32:45.826 INFO:teuthology.orchestra.run.smithi094.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 22 M 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 34 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 2.4 M 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 292 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 4.8 M 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 17 M 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 16 k 2024-09-19T13:32:45.827 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 25 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T13:32:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-19T13:32:45.829 INFO:teuthology.orchestra.run.smithi094.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-19T13:32:45.830 INFO:teuthology.orchestra.run.smithi094.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-19T13:32:45.831 INFO:teuthology.orchestra.run.smithi094.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-19T13:32:45.832 INFO:teuthology.orchestra.run.smithi094.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-19T13:32:45.833 INFO:teuthology.orchestra.run.smithi094.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 509 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-19T13:32:45.834 INFO:teuthology.orchestra.run.smithi094.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-19T13:32:45.835 INFO:teuthology.orchestra.run.smithi094.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-19T13:32:45.836 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-19T13:32:45.837 INFO:teuthology.orchestra.run.smithi094.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-19T13:32:45.838 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 45 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 148 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T13:32:45.839 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T13:32:45.840 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T13:32:45.841 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T13:32:45.842 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T13:32:45.843 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-19T13:32:45.844 INFO:teuthology.orchestra.run.smithi094.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-09-19T13:32:45.845 INFO:teuthology.orchestra.run.smithi094.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-19T13:32:45.846 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout:====================================================================================================== 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout:Install 284 Packages 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 2 Packages 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:32:45.847 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 322 M 2024-09-19T13:32:45.848 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-19T13:32:46.389 INFO:teuthology.orchestra.run.smithi094.stdout:(1/286): ceph-19.3.0-5012.g08af21e0.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-19T13:32:46.639 INFO:teuthology.orchestra.run.smithi094.stdout:(2/286): ceph-fuse-19.3.0-5012.g08af21e0.el9.x8 3.5 MB/s | 900 kB 00:00 2024-09-19T13:32:46.723 INFO:teuthology.orchestra.run.smithi094.stdout:(3/286): ceph-immutable-object-cache-19.3.0-501 1.7 MB/s | 145 kB 00:00 2024-09-19T13:32:46.956 INFO:teuthology.orchestra.run.smithi094.stdout:(4/286): ceph-base-19.3.0-5012.g08af21e0.el9.x8 7.9 MB/s | 5.5 MB 00:00 2024-09-19T13:32:47.040 INFO:teuthology.orchestra.run.smithi094.stdout:(5/286): ceph-mds-19.3.0-5012.g08af21e0.el9.x86 7.5 MB/s | 2.4 MB 00:00 2024-09-19T13:32:47.257 INFO:teuthology.orchestra.run.smithi094.stdout:(6/286): ceph-common-19.3.0-5012.g08af21e0.el9. 22 MB/s | 22 MB 00:00 2024-09-19T13:32:47.299 INFO:teuthology.orchestra.run.smithi094.stdout:(7/286): ceph-mgr-19.3.0-5012.g08af21e0.el9.x86 4.5 MB/s | 1.5 MB 00:00 2024-09-19T13:32:47.491 INFO:teuthology.orchestra.run.smithi094.stdout:(8/286): ceph-mon-19.3.0-5012.g08af21e0.el9.x86 11 MB/s | 4.8 MB 00:00 2024-09-19T13:32:47.549 INFO:teuthology.orchestra.run.smithi094.stdout:(9/286): ceph-selinux-19.3.0-5012.g08af21e0.el9 431 kB/s | 25 kB 00:00 2024-09-19T13:32:47.908 INFO:teuthology.orchestra.run.smithi094.stdout:(10/286): ceph-osd-19.3.0-5012.g08af21e0.el9.x8 26 MB/s | 17 MB 00:00 2024-09-19T13:32:47.950 INFO:teuthology.orchestra.run.smithi094.stdout:(11/286): libcephfs-devel-19.3.0-5012.g08af21e0 766 kB/s | 32 kB 00:00 2024-09-19T13:32:48.025 INFO:teuthology.orchestra.run.smithi094.stdout:(12/286): libcephfs2-19.3.0-5012.g08af21e0.el9. 9.8 MB/s | 755 kB 00:00 2024-09-19T13:32:48.150 INFO:teuthology.orchestra.run.smithi094.stdout:(13/286): ceph-radosgw-19.3.0-5012.g08af21e0.el 13 MB/s | 11 MB 00:00 2024-09-19T13:32:48.176 INFO:teuthology.orchestra.run.smithi094.stdout:(14/286): libcephsqlite-19.3.0-5012.g08af21e0.e 1.0 MB/s | 161 kB 00:00 2024-09-19T13:32:48.201 INFO:teuthology.orchestra.run.smithi094.stdout:(15/286): librados-devel-19.3.0-5012.g08af21e0. 2.5 MB/s | 127 kB 00:00 2024-09-19T13:32:48.235 INFO:teuthology.orchestra.run.smithi094.stdout:(16/286): libradosstriper1-19.3.0-5012.g08af21e 8.4 MB/s | 509 kB 00:00 2024-09-19T13:32:48.302 INFO:teuthology.orchestra.run.smithi094.stdout:(17/286): python3-ceph-argparse-19.3.0-5012.g08 677 kB/s | 45 kB 00:00 2024-09-19T13:32:48.385 INFO:teuthology.orchestra.run.smithi094.stdout:(18/286): python3-ceph-common-19.3.0-5012.g08af 1.7 MB/s | 148 kB 00:00 2024-09-19T13:32:48.461 INFO:teuthology.orchestra.run.smithi094.stdout:(19/286): librgw2-19.3.0-5012.g08af21e0.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-19T13:32:48.486 INFO:teuthology.orchestra.run.smithi094.stdout:(20/286): python3-cephfs-19.3.0-5012.g08af21e0. 1.6 MB/s | 161 kB 00:00 2024-09-19T13:32:48.512 INFO:teuthology.orchestra.run.smithi094.stdout:(21/286): python3-rados-19.3.0-5012.g08af21e0.e 6.2 MB/s | 321 kB 00:00 2024-09-19T13:32:48.545 INFO:teuthology.orchestra.run.smithi094.stdout:(22/286): python3-rbd-19.3.0-5012.g08af21e0.el9 5.1 MB/s | 307 kB 00:00 2024-09-19T13:32:48.587 INFO:teuthology.orchestra.run.smithi094.stdout:(23/286): python3-rgw-19.3.0-5012.g08af21e0.el9 1.3 MB/s | 99 kB 00:00 2024-09-19T13:32:48.612 INFO:teuthology.orchestra.run.smithi094.stdout:(24/286): rbd-fuse-19.3.0-5012.g08af21e0.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-19T13:32:48.663 INFO:teuthology.orchestra.run.smithi094.stdout:(25/286): rbd-nbd-19.3.0-5012.g08af21e0.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-19T13:32:48.738 INFO:teuthology.orchestra.run.smithi094.stdout:(26/286): rbd-mirror-19.3.0-5012.g08af21e0.el9. 21 MB/s | 3.2 MB 00:00 2024-09-19T13:32:48.763 INFO:teuthology.orchestra.run.smithi094.stdout:(27/286): ceph-grafana-dashboards-19.3.0-5012.g 341 kB/s | 34 kB 00:00 2024-09-19T13:32:48.789 INFO:teuthology.orchestra.run.smithi094.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5012.g08af21e 3.0 MB/s | 154 kB 00:00 2024-09-19T13:32:49.281 INFO:teuthology.orchestra.run.smithi094.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-19T13:32:49.339 INFO:teuthology.orchestra.run.smithi094.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5012.g08 4.9 MB/s | 292 kB 00:00 2024-09-19T13:32:49.498 INFO:teuthology.orchestra.run.smithi094.stdout:(31/286): ceph-mgr-dashboard-19.3.0-5012.g08af2 19 MB/s | 14 MB 00:00 2024-09-19T13:32:49.519 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:19 2024-09-19T13:32:49.523 INFO:teuthology.orchestra.run.smithi094.stdout:(32/286): ceph-mgr-rook-19.3.0-5012.g08af21e0.e 268 kB/s | 49 kB 00:00 2024-09-19T13:32:49.557 INFO:teuthology.orchestra.run.smithi094.stdout:(33/286): ceph-prometheus-alerts-19.3.0-5012.g0 282 kB/s | 16 kB 00:00 2024-09-19T13:32:49.582 INFO:teuthology.orchestra.run.smithi094.stdout:(34/286): ceph-volume-19.3.0-5012.g08af21e0.el9 4.8 MB/s | 285 kB 00:00 2024-09-19T13:32:49.624 INFO:teuthology.orchestra.run.smithi094.stdout:(35/286): cephadm-19.3.0-5012.g08af21e0.el9.noa 11 MB/s | 784 kB 00:00 2024-09-19T13:32:50.183 INFO:teuthology.orchestra.run.smithi094.stdout:(36/286): ceph-test-19.3.0-5012.g08af21e0.el9.x 17 MB/s | 46 MB 00:02 2024-09-19T13:32:50.209 INFO:teuthology.orchestra.run.smithi094.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 145 kB/s | 85 kB 00:00 2024-09-19T13:32:50.234 INFO:teuthology.orchestra.run.smithi094.stdout:(38/286): ModemManager-glib-1.20.2-1.el9.x86_64 514 kB/s | 335 kB 00:00 2024-09-19T13:32:50.259 INFO:teuthology.orchestra.run.smithi094.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 655 kB/s | 49 kB 00:00 2024-09-19T13:32:50.284 INFO:teuthology.orchestra.run.smithi094.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-19T13:32:50.327 INFO:teuthology.orchestra.run.smithi094.stdout:(41/286): libpciaccess-0.16-7.el9.x86_64.rpm 641 kB/s | 27 kB 00:00 2024-09-19T13:32:50.352 INFO:teuthology.orchestra.run.smithi094.stdout:(42/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 1.8 MB/s | 262 kB 00:00 2024-09-19T13:32:50.385 INFO:teuthology.orchestra.run.smithi094.stdout:(43/286): libgfortran-11.5.0-2.el9.x86_64.rpm 6.2 MB/s | 801 kB 00:00 2024-09-19T13:32:50.411 INFO:teuthology.orchestra.run.smithi094.stdout:(44/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T13:32:50.436 INFO:teuthology.orchestra.run.smithi094.stdout:(45/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-09-19T13:32:50.461 INFO:teuthology.orchestra.run.smithi094.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T13:32:50.487 INFO:teuthology.orchestra.run.smithi094.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T13:32:50.512 INFO:teuthology.orchestra.run.smithi094.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T13:32:50.537 INFO:teuthology.orchestra.run.smithi094.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T13:32:50.563 INFO:teuthology.orchestra.run.smithi094.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T13:32:50.605 INFO:teuthology.orchestra.run.smithi094.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-19T13:32:50.814 INFO:teuthology.orchestra.run.smithi094.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.3 MB/s | 650 kB 00:00 2024-09-19T13:32:50.839 INFO:teuthology.orchestra.run.smithi094.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.2 MB/s | 523 kB 00:00 2024-09-19T13:32:50.864 INFO:teuthology.orchestra.run.smithi094.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-19T13:32:50.898 INFO:teuthology.orchestra.run.smithi094.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-19T13:32:50.931 INFO:teuthology.orchestra.run.smithi094.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 4.1 MB/s | 283 kB 00:00 2024-09-19T13:32:50.973 INFO:teuthology.orchestra.run.smithi094.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 7.3 MB/s | 559 kB 00:00 2024-09-19T13:32:50.998 INFO:teuthology.orchestra.run.smithi094.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T13:32:51.040 INFO:teuthology.orchestra.run.smithi094.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2024-09-19T13:32:51.066 INFO:teuthology.orchestra.run.smithi094.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 347 kB/s | 23 kB 00:00 2024-09-19T13:32:51.099 INFO:teuthology.orchestra.run.smithi094.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T13:32:51.125 INFO:teuthology.orchestra.run.smithi094.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 254 kB/s | 15 kB 00:00 2024-09-19T13:32:51.158 INFO:teuthology.orchestra.run.smithi094.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-19T13:32:51.184 INFO:teuthology.orchestra.run.smithi094.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 908 kB/s | 53 kB 00:00 2024-09-19T13:32:51.217 INFO:teuthology.orchestra.run.smithi094.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-19T13:32:51.242 INFO:teuthology.orchestra.run.smithi094.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-19T13:32:51.268 INFO:teuthology.orchestra.run.smithi094.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 560 kB/s | 28 kB 00:00 2024-09-19T13:32:51.402 INFO:teuthology.orchestra.run.smithi094.stdout:(68/286): adwaita-icon-theme-40.1.1-3.el9.noarc 14 MB/s | 12 MB 00:00 2024-09-19T13:32:51.435 INFO:teuthology.orchestra.run.smithi094.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 584 kB/s | 113 kB 00:00 2024-09-19T13:32:51.461 INFO:teuthology.orchestra.run.smithi094.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 2.7 MB/s | 525 kB 00:00 2024-09-19T13:32:51.503 INFO:teuthology.orchestra.run.smithi094.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 9.6 MB/s | 980 kB 00:00 2024-09-19T13:32:51.528 INFO:teuthology.orchestra.run.smithi094.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.7 MB/s | 325 kB 00:00 2024-09-19T13:32:51.561 INFO:teuthology.orchestra.run.smithi094.stdout:(73/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-19T13:32:51.587 INFO:teuthology.orchestra.run.smithi094.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-19T13:32:51.612 INFO:teuthology.orchestra.run.smithi094.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 429 kB/s | 22 kB 00:00 2024-09-19T13:32:51.637 INFO:teuthology.orchestra.run.smithi094.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-19T13:32:51.679 INFO:teuthology.orchestra.run.smithi094.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2024-09-19T13:32:51.705 INFO:teuthology.orchestra.run.smithi094.stdout:(78/286): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-19T13:32:51.730 INFO:teuthology.orchestra.run.smithi094.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-09-19T13:32:51.755 INFO:teuthology.orchestra.run.smithi094.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-19T13:32:51.814 INFO:teuthology.orchestra.run.smithi094.stdout:(81/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-19T13:32:51.840 INFO:teuthology.orchestra.run.smithi094.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-09-19T13:32:51.865 INFO:teuthology.orchestra.run.smithi094.stdout:(83/286): geoclue2-2.6.0-7.el9.x86_64.rpm 927 kB/s | 124 kB 00:00 2024-09-19T13:32:51.923 INFO:teuthology.orchestra.run.smithi094.stdout:(84/286): google-guice-4.2.3-9.el9.noarch.rpm 4.2 MB/s | 473 kB 00:00 2024-09-19T13:32:51.949 INFO:teuthology.orchestra.run.smithi094.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 408 kB/s | 34 kB 00:00 2024-09-19T13:32:51.974 INFO:teuthology.orchestra.run.smithi094.stdout:(86/286): graphene-1.10.6-2.el9.x86_64.rpm 480 kB/s | 64 kB 00:00 2024-09-19T13:32:52.041 INFO:teuthology.orchestra.run.smithi094.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T13:32:52.066 INFO:teuthology.orchestra.run.smithi094.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 359 kB/s | 33 kB 00:00 2024-09-19T13:32:52.133 INFO:teuthology.orchestra.run.smithi094.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 12 MB/s | 2.2 MB 00:00 2024-09-19T13:32:52.192 INFO:teuthology.orchestra.run.smithi094.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 3.7 MB/s | 219 kB 00:00 2024-09-19T13:32:52.259 INFO:teuthology.orchestra.run.smithi094.stdout:(91/286): gtk3-3.24.31-5.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-19T13:32:52.301 INFO:teuthology.orchestra.run.smithi094.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 9.9 MB/s | 2.3 MB 00:00 2024-09-19T13:32:52.326 INFO:teuthology.orchestra.run.smithi094.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 4.8 MB/s | 657 kB 00:00 2024-09-19T13:32:52.351 INFO:teuthology.orchestra.run.smithi094.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 6.7 MB/s | 632 kB 00:00 2024-09-19T13:32:52.377 INFO:teuthology.orchestra.run.smithi094.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 889 kB/s | 45 kB 00:00 2024-09-19T13:32:52.419 INFO:teuthology.orchestra.run.smithi094.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 1.6 MB/s | 110 kB 00:00 2024-09-19T13:32:52.452 INFO:teuthology.orchestra.run.smithi094.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 5.4 MB/s | 413 kB 00:00 2024-09-19T13:32:52.528 INFO:teuthology.orchestra.run.smithi094.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 16 MB/s | 3.5 MB 00:00 2024-09-19T13:32:52.595 INFO:teuthology.orchestra.run.smithi094.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 19 MB/s | 3.3 MB 00:00 2024-09-19T13:32:52.620 INFO:teuthology.orchestra.run.smithi094.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 142 kB/s | 13 kB 00:00 2024-09-19T13:32:52.654 INFO:teuthology.orchestra.run.smithi094.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 906 kB/s | 53 kB 00:00 2024-09-19T13:32:52.679 INFO:teuthology.orchestra.run.smithi094.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 407 kB/s | 24 kB 00:00 2024-09-19T13:32:52.713 INFO:teuthology.orchestra.run.smithi094.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-19T13:32:52.746 INFO:teuthology.orchestra.run.smithi094.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 531 kB/s | 35 kB 00:00 2024-09-19T13:32:52.772 INFO:teuthology.orchestra.run.smithi094.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-19T13:32:52.805 INFO:teuthology.orchestra.run.smithi094.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 189 kB/s | 11 kB 00:00 2024-09-19T13:32:52.830 INFO:teuthology.orchestra.run.smithi094.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 413 kB/s | 24 kB 00:00 2024-09-19T13:32:52.864 INFO:teuthology.orchestra.run.smithi094.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 523 kB/s | 31 kB 00:00 2024-09-19T13:32:52.890 INFO:teuthology.orchestra.run.smithi094.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 389 kB/s | 23 kB 00:00 2024-09-19T13:32:52.915 INFO:teuthology.orchestra.run.smithi094.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-19T13:32:52.940 INFO:teuthology.orchestra.run.smithi094.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 786 kB/s | 40 kB 00:00 2024-09-19T13:32:52.966 INFO:teuthology.orchestra.run.smithi094.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 298 kB/s | 15 kB 00:00 2024-09-19T13:32:52.991 INFO:teuthology.orchestra.run.smithi094.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 564 kB/s | 28 kB 00:00 2024-09-19T13:32:53.016 INFO:teuthology.orchestra.run.smithi094.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 427 kB/s | 21 kB 00:00 2024-09-19T13:32:53.041 INFO:teuthology.orchestra.run.smithi094.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-19T13:32:53.067 INFO:teuthology.orchestra.run.smithi094.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 372 kB/s | 19 kB 00:00 2024-09-19T13:32:53.092 INFO:teuthology.orchestra.run.smithi094.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-09-19T13:32:53.126 INFO:teuthology.orchestra.run.smithi094.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-19T13:32:53.151 INFO:teuthology.orchestra.run.smithi094.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 542 kB/s | 32 kB 00:00 2024-09-19T13:32:53.185 INFO:teuthology.orchestra.run.smithi094.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-19T13:32:53.219 INFO:teuthology.orchestra.run.smithi094.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-09-19T13:32:53.244 INFO:teuthology.orchestra.run.smithi094.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 7.2 MB/s | 435 kB 00:00 2024-09-19T13:32:53.269 INFO:teuthology.orchestra.run.smithi094.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 614 kB/s | 31 kB 00:00 2024-09-19T13:32:53.303 INFO:teuthology.orchestra.run.smithi094.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-19T13:32:53.328 INFO:teuthology.orchestra.run.smithi094.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-19T13:32:53.354 INFO:teuthology.orchestra.run.smithi094.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 727 kB/s | 37 kB 00:00 2024-09-19T13:32:53.379 INFO:teuthology.orchestra.run.smithi094.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-19T13:32:53.413 INFO:teuthology.orchestra.run.smithi094.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-19T13:32:53.446 INFO:teuthology.orchestra.run.smithi094.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2024-09-19T13:32:53.475 INFO:teuthology.orchestra.run.smithi094.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 981 kB/s | 61 kB 00:00 2024-09-19T13:32:53.501 INFO:teuthology.orchestra.run.smithi094.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 764 kB/s | 41 kB 00:00 2024-09-19T13:32:53.534 INFO:teuthology.orchestra.run.smithi094.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-19T13:32:53.560 INFO:teuthology.orchestra.run.smithi094.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 743 kB/s | 44 kB 00:00 2024-09-19T13:32:53.585 INFO:teuthology.orchestra.run.smithi094.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 666 kB/s | 34 kB 00:00 2024-09-19T13:32:53.618 INFO:teuthology.orchestra.run.smithi094.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-19T13:32:53.644 INFO:teuthology.orchestra.run.smithi094.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T13:32:53.669 INFO:teuthology.orchestra.run.smithi094.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-19T13:32:53.703 INFO:teuthology.orchestra.run.smithi094.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T13:32:53.729 INFO:teuthology.orchestra.run.smithi094.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 761 kB/s | 45 kB 00:00 2024-09-19T13:32:53.762 INFO:teuthology.orchestra.run.smithi094.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 206 kB 00:00 2024-09-19T13:32:53.788 INFO:teuthology.orchestra.run.smithi094.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-19T13:32:53.813 INFO:teuthology.orchestra.run.smithi094.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.8 MB/s | 198 kB 00:00 2024-09-19T13:32:54.180 INFO:teuthology.orchestra.run.smithi094.stdout:(143/286): java-11-openjdk-headless-11.0.20.1.1 23 MB/s | 39 MB 00:01 2024-09-19T13:32:54.205 INFO:teuthology.orchestra.run.smithi094.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 85 kB/s | 36 kB 00:00 2024-09-19T13:32:54.230 INFO:teuthology.orchestra.run.smithi094.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 775 kB/s | 324 kB 00:00 2024-09-19T13:32:54.256 INFO:teuthology.orchestra.run.smithi094.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-09-19T13:32:54.283 INFO:teuthology.orchestra.run.smithi094.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-09-19T13:32:54.306 INFO:teuthology.orchestra.run.smithi094.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 442 kB/s | 33 kB 00:00 2024-09-19T13:32:54.331 INFO:teuthology.orchestra.run.smithi094.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-19T13:32:54.357 INFO:teuthology.orchestra.run.smithi094.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-19T13:32:54.382 INFO:teuthology.orchestra.run.smithi094.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 553 kB/s | 42 kB 00:00 2024-09-19T13:32:54.407 INFO:teuthology.orchestra.run.smithi094.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 277 kB 00:00 2024-09-19T13:32:54.433 INFO:teuthology.orchestra.run.smithi094.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 133 kB 00:00 2024-09-19T13:32:54.458 INFO:teuthology.orchestra.run.smithi094.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-19T13:32:54.483 INFO:teuthology.orchestra.run.smithi094.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 474 kB/s | 36 kB 00:00 2024-09-19T13:32:54.509 INFO:teuthology.orchestra.run.smithi094.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T13:32:54.534 INFO:teuthology.orchestra.run.smithi094.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T13:32:54.593 INFO:teuthology.orchestra.run.smithi094.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-09-19T13:32:54.609 INFO:teuthology.orchestra.run.smithi094.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 176 kB/s | 18 kB 00:00 2024-09-19T13:32:54.643 INFO:teuthology.orchestra.run.smithi094.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-19T13:32:54.677 INFO:teuthology.orchestra.run.smithi094.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 7.5 MB/s | 517 kB 00:00 2024-09-19T13:32:54.702 INFO:teuthology.orchestra.run.smithi094.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-19T13:32:54.744 INFO:teuthology.orchestra.run.smithi094.stdout:(163/286): maven-lib-3.6.3-15.el9.noarch.rpm 7.1 MB/s | 1.5 MB 00:00 2024-09-19T13:32:54.769 INFO:teuthology.orchestra.run.smithi094.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.2 MB/s | 112 kB 00:00 2024-09-19T13:32:54.786 INFO:teuthology.orchestra.run.smithi094.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 270 kB/s | 11 kB 00:00 2024-09-19T13:32:54.820 INFO:teuthology.orchestra.run.smithi094.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-19T13:32:54.870 INFO:teuthology.orchestra.run.smithi094.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-19T13:32:54.887 INFO:teuthology.orchestra.run.smithi094.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 541 kB/s | 36 kB 00:00 2024-09-19T13:32:54.913 INFO:teuthology.orchestra.run.smithi094.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 1.1 MB/s | 46 kB 00:00 2024-09-19T13:32:54.929 INFO:teuthology.orchestra.run.smithi094.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 767 kB/s | 32 kB 00:00 2024-09-19T13:32:55.030 INFO:teuthology.orchestra.run.smithi094.stdout:(171/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 27 MB/s | 8.8 MB 00:00 2024-09-19T13:32:55.046 INFO:teuthology.orchestra.run.smithi094.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-19T13:32:55.061 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-19T13:32:55.089 INFO:teuthology.orchestra.run.smithi094.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-19T13:32:55.114 INFO:teuthology.orchestra.run.smithi094.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-09-19T13:32:55.148 INFO:teuthology.orchestra.run.smithi094.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-19T13:32:55.234 INFO:teuthology.orchestra.run.smithi094.stdout:(176/286): openblas-openmp-0.3.26-2.el9.x86_64. 16 MB/s | 4.9 MB 00:00 2024-09-19T13:32:55.265 INFO:teuthology.orchestra.run.smithi094.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 630 kB/s | 74 kB 00:00 2024-09-19T13:32:55.290 INFO:teuthology.orchestra.run.smithi094.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 2.9 MB/s | 531 kB 00:00 2024-09-19T13:32:55.316 INFO:teuthology.orchestra.run.smithi094.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 5.6 MB/s | 468 kB 00:00 2024-09-19T13:32:55.341 INFO:teuthology.orchestra.run.smithi094.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 3.2 MB/s | 246 kB 00:00 2024-09-19T13:32:55.366 INFO:teuthology.orchestra.run.smithi094.stdout:(181/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-19T13:32:55.391 INFO:teuthology.orchestra.run.smithi094.stdout:(182/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 759 kB/s | 57 kB 00:00 2024-09-19T13:32:55.417 INFO:teuthology.orchestra.run.smithi094.stdout:(183/286): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-19T13:32:55.442 INFO:teuthology.orchestra.run.smithi094.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.7 MB/s | 135 kB 00:00 2024-09-19T13:32:55.467 INFO:teuthology.orchestra.run.smithi094.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.7 MB/s | 192 kB 00:00 2024-09-19T13:32:55.492 INFO:teuthology.orchestra.run.smithi094.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 514 kB/s | 26 kB 00:00 2024-09-19T13:32:55.535 INFO:teuthology.orchestra.run.smithi094.stdout:(187/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 13 MB/s | 1.9 MB 00:00 2024-09-19T13:32:55.560 INFO:teuthology.orchestra.run.smithi094.stdout:(188/286): plexus-containers-component-annotati 274 kB/s | 18 kB 00:00 2024-09-19T13:32:55.585 INFO:teuthology.orchestra.run.smithi094.stdout:(189/286): plexus-classworlds-2.6.0-11.el9.noar 511 kB/s | 60 kB 00:00 2024-09-19T13:32:55.610 INFO:teuthology.orchestra.run.smithi094.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-19T13:32:55.636 INFO:teuthology.orchestra.run.smithi094.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 445 kB/s | 34 kB 00:00 2024-09-19T13:32:55.661 INFO:teuthology.orchestra.run.smithi094.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-19T13:32:55.703 INFO:teuthology.orchestra.run.smithi094.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-09-19T13:32:55.728 INFO:teuthology.orchestra.run.smithi094.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-19T13:32:55.779 INFO:teuthology.orchestra.run.smithi094.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-19T13:32:55.812 INFO:teuthology.orchestra.run.smithi094.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 988 kB/s | 83 kB 00:00 2024-09-19T13:32:55.854 INFO:teuthology.orchestra.run.smithi094.stdout:(197/286): poppler-data-0.4.9-9.el9.noarch.rpm 8.6 MB/s | 1.9 MB 00:00 2024-09-19T13:32:55.880 INFO:teuthology.orchestra.run.smithi094.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.6 MB/s | 679 kB 00:00 2024-09-19T13:32:55.913 INFO:teuthology.orchestra.run.smithi094.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-19T13:32:55.947 INFO:teuthology.orchestra.run.smithi094.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-09-19T13:32:55.964 INFO:teuthology.orchestra.run.smithi094.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 511 kB/s | 26 kB 00:00 2024-09-19T13:32:56.056 INFO:teuthology.orchestra.run.smithi094.stdout:(202/286): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-09-19T13:32:56.073 INFO:teuthology.orchestra.run.smithi094.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 153 kB/s | 19 kB 00:00 2024-09-19T13:32:56.098 INFO:teuthology.orchestra.run.smithi094.stdout:(204/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-19T13:32:56.115 INFO:teuthology.orchestra.run.smithi094.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 591 kB/s | 35 kB 00:00 2024-09-19T13:32:56.165 INFO:teuthology.orchestra.run.smithi094.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.7 MB/s | 250 kB 00:00 2024-09-19T13:32:56.191 INFO:teuthology.orchestra.run.smithi094.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 2.9 MB/s | 222 kB 00:00 2024-09-19T13:32:56.225 INFO:teuthology.orchestra.run.smithi094.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-19T13:32:56.250 INFO:teuthology.orchestra.run.smithi094.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 721 kB/s | 42 kB 00:00 2024-09-19T13:32:56.325 INFO:teuthology.orchestra.run.smithi094.stdout:(210/286): python3-numpy-1.20.1-5.el9.x86_64.rp 20 MB/s | 5.1 MB 00:00 2024-09-19T13:32:56.350 INFO:teuthology.orchestra.run.smithi094.stdout:(211/286): python3-protobuf-3.14.0-13.el9.noarc 2.1 MB/s | 269 kB 00:00 2024-09-19T13:32:56.376 INFO:teuthology.orchestra.run.smithi094.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.2 MB/s | 159 kB 00:00 2024-09-19T13:32:56.401 INFO:teuthology.orchestra.run.smithi094.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 3.6 MB/s | 279 kB 00:00 2024-09-19T13:32:56.426 INFO:teuthology.orchestra.run.smithi094.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-19T13:32:56.452 INFO:teuthology.orchestra.run.smithi094.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 709 kB/s | 54 kB 00:00 2024-09-19T13:32:56.477 INFO:teuthology.orchestra.run.smithi094.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-19T13:32:56.519 INFO:teuthology.orchestra.run.smithi094.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T13:32:56.544 INFO:teuthology.orchestra.run.smithi094.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 537 kB/s | 36 kB 00:00 2024-09-19T13:32:56.586 INFO:teuthology.orchestra.run.smithi094.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-19T13:32:56.611 INFO:teuthology.orchestra.run.smithi094.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 835 kB/s | 56 kB 00:00 2024-09-19T13:32:56.653 INFO:teuthology.orchestra.run.smithi094.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-19T13:32:56.687 INFO:teuthology.orchestra.run.smithi094.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 913 kB/s | 69 kB 00:00 2024-09-19T13:32:56.712 INFO:teuthology.orchestra.run.smithi094.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.0 MB/s | 304 kB 00:00 2024-09-19T13:32:56.729 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-19T13:32:56.746 INFO:teuthology.orchestra.run.smithi094.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-19T13:32:56.771 INFO:teuthology.orchestra.run.smithi094.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-19T13:32:56.980 INFO:teuthology.orchestra.run.smithi094.stdout:(226/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-19T13:32:57.005 INFO:teuthology.orchestra.run.smithi094.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 2.1 MB/s | 555 kB 00:00 2024-09-19T13:32:57.039 INFO:teuthology.orchestra.run.smithi094.stdout:(228/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.5 MB/s | 944 kB 00:00 2024-09-19T13:32:57.089 INFO:teuthology.orchestra.run.smithi094.stdout:(229/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-19T13:32:57.114 INFO:teuthology.orchestra.run.smithi094.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.3 MB/s | 173 kB 00:00 2024-09-19T13:32:57.140 INFO:teuthology.orchestra.run.smithi094.stdout:(231/286): tzdata-java-2024a-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T13:32:57.173 INFO:teuthology.orchestra.run.smithi094.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 306 kB 00:00 2024-09-19T13:32:57.204 INFO:teuthology.orchestra.run.smithi094.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.1 MB/s | 96 kB 00:00 2024-09-19T13:32:57.224 INFO:teuthology.orchestra.run.smithi094.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 846 kB/s | 42 kB 00:00 2024-09-19T13:32:57.249 INFO:teuthology.orchestra.run.smithi094.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.2 MB/s | 358 kB 00:00 2024-09-19T13:32:57.283 INFO:teuthology.orchestra.run.smithi094.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.8 MB/s | 385 kB 00:00 2024-09-19T13:32:57.308 INFO:teuthology.orchestra.run.smithi094.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.6 MB/s | 134 kB 00:00 2024-09-19T13:32:57.350 INFO:teuthology.orchestra.run.smithi094.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 8.4 MB/s | 859 kB 00:00 2024-09-19T13:32:57.376 INFO:teuthology.orchestra.run.smithi094.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 689 kB/s | 64 kB 00:00 2024-09-19T13:32:57.401 INFO:teuthology.orchestra.run.smithi094.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.3 MB/s | 505 kB 00:00 2024-09-19T13:32:57.426 INFO:teuthology.orchestra.run.smithi094.stdout:(241/286): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-09-19T13:32:57.493 INFO:teuthology.orchestra.run.smithi094.stdout:(242/286): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-19T13:32:57.535 INFO:teuthology.orchestra.run.smithi094.stdout:(243/286): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T13:32:57.568 INFO:teuthology.orchestra.run.smithi094.stdout:(244/286): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-09-19T13:32:57.594 INFO:teuthology.orchestra.run.smithi094.stdout:(245/286): abseil-cpp-20211102.0-3.el9.x86_64.r 2.8 MB/s | 548 kB 00:00 2024-09-19T13:32:57.619 INFO:teuthology.orchestra.run.smithi094.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-09-19T13:32:57.645 INFO:teuthology.orchestra.run.smithi094.stdout:(247/286): liboath-2.6.7-2.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-19T13:32:57.670 INFO:teuthology.orchestra.run.smithi094.stdout:(248/286): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T13:32:57.712 INFO:teuthology.orchestra.run.smithi094.stdout:(249/286): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-19T13:32:57.796 INFO:teuthology.orchestra.run.smithi094.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-19T13:32:57.829 INFO:teuthology.orchestra.run.smithi094.stdout:(251/286): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T13:32:57.855 INFO:teuthology.orchestra.run.smithi094.stdout:(252/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-09-19T13:32:57.880 INFO:teuthology.orchestra.run.smithi094.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-19T13:32:57.905 INFO:teuthology.orchestra.run.smithi094.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T13:32:57.930 INFO:teuthology.orchestra.run.smithi094.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T13:32:57.972 INFO:teuthology.orchestra.run.smithi094.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T13:32:57.983 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-19T13:32:57.998 INFO:teuthology.orchestra.run.smithi094.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-19T13:32:58.065 INFO:teuthology.orchestra.run.smithi094.stdout:(258/286): libarrow-9.0.0-11.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-09-19T13:32:58.090 INFO:teuthology.orchestra.run.smithi094.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-19T13:32:58.115 INFO:teuthology.orchestra.run.smithi094.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-19T13:32:58.141 INFO:teuthology.orchestra.run.smithi094.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T13:32:58.166 INFO:teuthology.orchestra.run.smithi094.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T13:32:58.191 INFO:teuthology.orchestra.run.smithi094.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T13:32:58.216 INFO:teuthology.orchestra.run.smithi094.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T13:32:58.242 INFO:teuthology.orchestra.run.smithi094.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T13:32:58.267 INFO:teuthology.orchestra.run.smithi094.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T13:32:58.301 INFO:teuthology.orchestra.run.smithi094.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-19T13:32:58.343 INFO:teuthology.orchestra.run.smithi094.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-19T13:32:58.359 INFO:teuthology.orchestra.run.smithi094.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 985 kB/s | 16 kB 00:00 2024-09-19T13:32:58.410 INFO:teuthology.orchestra.run.smithi094.stdout:(270/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.7 MB/s | 2.0 MB 00:00 2024-09-19T13:32:58.427 INFO:teuthology.orchestra.run.smithi094.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-19T13:32:58.461 INFO:teuthology.orchestra.run.smithi094.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2024-09-19T13:32:58.486 INFO:teuthology.orchestra.run.smithi094.stdout:(273/286): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-19T13:32:58.511 INFO:teuthology.orchestra.run.smithi094.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T13:32:58.561 INFO:teuthology.orchestra.run.smithi094.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-09-19T13:32:58.587 INFO:teuthology.orchestra.run.smithi094.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T13:32:58.612 INFO:teuthology.orchestra.run.smithi094.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 741 kB/s | 74 kB 00:00 2024-09-19T13:32:58.638 INFO:teuthology.orchestra.run.smithi094.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T13:32:58.663 INFO:teuthology.orchestra.run.smithi094.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T13:32:58.688 INFO:teuthology.orchestra.run.smithi094.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T13:32:58.714 INFO:teuthology.orchestra.run.smithi094.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T13:32:58.739 INFO:teuthology.orchestra.run.smithi094.stdout:(282/286): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T13:32:58.764 INFO:teuthology.orchestra.run.smithi094.stdout:(283/286): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-19T13:32:58.823 INFO:teuthology.orchestra.run.smithi094.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T13:32:59.006 INFO:teuthology.orchestra.run.smithi094.stdout:(285/286): librados2-19.3.0-5012.g08af21e0.el9. 13 MB/s | 3.5 MB 00:00 2024-09-19T13:32:59.065 INFO:teuthology.orchestra.run.smithi094.stdout:(286/286): librbd1-19.3.0-5012.g08af21e0.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-19T13:32:59.071 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-19T13:32:59.072 INFO:teuthology.orchestra.run.smithi094.stdout:Total 24 MB/s | 322 MB 00:13 2024-09-19T13:33:02.306 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-19T13:33:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-19T13:33:02.492 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-19T13:33:03.497 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T13:33:05.686 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T13:33:05.687 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T13:33:05.734 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-19T13:33:05.734 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-19T13:33:05.779 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-09-19T13:33:05.803 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================================== 2024-09-19T13:33:05.803 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-09-19T13:33:05.803 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================================== 2024-09-19T13:33:05.803 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-09-19T13:33:05.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 6.6 k 2024-09-19T13:33:05.803 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 900 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 145 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 1.5 M 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 154 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 14 M 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 7.4 M 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 49 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 11 M 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 46 M 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 285 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 784 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 32 k 2024-09-19T13:33:05.804 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 755 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 127 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 321 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 307 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 99 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 85 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 171 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-09-19T13:33:05.805 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.5 M 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-19T13:33:05.806 INFO:teuthology.orchestra.run.smithi149.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 22 M 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 34 k 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 2.4 M 2024-09-19T13:33:05.807 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 292 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 4.8 M 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 17 M 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 16 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 25 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-19T13:33:05.808 INFO:teuthology.orchestra.run.smithi149.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-19T13:33:05.809 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-19T13:33:05.810 INFO:teuthology.orchestra.run.smithi149.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-19T13:33:05.811 INFO:teuthology.orchestra.run.smithi149.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-19T13:33:05.812 INFO:teuthology.orchestra.run.smithi149.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-19T13:33:05.813 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 509 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-19T13:33:05.814 INFO:teuthology.orchestra.run.smithi149.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-19T13:33:05.815 INFO:teuthology.orchestra.run.smithi149.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-19T13:33:05.816 INFO:teuthology.orchestra.run.smithi149.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-19T13:33:05.817 INFO:teuthology.orchestra.run.smithi149.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-19T13:33:05.818 INFO:teuthology.orchestra.run.smithi149.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 45 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 148 k 2024-09-19T13:33:05.819 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T13:33:05.820 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T13:33:05.821 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T13:33:05.822 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T13:33:05.823 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T13:33:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T13:33:05.825 INFO:teuthology.orchestra.run.smithi149.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-19T13:33:05.826 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================================== 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout:Install 284 Packages 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-09-19T13:33:05.827 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:33:05.828 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 322 M 2024-09-19T13:33:05.828 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-09-19T13:33:06.307 INFO:teuthology.orchestra.run.smithi149.stdout:(1/286): ceph-19.3.0-5012.g08af21e0.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-19T13:33:06.508 INFO:teuthology.orchestra.run.smithi149.stdout:(2/286): ceph-fuse-19.3.0-5012.g08af21e0.el9.x8 4.4 MB/s | 900 kB 00:00 2024-09-19T13:33:06.584 INFO:teuthology.orchestra.run.smithi149.stdout:(3/286): ceph-immutable-object-cache-19.3.0-501 1.9 MB/s | 145 kB 00:00 2024-09-19T13:33:06.650 INFO:teuthology.orchestra.run.smithi149.stdout:(4/286): ceph-base-19.3.0-5012.g08af21e0.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-19T13:33:06.783 INFO:teuthology.orchestra.run.smithi149.stdout:(5/286): ceph-mds-19.3.0-5012.g08af21e0.el9.x86 12 MB/s | 2.4 MB 00:00 2024-09-19T13:33:06.817 INFO:teuthology.orchestra.run.smithi149.stdout:(6/286): ceph-mgr-19.3.0-5012.g08af21e0.el9.x86 9.1 MB/s | 1.5 MB 00:00 2024-09-19T13:33:07.209 INFO:teuthology.orchestra.run.smithi149.stdout:(7/286): ceph-mon-19.3.0-5012.g08af21e0.el9.x86 11 MB/s | 4.8 MB 00:00 2024-09-19T13:33:07.451 INFO:teuthology.orchestra.run.smithi149.stdout:(8/286): ceph-common-19.3.0-5012.g08af21e0.el9. 17 MB/s | 22 MB 00:01 2024-09-19T13:33:07.510 INFO:teuthology.orchestra.run.smithi149.stdout:(9/286): ceph-selinux-19.3.0-5012.g08af21e0.el9 433 kB/s | 25 kB 00:00 2024-09-19T13:33:07.710 INFO:teuthology.orchestra.run.smithi149.stdout:(10/286): ceph-osd-19.3.0-5012.g08af21e0.el9.x8 19 MB/s | 17 MB 00:00 2024-09-19T13:33:07.768 INFO:teuthology.orchestra.run.smithi149.stdout:(11/286): libcephfs-devel-19.3.0-5012.g08af21e0 547 kB/s | 32 kB 00:00 2024-09-19T13:33:07.852 INFO:teuthology.orchestra.run.smithi149.stdout:(12/286): libcephfs2-19.3.0-5012.g08af21e0.el9. 8.9 MB/s | 755 kB 00:00 2024-09-19T13:33:07.969 INFO:teuthology.orchestra.run.smithi149.stdout:(13/286): ceph-radosgw-19.3.0-5012.g08af21e0.el 14 MB/s | 11 MB 00:00 2024-09-19T13:33:07.994 INFO:teuthology.orchestra.run.smithi149.stdout:(14/286): libcephsqlite-19.3.0-5012.g08af21e0.e 1.1 MB/s | 161 kB 00:00 2024-09-19T13:33:08.020 INFO:teuthology.orchestra.run.smithi149.stdout:(15/286): librados-devel-19.3.0-5012.g08af21e0. 2.5 MB/s | 127 kB 00:00 2024-09-19T13:33:08.053 INFO:teuthology.orchestra.run.smithi149.stdout:(16/286): libradosstriper1-19.3.0-5012.g08af21e 8.5 MB/s | 509 kB 00:00 2024-09-19T13:33:08.112 INFO:teuthology.orchestra.run.smithi149.stdout:(17/286): python3-ceph-argparse-19.3.0-5012.g08 773 kB/s | 45 kB 00:00 2024-09-19T13:33:08.179 INFO:teuthology.orchestra.run.smithi149.stdout:(18/286): python3-ceph-common-19.3.0-5012.g08af 2.2 MB/s | 148 kB 00:00 2024-09-19T13:33:08.246 INFO:teuthology.orchestra.run.smithi149.stdout:(19/286): python3-cephfs-19.3.0-5012.g08af21e0. 2.4 MB/s | 161 kB 00:00 2024-09-19T13:33:08.355 INFO:teuthology.orchestra.run.smithi149.stdout:(20/286): librgw2-19.3.0-5012.g08af21e0.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-19T13:33:08.388 INFO:teuthology.orchestra.run.smithi149.stdout:(21/286): python3-rados-19.3.0-5012.g08af21e0.e 2.2 MB/s | 321 kB 00:00 2024-09-19T13:33:08.413 INFO:teuthology.orchestra.run.smithi149.stdout:(22/286): python3-rbd-19.3.0-5012.g08af21e0.el9 5.1 MB/s | 307 kB 00:00 2024-09-19T13:33:08.498 INFO:teuthology.orchestra.run.smithi149.stdout:(23/286): python3-rgw-19.3.0-5012.g08af21e0.el9 909 kB/s | 99 kB 00:00 2024-09-19T13:33:08.531 INFO:teuthology.orchestra.run.smithi149.stdout:(24/286): rbd-fuse-19.3.0-5012.g08af21e0.el9.x8 729 kB/s | 85 kB 00:00 2024-09-19T13:33:08.598 INFO:teuthology.orchestra.run.smithi149.stdout:(25/286): rbd-nbd-19.3.0-5012.g08af21e0.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-19T13:33:08.648 INFO:teuthology.orchestra.run.smithi149.stdout:(26/286): rbd-mirror-19.3.0-5012.g08af21e0.el9. 21 MB/s | 3.2 MB 00:00 2024-09-19T13:33:08.673 INFO:teuthology.orchestra.run.smithi149.stdout:(27/286): ceph-grafana-dashboards-19.3.0-5012.g 457 kB/s | 34 kB 00:00 2024-09-19T13:33:08.699 INFO:teuthology.orchestra.run.smithi149.stdout:(28/286): ceph-mgr-cephadm-19.3.0-5012.g08af21e 3.0 MB/s | 154 kB 00:00 2024-09-19T13:33:09.099 INFO:teuthology.orchestra.run.smithi149.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 19 MB/s | 7.4 MB 00:00 2024-09-19T13:33:09.166 INFO:teuthology.orchestra.run.smithi149.stdout:(30/286): ceph-mgr-modules-core-19.3.0-5012.g08 4.3 MB/s | 292 kB 00:00 2024-09-19T13:33:09.225 INFO:teuthology.orchestra.run.smithi149.stdout:(31/286): ceph-mgr-rook-19.3.0-5012.g08af21e0.e 847 kB/s | 49 kB 00:00 2024-09-19T13:33:09.283 INFO:teuthology.orchestra.run.smithi149.stdout:(32/286): ceph-prometheus-alerts-19.3.0-5012.g0 282 kB/s | 16 kB 00:00 2024-09-19T13:33:09.350 INFO:teuthology.orchestra.run.smithi149.stdout:(33/286): ceph-volume-19.3.0-5012.g08af21e0.el9 4.2 MB/s | 285 kB 00:00 2024-09-19T13:33:09.526 INFO:teuthology.orchestra.run.smithi149.stdout:(34/286): ceph-mgr-dashboard-19.3.0-5012.g08af2 17 MB/s | 14 MB 00:00 2024-09-19T13:33:09.943 INFO:teuthology.orchestra.run.smithi149.stdout:(35/286): ceph-test-19.3.0-5012.g08af21e0.el9.x 19 MB/s | 46 MB 00:02 2024-09-19T13:33:09.976 INFO:teuthology.orchestra.run.smithi149.stdout:(36/286): cephadm-19.3.0-5012.g08af21e0.el9.noa 1.2 MB/s | 784 kB 00:00 2024-09-19T13:33:10.351 INFO:teuthology.orchestra.run.smithi149.stdout:(37/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 132 kB/s | 49 kB 00:00 2024-09-19T13:33:10.402 INFO:teuthology.orchestra.run.smithi149.stdout:(38/286): bluez-libs-5.56-6.el9.x86_64.rpm 185 kB/s | 85 kB 00:00 2024-09-19T13:33:10.502 INFO:teuthology.orchestra.run.smithi149.stdout:(39/286): ModemManager-glib-1.20.2-1.el9.x86_64 343 kB/s | 335 kB 00:00 2024-09-19T13:33:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-19T13:33:10.711 INFO:teuthology.orchestra.run.smithi149.stdout:(41/286): libpciaccess-0.16-7.el9.x86_64.rpm 231 kB/s | 27 kB 00:00 2024-09-19T13:33:10.736 INFO:teuthology.orchestra.run.smithi149.stdout:(42/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 681 kB/s | 262 kB 00:00 2024-09-19T13:33:10.795 INFO:teuthology.orchestra.run.smithi149.stdout:(43/286): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-19T13:33:10.846 INFO:teuthology.orchestra.run.smithi149.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 866 kB/s | 94 kB 00:00 2024-09-19T13:33:10.912 INFO:teuthology.orchestra.run.smithi149.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-19T13:33:11.021 INFO:teuthology.orchestra.run.smithi149.stdout:(46/286): libquadmath-11.5.0-2.el9.x86_64.rpm 617 kB/s | 191 kB 00:00 2024-09-19T13:33:11.046 INFO:teuthology.orchestra.run.smithi149.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 797 kB/s | 106 kB 00:00 2024-09-19T13:33:11.138 INFO:teuthology.orchestra.run.smithi149.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T13:33:11.172 INFO:teuthology.orchestra.run.smithi149.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 997 kB/s | 125 kB 00:00 2024-09-19T13:33:11.255 INFO:teuthology.orchestra.run.smithi149.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-19T13:33:11.347 INFO:teuthology.orchestra.run.smithi149.stdout:(51/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.6 MB/s | 650 kB 00:00 2024-09-19T13:33:11.414 INFO:teuthology.orchestra.run.smithi149.stdout:(52/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 7.7 MB/s | 523 kB 00:00 2024-09-19T13:33:11.448 INFO:teuthology.orchestra.run.smithi149.stdout:(53/286): python3-cryptography-36.0.1-4.el9.x86 2.0 MB/s | 1.2 MB 00:00 2024-09-19T13:33:11.473 INFO:teuthology.orchestra.run.smithi149.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-19T13:33:11.515 INFO:teuthology.orchestra.run.smithi149.stdout:(55/286): apache-commons-io-2.8.0-8.el9.noarch. 6.7 MB/s | 283 kB 00:00 2024-09-19T13:33:11.591 INFO:teuthology.orchestra.run.smithi149.stdout:(56/286): apache-commons-lang3-3.12.0-6.el9.noa 7.3 MB/s | 559 kB 00:00 2024-09-19T13:33:11.624 INFO:teuthology.orchestra.run.smithi149.stdout:(57/286): apache-commons-codec-1.15-7.el9.noarc 1.7 MB/s | 302 kB 00:00 2024-09-19T13:33:11.649 INFO:teuthology.orchestra.run.smithi149.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T13:33:11.700 INFO:teuthology.orchestra.run.smithi149.stdout:(59/286): atinject-1.0.3-6.el9.noarch.rpm 464 kB/s | 23 kB 00:00 2024-09-19T13:33:11.733 INFO:teuthology.orchestra.run.smithi149.stdout:(60/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.7 MB/s | 195 kB 00:00 2024-09-19T13:33:11.759 INFO:teuthology.orchestra.run.smithi149.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T13:33:11.784 INFO:teuthology.orchestra.run.smithi149.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 297 kB/s | 15 kB 00:00 2024-09-19T13:33:11.809 INFO:teuthology.orchestra.run.smithi149.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-19T13:33:11.834 INFO:teuthology.orchestra.run.smithi149.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-19T13:33:11.860 INFO:teuthology.orchestra.run.smithi149.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-19T13:33:11.885 INFO:teuthology.orchestra.run.smithi149.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-19T13:33:11.919 INFO:teuthology.orchestra.run.smithi149.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 482 kB/s | 28 kB 00:00 2024-09-19T13:33:11.944 INFO:teuthology.orchestra.run.smithi149.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.9 MB/s | 113 kB 00:00 2024-09-19T13:33:11.994 INFO:teuthology.orchestra.run.smithi149.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 525 kB 00:00 2024-09-19T13:33:12.078 INFO:teuthology.orchestra.run.smithi149.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 9.2 MB/s | 781 kB 00:00 2024-09-19T13:33:12.128 INFO:teuthology.orchestra.run.smithi149.stdout:(71/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 6.4 MB/s | 325 kB 00:00 2024-09-19T13:33:12.154 INFO:teuthology.orchestra.run.smithi149.stdout:(72/286): exiv2-0.27.5-2.el9.x86_64.rpm 4.6 MB/s | 980 kB 00:00 2024-09-19T13:33:12.179 INFO:teuthology.orchestra.run.smithi149.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 4.2 MB/s | 218 kB 00:00 2024-09-19T13:33:12.304 INFO:teuthology.orchestra.run.smithi149.stdout:(74/286): adwaita-icon-theme-40.1.1-3.el9.noarc 11 MB/s | 12 MB 00:01 2024-09-19T13:33:12.321 INFO:teuthology.orchestra.run.smithi149.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 152 kB/s | 22 kB 00:00 2024-09-19T13:33:12.346 INFO:teuthology.orchestra.run.smithi149.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.7 MB/s | 73 kB 00:00 2024-09-19T13:33:12.363 INFO:teuthology.orchestra.run.smithi149.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 781 kB/s | 33 kB 00:00 2024-09-19T13:33:12.397 INFO:teuthology.orchestra.run.smithi149.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 546 kB/s | 18 kB 00:00 2024-09-19T13:33:12.439 INFO:teuthology.orchestra.run.smithi149.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 2.1 MB/s | 89 kB 00:00 2024-09-19T13:33:12.473 INFO:teuthology.orchestra.run.smithi149.stdout:(80/286): flatpak-1.12.9-1.el9.x86_64.rpm 5.4 MB/s | 1.7 MB 00:00 2024-09-19T13:33:12.498 INFO:teuthology.orchestra.run.smithi149.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-19T13:33:12.515 INFO:teuthology.orchestra.run.smithi149.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-19T13:33:12.565 INFO:teuthology.orchestra.run.smithi149.stdout:(83/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-19T13:33:12.591 INFO:teuthology.orchestra.run.smithi149.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 852 kB/s | 64 kB 00:00 2024-09-19T13:33:12.616 INFO:teuthology.orchestra.run.smithi149.stdout:(85/286): google-guice-4.2.3-9.el9.noarch.rpm 3.9 MB/s | 473 kB 00:00 2024-09-19T13:33:12.633 INFO:teuthology.orchestra.run.smithi149.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 506 kB/s | 34 kB 00:00 2024-09-19T13:33:12.666 INFO:teuthology.orchestra.run.smithi149.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 991 kB/s | 33 kB 00:00 2024-09-19T13:33:12.733 INFO:teuthology.orchestra.run.smithi149.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-19T13:33:12.801 INFO:teuthology.orchestra.run.smithi149.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 12 MB/s | 2.2 MB 00:00 2024-09-19T13:33:12.851 INFO:teuthology.orchestra.run.smithi149.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 4.3 MB/s | 219 kB 00:00 2024-09-19T13:33:12.926 INFO:teuthology.orchestra.run.smithi149.stdout:(91/286): gtk3-3.24.31-5.el9.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-09-19T13:33:12.968 INFO:teuthology.orchestra.run.smithi149.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-09-19T13:33:13.010 INFO:teuthology.orchestra.run.smithi149.stdout:(93/286): guava-30.1-6.el9.noarch.rpm 8.4 MB/s | 2.3 MB 00:00 2024-09-19T13:33:13.044 INFO:teuthology.orchestra.run.smithi149.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 5.3 MB/s | 632 kB 00:00 2024-09-19T13:33:13.069 INFO:teuthology.orchestra.run.smithi149.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 772 kB/s | 45 kB 00:00 2024-09-19T13:33:13.094 INFO:teuthology.orchestra.run.smithi149.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-19T13:33:13.119 INFO:teuthology.orchestra.run.smithi149.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.0 MB/s | 413 kB 00:00 2024-09-19T13:33:13.203 INFO:teuthology.orchestra.run.smithi149.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-19T13:33:13.270 INFO:teuthology.orchestra.run.smithi149.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 19 MB/s | 3.3 MB 00:00 2024-09-19T13:33:13.295 INFO:teuthology.orchestra.run.smithi149.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 142 kB/s | 13 kB 00:00 2024-09-19T13:33:13.321 INFO:teuthology.orchestra.run.smithi149.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-19T13:33:13.346 INFO:teuthology.orchestra.run.smithi149.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 478 kB/s | 24 kB 00:00 2024-09-19T13:33:13.399 INFO:teuthology.orchestra.run.smithi149.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 4.7 MB/s | 377 kB 00:00 2024-09-19T13:33:13.430 INFO:teuthology.orchestra.run.smithi149.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 425 kB/s | 35 kB 00:00 2024-09-19T13:33:13.463 INFO:teuthology.orchestra.run.smithi149.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.6 MB/s | 168 kB 00:00 2024-09-19T13:33:13.488 INFO:teuthology.orchestra.run.smithi149.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 189 kB/s | 11 kB 00:00 2024-09-19T13:33:13.514 INFO:teuthology.orchestra.run.smithi149.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 482 kB/s | 24 kB 00:00 2024-09-19T13:33:13.539 INFO:teuthology.orchestra.run.smithi149.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 610 kB/s | 31 kB 00:00 2024-09-19T13:33:13.614 INFO:teuthology.orchestra.run.smithi149.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 228 kB/s | 23 kB 00:00 2024-09-19T13:33:13.631 INFO:teuthology.orchestra.run.smithi149.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 215 kB/s | 20 kB 00:00 2024-09-19T13:33:13.648 INFO:teuthology.orchestra.run.smithi149.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 1.2 MB/s | 40 kB 00:00 2024-09-19T13:33:13.665 INFO:teuthology.orchestra.run.smithi149.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 450 kB/s | 15 kB 00:00 2024-09-19T13:33:13.691 INFO:teuthology.orchestra.run.smithi149.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 674 kB/s | 28 kB 00:00 2024-09-19T13:33:13.708 INFO:teuthology.orchestra.run.smithi149.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 509 kB/s | 21 kB 00:00 2024-09-19T13:33:13.725 INFO:teuthology.orchestra.run.smithi149.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 569 kB/s | 19 kB 00:00 2024-09-19T13:33:13.742 INFO:teuthology.orchestra.run.smithi149.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 559 kB/s | 19 kB 00:00 2024-09-19T13:33:13.759 INFO:teuthology.orchestra.run.smithi149.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 905 kB/s | 30 kB 00:00 2024-09-19T13:33:13.784 INFO:teuthology.orchestra.run.smithi149.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2024-09-19T13:33:13.801 INFO:teuthology.orchestra.run.smithi149.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 763 kB/s | 32 kB 00:00 2024-09-19T13:33:13.827 INFO:teuthology.orchestra.run.smithi149.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.8 MB/s | 161 kB 00:00 2024-09-19T13:33:13.852 INFO:teuthology.orchestra.run.smithi149.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-19T13:33:13.877 INFO:teuthology.orchestra.run.smithi149.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-19T13:33:13.894 INFO:teuthology.orchestra.run.smithi149.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 740 kB/s | 31 kB 00:00 2024-09-19T13:33:13.919 INFO:teuthology.orchestra.run.smithi149.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2024-09-19T13:33:13.944 INFO:teuthology.orchestra.run.smithi149.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-19T13:33:13.961 INFO:teuthology.orchestra.run.smithi149.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 879 kB/s | 37 kB 00:00 2024-09-19T13:33:13.987 INFO:teuthology.orchestra.run.smithi149.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 3.3 MB/s | 142 kB 00:00 2024-09-19T13:33:14.012 INFO:teuthology.orchestra.run.smithi149.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-19T13:33:14.037 INFO:teuthology.orchestra.run.smithi149.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-19T13:33:14.063 INFO:teuthology.orchestra.run.smithi149.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-19T13:33:14.088 INFO:teuthology.orchestra.run.smithi149.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 823 kB/s | 41 kB 00:00 2024-09-19T13:33:14.113 INFO:teuthology.orchestra.run.smithi149.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-19T13:33:14.139 INFO:teuthology.orchestra.run.smithi149.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 867 kB/s | 44 kB 00:00 2024-09-19T13:33:14.164 INFO:teuthology.orchestra.run.smithi149.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 669 kB/s | 34 kB 00:00 2024-09-19T13:33:14.189 INFO:teuthology.orchestra.run.smithi149.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 6.2 MB/s | 319 kB 00:00 2024-09-19T13:33:14.215 INFO:teuthology.orchestra.run.smithi149.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T13:33:14.240 INFO:teuthology.orchestra.run.smithi149.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-19T13:33:14.274 INFO:teuthology.orchestra.run.smithi149.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T13:33:14.299 INFO:teuthology.orchestra.run.smithi149.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-09-19T13:33:14.333 INFO:teuthology.orchestra.run.smithi149.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 206 kB 00:00 2024-09-19T13:33:14.358 INFO:teuthology.orchestra.run.smithi149.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-19T13:33:14.384 INFO:teuthology.orchestra.run.smithi149.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.8 MB/s | 198 kB 00:00 2024-09-19T13:33:14.400 INFO:teuthology.orchestra.run.smithi149.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 852 kB/s | 36 kB 00:00 2024-09-19T13:33:14.426 INFO:teuthology.orchestra.run.smithi149.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 7.6 MB/s | 324 kB 00:00 2024-09-19T13:33:14.459 INFO:teuthology.orchestra.run.smithi149.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-19T13:33:14.485 INFO:teuthology.orchestra.run.smithi149.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-19T13:33:14.526 INFO:teuthology.orchestra.run.smithi149.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 498 kB/s | 33 kB 00:00 2024-09-19T13:33:14.552 INFO:teuthology.orchestra.run.smithi149.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 291 kB/s | 19 kB 00:00 2024-09-19T13:33:14.577 INFO:teuthology.orchestra.run.smithi149.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-09-19T13:33:14.602 INFO:teuthology.orchestra.run.smithi149.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 834 kB/s | 42 kB 00:00 2024-09-19T13:33:14.628 INFO:teuthology.orchestra.run.smithi149.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-19T13:33:14.653 INFO:teuthology.orchestra.run.smithi149.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-19T13:33:14.678 INFO:teuthology.orchestra.run.smithi149.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 252 kB/s | 13 kB 00:00 2024-09-19T13:33:14.704 INFO:teuthology.orchestra.run.smithi149.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-19T13:33:14.729 INFO:teuthology.orchestra.run.smithi149.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T13:33:14.754 INFO:teuthology.orchestra.run.smithi149.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T13:33:14.780 INFO:teuthology.orchestra.run.smithi149.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T13:33:14.805 INFO:teuthology.orchestra.run.smithi149.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 352 kB/s | 18 kB 00:00 2024-09-19T13:33:14.864 INFO:teuthology.orchestra.run.smithi149.stdout:(159/286): maven-openjdk11-3.6.3-15.el9.noarch. 154 kB/s | 9.0 kB 00:00 2024-09-19T13:33:14.905 INFO:teuthology.orchestra.run.smithi149.stdout:(160/286): maven-lib-3.6.3-15.el9.noarch.rpm 12 MB/s | 1.5 MB 00:00 2024-09-19T13:33:14.939 INFO:teuthology.orchestra.run.smithi149.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 6.7 MB/s | 517 kB 00:00 2024-09-19T13:33:14.965 INFO:teuthology.orchestra.run.smithi149.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 151 kB 00:00 2024-09-19T13:33:14.990 INFO:teuthology.orchestra.run.smithi149.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-19T13:33:15.040 INFO:teuthology.orchestra.run.smithi149.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 224 kB/s | 11 kB 00:00 2024-09-19T13:33:15.099 INFO:teuthology.orchestra.run.smithi149.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-19T13:33:15.149 INFO:teuthology.orchestra.run.smithi149.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-19T13:33:15.208 INFO:teuthology.orchestra.run.smithi149.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 620 kB/s | 36 kB 00:00 2024-09-19T13:33:15.308 INFO:teuthology.orchestra.run.smithi149.stdout:(168/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 26 MB/s | 8.8 MB 00:00 2024-09-19T13:33:15.342 INFO:teuthology.orchestra.run.smithi149.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 343 kB/s | 46 kB 00:00 2024-09-19T13:33:15.367 INFO:teuthology.orchestra.run.smithi149.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 553 kB/s | 32 kB 00:00 2024-09-19T13:33:15.392 INFO:teuthology.orchestra.run.smithi149.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-19T13:33:15.445 INFO:teuthology.orchestra.run.smithi149.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.0 MB/s | 163 kB 00:00 2024-09-19T13:33:15.487 INFO:teuthology.orchestra.run.smithi149.stdout:(173/286): opus-1.3.1-10.el9.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2024-09-19T13:33:15.563 INFO:teuthology.orchestra.run.smithi149.stdout:(174/286): openblas-openmp-0.3.26-2.el9.x86_64. 25 MB/s | 4.9 MB 00:00 2024-09-19T13:33:15.588 INFO:teuthology.orchestra.run.smithi149.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.8 MB/s | 183 kB 00:00 2024-09-19T13:33:15.621 INFO:teuthology.orchestra.run.smithi149.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-19T13:33:15.647 INFO:teuthology.orchestra.run.smithi149.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-19T13:33:15.681 INFO:teuthology.orchestra.run.smithi149.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-19T13:33:15.706 INFO:teuthology.orchestra.run.smithi149.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-19T13:33:15.731 INFO:teuthology.orchestra.run.smithi149.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-19T13:33:15.756 INFO:teuthology.orchestra.run.smithi149.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-19T13:33:15.782 INFO:teuthology.orchestra.run.smithi149.stdout:(182/286): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-19T13:33:15.807 INFO:teuthology.orchestra.run.smithi149.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-19T13:33:15.849 INFO:teuthology.orchestra.run.smithi149.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 29 MB/s | 1.9 MB 00:00 2024-09-19T13:33:15.875 INFO:teuthology.orchestra.run.smithi149.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.8 MB/s | 192 kB 00:00 2024-09-19T13:33:15.888 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-19T13:33:15.899 INFO:teuthology.orchestra.run.smithi149.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-19T13:33:15.925 INFO:teuthology.orchestra.run.smithi149.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-19T13:33:15.950 INFO:teuthology.orchestra.run.smithi149.stdout:(188/286): plexus-containers-component-annotati 365 kB/s | 18 kB 00:00 2024-09-19T13:33:15.984 INFO:teuthology.orchestra.run.smithi149.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-19T13:33:16.018 INFO:teuthology.orchestra.run.smithi149.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 500 kB/s | 34 kB 00:00 2024-09-19T13:33:16.050 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-19T13:33:16.051 INFO:teuthology.orchestra.run.smithi149.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.7 MB/s | 254 kB 00:00 2024-09-19T13:33:16.093 INFO:teuthology.orchestra.run.smithi149.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-19T13:33:16.135 INFO:teuthology.orchestra.run.smithi149.stdout:(193/286): poppler-glib-21.01.0-21.el9.x86_64.r 3.6 MB/s | 152 kB 00:00 2024-09-19T13:33:16.194 INFO:teuthology.orchestra.run.smithi149.stdout:(194/286): poppler-data-0.4.9-9.el9.noarch.rpm 13 MB/s | 1.9 MB 00:00 2024-09-19T13:33:16.205 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-19T13:33:16.277 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-19T13:33:16.311 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-19T13:33:16.387 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-19T13:33:16.440 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-19T13:33:16.497 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-19T13:33:16.544 INFO:teuthology.orchestra.run.smithi149.stdout:(195/286): java-11-openjdk-headless-11.0.20.1.1 11 MB/s | 39 MB 00:03 2024-09-19T13:33:16.569 INFO:teuthology.orchestra.run.smithi149.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 220 kB/s | 83 kB 00:00 2024-09-19T13:33:16.580 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-19T13:33:16.603 INFO:teuthology.orchestra.run.smithi149.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-09-19T13:33:16.637 INFO:teuthology.orchestra.run.smithi149.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-19T13:33:16.662 INFO:teuthology.orchestra.run.smithi149.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-19T13:33:16.712 INFO:teuthology.orchestra.run.smithi149.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 3.2 MB/s | 248 kB 00:00 2024-09-19T13:33:16.729 INFO:teuthology.orchestra.run.smithi149.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 383 kB/s | 26 kB 00:00 2024-09-19T13:33:16.754 INFO:teuthology.orchestra.run.smithi149.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 457 kB/s | 19 kB 00:00 2024-09-19T13:33:16.788 INFO:teuthology.orchestra.run.smithi149.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T13:33:16.805 INFO:teuthology.orchestra.run.smithi149.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 693 kB/s | 35 kB 00:00 2024-09-19T13:33:16.815 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-19T13:33:16.855 INFO:teuthology.orchestra.run.smithi149.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.9 MB/s | 250 kB 00:00 2024-09-19T13:33:16.883 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-19T13:33:16.905 INFO:teuthology.orchestra.run.smithi149.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 4.4 MB/s | 222 kB 00:00 2024-09-19T13:33:16.998 INFO:teuthology.orchestra.run.smithi149.stdout:(207/286): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-19T13:33:17.023 INFO:teuthology.orchestra.run.smithi149.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 659 kB/s | 77 kB 00:00 2024-09-19T13:33:17.048 INFO:teuthology.orchestra.run.smithi149.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 845 kB/s | 42 kB 00:00 2024-09-19T13:33:17.073 INFO:teuthology.orchestra.run.smithi149.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-19T13:33:17.099 INFO:teuthology.orchestra.run.smithi149.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-19T13:33:17.124 INFO:teuthology.orchestra.run.smithi149.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-19T13:33:17.150 INFO:teuthology.orchestra.run.smithi149.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T13:33:17.175 INFO:teuthology.orchestra.run.smithi149.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-19T13:33:17.242 INFO:teuthology.orchestra.run.smithi149.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 11 MB/s | 5.1 MB 00:00 2024-09-19T13:33:17.267 INFO:teuthology.orchestra.run.smithi149.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-19T13:33:17.278 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-19T13:33:17.292 INFO:teuthology.orchestra.run.smithi149.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T13:33:17.326 INFO:teuthology.orchestra.run.smithi149.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 612 kB/s | 36 kB 00:00 2024-09-19T13:33:17.340 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 10/288 2024-09-19T13:33:17.368 INFO:teuthology.orchestra.run.smithi149.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-19T13:33:17.393 INFO:teuthology.orchestra.run.smithi149.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 835 kB/s | 56 kB 00:00 2024-09-19T13:33:17.427 INFO:teuthology.orchestra.run.smithi149.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 8.5 MB/s | 510 kB 00:00 2024-09-19T13:33:17.452 INFO:teuthology.orchestra.run.smithi149.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 69 kB 00:00 2024-09-19T13:33:17.463 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 10/288 2024-09-19T13:33:17.477 INFO:teuthology.orchestra.run.smithi149.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T13:33:17.499 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 11/288 2024-09-19T13:33:17.503 INFO:teuthology.orchestra.run.smithi149.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 7.5 MB/s | 383 kB 00:00 2024-09-19T13:33:17.528 INFO:teuthology.orchestra.run.smithi149.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-19T13:33:17.562 INFO:teuthology.orchestra.run.smithi149.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.2 MB/s | 555 kB 00:00 2024-09-19T13:33:17.582 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 11/288 2024-09-19T13:33:17.604 INFO:teuthology.orchestra.run.smithi149.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-19T13:33:17.611 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 12/288 2024-09-19T13:33:17.629 INFO:teuthology.orchestra.run.smithi149.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 796 kB/s | 53 kB 00:00 2024-09-19T13:33:17.650 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-19T13:33:17.654 INFO:teuthology.orchestra.run.smithi149.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-19T13:33:17.680 INFO:teuthology.orchestra.run.smithi149.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-19T13:33:17.680 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-19T13:33:17.705 INFO:teuthology.orchestra.run.smithi149.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 5.9 MB/s | 306 kB 00:00 2024-09-19T13:33:17.705 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-19T13:33:17.730 INFO:teuthology.orchestra.run.smithi149.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-19T13:33:17.731 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-19T13:33:17.763 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-19T13:33:17.764 INFO:teuthology.orchestra.run.smithi149.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-19T13:33:17.789 INFO:teuthology.orchestra.run.smithi149.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 723 kB/s | 42 kB 00:00 2024-09-19T13:33:17.796 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-19T13:33:17.814 INFO:teuthology.orchestra.run.smithi149.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-19T13:33:17.840 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-19T13:33:17.840 INFO:teuthology.orchestra.run.smithi149.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-19T13:33:17.873 INFO:teuthology.orchestra.run.smithi149.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 14 MB/s | 859 kB 00:00 2024-09-19T13:33:17.876 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-19T13:33:17.890 INFO:teuthology.orchestra.run.smithi149.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T13:33:17.924 INFO:teuthology.orchestra.run.smithi149.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.8 MB/s | 505 kB 00:00 2024-09-19T13:33:17.974 INFO:teuthology.orchestra.run.smithi149.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-09-19T13:33:18.025 INFO:teuthology.orchestra.run.smithi149.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T13:33:18.051 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-19T13:33:18.058 INFO:teuthology.orchestra.run.smithi149.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T13:33:18.084 INFO:teuthology.orchestra.run.smithi149.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-19T13:33:18.251 INFO:teuthology.orchestra.run.smithi149.stdout:(244/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-19T13:33:18.282 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-19T13:33:18.285 INFO:teuthology.orchestra.run.smithi149.stdout:(245/286): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-19T13:33:18.326 INFO:teuthology.orchestra.run.smithi149.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-09-19T13:33:18.360 INFO:teuthology.orchestra.run.smithi149.stdout:(247/286): liboath-2.6.7-2.el9.x86_64.rpm 719 kB/s | 49 kB 00:00 2024-09-19T13:33:18.385 INFO:teuthology.orchestra.run.smithi149.stdout:(248/286): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-19T13:33:18.419 INFO:teuthology.orchestra.run.smithi149.stdout:(249/286): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-19T13:33:18.486 INFO:teuthology.orchestra.run.smithi149.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-19T13:33:18.511 INFO:teuthology.orchestra.run.smithi149.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T13:33:18.536 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-19T13:33:18.536 INFO:teuthology.orchestra.run.smithi149.stdout:(252/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-19T13:33:18.562 INFO:teuthology.orchestra.run.smithi149.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-19T13:33:18.581 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-19T13:33:18.587 INFO:teuthology.orchestra.run.smithi149.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T13:33:18.610 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 25/288 2024-09-19T13:33:18.612 INFO:teuthology.orchestra.run.smithi149.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T13:33:18.646 INFO:teuthology.orchestra.run.smithi149.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T13:33:18.671 INFO:teuthology.orchestra.run.smithi149.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T13:33:18.713 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 25/288 2024-09-19T13:33:18.736 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86 26/288 2024-09-19T13:33:18.755 INFO:teuthology.orchestra.run.smithi149.stdout:(258/286): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-19T13:33:18.780 INFO:teuthology.orchestra.run.smithi149.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-09-19T13:33:18.805 INFO:teuthology.orchestra.run.smithi149.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T13:33:18.807 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86 26/288 2024-09-19T13:33:18.831 INFO:teuthology.orchestra.run.smithi149.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T13:33:18.831 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-19T13:33:18.854 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-19T13:33:18.856 INFO:teuthology.orchestra.run.smithi149.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-19T13:33:18.881 INFO:teuthology.orchestra.run.smithi149.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T13:33:18.887 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-19T13:33:18.907 INFO:teuthology.orchestra.run.smithi149.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-19T13:33:18.932 INFO:teuthology.orchestra.run.smithi149.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T13:33:18.957 INFO:teuthology.orchestra.run.smithi149.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T13:33:18.982 INFO:teuthology.orchestra.run.smithi149.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T13:33:19.024 INFO:teuthology.orchestra.run.smithi149.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T13:33:19.050 INFO:teuthology.orchestra.run.smithi149.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-19T13:33:19.082 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-19T13:33:19.083 INFO:teuthology.orchestra.run.smithi149.stdout:(270/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T13:33:19.113 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-19T13:33:19.159 INFO:teuthology.orchestra.run.smithi149.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 828 kB/s | 90 kB 00:00 2024-09-19T13:33:19.184 INFO:teuthology.orchestra.run.smithi149.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-09-19T13:33:19.201 INFO:teuthology.orchestra.run.smithi149.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T13:33:19.225 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-19T13:33:19.243 INFO:teuthology.orchestra.run.smithi149.stdout:(274/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-19T13:33:19.252 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-19T13:33:19.268 INFO:teuthology.orchestra.run.smithi149.stdout:(275/286): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-19T13:33:19.285 INFO:teuthology.orchestra.run.smithi149.stdout:(276/286): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-09-19T13:33:19.288 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-19T13:33:19.311 INFO:teuthology.orchestra.run.smithi149.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-19T13:33:19.336 INFO:teuthology.orchestra.run.smithi149.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T13:33:19.361 INFO:teuthology.orchestra.run.smithi149.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-19T13:33:19.362 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-19T13:33:19.386 INFO:teuthology.orchestra.run.smithi149.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-19T13:33:19.412 INFO:teuthology.orchestra.run.smithi149.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T13:33:19.416 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-19T13:33:19.437 INFO:teuthology.orchestra.run.smithi149.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-19T13:33:19.462 INFO:teuthology.orchestra.run.smithi149.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T13:33:19.463 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-19T13:33:19.524 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-19T13:33:19.546 INFO:teuthology.orchestra.run.smithi149.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T13:33:19.556 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-19T13:33:19.589 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-19T13:33:19.614 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-19T13:33:19.639 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-19T13:33:19.668 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-19T13:33:19.700 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-19T13:33:19.721 INFO:teuthology.orchestra.run.smithi149.stdout:(285/286): librbd1-19.3.0-5012.g08af21e0.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-19T13:33:19.725 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-19T13:33:19.763 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-19T13:33:19.771 INFO:teuthology.orchestra.run.smithi149.stdout:(286/286): librados2-19.3.0-5012.g08af21e0.el9. 10 MB/s | 3.5 MB 00:00 2024-09-19T13:33:19.779 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-09-19T13:33:19.779 INFO:teuthology.orchestra.run.smithi149.stdout:Total 23 MB/s | 322 MB 00:13 2024-09-19T13:33:19.790 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-19T13:33:19.860 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-19T13:33:19.926 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-19T13:33:19.971 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-19T13:33:20.017 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-19T13:33:20.052 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-19T13:33:20.084 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-19T13:33:20.167 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-19T13:33:20.203 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9. 52/288 2024-09-19T13:33:20.246 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el 53/288 2024-09-19T13:33:20.288 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_6 54/288 2024-09-19T13:33:20.365 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-19T13:33:20.512 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-19T13:33:20.585 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-19T13:33:21.131 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-19T13:33:21.231 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-19T13:33:21.266 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-19T13:33:21.336 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-19T13:33:21.372 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-19T13:33:21.408 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-19T13:33:21.437 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-19T13:33:21.510 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-19T13:33:21.548 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-19T13:33:21.573 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-19T13:33:21.608 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-19T13:33:21.646 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_6 69/288 2024-09-19T13:33:21.679 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-19T13:33:21.711 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-19T13:33:21.759 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-19T13:33:21.821 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-19T13:33:21.872 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-19T13:33:21.917 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-19T13:33:22.010 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-19T13:33:22.074 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-19T13:33:22.148 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-19T13:33:22.186 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-19T13:33:22.230 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-19T13:33:22.286 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-19T13:33:22.331 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-19T13:33:22.373 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-19T13:33:22.514 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-19T13:33:22.558 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-19T13:33:22.600 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-19T13:33:22.714 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-19T13:33:22.761 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-19T13:33:22.799 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-19T13:33:22.832 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-19T13:33:22.857 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-19T13:33:22.864 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-09-19T13:33:22.955 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-19T13:33:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-09-19T13:33:23.052 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-09-19T13:33:23.087 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-19T13:33:23.126 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-19T13:33:23.342 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-19T13:33:23.394 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-19T13:33:23.425 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-19T13:33:23.464 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-19T13:33:23.514 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-19T13:33:23.542 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-19T13:33:23.557 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-19T13:33:23.557 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-19T13:33:23.557 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:23.747 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-19T13:33:23.825 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-19T13:33:23.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-19T13:33:23.899 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-19T13:33:23.925 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-19T13:33:23.959 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-19T13:33:24.441 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-19T13:33:24.471 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-19T13:33:24.486 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-19T13:33:24.486 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-19T13:33:24.486 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:24.527 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-19T13:33:24.562 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-19T13:33:24.595 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-19T13:33:24.646 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-19T13:33:24.689 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-19T13:33:24.776 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-19T13:33:24.827 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-19T13:33:24.875 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-19T13:33:24.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-19T13:33:25.044 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-19T13:33:25.799 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-19T13:33:25.850 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-19T13:33:25.883 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-19T13:33:25.987 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-19T13:33:26.028 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-19T13:33:26.220 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-19T13:33:26.256 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-19T13:33:26.301 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-19T13:33:26.367 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-09-19T13:33:26.368 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-09-19T13:33:26.823 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-19T13:33:26.890 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-19T13:33:26.935 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-19T13:33:26.970 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-19T13:33:27.003 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-19T13:33:27.188 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-19T13:33:27.217 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-19T13:33:27.296 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-19T13:33:27.991 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-19T13:33:28.177 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-19T13:33:29.466 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-19T13:33:29.554 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-19T13:33:29.606 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-19T13:33:29.640 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-19T13:33:29.668 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-19T13:33:29.697 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-19T13:33:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-19T13:33:29.709 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-19T13:33:29.709 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:29.764 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-19T13:33:29.792 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-19T13:33:29.821 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-19T13:33:30.147 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-19T13:33:30.193 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 145/288 2024-09-19T13:33:30.293 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 145/288 2024-09-19T13:33:30.325 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 146/288 2024-09-19T13:33:30.356 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-19T13:33:30.386 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-19T13:33:30.446 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-19T13:33:30.485 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-19T13:33:30.519 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-19T13:33:30.566 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-19T13:33:30.592 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-19T13:33:30.843 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-19T13:33:30.903 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-19T13:33:30.931 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-19T13:33:30.956 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-19T13:33:30.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-19T13:33:31.007 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-19T13:33:31.032 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-19T13:33:31.061 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-19T13:33:31.097 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-19T13:33:31.140 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-19T13:33:31.173 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-19T13:33:31.221 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-19T13:33:31.247 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-19T13:33:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-19T13:33:31.857 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-19T13:33:31.932 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-19T13:33:31.965 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-19T13:33:31.993 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-19T13:33:32.070 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-19T13:33:32.117 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-19T13:33:32.141 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-19T13:33:32.162 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-19T13:33:32.195 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-19T13:33:32.222 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-19T13:33:32.259 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-19T13:33:32.286 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-19T13:33:36.689 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-19T13:33:36.847 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-19T13:33:37.004 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-09-19T13:33:37.074 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-19T13:33:37.100 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-19T13:33:37.177 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-19T13:33:37.229 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-19T13:33:37.287 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-19T13:33:37.328 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-19T13:33:37.353 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-19T13:33:37.501 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-19T13:33:37.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-19T13:33:37.996 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 10/288 2024-09-19T13:33:38.118 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 10/288 2024-09-19T13:33:38.147 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 11/288 2024-09-19T13:33:38.229 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 11/288 2024-09-19T13:33:38.259 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 12/288 2024-09-19T13:33:38.299 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-19T13:33:38.327 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-19T13:33:38.353 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-19T13:33:38.379 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-19T13:33:38.411 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-19T13:33:38.443 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-19T13:33:38.470 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-19T13:33:38.507 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-19T13:33:38.660 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-19T13:33:38.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-19T13:33:38.846 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-19T13:33:38.883 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-19T13:33:38.912 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 25/288 2024-09-19T13:33:39.015 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 25/288 2024-09-19T13:33:39.037 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86 26/288 2024-09-19T13:33:39.100 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86 26/288 2024-09-19T13:33:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-19T13:33:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-19T13:33:39.175 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-19T13:33:39.370 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-19T13:33:39.401 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-19T13:33:39.513 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-19T13:33:39.549 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-19T13:33:39.592 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-19T13:33:39.667 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-19T13:33:39.726 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-19T13:33:39.767 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-19T13:33:39.811 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-19T13:33:39.835 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-19T13:33:39.861 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-19T13:33:39.887 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-19T13:33:39.912 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-19T13:33:39.941 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-19T13:33:39.982 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-19T13:33:40.014 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-19T13:33:40.072 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-19T13:33:40.104 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-19T13:33:40.171 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-19T13:33:40.222 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-19T13:33:40.253 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-19T13:33:40.296 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-19T13:33:40.332 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-19T13:33:40.364 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-19T13:33:40.445 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-19T13:33:40.491 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9. 52/288 2024-09-19T13:33:40.534 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el 53/288 2024-09-19T13:33:40.577 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_6 54/288 2024-09-19T13:33:40.654 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-19T13:33:40.788 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-19T13:33:40.841 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-19T13:33:41.375 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-19T13:33:41.463 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-19T13:33:41.506 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-19T13:33:41.576 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-19T13:33:41.612 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-19T13:33:41.648 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-19T13:33:41.677 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-19T13:33:41.751 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-19T13:33:41.781 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-19T13:33:41.813 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-19T13:33:41.849 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-19T13:33:41.895 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_6 69/288 2024-09-19T13:33:41.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-19T13:33:41.968 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-19T13:33:42.010 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-19T13:33:42.069 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-19T13:33:42.103 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-19T13:33:42.140 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-19T13:33:42.234 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-19T13:33:42.490 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-19T13:33:42.636 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-19T13:33:42.684 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-19T13:33:42.720 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-19T13:33:42.767 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-19T13:33:42.812 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-19T13:33:42.855 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-19T13:33:42.994 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-19T13:33:43.039 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-19T13:33:43.089 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-19T13:33:43.193 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-19T13:33:43.231 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-19T13:33:43.280 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-19T13:33:43.313 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-19T13:33:43.338 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-19T13:33:43.433 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-19T13:33:43.561 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-19T13:33:43.598 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-19T13:33:43.822 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-19T13:33:43.868 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-19T13:33:43.899 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-19T13:33:43.946 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-19T13:33:43.981 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-19T13:33:43.990 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-19T13:33:44.016 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-19T13:33:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-19T13:33:44.029 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-19T13:33:44.029 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:33:44.031 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-19T13:33:44.059 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-19T13:33:44.106 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-19T13:33:44.142 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-19T13:33:44.178 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-19T13:33:44.212 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-19T13:33:44.291 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-19T13:33:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-19T13:33:44.373 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-19T13:33:44.397 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-19T13:33:44.424 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-19T13:33:44.687 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-19T13:33:44.716 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 184/288 2024-09-19T13:33:44.797 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 184/288 2024-09-19T13:33:44.826 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 185/288 2024-09-19T13:33:44.869 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-19T13:33:44.911 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-19T13:33:44.925 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-19T13:33:44.926 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:33:44.968 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-19T13:33:45.002 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-19T13:33:45.035 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-19T13:33:45.077 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-19T13:33:45.140 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-19T13:33:45.233 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-19T13:33:45.284 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-19T13:33:45.314 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-19T13:33:45.420 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-19T13:33:45.483 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-19T13:33:46.234 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-19T13:33:46.280 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-19T13:33:46.313 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-19T13:33:46.415 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-19T13:33:46.448 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-19T13:33:46.639 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-19T13:33:46.677 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-19T13:33:46.722 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-19T13:33:47.250 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-19T13:33:47.264 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 186/288 2024-09-19T13:33:47.301 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 186/288 2024-09-19T13:33:47.312 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-19T13:33:47.357 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-19T13:33:47.391 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-19T13:33:47.424 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-19T13:33:47.611 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-19T13:33:47.638 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-19T13:33:47.726 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-19T13:33:47.854 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 186/288 2024-09-19T13:33:47.905 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 187/288 2024-09-19T13:33:47.988 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 187/288 2024-09-19T13:33:47.988 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T13:33:47.989 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T13:33:47.989 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:48.023 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 188/288 2024-09-19T13:33:48.426 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-19T13:33:48.546 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-19T13:33:49.846 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-19T13:33:49.946 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-19T13:33:50.013 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-19T13:33:50.052 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-19T13:33:50.088 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-19T13:33:50.117 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-19T13:33:50.129 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-19T13:33:50.129 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-19T13:33:50.129 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:33:50.182 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-19T13:33:50.213 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-19T13:33:50.241 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-19T13:33:50.565 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-19T13:33:50.613 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 145/288 2024-09-19T13:33:50.711 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 145/288 2024-09-19T13:33:50.745 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 146/288 2024-09-19T13:33:50.776 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-19T13:33:50.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-19T13:33:50.869 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-19T13:33:50.905 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-19T13:33:50.931 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-19T13:33:50.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-19T13:33:51.020 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-19T13:33:51.330 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-19T13:33:51.381 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-19T13:33:51.409 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-19T13:33:51.434 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-19T13:33:51.460 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-19T13:33:51.485 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-19T13:33:51.510 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-19T13:33:51.538 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-19T13:33:51.574 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-19T13:33:51.624 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-19T13:33:51.658 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-19T13:33:51.714 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-19T13:33:51.741 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-19T13:33:52.196 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-19T13:33:52.327 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-19T13:33:52.399 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-19T13:33:52.425 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-19T13:33:52.452 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-19T13:33:52.537 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-19T13:33:52.577 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-19T13:33:52.601 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-19T13:33:52.621 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-19T13:33:52.655 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-19T13:33:52.690 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-19T13:33:52.731 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-19T13:33:52.753 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 188/288 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-09-19T13:33:57.504 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:57.682 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 189/288 2024-09-19T13:33:57.698 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 189/288 2024-09-19T13:33:57.698 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:33:57.698 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T13:33:57.699 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:59.175 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 190/288 2024-09-19T13:33:59.202 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 190/288 2024-09-19T13:33:59.202 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:33:59.202 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T13:33:59.202 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T13:33:59.202 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T13:33:59.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:59.434 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 191/288 2024-09-19T13:33:59.457 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 191/288 2024-09-19T13:33:59.457 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:33:59.457 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T13:33:59.457 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T13:33:59.458 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T13:33:59.458 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:33:59.909 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 192/288 2024-09-19T13:33:59.933 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 192/288 2024-09-19T13:33:59.933 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:33:59.933 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T13:33:59.933 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T13:33:59.933 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T13:33:59.933 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:00.037 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-19T13:34:02.985 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-19T13:34:03.093 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-19T13:34:03.150 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-19T13:34:03.206 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-19T13:34:03.393 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-19T13:34:03.446 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-19T13:34:03.525 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-19T13:34:03.613 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-19T13:34:03.763 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-19T13:34:03.805 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-19T13:34:03.838 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-19T13:34:04.680 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-19T13:34:04.702 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-19T13:34:04.722 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-19T13:34:04.750 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-19T13:34:04.761 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-19T13:34:04.794 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-19T13:34:04.824 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-19T13:34:04.861 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-19T13:34:05.134 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-19T13:34:05.176 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-19T13:34:05.207 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-19T13:34:05.234 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-19T13:34:05.269 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-19T13:34:05.305 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-19T13:34:05.333 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-19T13:34:05.355 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-19T13:34:05.381 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 184/288 2024-09-19T13:34:05.386 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-19T13:34:05.418 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-19T13:34:05.443 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-19T13:34:05.444 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 184/288 2024-09-19T13:34:05.469 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-19T13:34:05.474 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 185/288 2024-09-19T13:34:05.494 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-19T13:34:05.530 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-19T13:34:05.568 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-19T13:34:05.596 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-19T13:34:05.631 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-19T13:34:05.667 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-19T13:34:05.697 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-19T13:34:05.732 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-19T13:34:05.766 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-19T13:34:05.802 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-19T13:34:05.858 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-19T13:34:05.909 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-19T13:34:05.953 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-19T13:34:05.985 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-19T13:34:06.008 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-19T13:34:06.061 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-19T13:34:06.093 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-19T13:34:06.123 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-19T13:34:06.161 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-19T13:34:06.186 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-19T13:34:06.356 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-19T13:34:06.387 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-19T13:34:06.414 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-19T13:34:06.441 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-19T13:34:06.473 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-19T13:34:06.609 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-19T13:34:06.672 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-19T13:34:06.740 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-19T13:34:06.769 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-19T13:34:06.890 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-19T13:34:06.933 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-19T13:34:06.948 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-19T13:34:06.978 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-19T13:34:07.001 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-19T13:34:07.406 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-19T13:34:07.446 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-19T13:34:07.463 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-19T13:34:07.463 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-19T13:34:07.463 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:07.697 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-19T13:34:07.767 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-19T13:34:07.813 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-19T13:34:07.858 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-19T13:34:07.883 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-19T13:34:07.918 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 186/288 2024-09-19T13:34:07.958 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 186/288 2024-09-19T13:34:08.306 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-19T13:34:08.345 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-19T13:34:08.362 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-19T13:34:08.510 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 186/288 2024-09-19T13:34:08.553 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 187/288 2024-09-19T13:34:08.644 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 187/288 2024-09-19T13:34:08.644 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T13:34:08.644 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T13:34:08.644 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:08.672 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 188/288 2024-09-19T13:34:08.915 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-19T13:34:08.999 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-19T13:34:09.036 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-19T13:34:09.064 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-19T13:34:09.266 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-19T13:34:09.326 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-19T13:34:09.352 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-19T13:34:09.374 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-19T13:34:09.403 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-19T13:34:09.466 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-19T13:34:09.497 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-19T13:34:09.508 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-19T13:34:09.539 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-19T13:34:09.557 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-19T13:34:09.590 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-19T13:34:10.028 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 265/288 2024-09-19T13:34:10.054 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 265/288 2024-09-19T13:34:10.087 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.e 266/288 2024-09-19T13:34:10.154 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0. 267/288 2024-09-19T13:34:10.186 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noa 268/288 2024-09-19T13:34:13.426 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noa 268/288 2024-09-19T13:34:13.484 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.n 269/288 2024-09-19T13:34:14.448 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.n 269/288 2024-09-19T13:34:14.476 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08a 270/288 2024-09-19T13:34:14.593 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08a 270/288 2024-09-19T13:34:14.746 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el 271/288 2024-09-19T13:34:14.778 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 272/288 2024-09-19T13:34:14.802 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 272/288 2024-09-19T13:34:14.802 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:14.802 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T13:34:14.802 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T13:34:14.802 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T13:34:14.802 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:14.862 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 273/288 2024-09-19T13:34:14.874 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 273/288 2024-09-19T13:34:14.897 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 274/288 2024-09-19T13:34:14.926 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-19T13:34:14.975 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-19T13:34:15.006 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-19T13:34:15.022 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-19T13:34:15.022 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-19T13:34:15.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:15.982 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 278/288 2024-09-19T13:34:16.006 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 278/288 2024-09-19T13:34:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T13:34:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:34:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:34:16.006 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:16.058 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5012.g08af2 279/288 2024-09-19T13:34:16.081 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5012.g08af2 279/288 2024-09-19T13:34:16.081 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:16.081 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T13:34:16.081 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:16.400 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 280/288 2024-09-19T13:34:16.423 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 280/288 2024-09-19T13:34:16.424 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:16.424 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T13:34:16.424 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T13:34:16.424 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T13:34:16.424 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 188/288 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-09-19T13:34:18.079 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:18.254 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 189/288 2024-09-19T13:34:18.270 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 189/288 2024-09-19T13:34:18.270 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:18.270 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T13:34:18.270 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:19.755 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 190/288 2024-09-19T13:34:19.782 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 190/288 2024-09-19T13:34:19.782 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:19.782 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T13:34:19.782 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T13:34:19.782 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T13:34:19.782 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:20.005 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 191/288 2024-09-19T13:34:20.029 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 191/288 2024-09-19T13:34:20.029 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:20.029 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T13:34:20.029 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T13:34:20.030 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T13:34:20.030 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:20.490 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 192/288 2024-09-19T13:34:20.513 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 192/288 2024-09-19T13:34:20.513 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:20.513 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T13:34:20.513 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T13:34:20.513 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T13:34:20.513 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:20.626 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-19T13:34:20.720 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 281/288 2024-09-19T13:34:20.761 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 282/288 2024-09-19T13:34:20.793 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 283/288 2024-09-19T13:34:20.898 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_ 284/288 2024-09-19T13:34:20.961 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 285/288 2024-09-19T13:34:20.992 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-19T13:34:20.993 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-19T13:34:21.085 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-19T13:34:21.085 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:21.167 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:21.187 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-19T13:34:21.193 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-19T13:34:21.202 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-19T13:34:21.213 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-19T13:34:21.213 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-19T13:34:21.213 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-19T13:34:21.213 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:21.273 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-19T13:34:21.341 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-19T13:34:23.497 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-19T13:34:23.733 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-19T13:34:23.790 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-19T13:34:23.855 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-19T13:34:24.041 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-19T13:34:24.095 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-19T13:34:24.173 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-19T13:34:24.261 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-19T13:34:24.403 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-19T13:34:24.453 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-19T13:34:24.486 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-19T13:34:25.369 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-19T13:34:25.435 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-19T13:34:25.795 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-19T13:34:25.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-19T13:34:25.864 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-19T13:34:25.891 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-19T13:34:25.927 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-19T13:34:25.964 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-19T13:34:25.991 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-19T13:34:26.017 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-19T13:34:26.043 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-19T13:34:26.067 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-19T13:34:26.094 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-19T13:34:26.128 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-19T13:34:26.163 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-19T13:34:26.194 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-19T13:34:26.221 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-19T13:34:26.256 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-19T13:34:26.292 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-19T13:34:26.323 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-19T13:34:26.357 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-19T13:34:26.392 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-19T13:34:26.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-19T13:34:26.475 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-19T13:34:26.527 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-19T13:34:26.571 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-19T13:34:26.603 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-19T13:34:26.626 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-19T13:34:26.678 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-19T13:34:26.711 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-19T13:34:26.741 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-19T13:34:26.771 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-19T13:34:26.796 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-19T13:34:26.966 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-19T13:34:26.997 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-19T13:34:27.032 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-19T13:34:27.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-19T13:34:27.100 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-19T13:34:27.234 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-19T13:34:27.302 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-19T13:34:27.360 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-19T13:34:27.389 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-19T13:34:27.512 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-19T13:34:27.552 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-19T13:34:27.567 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-19T13:34:27.597 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-19T13:34:27.629 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-19T13:34:28.028 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-19T13:34:28.060 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-19T13:34:28.075 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-19T13:34:28.076 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-19T13:34:28.076 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:28.311 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-19T13:34:28.381 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-19T13:34:28.418 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-19T13:34:28.463 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-19T13:34:28.488 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-19T13:34:28.879 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-19T13:34:28.909 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-19T13:34:28.925 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-19T13:34:29.390 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-19T13:34:29.480 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-19T13:34:29.525 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-19T13:34:29.553 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-19T13:34:29.751 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-19T13:34:29.811 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-19T13:34:29.842 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-19T13:34:29.863 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-19T13:34:29.901 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-19T13:34:29.972 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-19T13:34:30.012 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-19T13:34:30.023 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-19T13:34:30.054 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-19T13:34:30.073 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-19T13:34:30.096 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-19T13:34:30.434 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 265/288 2024-09-19T13:34:30.460 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 265/288 2024-09-19T13:34:30.494 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.e 266/288 2024-09-19T13:34:30.560 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0. 267/288 2024-09-19T13:34:30.593 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noa 268/288 2024-09-19T13:34:31.695 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 1/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 2/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 3/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 4/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5012.g08af2 5/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 6/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 7/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 8/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 9/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 10/288 2024-09-19T13:34:31.696 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 11/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 12/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_ 13/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 14/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 15/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_6 16/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86 17/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 18/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el 19/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9. 20/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_6 21/288 2024-09-19T13:34:31.697 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 22/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 23/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 24/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 25/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 26/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 27/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0. 28/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noa 29/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.n 30/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08a 31/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el 32/288 2024-09-19T13:34:31.698 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 33/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.e 34/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 35/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 36/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-19T13:34:31.699 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-19T13:34:31.700 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-19T13:34:31.701 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-19T13:34:31.702 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-19T13:34:31.703 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-19T13:34:31.704 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-19T13:34:31.705 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-19T13:34:31.706 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-19T13:34:31.707 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-19T13:34:31.708 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-19T13:34:31.709 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-19T13:34:31.710 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-19T13:34:31.711 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-19T13:34:31.712 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-19T13:34:31.713 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-19T13:34:31.714 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-19T13:34:31.715 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-19T13:34:31.716 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-19T13:34:31.717 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-19T13:34:31.718 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-19T13:34:31.719 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-19T13:34:31.720 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 285/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-19T13:34:31.721 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 287/288 2024-09-19T13:34:33.828 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noa 268/288 2024-09-19T13:34:33.883 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.n 269/288 2024-09-19T13:34:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.n 269/288 2024-09-19T13:34:34.891 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08a 270/288 2024-09-19T13:34:35.008 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08a 270/288 2024-09-19T13:34:35.170 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el 271/288 2024-09-19T13:34:35.201 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 272/288 2024-09-19T13:34:35.225 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 272/288 2024-09-19T13:34:35.225 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:35.225 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T13:34:35.225 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T13:34:35.225 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T13:34:35.225 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:35.277 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 273/288 2024-09-19T13:34:35.289 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 273/288 2024-09-19T13:34:35.311 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 274/288 2024-09-19T13:34:35.325 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-19T13:34:35.326 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: atinject-1.0.3-6.el9.noarch 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: atk-2.36.0-5.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.328 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-19T13:34:35.329 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-19T13:34:35.330 INFO:teuthology.orchestra.run.smithi094.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-19T13:34:35.331 INFO:teuthology.orchestra.run.smithi094.stdout: guava-30.1-6.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-19T13:34:35.332 INFO:teuthology.orchestra.run.smithi094.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: lcms2-2.12-3.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-19T13:34:35.333 INFO:teuthology.orchestra.run.smithi094.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-19T13:34:35.334 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T13:34:35.335 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-19T13:34:35.335 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-19T13:34:35.335 INFO:teuthology.orchestra.run.smithi094.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-19T13:34:35.335 INFO:teuthology.orchestra.run.smithi094.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-19T13:34:35.335 INFO:teuthology.orchestra.run.smithi094.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-19T13:34:35.335 INFO:teuthology.orchestra.run.smithi094.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.336 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libsbc-1.4-9.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-19T13:34:35.337 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-19T13:34:35.338 INFO:teuthology.orchestra.run.smithi094.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T13:34:35.339 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: opus-1.3.1-10.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: orc-0.4.31-8.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-19T13:34:35.340 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T13:34:35.341 INFO:teuthology.orchestra.run.smithi094.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T13:34:35.342 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T13:34:35.343 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T13:34:35.344 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.345 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T13:34:35.346 INFO:teuthology.orchestra.run.smithi094.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: rtkit-0.11-29.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-19T13:34:35.347 INFO:teuthology.orchestra.run.smithi094.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: upower-0.99.11-11.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-19T13:34:35.348 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T13:34:35.349 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-19T13:34:35.349 INFO:teuthology.orchestra.run.smithi094.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-19T13:34:35.349 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:34:35.349 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-19T13:34:35.390 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-19T13:34:35.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-19T13:34:35.445 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-19T13:34:35.445 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-19T13:34:35.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:35.782 DEBUG:teuthology.parallel:result is None 2024-09-19T13:34:36.465 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 278/288 2024-09-19T13:34:36.490 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 278/288 2024-09-19T13:34:36.491 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:36.491 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T13:34:36.491 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:34:36.491 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:34:36.491 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:36.541 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5012.g08af2 279/288 2024-09-19T13:34:36.565 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5012.g08af2 279/288 2024-09-19T13:34:36.565 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:36.565 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T13:34:36.565 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:36.901 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 280/288 2024-09-19T13:34:36.925 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 280/288 2024-09-19T13:34:36.925 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T13:34:36.925 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T13:34:36.925 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T13:34:36.925 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T13:34:36.925 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:41.238 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 281/288 2024-09-19T13:34:41.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 282/288 2024-09-19T13:34:41.311 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 283/288 2024-09-19T13:34:41.415 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_ 284/288 2024-09-19T13:34:41.479 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 285/288 2024-09-19T13:34:41.510 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-19T13:34:41.510 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-19T13:34:41.603 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-19T13:34:41.603 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:41.694 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:41.714 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-19T13:34:41.721 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-19T13:34:41.729 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-19T13:34:41.740 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-19T13:34:41.740 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-19T13:34:41.740 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-19T13:34:41.740 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:41.814 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-19T13:34:41.883 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-19T13:34:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 1/288 2024-09-19T13:34:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 2/288 2024-09-19T13:34:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 3/288 2024-09-19T13:34:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 4/288 2024-09-19T13:34:52.097 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5012.g08af2 5/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 6/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 7/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 8/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 9/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 10/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 11/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 12/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_ 13/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 14/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 15/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_6 16/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86 17/288 2024-09-19T13:34:52.098 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 18/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el 19/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9. 20/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_6 21/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 22/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 23/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 24/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 25/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 26/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 27/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0. 28/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noa 29/288 2024-09-19T13:34:52.099 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.n 30/288 2024-09-19T13:34:52.121 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08a 31/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el 32/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 33/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.e 34/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 35/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 36/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-19T13:34:52.122 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-19T13:34:52.123 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-19T13:34:52.124 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-19T13:34:52.125 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-19T13:34:52.126 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-19T13:34:52.127 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-19T13:34:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-19T13:34:52.129 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-19T13:34:52.130 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-19T13:34:52.131 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-19T13:34:52.132 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-19T13:34:52.133 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-19T13:34:52.134 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-19T13:34:52.135 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-19T13:34:52.136 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-19T13:34:52.137 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-19T13:34:52.138 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-19T13:34:52.139 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-19T13:34:52.140 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 285/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-19T13:34:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 287/288 2024-09-19T13:34:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-19T13:34:55.720 INFO:teuthology.orchestra.run.smithi149.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: atinject-1.0.3-6.el9.noarch 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: atk-2.36.0-5.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-19T13:34:55.721 INFO:teuthology.orchestra.run.smithi149.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.722 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.723 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T13:34:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-19T13:34:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-19T13:34:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-19T13:34:55.724 INFO:teuthology.orchestra.run.smithi149.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T13:34:55.725 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: guava-30.1-6.el9.noarch 2024-09-19T13:34:55.726 INFO:teuthology.orchestra.run.smithi149.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-19T13:34:55.727 INFO:teuthology.orchestra.run.smithi149.stdout: lcms2-2.12-3.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T13:34:55.728 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-19T13:34:55.729 INFO:teuthology.orchestra.run.smithi149.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T13:34:55.730 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: libsbc-1.4-9.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-19T13:34:55.731 INFO:teuthology.orchestra.run.smithi149.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-19T13:34:55.732 INFO:teuthology.orchestra.run.smithi149.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-19T13:34:55.733 INFO:teuthology.orchestra.run.smithi149.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: opus-1.3.1-10.el9.x86_64 2024-09-19T13:34:55.734 INFO:teuthology.orchestra.run.smithi149.stdout: orc-0.4.31-8.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-19T13:34:55.735 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-19T13:34:55.736 INFO:teuthology.orchestra.run.smithi149.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T13:34:55.737 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T13:34:55.738 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T13:34:55.739 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T13:34:55.740 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T13:34:55.741 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: rtkit-0.11-29.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-19T13:34:55.742 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: upower-0.99.11-11.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-19T13:34:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T13:34:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-19T13:34:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:34:55.744 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-09-19T13:34:56.117 DEBUG:teuthology.parallel:result is None 2024-09-19T13:34:56.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:34:56.272 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T13:34:56.347 INFO:teuthology.orchestra.run.smithi094.stdout:19.3.0-5012.g08af21e0.el9 2024-09-19T13:34:56.348 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012.g08af21e0.el9 2024-09-19T13:34:56.348 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012.g08af21e0 is installed. 2024-09-19T13:34:56.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:34:56.496 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T13:34:56.562 INFO:teuthology.orchestra.run.smithi149.stdout:19.3.0-5012.g08af21e0.el9 2024-09-19T13:34:56.563 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012.g08af21e0.el9 2024-09-19T13:34:56.563 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012.g08af21e0 is installed. 2024-09-19T13:34:56.565 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T13:34:56.565 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:34:56.565 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T13:34:56.611 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:34:56.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T13:34:56.654 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T13:34:56.655 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:34:56.655 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T13:34:56.697 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T13:34:56.778 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:34:56.778 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T13:34:56.817 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T13:34:56.895 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T13:34:56.895 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:34:56.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T13:34:56.936 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T13:34:57.014 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:34:57.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T13:34:57.054 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T13:34:57.132 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T13:34:57.133 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:34:57.133 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T13:34:57.171 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T13:34:57.251 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:34:57.251 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T13:34:57.289 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T13:34:57.367 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T13:34:57.452 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T13:34:57.453 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-09-19T13:34:57.455 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-09-19T13:34:57.494 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T13:34:57.494 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T13:34:57.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T13:34:57.573 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T13:34:57.573 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T13:34:57.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T13:34:57.661 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T13:34:57.661 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T13:34:57.661 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478', 'branch': 'wip-yuval-test', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7912478', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuval-test'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'rgw': {'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuval-test', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'owner': 'scheduled_yuvalif@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4251, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'sleep_before_teardown': 0, 'subset': '1/3', 'suite': 'rgw', 'suite_branch': 'wip-yuval-test', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'targets': {'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFf4C2A7mt0ArQ9ClcK4cffcTlaPzVzvOzZYfqliVkjbpGnxE0TpqWNpQe2vKNqa4pTyu7OsVIc9ckX0HMAFWzI=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKOt28hbj9297lfXWcM1RMO3nRi1HjEfiAUBCSIv9qSI3Gw7D0EeDzfXEFSUgV/miHJeMWwso6SaCg1Q7g8XWw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-19_13:09:30', 'tube': 'smithi', 'user': 'yuvalif', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T13:34:57.662 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T13:34:57.692 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T13:34:57.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T13:34:57.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T13:34:57.800 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:34:57.800 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T13:34:57.866 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T13:34:57.867 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-09-19T13:34:57.935 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T13:34:57.935 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-19 13:34:22.690000788 +0000 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-19 13:31:58.933227876 +0000 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-19 13:31:58.933227876 +0000 2024-09-19T13:34:57.936 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-19 13:31:58.933227876 +0000 2024-09-19T13:34:57.937 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T13:34:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-19T13:34:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-19T13:34:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000102047 s, 5.0 MB/s 2024-09-19T13:34:58.013 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T13:34:58.082 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-09-19T13:34:58.151 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T13:34:58.151 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:58.151 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T13:34:58.151 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:58.151 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:58.151 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-19 13:34:22.690000788 +0000 2024-09-19T13:34:58.152 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-19 13:31:59.271222444 +0000 2024-09-19T13:34:58.152 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-19 13:31:59.271222444 +0000 2024-09-19T13:34:58.152 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-19 13:31:59.271222444 +0000 2024-09-19T13:34:58.152 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T13:34:58.228 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-19T13:34:58.229 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-19T13:34:58.229 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000111622 s, 4.6 MB/s 2024-09-19T13:34:58.230 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T13:34:58.299 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-09-19T13:34:58.368 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T13:34:58.368 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:58.368 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T13:34:58.368 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:58.368 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:58.368 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-19 13:34:22.691000771 +0000 2024-09-19T13:34:58.369 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-19 13:31:59.593217270 +0000 2024-09-19T13:34:58.369 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-19 13:31:59.593217270 +0000 2024-09-19T13:34:58.369 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-19 13:31:59.593217270 +0000 2024-09-19T13:34:58.369 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T13:34:58.445 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-19T13:34:58.445 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-19T13:34:58.445 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 8.4578e-05 s, 6.1 MB/s 2024-09-19T13:34:58.446 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T13:34:58.515 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-19 13:34:22.691000771 +0000 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-19 13:31:59.933211806 +0000 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-19 13:31:59.933211806 +0000 2024-09-19T13:34:58.585 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-09-19 13:31:59.933211806 +0000 2024-09-19T13:34:58.586 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T13:34:58.661 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-19T13:34:58.661 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-19T13:34:58.661 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000106687 s, 4.8 MB/s 2024-09-19T13:34:58.662 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T13:34:58.731 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:34:58.731 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:34:58.731 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T13:34:58.767 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T13:34:58.767 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-19T13:34:58.841 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T13:34:58.841 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 800 Links: 1 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-19 13:34:43.451768878 +0000 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-19 13:32:07.265996749 +0000 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-19 13:32:07.265996749 +0000 2024-09-19T13:34:58.842 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-19 13:32:07.265996749 +0000 2024-09-19T13:34:58.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T13:34:58.921 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-19T13:34:58.921 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-19T13:34:58.921 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000203279 s, 2.5 MB/s 2024-09-19T13:34:58.923 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T13:34:58.995 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 819 Links: 1 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-19 13:34:43.452768857 +0000 2024-09-19T13:34:59.066 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-19 13:32:07.602989587 +0000 2024-09-19T13:34:59.067 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-19 13:32:07.602989587 +0000 2024-09-19T13:34:59.067 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-19 13:32:07.602989587 +0000 2024-09-19T13:34:59.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T13:34:59.144 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-19T13:34:59.145 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-19T13:34:59.145 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000218802 s, 2.3 MB/s 2024-09-19T13:34:59.146 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T13:34:59.216 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-19T13:34:59.285 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T13:34:59.285 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:59.285 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 838 Links: 1 2024-09-19T13:34:59.285 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:59.285 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:59.286 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-19 13:34:43.452768857 +0000 2024-09-19T13:34:59.286 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-19 13:32:07.956982063 +0000 2024-09-19T13:34:59.286 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-19 13:32:07.956982063 +0000 2024-09-19T13:34:59.286 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-19 13:32:07.956982063 +0000 2024-09-19T13:34:59.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T13:34:59.362 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-19T13:34:59.362 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-19T13:34:59.362 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000184624 s, 2.8 MB/s 2024-09-19T13:34:59.363 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T13:34:59.433 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 857 Links: 1 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-19 13:34:43.452768857 +0000 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-19 13:32:08.291974943 +0000 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-19 13:32:08.291974943 +0000 2024-09-19T13:34:59.501 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-19 13:32:08.291974943 +0000 2024-09-19T13:34:59.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T13:34:59.578 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-19T13:34:59.578 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-19T13:34:59.579 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000230863 s, 2.2 MB/s 2024-09-19T13:34:59.579 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T13:34:59.648 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:34:59.649 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T13:34:59.649 INFO:tasks.ceph:Generating config... 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-19T13:34:59.650 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-19T13:34:59.651 INFO:tasks.ceph:[client] setuser = ceph 2024-09-19T13:34:59.651 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-19T13:34:59.651 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-19T13:34:59.651 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-19T13:34:59.652 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-19T13:34:59.652 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T13:34:59.652 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T13:34:59.652 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T13:34:59.652 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T13:34:59.652 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T13:34:59.652 INFO:tasks.ceph:[mon] lockdep = True 2024-09-19T13:34:59.652 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-19T13:34:59.652 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-19T13:34:59.652 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] lockdep = True 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T13:34:59.653 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T13:34:59.654 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T13:34:59.654 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-19T13:34:59.654 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T13:34:59.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T13:34:59.722 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T13:34:59.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T13:34:59.783 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T13:34:59.822 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.94'), ('mon.c', '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]'), ('mon.b', '172.21.15.149')] 2024-09-19T13:34:59.823 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.149', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-19T13:34:59.824 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:34:59.824 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T13:34:59.894 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.94 --addv c '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]' --add b 172.21.15.149 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:34:59.994 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:34:59.994 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: generated fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:setting min_mon_release = quincy 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:epoch 0 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:34:59.995 INFO:teuthology.orchestra.run.smithi094.stdout:min_mon_release 17 (quincy) 2024-09-19T13:34:59.996 INFO:teuthology.orchestra.run.smithi094.stdout:election_strategy: 1 2024-09-19T13:34:59.996 INFO:teuthology.orchestra.run.smithi094.stdout:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:34:59.996 INFO:teuthology.orchestra.run.smithi094.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:34:59.996 INFO:teuthology.orchestra.run.smithi094.stdout:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:34:59.996 INFO:teuthology.orchestra.run.smithi094.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T13:34:59.997 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T13:35:00.025 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0f9e9aa8-63c5-4955-9c42-4c204ccced9a... 2024-09-19T13:35:00.026 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T13:35:00.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T13:35:00.122 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-19T13:35:00.122 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-19T13:35:00.123 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-19T13:35:00.124 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-19T13:35:00.125 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.149" 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: mon client directed command retry = 5 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: ms inject socket failures = 5000 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: osd_max_pg_log_entries = 10 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: osd_min_pg_log_entries = 10 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-19T13:35:00.126 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug trim objects = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.127 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-19T13:35:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: debug objclass = 20 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: lockdep = True 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: osd shutdown pgref assert = True 2024-09-19T13:35:00.129 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-19T13:35:00.130 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T13:35:00.131 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: lockdep = True 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-19T13:35:00.132 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = True 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: debug rgw = 20 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: debug rgw notification = 20 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw bucket counters cache = True 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt require ssl = False 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt s3 kms backend = testing 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw d3n l1 local datacache enabled = True 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw max chunk size = 4194304 2024-09-19T13:35:00.133 INFO:teuthology.orchestra.run.smithi094.stdout: rgw obj stripe size = 6291456 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: rgw reshard progress judge interval = 10 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: rgw s3 auth use sts = True 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: rgw sts key = abcdefghijklmnop 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: rgw torrent flag = True 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: rgw user counters cache = True 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: setgroup = ceph 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout: setuser = ceph 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-19T13:35:00.134 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-09-19T13:35:00.135 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-09-19T13:35:00.136 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.137 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790],172.21.15.149" 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: mon client directed command retry = 5 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: ms inject socket failures = 5000 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: osd_max_pg_log_entries = 10 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: osd_min_pg_log_entries = 10 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-09-19T13:35:00.138 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-09-19T13:35:00.139 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-09-19T13:35:00.140 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: debug objclass = 20 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: lockdep = True 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-09-19T13:35:00.141 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: osd shutdown pgref assert = True 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.142 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T13:35:00.143 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: lockdep = True 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = True 2024-09-19T13:35:00.144 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: debug rgw = 20 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: debug rgw notification = 20 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw bucket counters cache = True 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw crypt require ssl = False 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw crypt s3 kms backend = testing 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw d3n l1 local datacache enabled = True 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw max chunk size = 4194304 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw obj stripe size = 6291456 2024-09-19T13:35:00.145 INFO:teuthology.orchestra.run.smithi149.stdout: rgw reshard progress judge interval = 10 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout: rgw s3 auth use sts = True 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout: rgw sts key = abcdefghijklmnop 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout: rgw torrent flag = True 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout: rgw user counters cache = True 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout: setgroup = ceph 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout: setuser = ceph 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-09-19T13:35:00.146 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-09-19T13:35:00.148 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T13:35:00.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T13:35:00.217 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T13:35:00.217 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:00.217 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T13:35:00.247 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:00.247 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T13:35:00.317 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T13:35:00.317 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:00.317 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T13:35:00.317 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T13:35:00.405 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:00.405 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:00.474 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T13:35:00.474 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:00.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T13:35:00.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T13:35:00.525 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:00.525 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:00.594 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T13:35:00.594 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T13:35:00.594 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T13:35:00.659 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T13:35:00.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T13:35:00.758 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T13:35:00.761 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T13:35:00.761 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T13:35:00.761 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T13:35:00.816 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T13:35:00.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T13:35:00.883 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-19T13:35:00.896 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T13:35:00.896 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T13:35:00.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T13:35:00.935 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:00.935 INFO:tasks.ceph:role: osd.0 2024-09-19T13:35:00.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T13:35:00.935 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T13:35:01.013 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:01.013 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:01.014 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:01.045 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-19T13:35:01.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-19T13:35:01.047 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T13:35:01.129 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T13:35:01.213 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T13:35:01.293 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:01.293 INFO:tasks.ceph:role: osd.1 2024-09-19T13:35:01.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T13:35:01.293 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T13:35:01.370 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:01.370 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:01.370 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:01.371 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:01.402 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-19T13:35:01.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-19T13:35:01.405 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T13:35:01.488 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T13:35:01.571 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T13:35:01.649 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:01.649 INFO:tasks.ceph:role: osd.2 2024-09-19T13:35:01.650 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T13:35:01.650 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:01.728 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:01.729 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:01.729 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:01.760 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-19T13:35:01.762 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-19T13:35:01.762 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T13:35:01.845 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T13:35:01.928 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T13:35:02.006 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:02.007 INFO:tasks.ceph:role: osd.3 2024-09-19T13:35:02.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T13:35:02.007 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:02.086 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:02.119 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-09-19T13:35:02.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-19T13:35:02.122 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T13:35:02.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T13:35:02.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:02.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:02.397+0000 7f673480f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T13:35:02.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:02.397+0000 7f673480f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T13:35:02.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:02.397+0000 7f673480f640 -1 bdev(0x55ec1a177800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:02.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:02.397+0000 7f673480f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T13:35:05.305 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T13:35:05.350 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:05.411+0000 7f8a5b41e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T13:35:05.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:05.411+0000 7f8a5b41e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T13:35:05.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:05.411+0000 7f8a5b41e640 -1 bdev(0x55fe524e1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:05.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:05.411+0000 7f8a5b41e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T13:35:08.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T13:35:08.614 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:08.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:08.716+0000 7f2cb741a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T13:35:08.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:08.716+0000 7f2cb741a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T13:35:08.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:08.716+0000 7f2cb741a640 -1 bdev(0x5598e6f6b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:08.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:08.716+0000 7f2cb741a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T13:35:11.624 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T13:35:11.669 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:11.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:11.731+0000 7fad33354640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T13:35:11.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:11.731+0000 7fad33354640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T13:35:11.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:11.731+0000 7fad33354640 -1 bdev(0x555e4d423800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:11.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:35:11.731+0000 7fad33354640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T13:35:14.888 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T13:35:14.931 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T13:35:14.977 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:14.977 INFO:tasks.ceph:role: osd.4 2024-09-19T13:35:14.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T13:35:14.977 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:15.027 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:15.521 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-19T13:35:15.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-19T13:35:15.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T13:35:15.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T13:35:15.682 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T13:35:15.721 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:15.722 INFO:tasks.ceph:role: osd.5 2024-09-19T13:35:15.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T13:35:15.722 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:15.808 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:16.274 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-19T13:35:16.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-19T13:35:16.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T13:35:16.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T13:35:16.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T13:35:16.451 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:16.451 INFO:tasks.ceph:role: osd.6 2024-09-19T13:35:16.452 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T13:35:16.452 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T13:35:16.538 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:16.539 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:17.029 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-19T13:35:17.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-19T13:35:17.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T13:35:17.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T13:35:17.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T13:35:17.220 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:35:17.220 INFO:tasks.ceph:role: osd.7 2024-09-19T13:35:17.220 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T13:35:17.221 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:35:17.306 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:35:17.824 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-19T13:35:17.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-19T13:35:17.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T13:35:17.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T13:35:17.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:18.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:18.159+0000 7f97d4bd4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T13:35:18.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:18.159+0000 7f97d4bd4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T13:35:18.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:18.159+0000 7f97d4bd4640 -1 bdev(0x56086e439800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:18.161 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:18.159+0000 7f97d4bd4640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T13:35:21.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T13:35:21.113 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:21.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:21.211+0000 7fce62620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T13:35:21.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:21.211+0000 7fce62620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T13:35:21.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:21.211+0000 7fce62620640 -1 bdev(0x5555b2b01800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:21.214 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:21.211+0000 7fce62620640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T13:35:24.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T13:35:24.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:24.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:24.510+0000 7fd5813bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T13:35:24.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:24.511+0000 7fd5813bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T13:35:24.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:24.511+0000 7fd5813bf640 -1 bdev(0x55bc3e233800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:24.514 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:24.511+0000 7fd5813bf640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T13:35:27.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T13:35:27.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:27.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:27.588+0000 7f204442e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T13:35:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:27.588+0000 7f204442e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T13:35:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:27.588+0000 7f204442e640 -1 bdev(0x55896309d800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T13:35:27.591 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-19T13:35:27.588+0000 7f204442e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T13:35:30.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T13:35:30.806 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T13:35:30.806 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:30.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T13:35:30.852 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:30.852 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T13:35:30.935 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:30.935 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T13:35:31.017 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:31.017 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T13:35:31.098 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:31.098 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T13:35:31.177 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:31.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T13:35:31.223 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:31.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T13:35:31.305 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:31.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T13:35:31.385 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:31.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T13:35:31.465 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:31.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T13:35:31.543 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:31.543 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T13:35:31.573 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:31.574 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-19T13:35:31.612 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T13:35:31.612 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T13:35:31.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCEKOxmCx5HJxAA0xvUVfKVZeIGIa3GsVN7Sg== 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCGKOxm96HIFxAAhNpTTE+AK/Khx7r3LrKr3w== 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCJKOxmeAWMGBAAzrYg4ToKkC6CT6sQLR0bPA== 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-09-19T13:35:31.656 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCMKOxmOeS0KhAAPAYkEA3cBhzlZesjzdamWQ== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCPKOxmShyhKxAAdFrSAcuE03wDALrVpQR++g== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCEKOxmGC8sLRAAHO8423zrcrE1QOgsNVDBKQ== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCWKOxmBnOLCRAARP38NPFPtyt5FjGYdMtpPQ== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCZKOxmnemxDBAAeHrJHV0WOydrs2F+XZaPfQ== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCcKOxmr7yPHhAApQeoJT+qRlzfJujbw1DPew== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCfKOxmM1coIxAASjey+ITwQPuuL7WlnGRqpw== 2024-09-19T13:35:31.657 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-19T13:35:31.658 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCEKOxmyUubMBAAGYvB3NMxDkXbyxqTWKBciQ== 2024-09-19T13:35:31.658 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2024-09-19T13:35:31.658 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCEKOxmoAqgNBAAaDS1cU9Rxo+KisRJrtozSQ== 2024-09-19T13:35:31.689 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCEKOxmCx5HJxAA0xvUVfKVZeIGIa3GsVN7Sg== 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCGKOxm96HIFxAAhNpTTE+AK/Khx7r3LrKr3w== 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCJKOxmeAWMGBAAzrYg4ToKkC6CT6sQLR0bPA== 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCMKOxmOeS0KhAAPAYkEA3cBhzlZesjzdamWQ== 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCPKOxmShyhKxAAdFrSAcuE03wDALrVpQR++g== 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCEKOxmGC8sLRAAHO8423zrcrE1QOgsNVDBKQ== 2024-09-19T13:35:31.690 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCWKOxmBnOLCRAARP38NPFPtyt5FjGYdMtpPQ== 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCZKOxmnemxDBAAeHrJHV0WOydrs2F+XZaPfQ== 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCcKOxmr7yPHhAApQeoJT+qRlzfJujbw1DPew== 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCfKOxmM1coIxAASjey+ITwQPuuL7WlnGRqpw== 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCEKOxmyUubMBAAGYvB3NMxDkXbyxqTWKBciQ== 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-19T13:35:31.691 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQCEKOxmoAqgNBAAaDS1cU9Rxo+KisRJrtozSQ== 2024-09-19T13:35:31.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:35:31.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:35:31.797 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:31.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:31.864 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:31.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:31.931 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:31.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:31.997 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.065 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:35:32.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:35:32.131 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.200 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.264 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.333 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:35:32.400 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:35:32.403 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:35:32.472 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:35:32.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:35:32.542 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T13:35:32.542 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T13:35:32.580 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T13:35:32.689 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T13:35:32.727 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T13:35:32.806 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T13:35:32.914 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T13:35:32.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T13:35:32.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T13:35:33.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T13:35:33.145 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:33.147 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:35:33.213 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T13:35:33.214 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T13:35:33.214 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T13:35:33.217 INFO:tasks.ceph.mon.a:Started 2024-09-19T13:35:33.217 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T13:35:33.217 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T13:35:33.219 INFO:tasks.ceph.mon.c:Started 2024-09-19T13:35:33.219 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T13:35:33.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T13:35:33.256 INFO:tasks.ceph.mon.b:Started 2024-09-19T13:35:33.256 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T13:35:33.256 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T13:35:33.256 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T13:35:33.258 INFO:tasks.ceph.mgr.y:Started 2024-09-19T13:35:33.258 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T13:35:33.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T13:35:33.260 INFO:tasks.ceph.mgr.x:Started 2024-09-19T13:35:33.261 DEBUG:tasks.ceph:set 0 configs 2024-09-19T13:35:33.261 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T13:35:33.261 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T13:35:39.455 INFO:teuthology.orchestra.run.smithi094.stderr:adjusted tunables profile to default 2024-09-19T13:35:39.469 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T13:35:39.469 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T13:35:39.469 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:39.469 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T13:35:39.509 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:39.509 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T13:35:39.587 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:39.587 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T13:35:39.665 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:35:39.665 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T13:35:39.744 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:39.744 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T13:35:39.784 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:39.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T13:35:39.864 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:39.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T13:35:39.945 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-19T13:35:39.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T13:35:40.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 13ac99f9-0395-45d8-af2d-85fb6a74fd4b 0 2024-09-19T13:35:40.264 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-09-19T13:35:40.275 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 7a56daa1-457d-4a7f-a6ef-496cee83a5e7 1 2024-09-19T13:35:40.475 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-19T13:35:40.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 7db08beb-0782-4f83-bb02-70e08f6fdded 2 2024-09-19T13:35:40.688 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-09-19T13:35:40.699 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new ae120132-ec0d-4aa5-b573-42456b82b018 3 2024-09-19T13:35:40.912 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-09-19T13:35:40.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 82c729c9-4fb8-4e58-90ad-615aca660f2a 4 2024-09-19T13:35:41.120 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-09-19T13:35:41.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 9fdf6ffe-df56-4eb8-a879-cbb73618f54d 5 2024-09-19T13:35:41.324 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-09-19T13:35:41.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 450599d0-2e28-4886-8bdb-69dc45595893 6 2024-09-19T13:35:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-09-19T13:35:41.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 8487aebb-0dd5-489b-a14e-913f44484a60 7 2024-09-19T13:35:41.735 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-09-19T13:35:41.747 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T13:35:41.747 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T13:35:41.750 INFO:tasks.ceph.osd.0:Started 2024-09-19T13:35:41.750 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T13:35:41.750 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T13:35:41.752 INFO:tasks.ceph.osd.1:Started 2024-09-19T13:35:41.752 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T13:35:41.752 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T13:35:41.755 INFO:tasks.ceph.osd.2:Started 2024-09-19T13:35:41.755 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T13:35:41.755 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T13:35:41.757 INFO:tasks.ceph.osd.3:Started 2024-09-19T13:35:41.757 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T13:35:41.757 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T13:35:41.760 INFO:tasks.ceph.osd.4:Started 2024-09-19T13:35:41.760 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T13:35:41.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T13:35:41.762 INFO:tasks.ceph.osd.5:Started 2024-09-19T13:35:41.762 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T13:35:41.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T13:35:41.764 INFO:tasks.ceph.osd.6:Started 2024-09-19T13:35:41.764 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T13:35:41.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T13:35:41.767 INFO:tasks.ceph.osd.7:Started 2024-09-19T13:35:41.767 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T13:35:41.984 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:35:41.984 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":10,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T13:35:41.732911+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:35:41.995 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T13:35:41.995 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T13:35:42.802 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T13:35:42.982 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-19T13:35:42.982 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":10,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T13:35:41.732911+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:35:42.992 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T13:35:42.997 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-19T13:35:42.995+0000 7f79b3c0f640 -1 Falling back to public interface 2024-09-19T13:35:43.253 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-19T13:35:43.251+0000 7f55730fe640 -1 Falling back to public interface 2024-09-19T13:35:43.472 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-19T13:35:43.470+0000 7f6d19dd9640 -1 Falling back to public interface 2024-09-19T13:35:43.483 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-19T13:35:43.481+0000 7fec30413640 -1 Falling back to public interface 2024-09-19T13:35:43.492 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-19T13:35:43.490+0000 7f30e6c12640 -1 Falling back to public interface 2024-09-19T13:35:43.531 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-19T13:35:43.529+0000 7f67fbe16640 -1 Falling back to public interface 2024-09-19T13:35:43.533 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-19T13:35:43.531+0000 7f9e84812640 -1 Falling back to public interface 2024-09-19T13:35:43.714 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-19T13:35:43.712+0000 7ff2a9a9c640 -1 Falling back to public interface 2024-09-19T13:35:43.886 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-19T13:35:43.884+0000 7f210e678640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T13:35:43.886 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-19T13:35:43.884+0000 7f210e678640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T13:35:46.793 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-19T13:35:46.791+0000 7f55730fe640 -1 osd.6 0 log_to_monitors true 2024-09-19T13:35:46.803 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-19T13:35:46.801+0000 7f79b3c0f640 -1 osd.2 0 log_to_monitors true 2024-09-19T13:35:47.063 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-19T13:35:47.061+0000 7f67fbe16640 -1 osd.3 0 log_to_monitors true 2024-09-19T13:35:47.214 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-19T13:35:47.213+0000 7ff2a9a9c640 -1 osd.4 0 log_to_monitors true 2024-09-19T13:35:47.230 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-19T13:35:47.228+0000 7fec30413640 -1 osd.0 0 log_to_monitors true 2024-09-19T13:35:47.503 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-19T13:35:47.502+0000 7f6d19dd9640 -1 osd.5 0 log_to_monitors true 2024-09-19T13:35:47.591 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-19T13:35:47.589+0000 7f9e84812640 -1 osd.1 0 log_to_monitors true 2024-09-19T13:35:47.778 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-19T13:35:47.776+0000 7f30e6c12640 -1 osd.7 0 log_to_monitors true 2024-09-19T13:35:49.721 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-19T13:35:49.719+0000 7fec2bcf2640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T13:35:49.737 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-19T13:35:49.735+0000 7f79af5fe640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T13:35:49.738 INFO:tasks.ceph.osd.0.smithi094.stderr:2024-09-19T13:35:49.736+0000 7fec23b11640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:49.739 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-19T13:35:49.737+0000 7f67f7eba640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T13:35:49.751 INFO:tasks.ceph.osd.2.smithi094.stderr:2024-09-19T13:35:49.749+0000 7f79a741d640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:49.751 INFO:tasks.ceph.osd.3.smithi094.stderr:2024-09-19T13:35:49.749+0000 7f67ef4c5640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:49.800 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T13:35:50.146 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-19T13:35:50.146 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":13,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T13:35:49.557311+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:35:50.162 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T13:35:50.326 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-19T13:35:50.324+0000 7f556f8a6640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T13:35:50.342 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-19T13:35:50.340+0000 7f5566eb1640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:50.349 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-19T13:35:50.347+0000 7f9e80221640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T13:35:50.364 INFO:tasks.ceph.osd.1.smithi094.stderr:2024-09-19T13:35:50.362+0000 7f9e78040640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:50.397 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-19T13:35:50.396+0000 7f6d15d6d640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T13:35:50.407 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-19T13:35:50.406+0000 7f6d0db8c640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:50.423 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-19T13:35:50.422+0000 7ff2a6244640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T13:35:50.431 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-19T13:35:50.430+0000 7ff29d84f640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:50.668 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-19T13:35:50.666+0000 7f30e2cb0640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T13:35:50.681 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-19T13:35:50.680+0000 7f30da2bb640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:35:56.968 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T13:35:57.274 INFO:teuthology.misc.health.smithi094.stdout: 2024-09-19T13:35:57.274 INFO:teuthology.misc.health.smithi094.stdout:{"epoch":17,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T13:35:53.732567+0000","last_up_change":"2024-09-19T13:35:50.723767+0000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:35:50.893695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6809","nonce":2947892333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6811","nonce":2947892333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6815","nonce":2947892333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6813","nonce":2947892333}]},"public_addr":"172.21.15.94:6809/2947892333","cluster_addr":"172.21.15.94:6811/2947892333","heartbeat_back_addr":"172.21.15.94:6815/2947892333","heartbeat_front_addr":"172.21.15.94:6813/2947892333","state":["exists","up"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6825","nonce":4240401748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6827","nonce":4240401748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6831","nonce":4240401748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6829","nonce":4240401748}]},"public_addr":"172.21.15.94:6825/4240401748","cluster_addr":"172.21.15.94:6827/4240401748","heartbeat_back_addr":"172.21.15.94:6831/4240401748","heartbeat_front_addr":"172.21.15.94:6829/4240401748","state":["exists","up"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6801","nonce":943812970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6803","nonce":943812970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6807","nonce":943812970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6805","nonce":943812970}]},"public_addr":"172.21.15.94:6801/943812970","cluster_addr":"172.21.15.94:6803/943812970","heartbeat_back_addr":"172.21.15.94:6807/943812970","heartbeat_front_addr":"172.21.15.94:6805/943812970","state":["exists","up"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6817","nonce":2406227919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6819","nonce":2406227919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6824","nonce":2406227919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6821","nonce":2406227919}]},"public_addr":"172.21.15.94:6817/2406227919","cluster_addr":"172.21.15.94:6819/2406227919","heartbeat_back_addr":"172.21.15.94:6824/2406227919","heartbeat_front_addr":"172.21.15.94:6821/2406227919","state":["exists","up"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6827","nonce":1468975705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6829","nonce":1468975705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6833","nonce":1468975705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6831","nonce":1468975705}]},"public_addr":"172.21.15.149:6827/1468975705","cluster_addr":"172.21.15.149:6829/1468975705","heartbeat_back_addr":"172.21.15.149:6833/1468975705","heartbeat_front_addr":"172.21.15.149:6831/1468975705","state":["exists","up"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6811","nonce":155328186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6813","nonce":155328186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6817","nonce":155328186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6815","nonce":155328186}]},"public_addr":"172.21.15.149:6811/155328186","cluster_addr":"172.21.15.149:6813/155328186","heartbeat_back_addr":"172.21.15.149:6817/155328186","heartbeat_front_addr":"172.21.15.149:6815/155328186","state":["exists","up"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6803","nonce":2885675404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6805","nonce":2885675404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6809","nonce":2885675404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6807","nonce":2885675404}]},"public_addr":"172.21.15.149:6803/2885675404","cluster_addr":"172.21.15.149:6805/2885675404","heartbeat_back_addr":"172.21.15.149:6809/2885675404","heartbeat_front_addr":"172.21.15.149:6807/2885675404","state":["exists","up"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6819","nonce":2247801421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6821","nonce":2247801421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6825","nonce":2247801421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6823","nonce":2247801421}]},"public_addr":"172.21.15.149:6819/2247801421","cluster_addr":"172.21.15.149:6821/2247801421","heartbeat_back_addr":"172.21.15.149:6825/2247801421","heartbeat_front_addr":"172.21.15.149:6823/2247801421","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.202236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.608235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.805303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.059553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.176912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.527000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.797236+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.734976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:35:57.286 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T13:35:57.286 INFO:tasks.ceph:Creating RBD pool 2024-09-19T13:35:57.286 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-19T13:35:57.749 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'rbd' created 2024-09-19T13:35:57.764 DEBUG:teuthology.orchestra.run.smithi094:> rbd --cluster ceph pool init rbd 2024-09-19T13:35:57.894 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:35:57.895 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:00.775 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T13:36:00.775 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-19T13:36:00.776 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T13:36:01.093 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:01.106 INFO:teuthology.orchestra.run.smithi094.stdout:[{"version":9,"timestamp":"2024-09-19T13:35:50.668053+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"6515.410019"}]}] 2024-09-19T13:36:01.106 INFO:tasks.ceph_manager:config epoch is 9 2024-09-19T13:36:01.107 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T13:36:01.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T13:36:01.107 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T13:36:01.458 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:01.469 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3336356154},{"type":"v1","addr":"172.21.15.149:6801","nonce":3336356154}]},"active_addr":"172.21.15.149:6801/3336356154","active_change":"2024-09-19T13:35:42.871761+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":1667961631}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2946360124}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3701604309}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3984698070}]}]} 2024-09-19T13:36:01.473 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T13:36:01.473 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T13:36:01.474 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T13:36:01.777 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:01.777 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T13:36:00.759145+0000","last_up_change":"2024-09-19T13:35:50.723767+0000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:35:50.893695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T13:35:57.588696+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6809","nonce":2947892333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6811","nonce":2947892333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6815","nonce":2947892333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6813","nonce":2947892333}]},"public_addr":"172.21.15.94:6809/2947892333","cluster_addr":"172.21.15.94:6811/2947892333","heartbeat_back_addr":"172.21.15.94:6815/2947892333","heartbeat_front_addr":"172.21.15.94:6813/2947892333","state":["exists","up"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6825","nonce":4240401748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6827","nonce":4240401748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6831","nonce":4240401748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6829","nonce":4240401748}]},"public_addr":"172.21.15.94:6825/4240401748","cluster_addr":"172.21.15.94:6827/4240401748","heartbeat_back_addr":"172.21.15.94:6831/4240401748","heartbeat_front_addr":"172.21.15.94:6829/4240401748","state":["exists","up"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6801","nonce":943812970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6803","nonce":943812970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6807","nonce":943812970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6805","nonce":943812970}]},"public_addr":"172.21.15.94:6801/943812970","cluster_addr":"172.21.15.94:6803/943812970","heartbeat_back_addr":"172.21.15.94:6807/943812970","heartbeat_front_addr":"172.21.15.94:6805/943812970","state":["exists","up"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6817","nonce":2406227919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6819","nonce":2406227919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6824","nonce":2406227919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6821","nonce":2406227919}]},"public_addr":"172.21.15.94:6817/2406227919","cluster_addr":"172.21.15.94:6819/2406227919","heartbeat_back_addr":"172.21.15.94:6824/2406227919","heartbeat_front_addr":"172.21.15.94:6821/2406227919","state":["exists","up"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6827","nonce":1468975705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6829","nonce":1468975705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6833","nonce":1468975705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6831","nonce":1468975705}]},"public_addr":"172.21.15.149:6827/1468975705","cluster_addr":"172.21.15.149:6829/1468975705","heartbeat_back_addr":"172.21.15.149:6833/1468975705","heartbeat_front_addr":"172.21.15.149:6831/1468975705","state":["exists","up"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6811","nonce":155328186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6813","nonce":155328186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6817","nonce":155328186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6815","nonce":155328186}]},"public_addr":"172.21.15.149:6811/155328186","cluster_addr":"172.21.15.149:6813/155328186","heartbeat_back_addr":"172.21.15.149:6817/155328186","heartbeat_front_addr":"172.21.15.149:6815/155328186","state":["exists","up"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6803","nonce":2885675404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6805","nonce":2885675404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6809","nonce":2885675404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6807","nonce":2885675404}]},"public_addr":"172.21.15.149:6803/2885675404","cluster_addr":"172.21.15.149:6805/2885675404","heartbeat_back_addr":"172.21.15.149:6809/2885675404","heartbeat_front_addr":"172.21.15.149:6807/2885675404","state":["exists","up"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6819","nonce":2247801421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6821","nonce":2247801421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6825","nonce":2247801421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6823","nonce":2247801421}]},"public_addr":"172.21.15.149:6819/2247801421","cluster_addr":"172.21.15.149:6821/2247801421","heartbeat_back_addr":"172.21.15.149:6825/2247801421","heartbeat_front_addr":"172.21.15.149:6823/2247801421","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.202236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.608235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.805303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.059553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.176912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.527000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.797236+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.734976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:36:01.789 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T13:36:01.790 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T13:36:02.089 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:02.090 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":21,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T13:36:00.759145+0000","last_up_change":"2024-09-19T13:35:50.723767+0000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:35:50.893695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T13:35:57.588696+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6809","nonce":2947892333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6811","nonce":2947892333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6815","nonce":2947892333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6813","nonce":2947892333}]},"public_addr":"172.21.15.94:6809/2947892333","cluster_addr":"172.21.15.94:6811/2947892333","heartbeat_back_addr":"172.21.15.94:6815/2947892333","heartbeat_front_addr":"172.21.15.94:6813/2947892333","state":["exists","up"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6825","nonce":4240401748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6827","nonce":4240401748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6831","nonce":4240401748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6829","nonce":4240401748}]},"public_addr":"172.21.15.94:6825/4240401748","cluster_addr":"172.21.15.94:6827/4240401748","heartbeat_back_addr":"172.21.15.94:6831/4240401748","heartbeat_front_addr":"172.21.15.94:6829/4240401748","state":["exists","up"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6801","nonce":943812970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6803","nonce":943812970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6807","nonce":943812970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6805","nonce":943812970}]},"public_addr":"172.21.15.94:6801/943812970","cluster_addr":"172.21.15.94:6803/943812970","heartbeat_back_addr":"172.21.15.94:6807/943812970","heartbeat_front_addr":"172.21.15.94:6805/943812970","state":["exists","up"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6817","nonce":2406227919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6819","nonce":2406227919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6824","nonce":2406227919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6821","nonce":2406227919}]},"public_addr":"172.21.15.94:6817/2406227919","cluster_addr":"172.21.15.94:6819/2406227919","heartbeat_back_addr":"172.21.15.94:6824/2406227919","heartbeat_front_addr":"172.21.15.94:6821/2406227919","state":["exists","up"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6827","nonce":1468975705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6829","nonce":1468975705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6833","nonce":1468975705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6831","nonce":1468975705}]},"public_addr":"172.21.15.149:6827/1468975705","cluster_addr":"172.21.15.149:6829/1468975705","heartbeat_back_addr":"172.21.15.149:6833/1468975705","heartbeat_front_addr":"172.21.15.149:6831/1468975705","state":["exists","up"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6811","nonce":155328186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6813","nonce":155328186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6817","nonce":155328186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6815","nonce":155328186}]},"public_addr":"172.21.15.149:6811/155328186","cluster_addr":"172.21.15.149:6813/155328186","heartbeat_back_addr":"172.21.15.149:6817/155328186","heartbeat_front_addr":"172.21.15.149:6815/155328186","state":["exists","up"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6803","nonce":2885675404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6805","nonce":2885675404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6809","nonce":2885675404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6807","nonce":2885675404}]},"public_addr":"172.21.15.149:6803/2885675404","cluster_addr":"172.21.15.149:6805/2885675404","heartbeat_back_addr":"172.21.15.149:6809/2885675404","heartbeat_front_addr":"172.21.15.149:6807/2885675404","state":["exists","up"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6819","nonce":2247801421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6821","nonce":2247801421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6825","nonce":2247801421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6823","nonce":2247801421}]},"public_addr":"172.21.15.149:6819/2247801421","cluster_addr":"172.21.15.149:6821/2247801421","heartbeat_back_addr":"172.21.15.149:6825/2247801421","heartbeat_front_addr":"172.21.15.149:6823/2247801421","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.202236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.608235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.805303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.059553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.176912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.527000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.797236+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.734976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:36:02.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T13:36:02.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T13:36:02.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T13:36:02.104 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T13:36:02.104 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T13:36:02.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T13:36:02.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T13:36:02.105 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T13:36:02.353 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:02.353 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T13:36:02.360 INFO:teuthology.orchestra.run.smithi094.stdout:60129542151 2024-09-19T13:36:02.360 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T13:36:02.367 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:02.367 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T13:36:02.370 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:02.370 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T13:36:02.372 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-19T13:36:02.372 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T13:36:02.373 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:02.373 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T13:36:02.374 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-19T13:36:02.374 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T13:36:02.375 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:02.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T13:36:02.954 INFO:teuthology.orchestra.run.smithi094.stdout:60129542148 2024-09-19T13:36:02.967 INFO:teuthology.orchestra.run.smithi094.stdout:60129542148 2024-09-19T13:36:02.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.2 2024-09-19T13:36:02.975 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-19T13:36:02.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2024-09-19T13:36:02.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2024-09-19T13:36:03.005 INFO:teuthology.orchestra.run.smithi094.stdout:60129542148 2024-09-19T13:36:03.015 INFO:teuthology.orchestra.run.smithi094.stdout:60129542147 2024-09-19T13:36:03.018 INFO:teuthology.orchestra.run.smithi094.stdout:60129542148 2024-09-19T13:36:03.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2024-09-19T13:36:03.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.6 2024-09-19T13:36:03.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2024-09-19T13:36:03.052 INFO:teuthology.orchestra.run.smithi094.stdout:60129542148 2024-09-19T13:36:03.058 INFO:teuthology.orchestra.run.smithi094.stdout:60129542147 2024-09-19T13:36:03.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2024-09-19T13:36:03.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.7 2024-09-19T13:36:03.976 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T13:36:03.990 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T13:36:03.996 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T13:36:04.022 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T13:36:04.032 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T13:36:04.033 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T13:36:04.071 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T13:36:04.076 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T13:36:04.548 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:04.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-19T13:36:04.568 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.623 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-19T13:36:04.623 INFO:teuthology.orchestra.run.smithi094.stdout:60129542151 2024-09-19T13:36:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:04.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-19T13:36:04.640 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-09-19T13:36:04.645 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-19T13:36:04.650 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.660 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:04.668 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:04.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-19T13:36:04.674 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-19T13:36:04.681 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.724 INFO:teuthology.orchestra.run.smithi094.stdout:60129542149 2024-09-19T13:36:04.726 INFO:teuthology.orchestra.run.smithi094.stdout:60129542150 2024-09-19T13:36:04.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-19T13:36:04.738 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-19T13:36:04.740 DEBUG:teuthology.parallel:result is None 2024-09-19T13:36:04.740 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T13:36:04.740 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T13:36:05.079 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T13:36:05.091 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-19T13:36:04.880324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235744,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738976,"statfs":{"total":773094113280,"available":772852711424,"internally_reserved":0,"allocated":2899968,"data_stored":1757774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.128479"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.816633+0000","last_change":"2024-09-19T13:36:00.816633+0000","last_active":"2024-09-19T13:36:00.816633+0000","last_peered":"2024-09-19T13:36:00.816633+0000","last_clean":"2024-09-19T13:36:00.816633+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T13:36:00.816633+0000","last_undegraded":"2024-09-19T13:36:00.816633+0000","last_fullsized":"2024-09-19T13:36:00.816633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:57.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.763660+0000","last_change":"2024-09-19T13:36:00.763660+0000","last_active":"2024-09-19T13:36:00.763660+0000","last_peered":"2024-09-19T13:36:00.763660+0000","last_clean":"2024-09-19T13:36:00.763660+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T13:36:00.763660+0000","last_undegraded":"2024-09-19T13:36:00.763660+0000","last_fullsized":"2024-09-19T13:36:00.763660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:18.186285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.854514+0000","last_change":"2024-09-19T13:36:00.854514+0000","last_active":"2024-09-19T13:36:00.854514+0000","last_peered":"2024-09-19T13:36:00.854514+0000","last_clean":"2024-09-19T13:36:00.854514+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T13:36:00.854514+0000","last_undegraded":"2024-09-19T13:36:00.854514+0000","last_fullsized":"2024-09-19T13:36:00.854514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:14.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.763237+0000","last_change":"2024-09-19T13:36:00.763237+0000","last_active":"2024-09-19T13:36:00.763237+0000","last_peered":"2024-09-19T13:36:00.763237+0000","last_clean":"2024-09-19T13:36:00.763237+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T13:36:00.763237+0000","last_undegraded":"2024-09-19T13:36:00.763237+0000","last_fullsized":"2024-09-19T13:36:00.763237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:36.142012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.768910+0000","last_change":"2024-09-19T13:36:00.767107+0000","last_active":"2024-09-19T13:36:00.768910+0000","last_peered":"2024-09-19T13:36:00.768910+0000","last_clean":"2024-09-19T13:36:00.768910+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T13:36:00.768910+0000","last_undegraded":"2024-09-19T13:36:00.768910+0000","last_fullsized":"2024-09-19T13:36:00.768910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:58.438229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.763165+0000","last_change":"2024-09-19T13:36:00.763165+0000","last_active":"2024-09-19T13:36:00.763165+0000","last_peered":"2024-09-19T13:36:00.763165+0000","last_clean":"2024-09-19T13:36:00.763165+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T13:36:00.763165+0000","last_undegraded":"2024-09-19T13:36:00.763165+0000","last_fullsized":"2024-09-19T13:36:00.763165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:42.369963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.854468+0000","last_change":"2024-09-19T13:36:00.854468+0000","last_active":"2024-09-19T13:36:00.854468+0000","last_peered":"2024-09-19T13:36:00.854468+0000","last_clean":"2024-09-19T13:36:00.854468+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T13:36:00.854468+0000","last_undegraded":"2024-09-19T13:36:00.854468+0000","last_fullsized":"2024-09-19T13:36:00.854468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:35.110401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.766592+0000","last_change":"2024-09-19T13:36:00.766592+0000","last_active":"2024-09-19T13:36:00.766592+0000","last_peered":"2024-09-19T13:36:00.766592+0000","last_clean":"2024-09-19T13:36:00.766592+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T13:36:00.766592+0000","last_undegraded":"2024-09-19T13:36:00.766592+0000","last_fullsized":"2024-09-19T13:36:00.766592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:27.934615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.854048+0000","last_change":"2024-09-19T13:35:53.209257+0000","last_active":"2024-09-19T13:36:00.854048+0000","last_peered":"2024-09-19T13:36:00.854048+0000","last_clean":"2024-09-19T13:36:00.854048+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T13:36:00.854048+0000","last_undegraded":"2024-09-19T13:36:00.854048+0000","last_fullsized":"2024-09-19T13:36:00.854048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_clean_scrub_stamp":"2024-09-19T13:35:51.725320+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:26.239545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T13:36:05.092 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T13:36:05.387 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T13:36:05.399 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-19T13:36:04.880324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235744,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738976,"statfs":{"total":773094113280,"available":772852711424,"internally_reserved":0,"allocated":2899968,"data_stored":1757774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.128479"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.816633+0000","last_change":"2024-09-19T13:36:00.816633+0000","last_active":"2024-09-19T13:36:00.816633+0000","last_peered":"2024-09-19T13:36:00.816633+0000","last_clean":"2024-09-19T13:36:00.816633+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T13:36:00.816633+0000","last_undegraded":"2024-09-19T13:36:00.816633+0000","last_fullsized":"2024-09-19T13:36:00.816633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:57.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.763660+0000","last_change":"2024-09-19T13:36:00.763660+0000","last_active":"2024-09-19T13:36:00.763660+0000","last_peered":"2024-09-19T13:36:00.763660+0000","last_clean":"2024-09-19T13:36:00.763660+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T13:36:00.763660+0000","last_undegraded":"2024-09-19T13:36:00.763660+0000","last_fullsized":"2024-09-19T13:36:00.763660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:18.186285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.854514+0000","last_change":"2024-09-19T13:36:00.854514+0000","last_active":"2024-09-19T13:36:00.854514+0000","last_peered":"2024-09-19T13:36:00.854514+0000","last_clean":"2024-09-19T13:36:00.854514+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T13:36:00.854514+0000","last_undegraded":"2024-09-19T13:36:00.854514+0000","last_fullsized":"2024-09-19T13:36:00.854514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:14.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.763237+0000","last_change":"2024-09-19T13:36:00.763237+0000","last_active":"2024-09-19T13:36:00.763237+0000","last_peered":"2024-09-19T13:36:00.763237+0000","last_clean":"2024-09-19T13:36:00.763237+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T13:36:00.763237+0000","last_undegraded":"2024-09-19T13:36:00.763237+0000","last_fullsized":"2024-09-19T13:36:00.763237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:36.142012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.768910+0000","last_change":"2024-09-19T13:36:00.767107+0000","last_active":"2024-09-19T13:36:00.768910+0000","last_peered":"2024-09-19T13:36:00.768910+0000","last_clean":"2024-09-19T13:36:00.768910+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T13:36:00.768910+0000","last_undegraded":"2024-09-19T13:36:00.768910+0000","last_fullsized":"2024-09-19T13:36:00.768910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:58.438229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.763165+0000","last_change":"2024-09-19T13:36:00.763165+0000","last_active":"2024-09-19T13:36:00.763165+0000","last_peered":"2024-09-19T13:36:00.763165+0000","last_clean":"2024-09-19T13:36:00.763165+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T13:36:00.763165+0000","last_undegraded":"2024-09-19T13:36:00.763165+0000","last_fullsized":"2024-09-19T13:36:00.763165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:42.369963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.854468+0000","last_change":"2024-09-19T13:36:00.854468+0000","last_active":"2024-09-19T13:36:00.854468+0000","last_peered":"2024-09-19T13:36:00.854468+0000","last_clean":"2024-09-19T13:36:00.854468+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T13:36:00.854468+0000","last_undegraded":"2024-09-19T13:36:00.854468+0000","last_fullsized":"2024-09-19T13:36:00.854468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:35.110401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.766592+0000","last_change":"2024-09-19T13:36:00.766592+0000","last_active":"2024-09-19T13:36:00.766592+0000","last_peered":"2024-09-19T13:36:00.766592+0000","last_clean":"2024-09-19T13:36:00.766592+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T13:36:00.766592+0000","last_undegraded":"2024-09-19T13:36:00.766592+0000","last_fullsized":"2024-09-19T13:36:00.766592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:27.934615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:36:00.854048+0000","last_change":"2024-09-19T13:35:53.209257+0000","last_active":"2024-09-19T13:36:00.854048+0000","last_peered":"2024-09-19T13:36:00.854048+0000","last_clean":"2024-09-19T13:36:00.854048+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T13:36:00.854048+0000","last_undegraded":"2024-09-19T13:36:00.854048+0000","last_fullsized":"2024-09-19T13:36:00.854048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_clean_scrub_stamp":"2024-09-19T13:35:51.725320+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:26.239545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":212992,"data_stored":72125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":662493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T13:36:05.400 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T13:36:05.400 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T13:36:05.400 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T13:36:05.400 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T13:36:05.737 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:36:05.737 INFO:teuthology.orchestra.run.smithi094.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T13:36:05.750 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T13:36:05.750 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-19T13:36:05.763 INFO:teuthology.run_tasks:Running task rgw... 2024-09-19T13:36:05.776 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-19T13:36:05.776 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-19T13:36:05.776 INFO:tasks.rgw:Creating data pools 2024-09-19T13:36:05.776 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-19T13:36:05.776 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-19T13:36:06.789 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'default.rgw.buckets.data' created 2024-09-19T13:36:06.807 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-19T13:36:07.796 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-19T13:36:07.826 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-19T13:36:08.318 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'default.rgw.buckets.index' created 2024-09-19T13:36:08.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-19T13:36:09.319 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-19T13:36:09.356 DEBUG:tasks.rgw:Pools created 2024-09-19T13:36:09.356 INFO:tasks.rgw:Configuring compression type = random 2024-09-19T13:36:09.357 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T13:36:09.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T13:36:09.357 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T13:36:09.477 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:09.477 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:11.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.364+0000 7fc95df33640 0 -- 172.21.15.94:0/46719091 >> [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] conn(0x7fc834077480 msgr2=0x7fc834079940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:36:11.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.369+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.370+0000 7fc95e734640 0 -- 172.21.15.94:0/2340191628 >> [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] conn(0x7fc8240775a0 msgr2=0x7fc824079a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:36:11.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:11.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 realm 2024-09-19T13:36:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:36:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.371+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.372+0000 7fc962323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:36:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.372+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.372+0000 7fc962323800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T13:36:11.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.372+0000 7fc962323800 20 searching for the correct realm 2024-09-19T13:36:11.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:36:11.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:36:11.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:36:11.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:36:11.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:36:11.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:36:11.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.383+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:11.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 zone default found 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 4 Realm: () 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:36:11.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:36:11.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 zonegroup default 2024-09-19T13:36:11.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.384+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:11.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.385+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:11.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:11.385+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:13.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:13.345+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:13.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:13.346+0000 7fc962323800 20 rados->read ofs=0 len=0 2024-09-19T13:36:13.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:13.347+0000 7fc962323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:13.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:13.347+0000 7fc962323800 20 started sync module instance, tier type = 2024-09-19T13:36:13.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:13.347+0000 7fc962323800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=0 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=1 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=2 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=3 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=4 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=5 2024-09-19T13:36:15.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.363+0000 7fc962323800 20 add_watcher() i=6 2024-09-19T13:36:15.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 20 add_watcher() i=7 2024-09-19T13:36:15.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 2 all 8 watchers are set, enabling cache 2024-09-19T13:36:15.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.364+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-19T13:36:15.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-19T13:36:15.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.365+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-19T13:36:15.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.366+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-19T13:36:15.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-19T13:36:15.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.367+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-19T13:36:15.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.368+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-19T13:36:15.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.369+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-19T13:36:15.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.370+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-19T13:36:15.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.371+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.372+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.373+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.373+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.373+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.373+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.373+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.373+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-19T13:36:15.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.374+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-19T13:36:15.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.375+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-19T13:36:15.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.376+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-19T13:36:15.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.377+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.378+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-19T13:36:15.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.379+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-19T13:36:15.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.380+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.381+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.382+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-19T13:36:15.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.383+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-19T13:36:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.384+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-19T13:36:15.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-19T13:36:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-19T13:36:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.385+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-19T13:36:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-19T13:36:15.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.386+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-19T13:36:15.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.387+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-19T13:36:15.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.388+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-19T13:36:15.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.389+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-19T13:36:15.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.390+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.391+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.392+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-19T13:36:15.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-19T13:36:15.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.393+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.394+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-19T13:36:15.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.395+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.396+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.397+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-19T13:36:15.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.399+0000 7fc962323800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:36:15.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.402+0000 7fc80b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:36:15.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.402+0000 7fc962323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:15.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:15.402+0000 7fc962323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.352+0000 7fc962323800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-19T13:36:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.352+0000 7fc962323800 5 note: GC not initialized 2024-09-19T13:36:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.352+0000 7fc80a7fc640 20 reqs_thread_entry: start 2024-09-19T13:36:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.352+0000 7fc962323800 20 init_complete bucket index max shards: 11 2024-09-19T13:36:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.353+0000 7fc962323800 20 Filter name: none 2024-09-19T13:36:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.353+0000 7fc76bfff640 20 reqs_thread_entry: start 2024-09-19T13:36:18.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.383+0000 7fc80b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:36:18.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.386+0000 7fc962323800 20 remove_watcher() i=0 2024-09-19T13:36:18.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.386+0000 7fc962323800 2 removed watcher, disabling cache 2024-09-19T13:36:18.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.387+0000 7fc962323800 20 remove_watcher() i=1 2024-09-19T13:36:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.388+0000 7fc962323800 20 remove_watcher() i=2 2024-09-19T13:36:18.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.389+0000 7fc962323800 20 remove_watcher() i=3 2024-09-19T13:36:18.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.390+0000 7fc962323800 20 remove_watcher() i=4 2024-09-19T13:36:18.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.391+0000 7fc962323800 20 remove_watcher() i=5 2024-09-19T13:36:18.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.392+0000 7fc962323800 20 remove_watcher() i=6 2024-09-19T13:36:18.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.393+0000 7fc962323800 20 remove_watcher() i=7 2024-09-19T13:36:18.439 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-19T13:36:18.440 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T13:36:18.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-19T13:36:18.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-19T13:36:18.440 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-19T13:36:18.504 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:18.504 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:18.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.528+0000 7fe531737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:18.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.528+0000 7fe531737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:18.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.532+0000 7fe36b7fe640 20 reqs_thread_entry: start 2024-09-19T13:36:18.548 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"ebdf9632-5f0a-4135-af04-1b7f59e5ac82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T13:36:18.549 DEBUG:tasks.util.rgw: json result: {'id': 'ebdf9632-5f0a-4135-af04-1b7f59e5ac82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T13:36:18.549 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-19T13:36:18.549 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p /tmp/rgw_datacache 2024-09-19T13:36:18.578 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-19T13:36:18.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T13:36:18.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T13:36:18.656 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T13:36:18.755 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:18.755 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:18.788 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.787+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.788+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.788+0000 7fbc625ad800 20 realm 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.789+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.789+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.789+0000 7fbc625ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.789+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.789+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:18.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.789+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:18.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.790+0000 7fbc625ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:36:18.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.790+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:18.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.790+0000 7fbc625ad800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-19T13:36:18.791 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.790+0000 7fbc625ad800 20 searching for the correct realm 2024-09-19T13:36:18.794 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.793+0000 7fbc57fff640 0 -- 172.21.15.94:0/153949779 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fbc50041060 msgr2=0x7fbc50068ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:36:18.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:18.797+0000 7fbc60097640 0 -- 172.21.15.94:0/153949779 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fbc480a8450 msgr2=0x7fbc480a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:19.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:19.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.004+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 zone default found 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 4 Realm: () 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 zonegroup default 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:19.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.005+0000 7fbc625ad800 20 rados->read ofs=0 len=0 2024-09-19T13:36:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.006+0000 7fbc625ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:36:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.006+0000 7fbc625ad800 20 started sync module instance, tier type = 2024-09-19T13:36:19.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.006+0000 7fbc625ad800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:36:19.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=0 2024-09-19T13:36:19.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=1 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=2 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=3 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=4 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=5 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.018+0000 7fbc625ad800 20 add_watcher() i=6 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.019+0000 7fbc625ad800 20 add_watcher() i=7 2024-09-19T13:36:19.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.019+0000 7fbc625ad800 2 all 8 watchers are set, enabling cache 2024-09-19T13:36:19.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbb16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:36:19.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbc625ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:19.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbc625ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:19.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbc625ad800 5 note: GC not initialized 2024-09-19T13:36:19.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbb15fdb640 20 reqs_thread_entry: start 2024-09-19T13:36:19.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbc625ad800 20 init_complete bucket index max shards: 11 2024-09-19T13:36:19.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.021+0000 7fbc625ad800 20 Filter name: none 2024-09-19T13:36:19.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.022+0000 7fba877fe640 20 reqs_thread_entry: start 2024-09-19T13:36:19.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.030+0000 7fbb16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:36:19.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.033+0000 7fbc625ad800 20 remove_watcher() i=0 2024-09-19T13:36:19.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.033+0000 7fbc625ad800 2 removed watcher, disabling cache 2024-09-19T13:36:19.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.034+0000 7fbc625ad800 20 remove_watcher() i=1 2024-09-19T13:36:19.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.035+0000 7fbc625ad800 20 remove_watcher() i=2 2024-09-19T13:36:19.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.036+0000 7fbc625ad800 20 remove_watcher() i=3 2024-09-19T13:36:19.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.037+0000 7fbc625ad800 20 remove_watcher() i=4 2024-09-19T13:36:19.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.038+0000 7fbc625ad800 20 remove_watcher() i=5 2024-09-19T13:36:19.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.039+0000 7fbc625ad800 20 remove_watcher() i=6 2024-09-19T13:36:19.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.040+0000 7fbc625ad800 20 remove_watcher() i=7 2024-09-19T13:36:19.051 INFO:teuthology.orchestra.run.smithi094.stdout:[] 2024-09-19T13:36:19.052 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T13:36:19.052 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-19T13:36:19.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-19T13:36:19.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-19T13:36:19.052 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-19T13:36:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:19.114 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:19.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.137+0000 7f181e544800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:19.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.137+0000 7f181e544800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:19.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.141+0000 7f16dcfe1640 20 reqs_thread_entry: start 2024-09-19T13:36:19.156 INFO:teuthology.orchestra.run.smithi094.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-19T13:36:19.156 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-19T13:36:19.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-19T13:36:19.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-19T13:36:19.157 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-19T13:36:19.222 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:19.222 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:19.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.245+0000 7fa29ae96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:19.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.245+0000 7fa29ae96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:19.249 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.249+0000 7fa0eeffd640 20 reqs_thread_entry: start 2024-09-19T13:36:19.265 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"ebdf9632-5f0a-4135-af04-1b7f59e5ac82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T13:36:19.266 DEBUG:tasks.util.rgw: json result: {'id': 'ebdf9632-5f0a-4135-af04-1b7f59e5ac82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T13:36:19.266 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-19T13:36:19.266 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-19T13:36:19.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-19T13:36:19.266 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-19T13:36:19.328 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:19.328 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:19.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.352+0000 7f78b9812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:19.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.352+0000 7f78b9812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:19.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.357+0000 7f76faffd640 20 reqs_thread_entry: start 2024-09-19T13:36:19.373 INFO:teuthology.orchestra.run.smithi094.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-19T13:36:19.373 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-19T13:36:19.373 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-19T13:36:19.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-19T13:36:19.373 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-19T13:36:19.437 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:36:19.437 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:36:19.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.460+0000 7fdf5db25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:36:19.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.460+0000 7fdf5db25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:36:19.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:36:19.464+0000 7fdd977fe640 20 reqs_thread_entry: start 2024-09-19T13:36:19.481 INFO:teuthology.orchestra.run.smithi094.stdout:{"id":"ebdf9632-5f0a-4135-af04-1b7f59e5ac82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T13:36:19.482 DEBUG:tasks.util.rgw: json result: {'id': 'ebdf9632-5f0a-4135-af04-1b7f59e5ac82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T13:36:19.482 INFO:tasks.rgw:Starting rgw... 2024-09-19T13:36:19.482 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-19T13:36:19.482 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-19T13:36:19.482 DEBUG:teuthology.orchestra.run.smithi094:> sudo echo -n http://smithi094.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-19T13:36:19.521 INFO:teuthology.orchestra.run.smithi094.stdout:http://smithi094.front.sepia.ceph.com:80 2024-09-19T13:36:19.521 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-19T13:36:19.599 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-19T13:36:19.600 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-19T13:36:19.642 INFO:tasks.rgw.client.0:Started 2024-09-19T13:36:19.642 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi094.front.sepia.ceph.com:80/ 2024-09-19T13:36:19.642 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-19T13:36:19.684 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T13:36:19.685 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:36:19.685 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:36:19.685 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T13:36:19.685 INFO:teuthology.orchestra.run.smithi094.stderr:curl: (7) Failed to connect to smithi094.front.sepia.ceph.com port 80: Connection refused 2024-09-19T13:36:20.686 DEBUG:teuthology.orchestra.run.smithi094:> curl http://smithi094.front.sepia.ceph.com:80/ 2024-09-19T13:36:20.719 INFO:teuthology.orchestra.run.smithi094.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:36:20.719 INFO:teuthology.orchestra.run.smithi094.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:36:20.721 INFO:teuthology.orchestra.run.smithi094.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 182k 2024-09-19T13:36:20.721 INFO:teuthology.orchestra.run.smithi094.stdout:anonymous 2024-09-19T13:36:20.722 INFO:teuthology.run_tasks:Running task tox... 2024-09-19T13:36:20.732 INFO:tasks.tox:Deploying tox from pip... 2024-09-19T13:36:20.732 DEBUG:teuthology.orchestra.run.smithi094:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-19T13:36:23.100 DEBUG:teuthology.orchestra.run.smithi094:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-19T13:36:23.613 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting tox==3.15.0 2024-09-19T13:36:23.672 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-19T13:36:23.803 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting py<2,>=1.4.17 2024-09-19T13:36:23.817 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-19T13:36:23.952 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting filelock<4,>=3.0.0 2024-09-19T13:36:23.966 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-09-19T13:36:24.228 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-19T13:36:24.242 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading virtualenv-20.26.5-py3-none-any.whl (6.0 MB) 2024-09-19T13:36:24.462 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting toml>=0.9.4 2024-09-19T13:36:24.475 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-19T13:36:24.552 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting six<2,>=1.14.0 2024-09-19T13:36:24.566 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:36:24.656 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting packaging>=14 2024-09-19T13:36:24.669 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-19T13:36:24.741 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting pluggy<1,>=0.12.0 2024-09-19T13:36:24.755 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-19T13:36:24.876 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting distlib<1,>=0.3.7 2024-09-19T13:36:24.889 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-19T13:36:25.000 INFO:teuthology.orchestra.run.smithi094.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-19T13:36:25.014 INFO:teuthology.orchestra.run.smithi094.stdout: Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB) 2024-09-19T13:36:25.136 INFO:teuthology.orchestra.run.smithi094.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-19T13:36:25.949 INFO:teuthology.orchestra.run.smithi094.stdout:Successfully installed distlib-0.3.8 filelock-3.16.1 packaging-24.1 platformdirs-4.3.6 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.5 2024-09-19T13:36:26.147 INFO:teuthology.orchestra.run.smithi094.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-19T13:36:26.148 INFO:teuthology.orchestra.run.smithi094.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-19T13:36:26.207 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:36:26.255 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:36:26.255 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:36:26.256 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:36:26.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:36:26.285 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:36:26.286 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:36:26.364 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:36:26.365 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:36:26.439 INFO:tasks.workunit:timeout=3h 2024-09-19T13:36:26.439 INFO:tasks.workunit:cleanup=True 2024-09-19T13:36:26.440 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:36:26.510 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:37:27.285 INFO:tasks.workunit.client.0.smithi094.stderr:Updating files: 99% (12634/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-19T13:37:27.835 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.836 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-19T13:37:27.837 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.837 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:37:27.837 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:37:27.837 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:37:27.841 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:37:27.953 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:37:27.955 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:37:27.955 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:37:28.564 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:37:28.626 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:37:28.666 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:37:28.668 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:37:28.668 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:37:28.706 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:37:28.709 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:37:28.709 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:37:28.739 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-19T13:37:28.740 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-19T13:37:28.740 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-19T13:37:28.814 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-19T13:37:28.815 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:37:28.815 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:37:31.091 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T13:37:31.091 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-19T13:37:31.091 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:37:31.091 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:37:31.091 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:37:31.092 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T13:37:31.092 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:37:31.092 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-19T13:37:31.092 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T13:37:31.092 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:37:31.093 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-19T13:37:31.093 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:37:31.093 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:37:31.093 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-19T13:37:31.093 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:37:31.093 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-19T13:37:31.094 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T13:37:31.094 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-19T13:37:31.094 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-19T13:37:31.094 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:37:31.094 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T13:37:31.094 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-19T13:37:31.316 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-19T13:37:31.495 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-19T13:37:31.543 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T13:37:31.702 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-19T13:37:31.703 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-19T13:37:31.703 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-19T13:37:31.854 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-19T13:37:31.859 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-19T13:37:32.588 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-19T13:37:32.843 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install configobj 2024-09-19T13:37:33.212 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting configobj 2024-09-19T13:37:33.254 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-19T13:37:33.387 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six (from configobj) 2024-09-19T13:37:33.401 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T13:37:33.465 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-19T13:37:33.537 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:37:33.602 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: six, configobj 2024-09-19T13:37:33.728 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-19T13:37:33.772 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-19T13:37:33.804 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-19T13:37:33.804 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-19T13:37:33.806 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:33.806 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-19T13:37:33.806 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:37:33.806 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-19T13:37:33.851 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:33.851 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 43987/radosgw \ntcp6 0 0 :::80 :::* LISTEN 43987/radosgw \n' 2024-09-19T13:37:33.851 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:radosgw port: 80 2024-09-19T13:37:33.851 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-19T13:37:33.851 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-19T13:37:33.874 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:33.874 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'' 2024-09-19T13:37:33.874 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-19T13:37:34.206 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:34.207 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-19T13:37:34.180919Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-19T13:37:34.180907Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-19T13:37:34.207 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:Creating s3cmd config... 2024-09-19T13:37:34.207 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:proto for s3cmd config is http 2024-09-19T13:37:34.207 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:s3cmd config written 2024-09-19T13:37:34.207 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-19T13:37:34.344 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:34.345 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-19T13:37:34.345 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-19T13:37:34.570 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:34.570 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 75.77 MB/s) [1 of 1]\n" 2024-09-19T13:37:34.570 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-19T13:37:34.719 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:34.720 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 246.64 MB/s)\n" 2024-09-19T13:37:34.720 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-19T13:37:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340228,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zstd",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194414\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194414,\n "len": 3145814\n }\n ]\n },\n "etag": "3a1e37b85c99b466a54aefcdc2ecd54d",\n "tag": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14322857790272643227",\n "manifest": {\n "objs": [],\n "obj_size": 7340228,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".nyxgkJbTH_C9RtYN65mixD7fjH0SB8w_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1",\n "bucket_id": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1",\n "bucket_id": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7340228,\n "stripe_size": 3145924,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1",\n "bucket_id": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".nyxgkJbTH_C9RtYN65mixD7fjH0SB8w_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-19T13:37:34.539238Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14322857790272643227",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726753053/ctime:1726753053/gid:1333/gname:ubuntu/md5:3a1e37b85c99b466a54aefcdc2ecd54d/mode:33188/mtime:1726753053/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-19T13:37:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:Cached object name is: .nyxgkJbTH_C9RtYN65mixD7fjH0SB8w_ 2024-09-19T13:37:35.048 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-19T13:37:35.051 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:command succeeded 2024-09-19T13:37:35.051 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:b'0\n' 2024-09-19T13:37:35.051 INFO:tasks.workunit.client.0.smithi094.stderr:DEBUG:root:Check cache dir content: 0 2024-09-19T13:37:35.051 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-19T13:37:35.051 INFO:tasks.workunit.client.0.smithi094.stderr:INFO:root:Completed Datacache tests 2024-09-19T13:37:35.056 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-19T13:37:35.056 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-19T13:37:35.056 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:37:35.056 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-19T13:37:35.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-19T13:37:35.058 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-19T13:37:35.058 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:37:35.058 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:37:35.139 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-19T13:37:35.139 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T13:37:35.452 DEBUG:teuthology.parallel:result is None 2024-09-19T13:37:35.452 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:37:35.491 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:37:35.491 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:37:35.605 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:37:35.605 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:37:35.617 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:37:35.617 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:37:35.618 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:37:35.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:37:35.646 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:37:35.647 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:37:35.715 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:37:35.716 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:37:35.785 INFO:tasks.workunit:timeout=3h 2024-09-19T13:37:35.785 INFO:tasks.workunit:cleanup=True 2024-09-19T13:37:35.785 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:37:35.855 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:38:36.046 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:38:36.046 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.046 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:38:36.046 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:38:36.046 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:36.047 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:38:36.050 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:38:36.119 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:38:36.121 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:38:36.121 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:38:36.169 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:38:36.218 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:38:36.256 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:38:36.258 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:38:36.258 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:38:36.296 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:38:36.300 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:38:36.300 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:38:36.369 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-19T13:38:36.371 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-19T13:38:36.371 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-19T13:38:36.442 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-19T13:38:36.443 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:38:36.443 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:38:38.975 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T13:38:38.975 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-19T13:38:38.975 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:38:38.975 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:38:38.976 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:38:38.976 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T13:38:38.976 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:38:38.976 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-19T13:38:38.976 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T13:38:38.976 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-19T13:38:38.978 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T13:38:38.979 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-19T13:38:38.979 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-19T13:38:38.979 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:38:38.979 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T13:38:38.979 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-19T13:38:39.198 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-19T13:38:39.379 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-19T13:38:39.384 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T13:38:39.428 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-19T13:38:39.429 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-19T13:38:39.429 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-19T13:38:39.583 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-19T13:38:39.588 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-19T13:38:40.320 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-19T13:38:40.368 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-19T13:38:41.220 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-19T13:38:41.275 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T13:38:41.935 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T13:38:41.949 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T13:38:42.076 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T13:38:42.090 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T13:38:42.198 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T13:38:42.212 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T13:38:42.343 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:38:42.356 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T13:38:42.512 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:38:42.526 INFO:tasks.workunit.client.0.smithi094.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-19T13:38:42.783 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:38:42.784 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T13:38:42.802 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T13:38:42.884 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T13:38:43.106 INFO:tasks.workunit.client.0.smithi094.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.6/12.6 MB 59.2 MB/s eta 0:00:00 2024-09-19T13:38:43.120 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T13:38:43.184 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T13:38:43.252 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T13:38:43.319 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-19T13:38:43.404 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:38:43.479 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T13:38:44.515 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-19T13:38:44.636 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-19T13:38:44.775 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-19T13:38:44.809 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:44.809 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:44.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.844+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.845+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.845+0000 7f729472e800 20 realm 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.845+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.845+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.845+0000 7f729472e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.845+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:44.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.846+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:44.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.846+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:44.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.847+0000 7f729472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:44.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.847+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:44.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.847+0000 7f729472e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:44.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.847+0000 7f729472e800 20 searching for the correct realm 2024-09-19T13:38:44.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.850+0000 7f7287b63640 0 -- 172.21.15.94:0/2232579204 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5625e6d8b090 msgr2=0x5625e6d8d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:44.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:44.855+0000 7f7290364640 0 -- 172.21.15.94:0/2232579204 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f72780b5b00 msgr2=0x7f72780e2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:45.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:45.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:45.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:45.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:45.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:45.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:45.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.463+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:45.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:45.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 zone default found 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 4 Realm: () 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 zonegroup default 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.464+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.465+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.465+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.465+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.465+0000 7f729472e800 20 started sync module instance, tier type = 2024-09-19T13:38:45.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.465+0000 7f729472e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:45.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=0 2024-09-19T13:38:45.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=1 2024-09-19T13:38:45.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=2 2024-09-19T13:38:45.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=3 2024-09-19T13:38:45.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=4 2024-09-19T13:38:45.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=5 2024-09-19T13:38:45.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.478+0000 7f729472e800 20 add_watcher() i=6 2024-09-19T13:38:45.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.479+0000 7f729472e800 20 add_watcher() i=7 2024-09-19T13:38:45.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.479+0000 7f729472e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:45.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.480+0000 7f7146fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:45.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 5 note: GC not initialized 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f7145fe3640 20 reqs_thread_entry: start 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 20 Filter name: none 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f713f7fe640 20 reqs_thread_entry: start 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.481+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T13:38:45.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-19T13:38:45.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-19T13:38:45.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T13:38:45.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-19T13:38:45.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.482+0000 7f729472e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-19T13:38:45.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.484+0000 7f729472e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-19T13:38:45.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.484+0000 7f729472e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.484+0000 7f729472e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.484+0000 7f716f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822657 cookie 94720786752560 notifier 4662 bl.length()=593 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.484+0000 7f716f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.484+0000 7f716f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.486+0000 7f729472e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.486+0000 7f729472e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.486+0000 7f729472e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.486+0000 7f716f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822656 cookie 94720786745280 notifier 4662 bl.length()=186 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.486+0000 7f716f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-19T13:38:45.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.486+0000 7f716f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T13:38:45.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.487+0000 7f7146fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:45.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.490+0000 7f729472e800 20 remove_watcher() i=0 2024-09-19T13:38:45.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.490+0000 7f729472e800 2 removed watcher, disabling cache 2024-09-19T13:38:45.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.491+0000 7f729472e800 20 remove_watcher() i=1 2024-09-19T13:38:45.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.492+0000 7f729472e800 20 remove_watcher() i=2 2024-09-19T13:38:45.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.493+0000 7f729472e800 20 remove_watcher() i=3 2024-09-19T13:38:45.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.494+0000 7f729472e800 20 remove_watcher() i=4 2024-09-19T13:38:45.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.495+0000 7f729472e800 20 remove_watcher() i=5 2024-09-19T13:38:45.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.496+0000 7f729472e800 20 remove_watcher() i=6 2024-09-19T13:38:45.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.497+0000 7f729472e800 20 remove_watcher() i=7 2024-09-19T13:38:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: recalculated bucket check stats are correct 2024-09-19T13:38:45.795 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:45.796 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-19T13:38:45.827 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:45.827 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:45.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.861+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 20 realm 2024-09-19T13:38:45.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:45.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.862+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.863+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.863+0000 7f99ec32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:45.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.863+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.864+0000 7f99ec32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:45.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.864+0000 7f99ec32c800 20 searching for the correct realm 2024-09-19T13:38:45.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.867+0000 7f99e784e640 0 -- 172.21.15.94:0/2418262953 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x557f9198db00 msgr2=0x557f9198ff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:45.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.871+0000 7f99e784e640 0 -- 172.21.15.94:0/2418262953 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f99d8042c20 msgr2=0x7f99d803bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:45.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:45.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:45.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.874+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 zone default found 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 4 Realm: () 2024-09-19T13:38:45.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:45.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:45.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:45.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 zonegroup default 2024-09-19T13:38:45.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.875+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.876+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.876+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.876+0000 7f99ec32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.876+0000 7f99ec32c800 20 started sync module instance, tier type = 2024-09-19T13:38:45.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.876+0000 7f99ec32c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=0 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=1 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=2 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=3 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=4 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=5 2024-09-19T13:38:45.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.886+0000 7f99ec32c800 20 add_watcher() i=6 2024-09-19T13:38:45.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.887+0000 7f99ec32c800 20 add_watcher() i=7 2024-09-19T13:38:45.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.887+0000 7f99ec32c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:45.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.889+0000 7f989e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:45.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.889+0000 7f99ec32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.889+0000 7f99ec32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 5 note: GC not initialized 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f989d7e2640 20 reqs_thread_entry: start 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 20 Filter name: none 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f980effd640 20 reqs_thread_entry: start 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:45.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:45.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:45.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.890+0000 7f99ec32c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.891+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.892+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:45.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.893+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:45.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.893+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:45.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.894+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:45.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.894+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:45.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.895+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:45.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.895+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:45.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.896+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:45.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.896+0000 7f99ec32c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:45.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.903+0000 7f989e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:45.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.906+0000 7f99ec32c800 20 remove_watcher() i=0 2024-09-19T13:38:45.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.906+0000 7f99ec32c800 2 removed watcher, disabling cache 2024-09-19T13:38:45.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.908+0000 7f99ec32c800 20 remove_watcher() i=1 2024-09-19T13:38:45.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.909+0000 7f99ec32c800 20 remove_watcher() i=2 2024-09-19T13:38:45.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.911+0000 7f99ec32c800 20 remove_watcher() i=3 2024-09-19T13:38:45.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.912+0000 7f99ec32c800 20 remove_watcher() i=4 2024-09-19T13:38:45.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.913+0000 7f99ec32c800 20 remove_watcher() i=5 2024-09-19T13:38:45.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.914+0000 7f99ec32c800 20 remove_watcher() i=6 2024-09-19T13:38:45.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.914+0000 7f99ec32c800 20 remove_watcher() i=7 2024-09-19T13:38:45.928 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-19T13:38:45.957 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:45.957 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:45.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.991+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 realm 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:45.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.993+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.994+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:45.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.994+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:45.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.994+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:45.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.994+0000 7fd44db40800 20 searching for the correct realm 2024-09-19T13:38:45.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:45.997+0000 7fd4490bf640 0 -- 172.21.15.94:0/382576009 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x559a94522930 msgr2=0x559a94524d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:46.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.001+0000 7fd4498c0640 0 -- 172.21.15.94:0/382576009 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd44002f040 msgr2=0x7fd440049960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:46.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 zone default found 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 4 Realm: () 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 zonegroup default 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.005+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 started sync module instance, tier type = 2024-09-19T13:38:46.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.006+0000 7fd44db40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:46.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=0 2024-09-19T13:38:46.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=1 2024-09-19T13:38:46.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=2 2024-09-19T13:38:46.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=3 2024-09-19T13:38:46.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=4 2024-09-19T13:38:46.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=5 2024-09-19T13:38:46.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.015+0000 7fd44db40800 20 add_watcher() i=6 2024-09-19T13:38:46.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.016+0000 7fd44db40800 20 add_watcher() i=7 2024-09-19T13:38:46.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.016+0000 7fd44db40800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:46.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.017+0000 7fd2fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:46.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd44db40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:46.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd44db40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:46.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd44db40800 5 note: GC not initialized 2024-09-19T13:38:46.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd2fa7fc640 20 reqs_thread_entry: start 2024-09-19T13:38:46.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd44db40800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:46.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd44db40800 20 Filter name: none 2024-09-19T13:38:46.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd26bfff640 20 reqs_thread_entry: start 2024-09-19T13:38:46.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.018+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.019+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.019+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.019+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.019+0000 7fd44db40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.019+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.020+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:46.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.020+0000 7fd44db40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.020+0000 7fd44db40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:46.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.020+0000 7fd44db40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:46.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.022+0000 7fd2fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:46.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.024+0000 7fd44db40800 20 remove_watcher() i=0 2024-09-19T13:38:46.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.024+0000 7fd44db40800 2 removed watcher, disabling cache 2024-09-19T13:38:46.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.024+0000 7fd44db40800 20 remove_watcher() i=1 2024-09-19T13:38:46.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.026+0000 7fd44db40800 20 remove_watcher() i=2 2024-09-19T13:38:46.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.027+0000 7fd44db40800 20 remove_watcher() i=3 2024-09-19T13:38:46.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.027+0000 7fd44db40800 20 remove_watcher() i=4 2024-09-19T13:38:46.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.028+0000 7fd44db40800 20 remove_watcher() i=5 2024-09-19T13:38:46.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.029+0000 7fd44db40800 20 remove_watcher() i=6 2024-09-19T13:38:46.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.030+0000 7fd44db40800 20 remove_watcher() i=7 2024-09-19T13:38:46.043 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 75, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-19T13:38:46.043 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-19T13:38:46.043 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:46.044 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T13:38:46.077 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:46.077 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:46.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.111+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 realm 2024-09-19T13:38:46.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:46.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.113+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.114+0000 7f86bad2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:46.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.114+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.114+0000 7f86bad2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:46.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.114+0000 7f86bad2c800 20 searching for the correct realm 2024-09-19T13:38:46.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.119+0000 7f86b624e640 0 -- 172.21.15.94:0/254114999 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f86a8018070 msgr2=0x7f86a803c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:46.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.122+0000 7f86b7250640 0 -- 172.21.15.94:0/254114999 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7f86ac06d070 msgr2=0x7f86ac0bb570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.125+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:46.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 zone default found 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 4 Realm: () 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 zonegroup default 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.126+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.127+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.127+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.127+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.127+0000 7f86bad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:46.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.127+0000 7f86bad2c800 20 started sync module instance, tier type = 2024-09-19T13:38:46.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.127+0000 7f86bad2c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:46.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=0 2024-09-19T13:38:46.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=1 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=2 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=3 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=4 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=5 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.138+0000 7f86bad2c800 20 add_watcher() i=6 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.139+0000 7f86bad2c800 20 add_watcher() i=7 2024-09-19T13:38:46.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.139+0000 7f86bad2c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:46.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.141+0000 7f856d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.141+0000 7f86bad2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.141+0000 7f86bad2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 5 note: GC not initialized 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f84e7fff640 20 reqs_thread_entry: start 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 20 Filter name: none 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f84e5ffb640 20 reqs_thread_entry: start 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:46.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.142+0000 7f86bad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:46.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.143+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.144+0000 7f86bad2c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.144+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.144+0000 7f86bad2c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:38:46.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.144+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:46.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.145+0000 7f86bad2c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:38:46.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.145+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:46.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.145+0000 7f86bad2c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:38:46.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.145+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:46.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.146+0000 7f86bad2c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T13:38:46.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.146+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:46.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.146+0000 7f86bad2c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:38:46.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.146+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:46.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.147+0000 7f86bad2c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.147+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.147+0000 7f86bad2c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.147+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.148+0000 7f86bad2c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.148+0000 7f86bad2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.148+0000 7f86bad2c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:38:46.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.148+0000 7f86bad2c800 1 NOTICE: finished all shards (0 entries found) 2024-09-19T13:38:46.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.149+0000 7f856d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:46.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.151+0000 7f86bad2c800 20 remove_watcher() i=0 2024-09-19T13:38:46.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.151+0000 7f86bad2c800 2 removed watcher, disabling cache 2024-09-19T13:38:46.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.152+0000 7f86bad2c800 20 remove_watcher() i=1 2024-09-19T13:38:46.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.153+0000 7f86bad2c800 20 remove_watcher() i=2 2024-09-19T13:38:46.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.154+0000 7f86bad2c800 20 remove_watcher() i=3 2024-09-19T13:38:46.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.155+0000 7f86bad2c800 20 remove_watcher() i=4 2024-09-19T13:38:46.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.156+0000 7f86bad2c800 20 remove_watcher() i=5 2024-09-19T13:38:46.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.157+0000 7f86bad2c800 20 remove_watcher() i=6 2024-09-19T13:38:46.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:46.158+0000 7f86bad2c800 20 remove_watcher() i=7 2024-09-19T13:38:46.172 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T13:38:46.567 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T13:38:48.013 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:48.015 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:38:48.047 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:48.047 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:48.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.083+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 realm 2024-09-19T13:38:48.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.085+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.086+0000 7f6d9b937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.086+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.087+0000 7f6d9b937800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:48.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.087+0000 7f6d9b937800 20 searching for the correct realm 2024-09-19T13:38:48.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.090+0000 7f6d97e22640 0 -- 172.21.15.94:0/3433274868 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f6d80026b80 msgr2=0x7f6d80031900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:48.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.094+0000 7f6d97621640 0 -- 172.21.15.94:0/3433274868 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6d8003d900 msgr2=0x7f6d8000d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:48.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.301+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:48.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 zone default found 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 4 Realm: () 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 zonegroup default 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.302+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.303+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.303+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.303+0000 7f6d9b937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.303+0000 7f6d9b937800 20 started sync module instance, tier type = 2024-09-19T13:38:48.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.303+0000 7f6d9b937800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:48.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=0 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=1 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=2 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=3 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=4 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=5 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=6 2024-09-19T13:38:48.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 20 add_watcher() i=7 2024-09-19T13:38:48.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.316+0000 7f6d9b937800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:48.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.318+0000 7f6c4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6d9b937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6d9b937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6d9b937800 5 note: GC not initialized 2024-09-19T13:38:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6c4cfe1640 20 reqs_thread_entry: start 2024-09-19T13:38:48.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6d9b937800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6d9b937800 20 Filter name: none 2024-09-19T13:38:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6bc67fc640 20 reqs_thread_entry: start 2024-09-19T13:38:48.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.319+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 INFO: main: starting shard=0 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.320+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.321+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.321+0000 7f6d9b937800 20 INFO: main: starting shard=1 2024-09-19T13:38:48.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.321+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.321+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.321+0000 7f6d9b937800 20 INFO: main: starting shard=2 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.321+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.322+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.322+0000 7f6d9b937800 20 INFO: main: starting shard=3 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.322+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:48.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.322+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.322+0000 7f6d9b937800 20 INFO: main: starting shard=4 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.322+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.323+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.323+0000 7f6d9b937800 20 INFO: main: starting shard=5 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.323+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.323+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.323+0000 7f6d9b937800 20 INFO: main: starting shard=6 2024-09-19T13:38:48.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.323+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:48.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.324+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.324+0000 7f6d9b937800 20 INFO: main: starting shard=7 2024-09-19T13:38:48.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.324+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:48.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.324+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.324+0000 7f6d9b937800 20 INFO: main: starting shard=8 2024-09-19T13:38:48.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.324+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:48.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.325+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:38:48.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.326+0000 7f6d9b937800 20 INFO: main: starting shard=9 2024-09-19T13:38:48.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.326+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:48.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.326+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.326+0000 7f6d9b937800 20 INFO: main: starting shard=10 2024-09-19T13:38:48.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.326+0000 7f6d9b937800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:48.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.327+0000 7f6d9b937800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.327+0000 7f6d9b937800 20 INFO: main: done 2024-09-19T13:38:48.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.328+0000 7f6c4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:48.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.332+0000 7f6d9b937800 20 remove_watcher() i=0 2024-09-19T13:38:48.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.332+0000 7f6d9b937800 2 removed watcher, disabling cache 2024-09-19T13:38:48.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.333+0000 7f6d9b937800 20 remove_watcher() i=1 2024-09-19T13:38:48.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.334+0000 7f6d9b937800 20 remove_watcher() i=2 2024-09-19T13:38:48.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.339+0000 7f6d9b937800 20 remove_watcher() i=3 2024-09-19T13:38:48.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.339+0000 7f6d9b937800 20 remove_watcher() i=4 2024-09-19T13:38:48.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.340+0000 7f6d9b937800 20 remove_watcher() i=5 2024-09-19T13:38:48.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.341+0000 7f6d9b937800 20 remove_watcher() i=6 2024-09-19T13:38:48.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.342+0000 7f6d9b937800 20 remove_watcher() i=7 2024-09-19T13:38:48.410 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:48.412 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:38:48.442 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:48.442 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:48.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.476+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 realm 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.478+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.479+0000 7f5e73e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.479+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.479+0000 7f5e73e63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:48.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.479+0000 7f5e73e63800 20 searching for the correct realm 2024-09-19T13:38:48.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.483+0000 7f5e72155640 0 -- 172.21.15.94:0/2016909132 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55a34974c000 msgr2=0x55a34974e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:48.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.486+0000 7f5e71153640 0 -- 172.21.15.94:0/2016909132 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f5e64061400 msgr2=0x7f5e64061840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:48.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 zone default found 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 4 Realm: () 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:48.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.490+0000 7f5e73e63800 20 zonegroup default 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 started sync module instance, tier type = 2024-09-19T13:38:48.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.491+0000 7f5e73e63800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=0 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=1 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=2 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=3 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=4 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=5 2024-09-19T13:38:48.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.503+0000 7f5e73e63800 20 add_watcher() i=6 2024-09-19T13:38:48.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.504+0000 7f5e73e63800 20 add_watcher() i=7 2024-09-19T13:38:48.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.504+0000 7f5e73e63800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:48.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.505+0000 7f5d237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:48.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5e73e63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5e73e63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5e73e63800 5 note: GC not initialized 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5d227fc640 20 reqs_thread_entry: start 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5e73e63800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5e73e63800 20 Filter name: none 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5c93fff640 20 reqs_thread_entry: start 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.506+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:48.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 INFO: main: starting shard=0 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 INFO: main: starting shard=1 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.507+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.508+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.508+0000 7f5e73e63800 20 INFO: main: starting shard=2 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.508+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.509+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.509+0000 7f5e73e63800 20 INFO: main: starting shard=3 2024-09-19T13:38:48.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.509+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:48.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.509+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.509+0000 7f5e73e63800 20 INFO: main: starting shard=4 2024-09-19T13:38:48.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.509+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:48.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.510+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.510+0000 7f5e73e63800 20 INFO: main: starting shard=5 2024-09-19T13:38:48.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.510+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:48.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.510+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:38:48.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.511+0000 7f5e73e63800 20 INFO: main: starting shard=6 2024-09-19T13:38:48.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.511+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:48.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.511+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.511+0000 7f5e73e63800 20 INFO: main: starting shard=7 2024-09-19T13:38:48.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.511+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:48.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.512+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.512+0000 7f5e73e63800 20 INFO: main: starting shard=8 2024-09-19T13:38:48.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.512+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:48.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.512+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.512+0000 7f5e73e63800 20 INFO: main: starting shard=9 2024-09-19T13:38:48.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.512+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:48.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.513+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.513+0000 7f5e73e63800 20 INFO: main: starting shard=10 2024-09-19T13:38:48.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.513+0000 7f5e73e63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:48.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.513+0000 7f5e73e63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.513+0000 7f5e73e63800 20 INFO: main: done 2024-09-19T13:38:48.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.514+0000 7f5d237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:48.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.516+0000 7f5e73e63800 20 remove_watcher() i=0 2024-09-19T13:38:48.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.516+0000 7f5e73e63800 2 removed watcher, disabling cache 2024-09-19T13:38:48.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.518+0000 7f5e73e63800 20 remove_watcher() i=1 2024-09-19T13:38:48.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.519+0000 7f5e73e63800 20 remove_watcher() i=2 2024-09-19T13:38:48.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.520+0000 7f5e73e63800 20 remove_watcher() i=3 2024-09-19T13:38:48.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.520+0000 7f5e73e63800 20 remove_watcher() i=4 2024-09-19T13:38:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.521+0000 7f5e73e63800 20 remove_watcher() i=5 2024-09-19T13:38:48.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.522+0000 7f5e73e63800 20 remove_watcher() i=6 2024-09-19T13:38:48.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.523+0000 7f5e73e63800 20 remove_watcher() i=7 2024-09-19T13:38:48.592 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:48.593 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-19T13:38:48.623 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:48.623 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:48.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.657+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 realm 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.659+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.660+0000 7f3f00f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.660+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.660+0000 7f3f00f2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:48.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.660+0000 7f3f00f2f800 20 searching for the correct realm 2024-09-19T13:38:48.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.663+0000 7f3ef7fff640 0 -- 172.21.15.94:0/3720859902 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55966f3ffa70 msgr2=0x55966f401ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:48.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.667+0000 7f3efcc76640 0 -- 172.21.15.94:0/3720859902 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3ee8080b90 msgr2=0x7f3ee80d60b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:48.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:48.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:48.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:48.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:48.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:48.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:48.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.671+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:48.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 zone default found 2024-09-19T13:38:48.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 4 Realm: () 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 zonegroup default 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.672+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.673+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.673+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.673+0000 7f3f00f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.673+0000 7f3f00f2f800 20 started sync module instance, tier type = 2024-09-19T13:38:48.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.673+0000 7f3f00f2f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:48.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=0 2024-09-19T13:38:48.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=1 2024-09-19T13:38:48.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=2 2024-09-19T13:38:48.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=3 2024-09-19T13:38:48.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=4 2024-09-19T13:38:48.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=5 2024-09-19T13:38:48.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.682+0000 7f3f00f2f800 20 add_watcher() i=6 2024-09-19T13:38:48.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.683+0000 7f3f00f2f800 20 add_watcher() i=7 2024-09-19T13:38:48.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.683+0000 7f3f00f2f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:48.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.684+0000 7f3db2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:48.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3f00f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:48.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3f00f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:48.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3f00f2f800 5 note: GC not initialized 2024-09-19T13:38:48.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3db1fe3640 20 reqs_thread_entry: start 2024-09-19T13:38:48.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3f00f2f800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:48.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3f00f2f800 20 Filter name: none 2024-09-19T13:38:48.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3d237fe640 20 reqs_thread_entry: start 2024-09-19T13:38:48.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.685+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 INFO: main: starting shard=0 2024-09-19T13:38:48.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:48.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.686+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.687+0000 7f3f00f2f800 20 INFO: main: starting shard=1 2024-09-19T13:38:48.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.687+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:48.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.687+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:38:48.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.687+0000 7f3f00f2f800 20 INFO: main: starting shard=2 2024-09-19T13:38:48.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.687+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.688+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.688+0000 7f3f00f2f800 20 INFO: main: starting shard=3 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.688+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.688+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.688+0000 7f3f00f2f800 20 INFO: main: starting shard=4 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.688+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.689+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.689+0000 7f3f00f2f800 20 INFO: main: starting shard=5 2024-09-19T13:38:48.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.689+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:48.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.689+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.689+0000 7f3f00f2f800 20 INFO: main: starting shard=6 2024-09-19T13:38:48.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.689+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:48.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.690+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.690+0000 7f3f00f2f800 20 INFO: main: starting shard=7 2024-09-19T13:38:48.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.690+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:48.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.690+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.690+0000 7f3f00f2f800 20 INFO: main: starting shard=8 2024-09-19T13:38:48.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.690+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:48.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.691+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.691+0000 7f3f00f2f800 20 INFO: main: starting shard=9 2024-09-19T13:38:48.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.691+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:48.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.691+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.691+0000 7f3f00f2f800 20 INFO: main: starting shard=10 2024-09-19T13:38:48.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.691+0000 7f3f00f2f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:48.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.692+0000 7f3f00f2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:48.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.692+0000 7f3f00f2f800 20 INFO: main: done 2024-09-19T13:38:48.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.693+0000 7f3db2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:48.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.695+0000 7f3f00f2f800 20 remove_watcher() i=0 2024-09-19T13:38:48.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.695+0000 7f3f00f2f800 2 removed watcher, disabling cache 2024-09-19T13:38:48.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.696+0000 7f3f00f2f800 20 remove_watcher() i=1 2024-09-19T13:38:48.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.697+0000 7f3f00f2f800 20 remove_watcher() i=2 2024-09-19T13:38:48.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.698+0000 7f3f00f2f800 20 remove_watcher() i=3 2024-09-19T13:38:48.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.699+0000 7f3f00f2f800 20 remove_watcher() i=4 2024-09-19T13:38:48.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.700+0000 7f3f00f2f800 20 remove_watcher() i=5 2024-09-19T13:38:48.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.701+0000 7f3f00f2f800 20 remove_watcher() i=6 2024-09-19T13:38:48.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.702+0000 7f3f00f2f800 20 remove_watcher() i=7 2024-09-19T13:38:48.767 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:48.768 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-19T13:38:48.800 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:48.800 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:48.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.834+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.835+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.835+0000 7f23c6330800 20 realm 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.835+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.836+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.836+0000 7f23c6330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.836+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.836+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:48.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.836+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.836+0000 7f23c6330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:48.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.837+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:48.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.837+0000 7f23c6330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:48.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.837+0000 7f23c6330800 20 searching for the correct realm 2024-09-19T13:38:48.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.840+0000 7f23c28b1640 0 -- 172.21.15.94:0/2729889260 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f23ac022040 msgr2=0x7f23ac069b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:48.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:48.843+0000 7f23c20b0640 0 -- 172.21.15.94:0/2729889260 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f23ac0742d0 msgr2=0x7f23ac073ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:49.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.049+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:49.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:49.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 zone default found 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 4 Realm: () 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 zonegroup default 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.050+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.051+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.051+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.051+0000 7f23c6330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.051+0000 7f23c6330800 20 started sync module instance, tier type = 2024-09-19T13:38:49.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.051+0000 7f23c6330800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=0 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=1 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=2 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=3 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=4 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=5 2024-09-19T13:38:49.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.060+0000 7f23c6330800 20 add_watcher() i=6 2024-09-19T13:38:49.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.061+0000 7f23c6330800 20 add_watcher() i=7 2024-09-19T13:38:49.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.061+0000 7f23c6330800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:49.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.062+0000 7f2278fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:49.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f23c6330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:49.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f23c6330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f23c6330800 5 note: GC not initialized 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f21f37fe640 20 reqs_thread_entry: start 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f23c6330800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f23c6330800 20 Filter name: none 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f21f17fa640 20 reqs_thread_entry: start 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.063+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 INFO: main: starting shard=0 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 INFO: main: starting shard=1 2024-09-19T13:38:49.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.064+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.065+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.065+0000 7f23c6330800 20 INFO: main: starting shard=2 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.065+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.065+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.065+0000 7f23c6330800 20 INFO: main: starting shard=3 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.065+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.066+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.066+0000 7f23c6330800 20 INFO: main: starting shard=4 2024-09-19T13:38:49.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.066+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.066+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.066+0000 7f23c6330800 20 INFO: main: starting shard=5 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.066+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.067+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.067+0000 7f23c6330800 20 INFO: main: starting shard=6 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.067+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.067+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.067+0000 7f23c6330800 20 INFO: main: starting shard=7 2024-09-19T13:38:49.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.067+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.068+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.068+0000 7f23c6330800 20 INFO: main: starting shard=8 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.068+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.069+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.069+0000 7f23c6330800 20 INFO: main: starting shard=9 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.069+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.069+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:49.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.069+0000 7f23c6330800 20 INFO: main: starting shard=10 2024-09-19T13:38:49.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.069+0000 7f23c6330800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:49.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.070+0000 7f23c6330800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:38:49.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.070+0000 7f23c6330800 20 INFO: main: done 2024-09-19T13:38:49.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.070+0000 7f2278fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:49.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.073+0000 7f23c6330800 20 remove_watcher() i=0 2024-09-19T13:38:49.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.073+0000 7f23c6330800 2 removed watcher, disabling cache 2024-09-19T13:38:49.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.074+0000 7f23c6330800 20 remove_watcher() i=1 2024-09-19T13:38:49.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.074+0000 7f23c6330800 20 remove_watcher() i=2 2024-09-19T13:38:49.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.075+0000 7f23c6330800 20 remove_watcher() i=3 2024-09-19T13:38:49.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.077+0000 7f23c6330800 20 remove_watcher() i=4 2024-09-19T13:38:49.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.078+0000 7f23c6330800 20 remove_watcher() i=5 2024-09-19T13:38:49.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.079+0000 7f23c6330800 20 remove_watcher() i=6 2024-09-19T13:38:49.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.079+0000 7f23c6330800 20 remove_watcher() i=7 2024-09-19T13:38:49.098 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T13:38:49.490 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T13:38:49.880 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-19T13:38:49.880 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:49.881 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T13:38:49.913 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:49.914 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:49.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.947+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 realm 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.949+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.950+0000 7f888cc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:49.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.950+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.951+0000 7f888cc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:49.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.951+0000 7f888cc0f800 20 searching for the correct realm 2024-09-19T13:38:49.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.954+0000 7f888af01640 0 -- 172.21.15.94:0/3743075594 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x561e3d9399c0 msgr2=0x561e3d93be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:49.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.957+0000 7f888a700640 0 -- 172.21.15.94:0/3743075594 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f887401f460 msgr2=0x7f887401f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 zone default found 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 4 Realm: () 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.962+0000 7f888cc0f800 20 zonegroup default 2024-09-19T13:38:49.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 started sync module instance, tier type = 2024-09-19T13:38:49.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.963+0000 7f888cc0f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:49.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=0 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=1 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=2 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=3 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=4 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=5 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=6 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 20 add_watcher() i=7 2024-09-19T13:38:49.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.973+0000 7f888cc0f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:49.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f8740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:49.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:49.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 5 note: GC not initialized 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f86bb7fe640 20 reqs_thread_entry: start 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 20 Filter name: none 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f86b97fa640 20 reqs_thread_entry: start 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.976+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:49.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 20 rados->read ofs=0 len=0 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:49.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.977+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:49.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.978+0000 7f888cc0f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:38:49.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.978+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.978+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.979+0000 7f888cc0f800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.979+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.979+0000 7f888cc0f800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.979+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.980+0000 7f888cc0f800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.980+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:49.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.981+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:49.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.981+0000 7f888cc0f800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:38:49.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.981+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:49.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.982+0000 7f888cc0f800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:38:49.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.982+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:49.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.982+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:49.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.983+0000 7f888cc0f800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:38:49.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.983+0000 7f888cc0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:49.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.983+0000 7f888cc0f800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-19T13:38:49.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.983+0000 7f888cc0f800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-19T13:38:49.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.983+0000 7f888cc0f800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-19T13:38:49.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.984+0000 7f888cc0f800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-19T13:38:49.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.984+0000 7f888cc0f800 1 NOTICE: finished all shards (4 entries found) 2024-09-19T13:38:49.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.985+0000 7f8740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:49.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.987+0000 7f888cc0f800 20 remove_watcher() i=0 2024-09-19T13:38:49.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.987+0000 7f888cc0f800 2 removed watcher, disabling cache 2024-09-19T13:38:49.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.988+0000 7f888cc0f800 20 remove_watcher() i=1 2024-09-19T13:38:49.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.989+0000 7f888cc0f800 20 remove_watcher() i=2 2024-09-19T13:38:49.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.990+0000 7f888cc0f800 20 remove_watcher() i=3 2024-09-19T13:38:49.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.991+0000 7f888cc0f800 20 remove_watcher() i=4 2024-09-19T13:38:49.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.992+0000 7f888cc0f800 20 remove_watcher() i=5 2024-09-19T13:38:49.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.993+0000 7f888cc0f800 20 remove_watcher() i=6 2024-09-19T13:38:49.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:49.994+0000 7f888cc0f800 20 remove_watcher() i=7 2024-09-19T13:38:50.007 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: unlinked entries are not listable 2024-09-19T13:38:50.007 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:50.014 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-19T13:38:50.014 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:50.103 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-19T13:38:50.103 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:50.104 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T13:38:50.140 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:50.140 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:50.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.174+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 realm 2024-09-19T13:38:50.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:50.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.175+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.176+0000 7f8173925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:50.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.176+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.176+0000 7f8173925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:50.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.176+0000 7f8173925800 20 searching for the correct realm 2024-09-19T13:38:50.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.180+0000 7f816fd34640 0 -- 172.21.15.94:0/2766685282 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x560c4718cf40 msgr2=0x560c4718f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:50.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.183+0000 7f8167fff640 0 -- 172.21.15.94:0/2766685282 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f8160043650 msgr2=0x7f8160069210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:50.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 zone default found 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 4 Realm: () 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 zonegroup default 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.188+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.189+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.189+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.189+0000 7f8173925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.189+0000 7f8173925800 20 started sync module instance, tier type = 2024-09-19T13:38:50.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.189+0000 7f8173925800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=0 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=1 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=2 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=3 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=4 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=5 2024-09-19T13:38:50.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.203+0000 7f8173925800 20 add_watcher() i=6 2024-09-19T13:38:50.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.204+0000 7f8173925800 20 add_watcher() i=7 2024-09-19T13:38:50.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.204+0000 7f8173925800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:50.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.205+0000 7f8025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.205+0000 7f8173925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.205+0000 7f8173925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.205+0000 7f8173925800 5 note: GC not initialized 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8024fe1640 20 reqs_thread_entry: start 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 20 Filter name: none 2024-09-19T13:38:50.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f7f9e7fc640 20 reqs_thread_entry: start 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.206+0000 7f8173925800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:50.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:50.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:50.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T13:38:50.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.207+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.208+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.208+0000 7f8173925800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.208+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.209+0000 7f8173925800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.209+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.209+0000 7f8173925800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.209+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.210+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:50.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.210+0000 7f8173925800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T13:38:50.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.210+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:50.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.211+0000 7f8173925800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T13:38:50.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.211+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.211+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:50.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.212+0000 7f8173925800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-19T13:38:50.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.212+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.212+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.212+0000 7f8173925800 20 get_obj_state: octx=0x560c46f01f20 obj=check-bucket:e state=0x560c471ca128 s->prefetch_data=0 2024-09-19T13:38:50.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.212+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state: octx=0x560c46f2a4a0 obj=check-bucket:d state=0x560c471c5488 s->prefetch_data=0 2024-09-19T13:38:50.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state: octx=0x560c471cac60 obj=check-bucket:c state=0x560c471c7d08 s->prefetch_data=0 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state: octx=0x560c471c8a40 obj=check-bucket:f state=0x560c472637f8 s->prefetch_data=0 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to w1r2lrpnpquiku4txqqxse6ow6n6dz9q 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state_impl: setting s->olh_tag to fgwkxzufbazdhu0rp0iwyww7ifwaukod 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fgwkxzufbazdhu0rp0iwyww7ifwaukod 2024-09-19T13:38:50.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to vya89tcdf6ehbxfxy7py8hcrzlvcsphh 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 get_obj_state_impl: setting s->olh_tag to s5cmdb1q1ev4cqzp7tut8f2npp2ug4lt 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.213+0000 7f8173925800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s5cmdb1q1ev4cqzp7tut8f2npp2ug4lt 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.214+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to 1cayw29iq04k228t9qvx9682jigxxz1e 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.214+0000 7f8173925800 20 get_obj_state_impl: setting s->olh_tag to s4j58tokjrz4kh90ee93veyhl4819i9v 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.214+0000 7f8173925800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s4j58tokjrz4kh90ee93veyhl4819i9v 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.214+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to x7ypie6z2g4f2ymksu21gsq1ocuwfqjz 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.214+0000 7f8173925800 20 get_obj_state_impl: setting s->olh_tag to 15rdvc23irj3pkbjhsg86pda7fly969t 2024-09-19T13:38:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.214+0000 7f8173925800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=15rdvc23irj3pkbjhsg86pda7fly969t 2024-09-19T13:38:50.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.215+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.215+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.215+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.216+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.216+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.216+0000 7f8173925800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-19T13:38:50.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.216+0000 7f8173925800 20 olh_log_entry: epoch=2 op=3 key=e[F-YKP.4U6SF-JbadmjngXN7AaNFu6j3] 2024-09-19T13:38:50.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.216+0000 7f8173925800 20 get_obj_state: octx=0x560c46f01f20 obj=check-bucket:_:F-YKP.4U6SF-JbadmjngXN7AaNFu6j3_e state=0x560c4727eca8 s->prefetch_data=0 2024-09-19T13:38:50.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 10 manifest: total_size = 12 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7630910262281343590 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 get_obj_state: octx=0x560c46f01f20 obj=check-bucket:_:F-YKP.4U6SF-JbadmjngXN7AaNFu6j3_e state=0x560c4727eca8 s->prefetch_data=0 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 prepare_atomic_modification: state is not atomic. state=0x560c4727eca8 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 olh_log_entry: epoch=3 op=3 key=c[eHJ2ArCiwgV9giHBBs.C-92lQUVkDOI] 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 get_obj_state: octx=0x560c471cac60 obj=check-bucket:_:eHJ2ArCiwgV9giHBBs.C-92lQUVkDOI_c state=0x560c47273f48 s->prefetch_data=0 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 olh_log_entry: epoch=3 op=3 key=d[YXiVzBdjT7.eZmYykkTcJiay55Bm4n1] 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 get_obj_state: octx=0x560c46f2a4a0 obj=check-bucket:_:YXiVzBdjT7.eZmYykkTcJiay55Bm4n1_d state=0x560c4728a018 s->prefetch_data=0 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 olh_log_entry: epoch=2 op=3 key=f[2NXoYHrymSZncRjdW34bIxa2h5Y3m2d] 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.217+0000 7f8173925800 20 get_obj_state: octx=0x560c471c8a40 obj=check-bucket:_:2NXoYHrymSZncRjdW34bIxa2h5Y3m2d_f state=0x560c47291d98 s->prefetch_data=0 2024-09-19T13:38:50.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 10 manifest: total_size = 22 2024-09-19T13:38:50.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9367730790472722939 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 get_obj_state: octx=0x560c471cac60 obj=check-bucket:_:eHJ2ArCiwgV9giHBBs.C-92lQUVkDOI_c state=0x560c47273f48 s->prefetch_data=0 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 prepare_atomic_modification: state is not atomic. state=0x560c47273f48 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 10 manifest: total_size = 12 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4479567529909895883 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 get_obj_state: octx=0x560c46f2a4a0 obj=check-bucket:_:YXiVzBdjT7.eZmYykkTcJiay55Bm4n1_d state=0x560c4728a018 s->prefetch_data=0 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 prepare_atomic_modification: state is not atomic. state=0x560c4728a018 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 10 manifest: total_size = 22 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16309845602680348365 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 get_obj_state: octx=0x560c471c8a40 obj=check-bucket:_:2NXoYHrymSZncRjdW34bIxa2h5Y3m2d_f state=0x560c47291d98 s->prefetch_data=0 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 prepare_atomic_modification: state is not atomic. state=0x560c47291d98 2024-09-19T13:38:50.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.218+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.221+0000 7f8173925800 20 get_obj_state: octx=0x560c46f01f20 obj=check-bucket:e state=0x560c471ca128 s->prefetch_data=0 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.221+0000 7f8173925800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fgwkxzufbazdhu0rp0iwyww7ifwaukod 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.221+0000 7f8052ffd640 20 handle_completion(): completion ok for obj=e[F-YKP.4U6SF-JbadmjngXN7AaNFu6j3] 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.222+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.222+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.222+0000 7f80527fc640 20 handle_completion(): completion ok for obj=d[YXiVzBdjT7.eZmYykkTcJiay55Bm4n1] 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.223+0000 7f80527fc640 20 handle_completion(): completion ok for obj=c[eHJ2ArCiwgV9giHBBs.C-92lQUVkDOI] 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.223+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.223+0000 7f8173925800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-19T13:38:50.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.224+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f8173925800 20 get_obj_state: octx=0x560c471c8a40 obj=check-bucket:f state=0x560c472637f8 s->prefetch_data=0 2024-09-19T13:38:50.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f8173925800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=15rdvc23irj3pkbjhsg86pda7fly969t 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f80527fc640 20 handle_completion(): completion ok for obj=f[2NXoYHrymSZncRjdW34bIxa2h5Y3m2d] 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.225+0000 7f8173925800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.226+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.226+0000 7f8173925800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-19T13:38:50.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.227+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.228+0000 7f8173925800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.228+0000 7f8173925800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-19T13:38:50.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.228+0000 7f8173925800 1 NOTICE: finished all shards (4 entries removed) 2024-09-19T13:38:50.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.229+0000 7f8025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:50.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.231+0000 7f8173925800 20 remove_watcher() i=0 2024-09-19T13:38:50.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.231+0000 7f8173925800 2 removed watcher, disabling cache 2024-09-19T13:38:50.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.232+0000 7f8173925800 20 remove_watcher() i=1 2024-09-19T13:38:50.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.233+0000 7f8173925800 20 remove_watcher() i=2 2024-09-19T13:38:50.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.234+0000 7f8173925800 20 remove_watcher() i=3 2024-09-19T13:38:50.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.235+0000 7f8173925800 20 remove_watcher() i=4 2024-09-19T13:38:50.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.236+0000 7f8173925800 20 remove_watcher() i=5 2024-09-19T13:38:50.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.237+0000 7f8173925800 20 remove_watcher() i=6 2024-09-19T13:38:50.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.238+0000 7f8173925800 20 remove_watcher() i=7 2024-09-19T13:38:50.262 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-19T13:38:50.262 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:50.317 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-19T13:38:50.317 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T13:38:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:50.352 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:50.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.388+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.389+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.389+0000 7f26809ad800 20 realm 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.389+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.390+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.390+0000 7f26809ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.390+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.390+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.390+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.391+0000 7f26809ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:50.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.391+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.391+0000 7f26809ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:50.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.391+0000 7f26809ad800 20 searching for the correct realm 2024-09-19T13:38:50.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.391+0000 7f267dc96640 0 -- 172.21.15.94:0/679990729 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x560da0b50b60 msgr2=0x560da0b53020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:50.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.596+0000 7f267dc96640 0 -- 172.21.15.94:0/679990729 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x560da0b50b60 msgr2=0x560da0b53020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.604+0000 7f26809ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 zone default found 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 4 Realm: () 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 zonegroup default 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 started sync module instance, tier type = 2024-09-19T13:38:50.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.605+0000 7f26809ad800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:50.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.616+0000 7f26809ad800 20 add_watcher() i=0 2024-09-19T13:38:50.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.616+0000 7f26809ad800 20 add_watcher() i=1 2024-09-19T13:38:50.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.616+0000 7f26809ad800 20 add_watcher() i=2 2024-09-19T13:38:50.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.616+0000 7f26809ad800 20 add_watcher() i=3 2024-09-19T13:38:50.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.617+0000 7f26809ad800 20 add_watcher() i=4 2024-09-19T13:38:50.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.617+0000 7f26809ad800 20 add_watcher() i=5 2024-09-19T13:38:50.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.617+0000 7f26809ad800 20 add_watcher() i=6 2024-09-19T13:38:50.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.617+0000 7f26809ad800 20 add_watcher() i=7 2024-09-19T13:38:50.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.617+0000 7f26809ad800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:50.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.619+0000 7f2534fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:50.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.619+0000 7f26809ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:50.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.619+0000 7f26809ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:50.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.619+0000 7f26809ad800 5 note: GC not initialized 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f24af7fe640 20 reqs_thread_entry: start 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 20 Filter name: none 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f24ad7fa640 20 reqs_thread_entry: start 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:50.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.620+0000 7f26809ad800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:50.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:50.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:50.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:50.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:38:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.621+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.622+0000 7f26809ad800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.622+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.623+0000 7f26809ad800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.623+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.623+0000 7f26809ad800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.623+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.624+0000 7f26809ad800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.624+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.624+0000 7f26809ad800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T13:38:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.624+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.625+0000 7f26809ad800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:38:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.625+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.625+0000 7f26809ad800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:38:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.625+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.626+0000 7f26809ad800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T13:38:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.626+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:50.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.627+0000 7f26809ad800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:38:50.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.627+0000 7f26809ad800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.627+0000 7f26809ad800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:38:50.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.627+0000 7f26809ad800 1 NOTICE: finished all shards (0 entries found) 2024-09-19T13:38:50.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.628+0000 7f2534fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:50.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.630+0000 7f26809ad800 20 remove_watcher() i=0 2024-09-19T13:38:50.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.630+0000 7f26809ad800 2 removed watcher, disabling cache 2024-09-19T13:38:50.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.631+0000 7f26809ad800 20 remove_watcher() i=1 2024-09-19T13:38:50.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.632+0000 7f26809ad800 20 remove_watcher() i=2 2024-09-19T13:38:50.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.633+0000 7f26809ad800 20 remove_watcher() i=3 2024-09-19T13:38:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.634+0000 7f26809ad800 20 remove_watcher() i=4 2024-09-19T13:38:50.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.635+0000 7f26809ad800 20 remove_watcher() i=5 2024-09-19T13:38:50.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.636+0000 7f26809ad800 20 remove_watcher() i=6 2024-09-19T13:38:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.637+0000 7f26809ad800 20 remove_watcher() i=7 2024-09-19T13:38:50.681 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:38:50.710 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:50.711 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:50.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.744+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.746+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.746+0000 7ff8e813e800 20 realm 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.746+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.746+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.746+0000 7ff8e813e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.746+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.747+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.747+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.747+0000 7ff8e813e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:50.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.747+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.748+0000 7ff8e813e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:50.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.748+0000 7ff8e813e800 20 searching for the correct realm 2024-09-19T13:38:50.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.750+0000 7ff8db685640 0 -- 172.21.15.94:0/1170804556 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7ff8d4078040 msgr2=0x7ff8d406c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:50.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.754+0000 7ff8e3e86640 0 -- 172.21.15.94:0/1170804556 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff8cc039950 msgr2=0x7ff8cc04c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:50.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 zone default found 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 4 Realm: () 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 zonegroup default 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.960+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.961+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.961+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.961+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.961+0000 7ff8e813e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.961+0000 7ff8e813e800 20 started sync module instance, tier type = 2024-09-19T13:38:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.961+0000 7ff8e813e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=0 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=1 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=2 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=3 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=4 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=5 2024-09-19T13:38:50.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=6 2024-09-19T13:38:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 20 add_watcher() i=7 2024-09-19T13:38:50.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.972+0000 7ff8e813e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:50.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.974+0000 7ff799fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.974+0000 7ff8e813e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.974+0000 7ff8e813e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.974+0000 7ff8e813e800 5 note: GC not initialized 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff798fe1640 20 reqs_thread_entry: start 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff8e813e800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff8e813e800 20 Filter name: none 2024-09-19T13:38:50.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff7127fc640 20 reqs_thread_entry: start 2024-09-19T13:38:50.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff8e813e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:50.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.975+0000 7ff8e813e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 INFO: main: starting shard=0 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 INFO: main: starting shard=1 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.976+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.977+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.977+0000 7ff8e813e800 20 INFO: main: starting shard=2 2024-09-19T13:38:50.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.977+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:50.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.977+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.977+0000 7ff8e813e800 20 INFO: main: starting shard=3 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.977+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 INFO: main: starting shard=4 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 INFO: main: starting shard=5 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 INFO: main: starting shard=6 2024-09-19T13:38:50.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.978+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.979+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.979+0000 7ff8e813e800 20 INFO: main: starting shard=7 2024-09-19T13:38:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.979+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.980+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.980+0000 7ff8e813e800 20 INFO: main: starting shard=8 2024-09-19T13:38:50.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.980+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.980+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.980+0000 7ff8e813e800 20 INFO: main: starting shard=9 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.980+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.981+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.981+0000 7ff8e813e800 20 INFO: main: starting shard=10 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.981+0000 7ff8e813e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.981+0000 7ff8e813e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.981+0000 7ff8e813e800 20 INFO: main: done 2024-09-19T13:38:50.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.982+0000 7ff799fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.987+0000 7ff8e813e800 20 remove_watcher() i=0 2024-09-19T13:38:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.987+0000 7ff8e813e800 2 removed watcher, disabling cache 2024-09-19T13:38:50.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.988+0000 7ff8e813e800 20 remove_watcher() i=1 2024-09-19T13:38:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.989+0000 7ff8e813e800 20 remove_watcher() i=2 2024-09-19T13:38:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.990+0000 7ff8e813e800 20 remove_watcher() i=3 2024-09-19T13:38:50.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.991+0000 7ff8e813e800 20 remove_watcher() i=4 2024-09-19T13:38:50.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.992+0000 7ff8e813e800 20 remove_watcher() i=5 2024-09-19T13:38:50.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.993+0000 7ff8e813e800 20 remove_watcher() i=6 2024-09-19T13:38:50.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:50.994+0000 7ff8e813e800 20 remove_watcher() i=7 2024-09-19T13:38:51.008 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:38:51.038 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:51.039 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:51.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.073+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 realm 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.075+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.076+0000 7fbe9492e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.076+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.076+0000 7fbe9492e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:51.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.076+0000 7fbe9492e800 20 searching for the correct realm 2024-09-19T13:38:51.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.079+0000 7fbe8fedc640 0 -- 172.21.15.94:0/1820572037 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55d185a06d20 msgr2=0x55d185a09110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.082+0000 7fbe906dd640 0 -- 172.21.15.94:0/1820572037 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fbe78088300 msgr2=0x7fbe78098320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:51.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:51.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:51.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:51.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.086+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 zone default found 2024-09-19T13:38:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 4 Realm: () 2024-09-19T13:38:51.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 zonegroup default 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 started sync module instance, tier type = 2024-09-19T13:38:51.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.087+0000 7fbe9492e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=0 2024-09-19T13:38:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=1 2024-09-19T13:38:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=2 2024-09-19T13:38:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=3 2024-09-19T13:38:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=4 2024-09-19T13:38:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=5 2024-09-19T13:38:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.098+0000 7fbe9492e800 20 add_watcher() i=6 2024-09-19T13:38:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.099+0000 7fbe9492e800 20 add_watcher() i=7 2024-09-19T13:38:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.099+0000 7fbe9492e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.100+0000 7fbd46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.100+0000 7fbe9492e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.100+0000 7fbe9492e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbe9492e800 5 note: GC not initialized 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbd45fdb640 20 reqs_thread_entry: start 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbe9492e800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbe9492e800 20 Filter name: none 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbcb77fe640 20 reqs_thread_entry: start 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbe9492e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.101+0000 7fbe9492e800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 INFO: main: starting shard=0 2024-09-19T13:38:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 INFO: main: starting shard=1 2024-09-19T13:38:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.102+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.103+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.103+0000 7fbe9492e800 20 INFO: main: starting shard=2 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.103+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.103+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.103+0000 7fbe9492e800 20 INFO: main: starting shard=3 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.103+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.104+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.104+0000 7fbe9492e800 20 INFO: main: starting shard=4 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.104+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.104+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.104+0000 7fbe9492e800 20 INFO: main: starting shard=5 2024-09-19T13:38:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.104+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.105+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.105+0000 7fbe9492e800 20 INFO: main: starting shard=6 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.105+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.106+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.106+0000 7fbe9492e800 20 INFO: main: starting shard=7 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.106+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.106+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.106+0000 7fbe9492e800 20 INFO: main: starting shard=8 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.106+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 INFO: main: starting shard=9 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 INFO: main: starting shard=10 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.107+0000 7fbe9492e800 20 INFO: main: done 2024-09-19T13:38:51.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.108+0000 7fbd46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.110+0000 7fbe9492e800 20 remove_watcher() i=0 2024-09-19T13:38:51.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.110+0000 7fbe9492e800 2 removed watcher, disabling cache 2024-09-19T13:38:51.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.111+0000 7fbe9492e800 20 remove_watcher() i=1 2024-09-19T13:38:51.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.112+0000 7fbe9492e800 20 remove_watcher() i=2 2024-09-19T13:38:51.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.113+0000 7fbe9492e800 20 remove_watcher() i=3 2024-09-19T13:38:51.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.114+0000 7fbe9492e800 20 remove_watcher() i=4 2024-09-19T13:38:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.115+0000 7fbe9492e800 20 remove_watcher() i=5 2024-09-19T13:38:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.116+0000 7fbe9492e800 20 remove_watcher() i=6 2024-09-19T13:38:51.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.117+0000 7fbe9492e800 20 remove_watcher() i=7 2024-09-19T13:38:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-19T13:38:51.130 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-19T13:38:51.162 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:51.162 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:51.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.196+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 realm 2024-09-19T13:38:51.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:51.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.197+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.198+0000 7fdba9b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.198+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.198+0000 7fdba9b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:51.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.198+0000 7fdba9b22800 20 searching for the correct realm 2024-09-19T13:38:51.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.201+0000 7fdb9cf01640 0 -- 172.21.15.94:0/2179515994 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5556e224e540 msgr2=0x5556e2250a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:51.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.205+0000 7fdba5702640 0 -- 172.21.15.94:0/2179515994 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fdb900988e0 msgr2=0x7fdb9006c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:51.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.209+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 zone default found 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 4 Realm: () 2024-09-19T13:38:51.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 zonegroup default 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 started sync module instance, tier type = 2024-09-19T13:38:51.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.210+0000 7fdba9b22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=0 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=1 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=2 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=3 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=4 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=5 2024-09-19T13:38:51.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.219+0000 7fdba9b22800 20 add_watcher() i=6 2024-09-19T13:38:51.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.220+0000 7fdba9b22800 20 add_watcher() i=7 2024-09-19T13:38:51.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.220+0000 7fdba9b22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:51.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.221+0000 7fda5bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 5 note: GC not initialized 2024-09-19T13:38:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fda5afe5640 20 reqs_thread_entry: start 2024-09-19T13:38:51.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 20 Filter name: none 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fda58fe1640 20 reqs_thread_entry: start 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.222+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:51.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:51.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.223+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.224+0000 7fdba9b22800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.224+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.224+0000 7fdba9b22800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.224+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.225+0000 7fdba9b22800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.225+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.225+0000 7fdba9b22800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.225+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.225+0000 7fdba9b22800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.225+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.226+0000 7fdba9b22800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-19T13:38:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.226+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.227+0000 7fdba9b22800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:38:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.227+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:51.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.227+0000 7fdba9b22800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.227+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.228+0000 7fdba9b22800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.228+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.228+0000 7fdba9b22800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.228+0000 7fdba9b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.229+0000 7fdba9b22800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:38:51.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.229+0000 7fdba9b22800 1 NOTICE: finished all shards (2 entries found) 2024-09-19T13:38:51.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.230+0000 7fda5bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.232+0000 7fdba9b22800 20 remove_watcher() i=0 2024-09-19T13:38:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.232+0000 7fdba9b22800 2 removed watcher, disabling cache 2024-09-19T13:38:51.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.233+0000 7fdba9b22800 20 remove_watcher() i=1 2024-09-19T13:38:51.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.233+0000 7fdba9b22800 20 remove_watcher() i=2 2024-09-19T13:38:51.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.234+0000 7fdba9b22800 20 remove_watcher() i=3 2024-09-19T13:38:51.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.235+0000 7fdba9b22800 20 remove_watcher() i=4 2024-09-19T13:38:51.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.236+0000 7fdba9b22800 20 remove_watcher() i=5 2024-09-19T13:38:51.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.237+0000 7fdba9b22800 20 remove_watcher() i=6 2024-09-19T13:38:51.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.238+0000 7fdba9b22800 20 remove_watcher() i=7 2024-09-19T13:38:51.251 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-19T13:38:51.251 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:51.252 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T13:38:51.285 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:51.285 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:51.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.319+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 realm 2024-09-19T13:38:51.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:51.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.321+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.322+0000 7f3dbb346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.322+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.322+0000 7f3dbb346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.322+0000 7f3dbb346800 20 searching for the correct realm 2024-09-19T13:38:51.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.325+0000 7f3db862f640 0 -- 172.21.15.94:0/1327269995 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55825134e0e0 msgr2=0x5582513504d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.329+0000 7f3db8e30640 0 -- 172.21.15.94:0/1327269995 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3dac0d12e0 msgr2=0x7f3dac0d19c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 zone default found 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 4 Realm: () 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 zonegroup default 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.333+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 started sync module instance, tier type = 2024-09-19T13:38:51.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.334+0000 7f3dbb346800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=0 2024-09-19T13:38:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=1 2024-09-19T13:38:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=2 2024-09-19T13:38:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=3 2024-09-19T13:38:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=4 2024-09-19T13:38:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=5 2024-09-19T13:38:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.343+0000 7f3dbb346800 20 add_watcher() i=6 2024-09-19T13:38:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.344+0000 7f3dbb346800 20 add_watcher() i=7 2024-09-19T13:38:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.344+0000 7f3dbb346800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:51.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.346+0000 7f3c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.346+0000 7f3dbb346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.346+0000 7f3dbb346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.346+0000 7f3dbb346800 5 note: GC not initialized 2024-09-19T13:38:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.346+0000 7f3c6e7e4640 20 reqs_thread_entry: start 2024-09-19T13:38:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 20 Filter name: none 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3c67fff640 20 reqs_thread_entry: start 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:51.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:51.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.347+0000 7f3dbb346800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T13:38:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.348+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.349+0000 7f3dbb346800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.349+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.349+0000 7f3dbb346800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.349+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.349+0000 7f3dbb346800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.349+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.350+0000 7f3dbb346800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T13:38:51.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.350+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.350+0000 7f3dbb346800 20 get_obj_state: octx=0x5582510b7f30 obj=check-bucket:d state=0x55825137ffb8 s->prefetch_data=0 2024-09-19T13:38:51.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.350+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:51.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.351+0000 7f3dbb346800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T13:38:51.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.351+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:51.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.352+0000 7f3dbb346800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T13:38:51.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.352+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.352+0000 7f3dbb346800 20 get_obj_state: octx=0x5582510e0490 obj=check-bucket:c state=0x558251381028 s->prefetch_data=0 2024-09-19T13:38:51.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.352+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:51.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-19T13:38:51.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:51.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-19T13:38:51.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 get_obj_state: setting s->obj_tag to vya89tcdf6ehbxfxy7py8hcrzlvcsphh 2024-09-19T13:38:51.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 get_obj_state_impl: setting s->olh_tag to s5cmdb1q1ev4cqzp7tut8f2npp2ug4lt 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 get_obj_state: setting s->obj_tag to 1cayw29iq04k228t9qvx9682jigxxz1e 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 get_obj_state_impl: setting s->olh_tag to s4j58tokjrz4kh90ee93veyhl4819i9v 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 olh_log_entry: epoch=4 op=3 key=d[-tOucGeR7.3g6rQP5iCOG5z1j9GEv9.] 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.353+0000 7f3dbb346800 20 get_obj_state: octx=0x5582513b9ab0 obj=check-bucket:_:-tOucGeR7.3g6rQP5iCOG5z1j9GEv9._d state=0x5582513e05c8 s->prefetch_data=0 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.354+0000 7f3dbb346800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.354+0000 7f3dbb346800 20 olh_log_entry: epoch=4 op=3 key=c[MWGGePJ9eSyBc.yRp.qIaDffF7ywkgS] 2024-09-19T13:38:51.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.354+0000 7f3dbb346800 20 get_obj_state: octx=0x5582513d9ab0 obj=check-bucket:_:MWGGePJ9eSyBc.yRp.qIaDffF7ywkgS_c state=0x5582513e78c8 s->prefetch_data=0 2024-09-19T13:38:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 get_obj_state: octx=0x5582513b9ab0 obj=check-bucket:d state=0x5582513e7898 s->prefetch_data=0 2024-09-19T13:38:51.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 get_obj_state: octx=0x5582513d9ab0 obj=check-bucket:c state=0x55825137dec8 s->prefetch_data=0 2024-09-19T13:38:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 get_obj_state: setting s->obj_tag to vya89tcdf6ehbxfxy7py8hcrzlvcsphh 2024-09-19T13:38:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 get_obj_state_impl: setting s->olh_tag to s5cmdb1q1ev4cqzp7tut8f2npp2ug4lt 2024-09-19T13:38:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s5cmdb1q1ev4cqzp7tut8f2npp2ug4lt 2024-09-19T13:38:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 get_obj_state: setting s->obj_tag to 1cayw29iq04k228t9qvx9682jigxxz1e 2024-09-19T13:38:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 get_obj_state_impl: setting s->olh_tag to s4j58tokjrz4kh90ee93veyhl4819i9v 2024-09-19T13:38:51.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.355+0000 7f3dbb346800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=s4j58tokjrz4kh90ee93veyhl4819i9v 2024-09-19T13:38:51.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.358+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.358+0000 7f3dbb346800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.359+0000 7f3dbb346800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-19T13:38:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.359+0000 7f3dbb346800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-19T13:38:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.359+0000 7f3dbb346800 1 NOTICE: finished all shards (2 entries removed) 2024-09-19T13:38:51.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.360+0000 7f3c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.362+0000 7f3dbb346800 20 remove_watcher() i=0 2024-09-19T13:38:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.362+0000 7f3dbb346800 2 removed watcher, disabling cache 2024-09-19T13:38:51.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.363+0000 7f3dbb346800 20 remove_watcher() i=1 2024-09-19T13:38:51.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.364+0000 7f3dbb346800 20 remove_watcher() i=2 2024-09-19T13:38:51.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.365+0000 7f3dbb346800 20 remove_watcher() i=3 2024-09-19T13:38:51.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.366+0000 7f3dbb346800 20 remove_watcher() i=4 2024-09-19T13:38:51.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.366+0000 7f3dbb346800 20 remove_watcher() i=5 2024-09-19T13:38:51.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.367+0000 7f3dbb346800 20 remove_watcher() i=6 2024-09-19T13:38:51.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.368+0000 7f3dbb346800 20 remove_watcher() i=7 2024-09-19T13:38:51.382 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:38:51.413 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:51.413 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.447+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.449+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.449+0000 7f7d96d22800 20 realm 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.449+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.449+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.449+0000 7f7d96d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.449+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.450+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.450+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.450+0000 7f7d96d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.450+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.451+0000 7f7d96d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.451+0000 7f7d96d22800 20 searching for the correct realm 2024-09-19T13:38:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.454+0000 7f7d931af640 0 -- 172.21.15.94:0/2307127767 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f7d7c09e040 msgr2=0x7f7d7c062380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.457+0000 7f7d929ae640 0 -- 172.21.15.94:0/2307127767 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f7d7c07a970 msgr2=0x7f7d7c0649e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.461+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 zone default found 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 4 Realm: () 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 zonegroup default 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 started sync module instance, tier type = 2024-09-19T13:38:51.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.462+0000 7f7d96d22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=0 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=1 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=2 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=3 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=4 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=5 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.471+0000 7f7d96d22800 20 add_watcher() i=6 2024-09-19T13:38:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.472+0000 7f7d96d22800 20 add_watcher() i=7 2024-09-19T13:38:51.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.472+0000 7f7d96d22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:51.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7d96d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:51.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7d96d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:51.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7d96d22800 5 note: GC not initialized 2024-09-19T13:38:51.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7bc3fff640 20 reqs_thread_entry: start 2024-09-19T13:38:51.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7d96d22800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.474+0000 7f7d96d22800 20 Filter name: none 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7bc1ffb640 20 reqs_thread_entry: start 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 INFO: main: starting shard=0 2024-09-19T13:38:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.475+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.476+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.476+0000 7f7d96d22800 20 INFO: main: starting shard=1 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.476+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.476+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.476+0000 7f7d96d22800 20 INFO: main: starting shard=2 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.476+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.477+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.477+0000 7f7d96d22800 20 INFO: main: starting shard=3 2024-09-19T13:38:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.477+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.477+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.477+0000 7f7d96d22800 20 INFO: main: starting shard=4 2024-09-19T13:38:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.477+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.478+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.478+0000 7f7d96d22800 20 INFO: main: starting shard=5 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.478+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.478+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.478+0000 7f7d96d22800 20 INFO: main: starting shard=6 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.478+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.479+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.479+0000 7f7d96d22800 20 INFO: main: starting shard=7 2024-09-19T13:38:51.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.479+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:51.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.479+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.479+0000 7f7d96d22800 20 INFO: main: starting shard=8 2024-09-19T13:38:51.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.479+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.480+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.480+0000 7f7d96d22800 20 INFO: main: starting shard=9 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.480+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.480+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.481+0000 7f7d96d22800 20 INFO: main: starting shard=10 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.481+0000 7f7d96d22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.481+0000 7f7d96d22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.481+0000 7f7d96d22800 20 INFO: main: done 2024-09-19T13:38:51.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.482+0000 7f7c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.484+0000 7f7d96d22800 20 remove_watcher() i=0 2024-09-19T13:38:51.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.484+0000 7f7d96d22800 2 removed watcher, disabling cache 2024-09-19T13:38:51.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.485+0000 7f7d96d22800 20 remove_watcher() i=1 2024-09-19T13:38:51.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.486+0000 7f7d96d22800 20 remove_watcher() i=2 2024-09-19T13:38:51.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.487+0000 7f7d96d22800 20 remove_watcher() i=3 2024-09-19T13:38:51.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.488+0000 7f7d96d22800 20 remove_watcher() i=4 2024-09-19T13:38:51.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.489+0000 7f7d96d22800 20 remove_watcher() i=5 2024-09-19T13:38:51.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.490+0000 7f7d96d22800 20 remove_watcher() i=6 2024-09-19T13:38:51.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.491+0000 7f7d96d22800 20 remove_watcher() i=7 2024-09-19T13:38:51.504 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:38:51.535 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:51.535 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:51.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.569+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 realm 2024-09-19T13:38:51.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:51.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.571+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.572+0000 7fc0a8b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.572+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.572+0000 7fc0a8b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:51.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.572+0000 7fc0a8b22800 20 searching for the correct realm 2024-09-19T13:38:51.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.576+0000 7fc0a3f01640 0 -- 172.21.15.94:0/774060477 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5581e40a5450 msgr2=0x5581e40a7840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.579+0000 7fc0a4702640 0 -- 172.21.15.94:0/774060477 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc098041430 msgr2=0x7fc098041890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:51.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.583+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 zone default found 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 4 Realm: () 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 zonegroup default 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.584+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.585+0000 7fc0a8b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.585+0000 7fc0a8b22800 20 started sync module instance, tier type = 2024-09-19T13:38:51.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.585+0000 7fc0a8b22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:51.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=0 2024-09-19T13:38:51.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=1 2024-09-19T13:38:51.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=2 2024-09-19T13:38:51.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=3 2024-09-19T13:38:51.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=4 2024-09-19T13:38:51.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=5 2024-09-19T13:38:51.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.594+0000 7fc0a8b22800 20 add_watcher() i=6 2024-09-19T13:38:51.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.595+0000 7fc0a8b22800 20 add_watcher() i=7 2024-09-19T13:38:51.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.595+0000 7fc0a8b22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:51.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.597+0000 7fbf5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.597+0000 7fc0a8b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.597+0000 7fc0a8b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.597+0000 7fc0a8b22800 5 note: GC not initialized 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.597+0000 7fbf59fdb640 20 reqs_thread_entry: start 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 Filter name: none 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fbecb7fe640 20 reqs_thread_entry: start 2024-09-19T13:38:51.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:51.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 INFO: main: starting shard=0 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.598+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.599+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.599+0000 7fc0a8b22800 20 INFO: main: starting shard=1 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.599+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.599+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.599+0000 7fc0a8b22800 20 INFO: main: starting shard=2 2024-09-19T13:38:51.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.599+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:51.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.600+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.600+0000 7fc0a8b22800 20 INFO: main: starting shard=3 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.600+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.600+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.600+0000 7fc0a8b22800 20 INFO: main: starting shard=4 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.600+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.601+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.601+0000 7fc0a8b22800 20 INFO: main: starting shard=5 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.601+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.601+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.601+0000 7fc0a8b22800 20 INFO: main: starting shard=6 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.601+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:51.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 INFO: main: starting shard=7 2024-09-19T13:38:51.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:51.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 INFO: main: starting shard=8 2024-09-19T13:38:51.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 INFO: main: starting shard=9 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.602+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.603+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.603+0000 7fc0a8b22800 20 INFO: main: starting shard=10 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.603+0000 7fc0a8b22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.604+0000 7fc0a8b22800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.604+0000 7fc0a8b22800 20 INFO: main: done 2024-09-19T13:38:51.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.604+0000 7fbf5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.606+0000 7fc0a8b22800 20 remove_watcher() i=0 2024-09-19T13:38:51.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.606+0000 7fc0a8b22800 2 removed watcher, disabling cache 2024-09-19T13:38:51.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.607+0000 7fc0a8b22800 20 remove_watcher() i=1 2024-09-19T13:38:51.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.608+0000 7fc0a8b22800 20 remove_watcher() i=2 2024-09-19T13:38:51.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.610+0000 7fc0a8b22800 20 remove_watcher() i=3 2024-09-19T13:38:51.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.611+0000 7fc0a8b22800 20 remove_watcher() i=4 2024-09-19T13:38:51.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.612+0000 7fc0a8b22800 20 remove_watcher() i=5 2024-09-19T13:38:51.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.613+0000 7fc0a8b22800 20 remove_watcher() i=6 2024-09-19T13:38:51.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.613+0000 7fc0a8b22800 20 remove_watcher() i=7 2024-09-19T13:38:51.625 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-19T13:38:51.626 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:51.627 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-19T13:38:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:51.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.691+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 realm 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.693+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.694+0000 7fcab2f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.694+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.694+0000 7fcab2f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:51.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.694+0000 7fcab2f22800 20 searching for the correct realm 2024-09-19T13:38:51.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.697+0000 7fcaae3ad640 0 -- 172.21.15.94:0/3781014813 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fcaa0087030 msgr2=0x7fcaa0007cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:51.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.701+0000 7fcaaebae640 0 -- 172.21.15.94:0/3781014813 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fcaa40a1040 msgr2=0x7fcaa40a30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.906+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:51.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 zone default found 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 4 Realm: () 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 zonegroup default 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.907+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.908+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.908+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.908+0000 7fcab2f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:51.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.908+0000 7fcab2f22800 20 started sync module instance, tier type = 2024-09-19T13:38:51.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.908+0000 7fcab2f22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:51.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=0 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=1 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=2 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=3 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=4 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=5 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.920+0000 7fcab2f22800 20 add_watcher() i=6 2024-09-19T13:38:51.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.921+0000 7fcab2f22800 20 add_watcher() i=7 2024-09-19T13:38:51.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.921+0000 7fcab2f22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:51.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.922+0000 7fc9657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.922+0000 7fcab2f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:51.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.922+0000 7fcab2f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:51.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.922+0000 7fcab2f22800 5 note: GC not initialized 2024-09-19T13:38:51.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fc8dffff640 20 reqs_thread_entry: start 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 20 Filter name: none 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fc8ddffb640 20 reqs_thread_entry: start 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.923+0000 7fcab2f22800 20 rados->read ofs=0 len=0 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:51.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.924+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.925+0000 7fcab2f22800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.925+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.925+0000 7fcab2f22800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:38:51.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.925+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:51.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.926+0000 7fcab2f22800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.926+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.926+0000 7fcab2f22800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.926+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.926+0000 7fcab2f22800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.926+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.927+0000 7fcab2f22800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.927+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.928+0000 7fcab2f22800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.928+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.928+0000 7fcab2f22800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.928+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:51.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.929+0000 7fcab2f22800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:38:51.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.929+0000 7fcab2f22800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:51.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.929+0000 7fcab2f22800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:38:51.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.929+0000 7fcab2f22800 1 NOTICE: finished all shards (0 entries found) 2024-09-19T13:38:51.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.930+0000 7fc9657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:51.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.933+0000 7fcab2f22800 20 remove_watcher() i=0 2024-09-19T13:38:51.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.933+0000 7fcab2f22800 2 removed watcher, disabling cache 2024-09-19T13:38:51.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.934+0000 7fcab2f22800 20 remove_watcher() i=1 2024-09-19T13:38:51.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.935+0000 7fcab2f22800 20 remove_watcher() i=2 2024-09-19T13:38:51.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.936+0000 7fcab2f22800 20 remove_watcher() i=3 2024-09-19T13:38:51.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.936+0000 7fcab2f22800 20 remove_watcher() i=4 2024-09-19T13:38:51.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.937+0000 7fcab2f22800 20 remove_watcher() i=5 2024-09-19T13:38:51.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.938+0000 7fcab2f22800 20 remove_watcher() i=6 2024-09-19T13:38:51.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:51.939+0000 7fcab2f22800 20 remove_watcher() i=7 2024-09-19T13:38:51.951 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-19T13:38:51.952 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:52.004 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-19T13:38:52.004 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:38:52.180 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T13:38:52.572 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T13:38:54.010 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:54.012 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:38:54.047 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:54.047 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:54.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.087+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 realm 2024-09-19T13:38:54.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.089+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.090+0000 7f0be84bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:54.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.090+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.090+0000 7f0be84bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:54.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.090+0000 7f0be84bb800 20 searching for the correct realm 2024-09-19T13:38:54.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.092+0000 7f0be5fa5640 0 -- 172.21.15.94:0/3780741166 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x5595e46584f0 msgr2=0x7f0be00611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:54.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.698+0000 7f0be67a6640 0 -- 172.21.15.94:0/3780741166 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x5595e488e2a0 msgr2=0x5595e4890740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:54.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.706+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.707+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.707+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.707+0000 7f0be84bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.707+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 zone default found 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 4 Realm: () 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:54.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 zonegroup default 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.708+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.709+0000 7f0be84bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:54.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.709+0000 7f0be84bb800 20 started sync module instance, tier type = 2024-09-19T13:38:54.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.709+0000 7f0be84bb800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=0 2024-09-19T13:38:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=1 2024-09-19T13:38:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=2 2024-09-19T13:38:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=3 2024-09-19T13:38:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=4 2024-09-19T13:38:54.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=5 2024-09-19T13:38:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.720+0000 7f0be84bb800 20 add_watcher() i=6 2024-09-19T13:38:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.721+0000 7f0be84bb800 20 add_watcher() i=7 2024-09-19T13:38:54.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.721+0000 7f0be84bb800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:54.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.843+0000 7f0a977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:54.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.843+0000 7f0be84bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:54.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.843+0000 7f0be84bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:54.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.844+0000 7f0be84bb800 5 note: GC not initialized 2024-09-19T13:38:54.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.844+0000 7f0a967fc640 20 reqs_thread_entry: start 2024-09-19T13:38:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.844+0000 7f0be84bb800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.844+0000 7f0be84bb800 20 Filter name: none 2024-09-19T13:38:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.844+0000 7f0a07fff640 20 reqs_thread_entry: start 2024-09-19T13:38:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.844+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:54.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 rados->read ofs=0 len=0 2024-09-19T13:38:54.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:54.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:54.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 INFO: main: starting shard=0 2024-09-19T13:38:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.845+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.846+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.846+0000 7f0be84bb800 20 INFO: main: starting shard=1 2024-09-19T13:38:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.846+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:54.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.847+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.847+0000 7f0be84bb800 20 INFO: main: starting shard=2 2024-09-19T13:38:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.847+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.847+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.847+0000 7f0be84bb800 20 INFO: main: starting shard=3 2024-09-19T13:38:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.847+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:54.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.848+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.848+0000 7f0be84bb800 20 INFO: main: starting shard=4 2024-09-19T13:38:54.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.848+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:54.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.848+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.848+0000 7f0be84bb800 20 INFO: main: starting shard=5 2024-09-19T13:38:54.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.848+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:54.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.849+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.849+0000 7f0be84bb800 20 INFO: main: starting shard=6 2024-09-19T13:38:54.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.849+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:54.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.850+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.850+0000 7f0be84bb800 20 INFO: main: starting shard=7 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.850+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.850+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.850+0000 7f0be84bb800 20 INFO: main: starting shard=8 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.850+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.851+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.851+0000 7f0be84bb800 20 INFO: main: starting shard=9 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.851+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:54.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.852+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.852+0000 7f0be84bb800 20 INFO: main: starting shard=10 2024-09-19T13:38:54.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.852+0000 7f0be84bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:54.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.852+0000 7f0be84bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:54.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.852+0000 7f0be84bb800 20 INFO: main: done 2024-09-19T13:38:54.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.854+0000 7f0a977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:54.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.856+0000 7f0be84bb800 20 remove_watcher() i=0 2024-09-19T13:38:54.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.856+0000 7f0be84bb800 2 removed watcher, disabling cache 2024-09-19T13:38:54.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.858+0000 7f0be84bb800 20 remove_watcher() i=1 2024-09-19T13:38:54.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.859+0000 7f0be84bb800 20 remove_watcher() i=2 2024-09-19T13:38:54.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.860+0000 7f0be84bb800 20 remove_watcher() i=3 2024-09-19T13:38:54.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.862+0000 7f0be84bb800 20 remove_watcher() i=4 2024-09-19T13:38:54.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.863+0000 7f0be84bb800 20 remove_watcher() i=5 2024-09-19T13:38:54.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.864+0000 7f0be84bb800 20 remove_watcher() i=6 2024-09-19T13:38:54.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:54.866+0000 7f0be84bb800 20 remove_watcher() i=7 2024-09-19T13:38:54.934 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:54.936 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:38:54.969 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:54.969 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:55.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.006+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 realm 2024-09-19T13:38:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.008+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.009+0000 7f79d4296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:55.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.009+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.009+0000 7f79d4296800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:55.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.009+0000 7f79d4296800 20 searching for the correct realm 2024-09-19T13:38:55.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.013+0000 7f79d2581640 0 -- 172.21.15.94:0/1068828568 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f79bc0a58b0 msgr2=0x7f79bc0afa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:55.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.017+0000 7f79d1d80640 0 -- 172.21.15.94:0/1068828568 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f79bc0ac7a0 msgr2=0x7f79bc0bc2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:55.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.223+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 zone default found 2024-09-19T13:38:55.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 4 Realm: () 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 zonegroup default 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.224+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.225+0000 7f79d4296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.225+0000 7f79d4296800 20 started sync module instance, tier type = 2024-09-19T13:38:55.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.225+0000 7f79d4296800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:55.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=0 2024-09-19T13:38:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=1 2024-09-19T13:38:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=2 2024-09-19T13:38:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=3 2024-09-19T13:38:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=4 2024-09-19T13:38:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=5 2024-09-19T13:38:55.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.237+0000 7f79d4296800 20 add_watcher() i=6 2024-09-19T13:38:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.238+0000 7f79d4296800 20 add_watcher() i=7 2024-09-19T13:38:55.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.238+0000 7f79d4296800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.240+0000 7f78837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:55.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.240+0000 7f79d4296800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.240+0000 7f79d4296800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.240+0000 7f79d4296800 5 note: GC not initialized 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.240+0000 7f78827fc640 20 reqs_thread_entry: start 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.241+0000 7f79d4296800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.241+0000 7f79d4296800 20 Filter name: none 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.241+0000 7f77f3fff640 20 reqs_thread_entry: start 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.241+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.241+0000 7f79d4296800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.241+0000 7f79d4296800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 INFO: main: starting shard=0 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:55.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 INFO: main: starting shard=1 2024-09-19T13:38:55.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.242+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:55.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.243+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.243+0000 7f79d4296800 20 INFO: main: starting shard=2 2024-09-19T13:38:55.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.243+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:55.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.243+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.243+0000 7f79d4296800 20 INFO: main: starting shard=3 2024-09-19T13:38:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.243+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.244+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.244+0000 7f79d4296800 20 INFO: main: starting shard=4 2024-09-19T13:38:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.244+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:55.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.245+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.245+0000 7f79d4296800 20 INFO: main: starting shard=5 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.245+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.245+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.245+0000 7f79d4296800 20 INFO: main: starting shard=6 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.245+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.246+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.246+0000 7f79d4296800 20 INFO: main: starting shard=7 2024-09-19T13:38:55.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.246+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:55.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.247+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.247+0000 7f79d4296800 20 INFO: main: starting shard=8 2024-09-19T13:38:55.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.247+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.247+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.247+0000 7f79d4296800 20 INFO: main: starting shard=9 2024-09-19T13:38:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.247+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.248+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.248+0000 7f79d4296800 20 INFO: main: starting shard=10 2024-09-19T13:38:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.248+0000 7f79d4296800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.248+0000 7f79d4296800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.248+0000 7f79d4296800 20 INFO: main: done 2024-09-19T13:38:55.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.249+0000 7f78837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.251+0000 7f79d4296800 20 remove_watcher() i=0 2024-09-19T13:38:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.251+0000 7f79d4296800 2 removed watcher, disabling cache 2024-09-19T13:38:55.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.253+0000 7f79d4296800 20 remove_watcher() i=1 2024-09-19T13:38:55.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.254+0000 7f79d4296800 20 remove_watcher() i=2 2024-09-19T13:38:55.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.255+0000 7f79d4296800 20 remove_watcher() i=3 2024-09-19T13:38:55.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.256+0000 7f79d4296800 20 remove_watcher() i=4 2024-09-19T13:38:55.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.257+0000 7f79d4296800 20 remove_watcher() i=5 2024-09-19T13:38:55.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.258+0000 7f79d4296800 20 remove_watcher() i=6 2024-09-19T13:38:55.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.259+0000 7f79d4296800 20 remove_watcher() i=7 2024-09-19T13:38:55.324 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:55.325 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-19T13:38:55.359 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:55.359 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:55.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.393+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.395+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.395+0000 7f6ac1a40800 20 realm 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.395+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.396+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.396+0000 7f6ac1a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.396+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.396+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.396+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.397+0000 7f6ac1a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.397+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.397+0000 7f6ac1a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.397+0000 7f6ac1a40800 20 searching for the correct realm 2024-09-19T13:38:55.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.401+0000 7f6ab7fff640 0 -- 172.21.15.94:0/133480520 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55b526e18790 msgr2=0x55b526e1ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:55.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.404+0000 7f6ab7fff640 0 -- 172.21.15.94:0/133480520 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6ab0087020 msgr2=0x7f6ab00b5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:55.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:55.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.408+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:55.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 20 zone default found 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 4 Realm: () 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 20 zonegroup default 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.409+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 started sync module instance, tier type = 2024-09-19T13:38:55.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.410+0000 7f6ac1a40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:55.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=0 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=1 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=2 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=3 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=4 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=5 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.419+0000 7f6ac1a40800 20 add_watcher() i=6 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.420+0000 7f6ac1a40800 20 add_watcher() i=7 2024-09-19T13:38:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.420+0000 7f6ac1a40800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:55.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.422+0000 7f6975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.422+0000 7f6ac1a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.422+0000 7f6ac1a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.422+0000 7f6ac1a40800 5 note: GC not initialized 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f6974fe1640 20 reqs_thread_entry: start 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f6ac1a40800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f6ac1a40800 20 Filter name: none 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f68ee7fc640 20 reqs_thread_entry: start 2024-09-19T13:38:55.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f6ac1a40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.423+0000 7f6ac1a40800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 INFO: main: starting shard=0 2024-09-19T13:38:55.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:55.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 INFO: main: starting shard=1 2024-09-19T13:38:55.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.424+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:55.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:38:55.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 INFO: main: starting shard=2 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 INFO: main: starting shard=3 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 INFO: main: starting shard=4 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.425+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:55.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.426+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.426+0000 7f6ac1a40800 20 INFO: main: starting shard=5 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.426+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.426+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.426+0000 7f6ac1a40800 20 INFO: main: starting shard=6 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.426+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.427+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.427+0000 7f6ac1a40800 20 INFO: main: starting shard=7 2024-09-19T13:38:55.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.427+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:55.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.428+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.428+0000 7f6ac1a40800 20 INFO: main: starting shard=8 2024-09-19T13:38:55.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.428+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:55.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.428+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.428+0000 7f6ac1a40800 20 INFO: main: starting shard=9 2024-09-19T13:38:55.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.428+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:55.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.429+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.429+0000 7f6ac1a40800 20 INFO: main: starting shard=10 2024-09-19T13:38:55.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.429+0000 7f6ac1a40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:55.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.430+0000 7f6ac1a40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.430+0000 7f6ac1a40800 20 INFO: main: done 2024-09-19T13:38:55.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.430+0000 7f6975fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:55.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.433+0000 7f6ac1a40800 20 remove_watcher() i=0 2024-09-19T13:38:55.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.433+0000 7f6ac1a40800 2 removed watcher, disabling cache 2024-09-19T13:38:55.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.434+0000 7f6ac1a40800 20 remove_watcher() i=1 2024-09-19T13:38:55.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.435+0000 7f6ac1a40800 20 remove_watcher() i=2 2024-09-19T13:38:55.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.436+0000 7f6ac1a40800 20 remove_watcher() i=3 2024-09-19T13:38:55.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.437+0000 7f6ac1a40800 20 remove_watcher() i=4 2024-09-19T13:38:55.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.438+0000 7f6ac1a40800 20 remove_watcher() i=5 2024-09-19T13:38:55.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.439+0000 7f6ac1a40800 20 remove_watcher() i=6 2024-09-19T13:38:55.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.440+0000 7f6ac1a40800 20 remove_watcher() i=7 2024-09-19T13:38:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:38:55.507 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-19T13:38:55.536 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:55.537 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:55.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.570+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 realm 2024-09-19T13:38:55.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.572+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.573+0000 7f5f48122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:55.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.573+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.574+0000 7f5f48122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:55.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.574+0000 7f5f48122800 20 searching for the correct realm 2024-09-19T13:38:55.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.577+0000 7f5f44503640 0 -- 172.21.15.94:0/4136911784 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x563a420db150 msgr2=0x563a420dd580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:55.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.581+0000 7f5f43d02640 0 -- 172.21.15.94:0/4136911784 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f5f38063930 msgr2=0x7f5f380623c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:55.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.585+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:55.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 zone default found 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 4 Realm: () 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 zonegroup default 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.586+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.587+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.587+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.587+0000 7f5f48122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.587+0000 7f5f48122800 20 started sync module instance, tier type = 2024-09-19T13:38:55.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.587+0000 7f5f48122800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:55.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=0 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=1 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=2 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=3 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=4 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=5 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.597+0000 7f5f48122800 20 add_watcher() i=6 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.598+0000 7f5f48122800 20 add_watcher() i=7 2024-09-19T13:38:55.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.598+0000 7f5f48122800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:55.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.600+0000 7f5df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.600+0000 7f5f48122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.600+0000 7f5f48122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.600+0000 7f5f48122800 5 note: GC not initialized 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.600+0000 7f5df8fe1640 20 reqs_thread_entry: start 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 Filter name: none 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5d727fc640 20 reqs_thread_entry: start 2024-09-19T13:38:55.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:55.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 rados->read ofs=0 len=0 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 INFO: main: starting shard=0 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.601+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.602+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.602+0000 7f5f48122800 20 INFO: main: starting shard=1 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.602+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 INFO: main: starting shard=2 2024-09-19T13:38:55.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 INFO: main: starting shard=3 2024-09-19T13:38:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 INFO: main: starting shard=4 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.603+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.604+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.604+0000 7f5f48122800 20 INFO: main: starting shard=5 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.604+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.604+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.604+0000 7f5f48122800 20 INFO: main: starting shard=6 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.604+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.605+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.605+0000 7f5f48122800 20 INFO: main: starting shard=7 2024-09-19T13:38:55.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.605+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.605+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.605+0000 7f5f48122800 20 INFO: main: starting shard=8 2024-09-19T13:38:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.605+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.606+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.606+0000 7f5f48122800 20 INFO: main: starting shard=9 2024-09-19T13:38:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.606+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.607+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:38:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.607+0000 7f5f48122800 20 INFO: main: starting shard=10 2024-09-19T13:38:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.607+0000 7f5f48122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.607+0000 7f5f48122800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:38:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.607+0000 7f5f48122800 20 INFO: main: done 2024-09-19T13:38:55.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.608+0000 7f5df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.611+0000 7f5f48122800 20 remove_watcher() i=0 2024-09-19T13:38:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.611+0000 7f5f48122800 2 removed watcher, disabling cache 2024-09-19T13:38:55.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.611+0000 7f5f48122800 20 remove_watcher() i=1 2024-09-19T13:38:55.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.612+0000 7f5f48122800 20 remove_watcher() i=2 2024-09-19T13:38:55.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.613+0000 7f5f48122800 20 remove_watcher() i=3 2024-09-19T13:38:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.614+0000 7f5f48122800 20 remove_watcher() i=4 2024-09-19T13:38:55.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.615+0000 7f5f48122800 20 remove_watcher() i=5 2024-09-19T13:38:55.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.616+0000 7f5f48122800 20 remove_watcher() i=6 2024-09-19T13:38:55.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:55.617+0000 7f5f48122800 20 remove_watcher() i=7 2024-09-19T13:38:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T13:38:56.029 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T13:38:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-19T13:38:56.451 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:56.451 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:56.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.487+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 realm 2024-09-19T13:38:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.489+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.490+0000 7f95fd121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:56.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.490+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.490+0000 7f95fd121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:56.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.490+0000 7f95fd121800 20 searching for the correct realm 2024-09-19T13:38:56.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.494+0000 7f95f3fff640 0 -- 172.21.15.94:0/2038367279 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5652fe81ef30 msgr2=0x5652fe8213f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:56.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.498+0000 7f95f8e44640 0 -- 172.21.15.94:0/2038367279 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f95e40772a0 msgr2=0x7f95e406a600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.703+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:56.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 zone default found 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 4 Realm: () 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 zonegroup default 2024-09-19T13:38:56.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.704+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.705+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.705+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.705+0000 7f95fd121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.705+0000 7f95fd121800 20 started sync module instance, tier type = 2024-09-19T13:38:56.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.705+0000 7f95fd121800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=0 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=1 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=2 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=3 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=4 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=5 2024-09-19T13:38:56.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=6 2024-09-19T13:38:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 20 add_watcher() i=7 2024-09-19T13:38:56.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.715+0000 7f95fd121800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.717+0000 7f94af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 5 note: GC not initialized 2024-09-19T13:38:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f94ae7e4640 20 reqs_thread_entry: start 2024-09-19T13:38:56.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:56.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 20 Filter name: none 2024-09-19T13:38:56.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f94a7fff640 20 reqs_thread_entry: start 2024-09-19T13:38:56.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:56.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.718+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 20 rados->read ofs=0 len=0 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:56.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.719+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.720+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:56.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.720+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:56.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.721+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:56.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.721+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:56.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.722+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:56.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.722+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:56.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.723+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:56.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.724+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:56.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.724+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:56.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.725+0000 7f95fd121800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:56.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.731+0000 7f94af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:56.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.733+0000 7f95fd121800 20 remove_watcher() i=0 2024-09-19T13:38:56.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.733+0000 7f95fd121800 2 removed watcher, disabling cache 2024-09-19T13:38:56.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.734+0000 7f95fd121800 20 remove_watcher() i=1 2024-09-19T13:38:56.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.735+0000 7f95fd121800 20 remove_watcher() i=2 2024-09-19T13:38:56.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.737+0000 7f95fd121800 20 remove_watcher() i=3 2024-09-19T13:38:56.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.738+0000 7f95fd121800 20 remove_watcher() i=4 2024-09-19T13:38:56.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.739+0000 7f95fd121800 20 remove_watcher() i=5 2024-09-19T13:38:56.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.740+0000 7f95fd121800 20 remove_watcher() i=6 2024-09-19T13:38:56.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:56.741+0000 7f95fd121800 20 remove_watcher() i=7 2024-09-19T13:38:56.755 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T13:38:56.790 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:56.790 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:57.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.024+0000 7ff2fedf2640 0 --2- 172.21.15.94:0/1164156429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x5626a065c9a0 0x5626a06584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-19T13:38:57.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.026+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.027+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.027+0000 7ff30361d800 20 realm 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.027+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.028+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.028+0000 7ff30361d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.028+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.028+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.028+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.029+0000 7ff30361d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.029+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.029+0000 7ff30361d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:57.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.029+0000 7ff30361d800 20 searching for the correct realm 2024-09-19T13:38:57.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.032+0000 7ff2fe5f1640 0 -- 172.21.15.94:0/1164156429 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7ff2f00b7070 msgr2=0x7ff2f00a8900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:57.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.037+0000 7ff2fedf2640 0 -- 172.21.15.94:0/1164156429 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff2e8018040 msgr2=0x7ff2e80a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.243+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 zone default found 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 4 Realm: () 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 zonegroup default 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.244+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 started sync module instance, tier type = 2024-09-19T13:38:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.245+0000 7ff30361d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=0 2024-09-19T13:38:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=1 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=2 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=3 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=4 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=5 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.256+0000 7ff30361d800 20 add_watcher() i=6 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.257+0000 7ff30361d800 20 add_watcher() i=7 2024-09-19T13:38:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.257+0000 7ff30361d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.259+0000 7ff1b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:57.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:57.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 5 note: GC not initialized 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff1b4fe1640 20 reqs_thread_entry: start 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 20 Filter name: none 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff1adffb640 20 reqs_thread_entry: start 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.260+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 : miss 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 info.flags=0x17 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 to cache LRU end 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:38:57.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:38:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2 2024-09-19T13:38:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.261+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.0 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.262+0000 7ff30361d800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.262+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.262+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.2 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.263+0000 7ff30361d800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.263+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.3 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.264+0000 7ff30361d800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T13:38:57.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.264+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.4 2024-09-19T13:38:57.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.264+0000 7ff30361d800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T13:38:57.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.264+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.265+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.6 2024-09-19T13:38:57.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.266+0000 7ff30361d800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T13:38:57.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.266+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.7 2024-09-19T13:38:57.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.266+0000 7ff30361d800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T13:38:57.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.266+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.267+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.9 2024-09-19T13:38:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.267+0000 7ff30361d800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-19T13:38:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.267+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.268+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.268+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0418f20 obj=check-bucket:e state=0x5626a06dd478 s->prefetch_data=0 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.268+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.269+0000 7ff30361d800 20 get_obj_state: octx=0x5626a04414a0 obj=check-bucket:d state=0x5626a06dac28 s->prefetch_data=0 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.269+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.269+0000 7ff30361d800 20 get_obj_state: octx=0x5626a06dde20 obj=check-bucket:c state=0x5626a06d74d8 s->prefetch_data=0 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.269+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0776910 obj=check-bucket:f state=0x5626a0777018 s->prefetch_data=0 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to tmg63ux2zs3siv08rouk3039yn910kxz 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state_impl: setting s->olh_tag to zcxmwy4khwsbkz9k5k23pgwqao94cn6u 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zcxmwy4khwsbkz9k5k23pgwqao94cn6u 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to mlniizaitrg0dv1yd8y6uuglye5mmuz0 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state_impl: setting s->olh_tag to p9uwoykru0k8t4tfbskovcb9zcuda829 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p9uwoykru0k8t4tfbskovcb9zcuda829 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to ki2ylbujh4rqv9zq3hddzhsdpiqhuvn4 2024-09-19T13:38:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state_impl: setting s->olh_tag to 4dp9n0tbx2u2yrlbpxn6n0w8uvamstaz 2024-09-19T13:38:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4dp9n0tbx2u2yrlbpxn6n0w8uvamstaz 2024-09-19T13:38:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to jxmezr65oi9yxhwtad3dbx8a7n67fcbe 2024-09-19T13:38:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 get_obj_state_impl: setting s->olh_tag to zrbss5sdl7eg76c6eckm16v8k4oraeeo 2024-09-19T13:38:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.270+0000 7ff30361d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zrbss5sdl7eg76c6eckm16v8k4oraeeo 2024-09-19T13:38:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.271+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.271+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.271+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.272+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.272+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 olh_log_entry: epoch=3 op=3 key=d[qS-HsuBMyyzj-4wfLZ3.RxAsMYHJqCS] 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: octx=0x5626a04414a0 obj=check-bucket:_:qS-HsuBMyyzj-4wfLZ3.RxAsMYHJqCS_d state=0x5626a07820a8 s->prefetch_data=0 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 olh_log_entry: epoch=2 op=3 key=e[hMS0qjlTtJb3ksenKrDWOHCNekuEsxU] 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0418f20 obj=check-bucket:_:hMS0qjlTtJb3ksenKrDWOHCNekuEsxU_e state=0x5626a078d4f8 s->prefetch_data=0 2024-09-19T13:38:57.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 olh_log_entry: epoch=3 op=3 key=c[8CI-m.fvIieqfF8xdxOY2EWERRgxZfo] 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: octx=0x5626a06dde20 obj=check-bucket:_:8CI-m.fvIieqfF8xdxOY2EWERRgxZfo_c state=0x5626a079a1a8 s->prefetch_data=0 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 10 manifest: total_size = 22 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14853665372955260261 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: octx=0x5626a04414a0 obj=check-bucket:_:qS-HsuBMyyzj-4wfLZ3.RxAsMYHJqCS_d state=0x5626a07820a8 s->prefetch_data=0 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 prepare_atomic_modification: state is not atomic. state=0x5626a07820a8 2024-09-19T13:38:57.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 10 manifest: total_size = 9 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6604808859522170817 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0418f20 obj=check-bucket:_:hMS0qjlTtJb3ksenKrDWOHCNekuEsxU_e state=0x5626a078d4f8 s->prefetch_data=0 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.273+0000 7ff30361d800 20 prepare_atomic_modification: state is not atomic. state=0x5626a078d4f8 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 olh_log_entry: epoch=2 op=3 key=f[9nSLv28vjQIwLe-6tmg6S7YfCcKUBT1] 2024-09-19T13:38:57.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0776910 obj=check-bucket:_:9nSLv28vjQIwLe-6tmg6S7YfCcKUBT1_f state=0x5626a07aa1f8 s->prefetch_data=0 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 10 manifest: total_size = 12 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5528221653860300246 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 get_obj_state: octx=0x5626a06dde20 obj=check-bucket:_:8CI-m.fvIieqfF8xdxOY2EWERRgxZfo_c state=0x5626a079a1a8 s->prefetch_data=0 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 prepare_atomic_modification: state is not atomic. state=0x5626a079a1a8 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 10 manifest: total_size = 22 2024-09-19T13:38:57.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6403873882194059501 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0776910 obj=check-bucket:_:9nSLv28vjQIwLe-6tmg6S7YfCcKUBT1_f state=0x5626a07aa1f8 s->prefetch_data=0 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 prepare_atomic_modification: state is not atomic. state=0x5626a07aa1f8 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.274+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.277+0000 7ff1e27fc640 20 handle_completion(): completion ok for obj=d[qS-HsuBMyyzj-4wfLZ3.RxAsMYHJqCS] 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.278+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0418f20 obj=check-bucket:e state=0x5626a06dd478 s->prefetch_data=0 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.278+0000 7ff30361d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zcxmwy4khwsbkz9k5k23pgwqao94cn6u 2024-09-19T13:38:57.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.278+0000 7ff1e27fc640 20 handle_completion(): completion ok for obj=c[8CI-m.fvIieqfF8xdxOY2EWERRgxZfo] 2024-09-19T13:38:57.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.278+0000 7ff1e27fc640 20 handle_completion(): completion ok for obj=e[hMS0qjlTtJb3ksenKrDWOHCNekuEsxU] 2024-09-19T13:38:57.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.278+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.278+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.279+0000 7ff1e27fc640 20 handle_completion(): completion ok for obj=f[9nSLv28vjQIwLe-6tmg6S7YfCcKUBT1] 2024-09-19T13:38:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.5 2024-09-19T13:38:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-19T13:38:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 20 get_obj_state: octx=0x5626a0776910 obj=check-bucket:f state=0x5626a0777018 s->prefetch_data=0 2024-09-19T13:38:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zrbss5sdl7eg76c6eckm16v8k4oraeeo 2024-09-19T13:38:57.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.280+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.281+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.8 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.281+0000 7ff30361d800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.281+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.1 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.281+0000 7ff30361d800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.282+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.284+0000 7ff30361d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2.10 2024-09-19T13:38:57.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.284+0000 7ff30361d800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-19T13:38:57.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.284+0000 7ff30361d800 1 NOTICE: finished all shards (4 entries removed) 2024-09-19T13:38:57.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.284+0000 7ff1b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:57.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.287+0000 7ff30361d800 20 remove_watcher() i=0 2024-09-19T13:38:57.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.287+0000 7ff30361d800 2 removed watcher, disabling cache 2024-09-19T13:38:57.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.288+0000 7ff30361d800 20 remove_watcher() i=1 2024-09-19T13:38:57.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.289+0000 7ff30361d800 20 remove_watcher() i=2 2024-09-19T13:38:57.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.291+0000 7ff30361d800 20 remove_watcher() i=3 2024-09-19T13:38:57.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.292+0000 7ff30361d800 20 remove_watcher() i=4 2024-09-19T13:38:57.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.293+0000 7ff30361d800 20 remove_watcher() i=5 2024-09-19T13:38:57.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.294+0000 7ff30361d800 20 remove_watcher() i=6 2024-09-19T13:38:57.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.295+0000 7ff30361d800 20 remove_watcher() i=7 2024-09-19T13:38:57.358 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-19T13:38:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:38:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:38:57.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.420+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.422+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.422+0000 7f3ee8926800 20 realm 2024-09-19T13:38:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.422+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.423+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.423+0000 7f3ee8926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:38:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.423+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.423+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.423+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.424+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:57.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.424+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.424+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:38:57.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.424+0000 7f3ee8926800 20 searching for the correct realm 2024-09-19T13:38:57.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.427+0000 7f3edbe4a640 0 -- 172.21.15.94:0/2267978139 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5569a8572d30 msgr2=0x5569a8575120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:38:57.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.431+0000 7f3ee464b640 0 -- 172.21.15.94:0/2267978139 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3ecc088050 msgr2=0x7f3ecc04d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.636+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:38:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 zone default found 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 4 Realm: () 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 zonegroup default 2024-09-19T13:38:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.637+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 started sync module instance, tier type = 2024-09-19T13:38:57.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.638+0000 7f3ee8926800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:38:57.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=0 2024-09-19T13:38:57.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=1 2024-09-19T13:38:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=2 2024-09-19T13:38:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=3 2024-09-19T13:38:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=4 2024-09-19T13:38:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=5 2024-09-19T13:38:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.648+0000 7f3ee8926800 20 add_watcher() i=6 2024-09-19T13:38:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.649+0000 7f3ee8926800 20 add_watcher() i=7 2024-09-19T13:38:57.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.649+0000 7f3ee8926800 2 all 8 watchers are set, enabling cache 2024-09-19T13:38:57.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.651+0000 7f3d9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:57.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.651+0000 7f3ee8926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:38:57.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.651+0000 7f3ee8926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:38:57.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.651+0000 7f3ee8926800 5 note: GC not initialized 2024-09-19T13:38:57.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3d997e2640 20 reqs_thread_entry: start 2024-09-19T13:38:57.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3ee8926800 20 init_complete bucket index max shards: 11 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3ee8926800 20 Filter name: none 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3d0affd640 20 reqs_thread_entry: start 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.652+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 rados->read ofs=0 len=0 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:38:57.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.653+0000 7f3ee8926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:38:57.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.655+0000 7f3d9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:38:57.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.657+0000 7f3ee8926800 20 remove_watcher() i=0 2024-09-19T13:38:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.657+0000 7f3ee8926800 2 removed watcher, disabling cache 2024-09-19T13:38:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.658+0000 7f3ee8926800 20 remove_watcher() i=1 2024-09-19T13:38:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.659+0000 7f3ee8926800 20 remove_watcher() i=2 2024-09-19T13:38:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.660+0000 7f3ee8926800 20 remove_watcher() i=3 2024-09-19T13:38:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.661+0000 7f3ee8926800 20 remove_watcher() i=4 2024-09-19T13:38:57.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.662+0000 7f3ee8926800 20 remove_watcher() i=5 2024-09-19T13:38:57.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.663+0000 7f3ee8926800 20 remove_watcher() i=6 2024-09-19T13:38:57.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:38:57.664+0000 7f3ee8926800 20 remove_watcher() i=7 2024-09-19T13:38:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-19T13:38:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket check-bucket 2024-09-19T13:38:57.716 INFO:tasks.workunit.client.0.smithi094.stderr:Completed bucket check tests 2024-09-19T13:38:57.716 INFO:tasks.workunit.client.0.smithi094.stdout:connected to http://localhost:80 2024-09-19T13:38:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-19T13:38:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-19T13:38:57.773 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-19T13:38:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-19T13:38:57.775 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-19T13:38:57.775 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:38:57.776 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:38:57.855 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-19T13:38:57.855 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T13:38:58.205 DEBUG:teuthology.parallel:result is None 2024-09-19T13:38:58.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:38:58.244 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:38:58.245 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:38:58.314 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:38:58.314 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:38:58.325 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:38:58.326 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:38:58.326 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:38:58.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:38:58.383 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:38:58.383 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:38:58.453 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:38:58.453 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:38:58.522 INFO:tasks.workunit:timeout=3h 2024-09-19T13:38:58.522 INFO:tasks.workunit:cleanup=True 2024-09-19T13:38:58.523 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:38:58.592 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:39:59.181 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-19T13:39:59.182 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.183 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-19T13:39:59.183 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.183 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:39:59.183 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:39:59.183 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:39:59.189 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:39:59.257 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:39:59.260 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:39:59.260 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:39:59.379 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:39:59.429 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:39:59.467 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:39:59.469 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:39:59.469 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:39:59.507 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:39:59.511 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:39:59.511 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:39:59.580 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-19T13:39:59.581 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-19T13:39:59.581 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-19T13:39:59.663 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:39:59.664 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T13:39:59.664 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:39:59.664 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from ClsLock 2024-09-19T13:39:59.664 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-19T13:40:01.582 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:01.582 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-19T13:40:01.582 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-19T13:40:01.582 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:01.582 INFO:tasks.workunit.client.0.smithi094.stdout: client.5030 expiration=2024-09-19T13:42:01.577415+0000 addr=v1:172.21.15.94:0/973578199 cookie= 2024-09-19T13:40:01.587 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:01.587 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-19T13:40:01.587 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-19T13:40:01.588 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:01.588 INFO:tasks.workunit.client.0.smithi094.stdout: client.5030 expiration=2024-09-19T13:42:01.584012+0000 addr=v1:172.21.15.94:0/973578199 cookie= 2024-09-19T13:40:01.588 INFO:tasks.workunit.client.0.smithi094.stdout: client.5036 expiration=0.000000 addr=v1:172.21.15.94:0/1807943416 cookie= 2024-09-19T13:40:01.590 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:01.590 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-19T13:40:01.590 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-19T13:40:01.590 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:01.590 INFO:tasks.workunit.client.0.smithi094.stdout: client.5036 expiration=0.000000 addr=v1:172.21.15.94:0/1807943416 cookie= 2024-09-19T13:40:02.560 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMultiLocking (2895 ms) 2024-09-19T13:40:02.560 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMeta 2024-09-19T13:40:04.811 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:04.811 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-19T13:40:04.811 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-19T13:40:04.811 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:04.811 INFO:tasks.workunit.client.0.smithi094.stdout: client.5045 expiration=0.000000 addr=v1:172.21.15.94:0/540348073 cookie= 2024-09-19T13:40:04.814 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:04.814 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-19T13:40:04.814 INFO:tasks.workunit.client.0.smithi094.stdout: tag: new_tag 2024-09-19T13:40:04.814 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:04.814 INFO:tasks.workunit.client.0.smithi094.stdout: client.5042 expiration=0.000000 addr=v1:172.21.15.94:0/2169388774 cookie= 2024-09-19T13:40:05.581 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMeta (3021 ms) 2024-09-19T13:40:05.581 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestCookie 2024-09-19T13:40:07.598 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:07.598 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: exclusive 2024-09-19T13:40:07.598 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-19T13:40:07.598 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:07.600 INFO:tasks.workunit.client.0.smithi094.stdout:lock: mylock 2024-09-19T13:40:07.600 INFO:tasks.workunit.client.0.smithi094.stdout: lock_type: shared 2024-09-19T13:40:07.600 INFO:tasks.workunit.client.0.smithi094.stdout: tag: 2024-09-19T13:40:07.600 INFO:tasks.workunit.client.0.smithi094.stdout: lockers: 2024-09-19T13:40:07.600 INFO:tasks.workunit.client.0.smithi094.stdout: client.5051 expiration=0.000000 addr=v1:172.21.15.94:0/2061827395 cookie= 2024-09-19T13:40:07.600 INFO:tasks.workunit.client.0.smithi094.stdout: client.5051 expiration=0.000000 addr=v1:172.21.15.94:0/2061827395 cookie=new cookie 2024-09-19T13:40:08.584 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestCookie (3000 ms) 2024-09-19T13:40:08.584 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-19T13:40:11.611 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestMultipleLocks (3031 ms) 2024-09-19T13:40:11.612 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-19T13:40:18.705 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestLockDuration (7093 ms) 2024-09-19T13:40:18.706 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-19T13:40:21.723 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestAssertLocked (3018 ms) 2024-09-19T13:40:21.723 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-19T13:40:24.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestSetCookie (3014 ms) 2024-09-19T13:40:24.737 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestRenew 2024-09-19T13:40:45.050 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestRenew (20312 ms) 2024-09-19T13:40:45.050 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-19T13:40:52.079 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7030 ms) 2024-09-19T13:40:52.079 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-19T13:41:00.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8034 ms) 2024-09-19T13:41:00.113 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-19T13:41:08.153 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2024-09-19T13:41:08.153 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from ClsLock (68484 ms total) 2024-09-19T13:41:08.153 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:41:08.153 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:41:08.154 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (68484 ms total) 2024-09-19T13:41:08.154 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-19T13:41:08.154 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:41:08.154 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:41:08.239 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-19T13:41:08.240 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-19T13:41:08.241 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-19T13:41:08.287 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:41:08.287 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T13:41:08.287 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:41:08.287 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from cls_log 2024-09-19T13:41:08.287 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-19T13:41:11.171 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.test_log_add_same_time (2884 ms) 2024-09-19T13:41:11.171 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-19T13:41:14.183 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.test_log_add_different_time (3012 ms) 2024-09-19T13:41:14.183 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.trim_by_time 2024-09-19T13:41:17.201 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.trim_by_time (3018 ms) 2024-09-19T13:41:17.201 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-19T13:41:20.220 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_log.trim_by_marker (3019 ms) 2024-09-19T13:41:20.220 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from cls_log (11934 ms total) 2024-09-19T13:41:20.220 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:41:20.221 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:41:20.221 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (11934 ms total) 2024-09-19T13:41:20.221 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-19T13:41:20.224 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:41:20.224 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:41:20.268 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-19T13:41:20.269 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-19T13:41:20.270 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-19T13:41:20.315 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:41:20.315 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-19T13:41:20.316 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:41:20.316 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from cls_refcount 2024-09-19T13:41:20.316 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-19T13:41:23.237 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit (2920 ms) 2024-09-19T13:41:23.237 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-19T13:41:26.249 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3012 ms) 2024-09-19T13:41:26.249 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-19T13:41:35.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_put_snap (9047 ms) 2024-09-19T13:41:35.295 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-19T13:41:38.311 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_explicit (3016 ms) 2024-09-19T13:41:38.311 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.set 2024-09-19T13:41:41.327 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.set (3016 ms) 2024-09-19T13:41:41.327 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-19T13:41:48.338 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_ec (7011 ms) 2024-09-19T13:41:48.338 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-19T13:41:55.385 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7047 ms) 2024-09-19T13:41:55.385 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-19T13:42:07.424 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_put_snap_ec (12039 ms) 2024-09-19T13:42:07.424 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-19T13:42:14.455 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.test_explicit_ec (7031 ms) 2024-09-19T13:42:14.455 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_refcount.set_ec 2024-09-19T13:42:21.495 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_refcount.set_ec (7040 ms) 2024-09-19T13:42:21.495 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from cls_refcount (61179 ms total) 2024-09-19T13:42:21.495 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:42:21.495 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:42:21.496 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 10 tests from 1 test suite ran. (61179 ms total) 2024-09-19T13:42:21.496 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 10 tests. 2024-09-19T13:42:21.498 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:42:21.498 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:42:21.541 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-19T13:42:21.542 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-19T13:42:21.542 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-19T13:42:21.627 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:42:21.627 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-19T13:42:21.627 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:42:21.627 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 18 tests from cls_rgw 2024-09-19T13:42:23.514 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_basic 2024-09-19T13:42:23.555 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_basic (41 ms) 2024-09-19T13:42:23.555 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-19T13:42:23.589 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (35 ms) 2024-09-19T13:42:23.589 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-19T13:42:23.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_remove_object (40 ms) 2024-09-19T13:42:23.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-19T13:42:25.088 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_suggest (1458 ms) 2024-09-19T13:42:25.088 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-19T13:42:25.094 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-09-19T13:42:25.094 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_list 2024-09-19T13:42:25.118 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_list (25 ms) 2024-09-19T13:42:25.119 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-19T13:42:43.459 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_list_delimited (18340 ms) 2024-09-19T13:42:43.459 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.bi_list 2024-09-19T13:42:43.527 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.bi_list (68 ms) 2024-09-19T13:42:43.527 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_set 2024-09-19T13:42:43.536 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_set (9 ms) 2024-09-19T13:42:43.536 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_list 2024-09-19T13:42:43.546 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2024-09-19T13:42:43.546 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-19T13:42:51.579 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.gc_defer (8034 ms) 2024-09-19T13:42:51.580 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-19T13:42:51.663 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_basic (83 ms) 2024-09-19T13:42:51.663 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-19T13:42:51.664 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-19T13:42:51.664 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-19T13:42:51.758 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-09-19T13:42:51.758 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-19T13:42:51.797 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.bi_log_trim (40 ms) 2024-09-19T13:42:51.797 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-19T13:42:51.814 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.index_racing_removes (16 ms) 2024-09-19T13:42:51.814 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-19T13:42:51.828 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.reshardlog_list (15 ms) 2024-09-19T13:42:51.828 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-19T13:42:51.838 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-19T13:42:52.588 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 18 tests from cls_rgw (28325 ms total) 2024-09-19T13:42:52.588 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:42:52.588 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:42:52.588 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 18 tests from 1 test suite ran. (30957 ms total) 2024-09-19T13:42:52.588 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 18 tests. 2024-09-19T13:42:52.588 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:42:52.589 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:42:52.635 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-19T13:42:52.636 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-19T13:42:52.636 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-19T13:42:52.680 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:42:52.680 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T13:42:52.680 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:42:52.680 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-19T13:42:52.680 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.init 2024-09-19T13:42:54.595 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.init (1914 ms) 2024-09-19T13:42:54.595 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-19T13:42:54.621 INFO:tasks.workunit.client.0.smithi094.stderr:[ ] list info tag = chain-0 2024-09-19T13:42:54.621 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (26 ms) 2024-09-19T13:42:54.621 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-19T13:42:54.628 INFO:tasks.workunit.client.0.smithi094.stderr:[ ] next_marker is: = 0/4263 2024-09-19T13:42:54.628 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-09-19T13:42:54.628 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-19T13:42:54.639 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (11 ms) 2024-09-19T13:42:54.640 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-19T13:42:54.647 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (7 ms) 2024-09-19T13:42:54.647 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-19T13:42:54.658 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (12 ms) 2024-09-19T13:42:54.658 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-19T13:42:54.666 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-09-19T13:42:54.666 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-19T13:42:54.672 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-19T13:42:54.672 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-19T13:42:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_gc.finalize (938 ms) 2024-09-19T13:42:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from cls_rgw_gc (2930 ms total) 2024-09-19T13:42:55.611 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:42:55.611 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:42:55.611 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (2931 ms total) 2024-09-19T13:42:55.611 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-19T13:42:55.614 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:42:55.614 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:42:55.656 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-19T13:42:55.657 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-19T13:42:55.657 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-19T13:42:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:55.751 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 1 test from 1 test suite. 2024-09-19T13:42:55.751 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:42:57.620 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from cls_rgw_stats 2024-09-19T13:42:57.620 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-19T13:42:57.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.635+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=IOIQ37AP2J86 type=del size=3830400 2024-09-19T13:42:57.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.636+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=X8VLCH2TOF60 type=del size=1452255 2024-09-19T13:42:57.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.637+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=1AB1L46FEJ1W type=write size=1017269 2024-09-19T13:42:57.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.639+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=3VXCEW2M29JO type=del size=1847733 2024-09-19T13:42:57.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.640+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=5SCDGRXK8CX0 type=del size=535253 2024-09-19T13:42:57.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.642+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~N4KN1SWRFL1B.0 size=1048576 2024-09-19T13:42:57.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.643+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~N4KN1SWRFL1B.1 size=1048576 2024-09-19T13:42:57.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.644+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~N4KN1SWRFL1B.2 size=79663 2024-09-19T13:42:57.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.644+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=N4KN1SWRFL1B tag=DXGMW84L6LMU type=write size=3225391 2024-09-19T13:42:57.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.645+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=MOR3YJPERLPP type=write size=691077 2024-09-19T13:42:57.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.647+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=9515NJPG97GM type=del size=2780231 2024-09-19T13:42:57.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.649+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~A7Q1CCDUP7ZJ.0 size=1048576 2024-09-19T13:42:57.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.650+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~A7Q1CCDUP7ZJ.1 size=1048576 2024-09-19T13:42:57.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.651+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~A7Q1CCDUP7ZJ.2 size=719571 2024-09-19T13:42:57.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.651+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=A7Q1CCDUP7ZJ tag=3SVEHVVE4YPJ type=write size=3865299 2024-09-19T13:42:57.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.652+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=2ZKVUEK5Q5IK type=write size=264609 2024-09-19T13:42:57.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.654+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~3XCTZRG0VYLK.0 size=1048576 2024-09-19T13:42:57.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.655+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~3XCTZRG0VYLK.1 size=538404 2024-09-19T13:42:57.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.655+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=3XCTZRG0VYLK tag=0RU3B9ACPQ4X type=write size=2635556 2024-09-19T13:42:57.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.656+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=XBLLKYWL17OF type=del size=3850214 2024-09-19T13:42:57.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.658+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=830IXBW1TNID type=write size=299913 2024-09-19T13:42:57.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.659+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=3RWNET1XAWCH type=del size=699508 2024-09-19T13:42:57.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.661+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~CQ1CU0GB4L98.0 size=597940 2024-09-19T13:42:57.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.661+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=CQ1CU0GB4L98 tag=3CS5V9ZXNL4B type=write size=1646516 2024-09-19T13:42:57.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.663+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~6S552QC27CL9.0 size=1048576 2024-09-19T13:42:57.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.664+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~6S552QC27CL9.1 size=438733 2024-09-19T13:42:57.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.664+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=6S552QC27CL9 tag=FD7TPGIUE8JX type=write size=2535885 2024-09-19T13:42:57.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.665+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=IOIQ37AP2J86 type=del 2024-09-19T13:42:57.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.667+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=IJ821L0QU96E type=del size=730489 2024-09-19T13:42:57.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.668+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=X8VLCH2TOF60 type=del 2024-09-19T13:42:57.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.670+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~JJLXMHWSH411.0 size=635702 2024-09-19T13:42:57.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.670+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=JJLXMHWSH411 tag=J8UMMXE0A45A type=write size=1684278 2024-09-19T13:42:57.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.671+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=1AB1L46FEJ1W type=write size=1017269 2024-09-19T13:42:57.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.673+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~K4V9PP3O437U.0 size=1048576 2024-09-19T13:42:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.674+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~K4V9PP3O437U.1 size=581412 2024-09-19T13:42:57.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.674+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=K4V9PP3O437U tag=C9V1D9T9A1ET type=write size=2678564 2024-09-19T13:42:57.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.675+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=3VXCEW2M29JO type=del 2024-09-19T13:42:57.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.677+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=51AODTVQ6D5R type=del size=2415332 2024-09-19T13:42:57.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.678+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=5SCDGRXK8CX0 type=del 2024-09-19T13:42:57.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.680+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~0CTPVNCPNPP4.0 size=1048576 2024-09-19T13:42:57.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.681+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~0CTPVNCPNPP4.1 size=1048576 2024-09-19T13:42:57.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.682+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~0CTPVNCPNPP4.2 size=998651 2024-09-19T13:42:57.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.682+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=0CTPVNCPNPP4 tag=C657URTSRO41 type=write size=4144379 2024-09-19T13:42:57.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.683+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~N4KN1SWRFL1B.0 size=1048576 2024-09-19T13:42:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.684+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~N4KN1SWRFL1B.1 size=1048576 2024-09-19T13:42:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.685+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~N4KN1SWRFL1B.2 size=79663 2024-09-19T13:42:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.687+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=N4KN1SWRFL1B tag=DXGMW84L6LMU type=write size=3225391 2024-09-19T13:42:57.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.689+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~1YSQ1W3KJPYP.0 size=1048576 2024-09-19T13:42:57.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.690+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~1YSQ1W3KJPYP.1 size=1048576 2024-09-19T13:42:57.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.691+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~1YSQ1W3KJPYP.2 size=291834 2024-09-19T13:42:57.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.691+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=1YSQ1W3KJPYP tag=U1TZQFDB0A00 type=write size=3437562 2024-09-19T13:42:57.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.693+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=MOR3YJPERLPP type=write size=691077 2024-09-19T13:42:57.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.694+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=QIWXWUDPZJ5A type=del size=415114 2024-09-19T13:42:57.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.696+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=9515NJPG97GM type=del size=2780231 2024-09-19T13:42:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.698+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~RECCEXG0C6QU.0 size=1048576 2024-09-19T13:42:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.699+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~RECCEXG0C6QU.1 size=785346 2024-09-19T13:42:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.699+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=RECCEXG0C6QU tag=7136IKWS4YZE type=write size=2882498 2024-09-19T13:42:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.700+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~A7Q1CCDUP7ZJ.0 size=1048576 2024-09-19T13:42:57.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.701+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~A7Q1CCDUP7ZJ.1 size=1048576 2024-09-19T13:42:57.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.702+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~A7Q1CCDUP7ZJ.2 size=719571 2024-09-19T13:42:57.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.704+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=A7Q1CCDUP7ZJ tag=3SVEHVVE4YPJ type=write size=3865299 2024-09-19T13:42:57.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.705+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=ER6QUYSAPR03 type=del size=3251961 2024-09-19T13:42:57.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.707+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=2ZKVUEK5Q5IK type=write size=264609 2024-09-19T13:42:57.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.708+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=TQM6V3VQM9RV type=write size=37190 2024-09-19T13:42:57.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.709+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~3XCTZRG0VYLK.0 size=1048576 2024-09-19T13:42:57.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.710+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~3XCTZRG0VYLK.1 size=538404 2024-09-19T13:42:57.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.712+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=3XCTZRG0VYLK tag=0RU3B9ACPQ4X type=write size=2635556 2024-09-19T13:42:57.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.714+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~KDZZH4FBXQK6.0 size=571806 2024-09-19T13:42:57.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.714+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=KDZZH4FBXQK6 tag=5Y7WDMNEXHMR type=write size=1620382 2024-09-19T13:42:57.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.715+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=XBLLKYWL17OF type=del 2024-09-19T13:42:57.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.718+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~LHKQLIYB8ZZU.0 size=1048576 2024-09-19T13:42:57.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.718+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~LHKQLIYB8ZZU.1 size=1048576 2024-09-19T13:42:57.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.719+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~LHKQLIYB8ZZU.2 size=832282 2024-09-19T13:42:57.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.719+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=LHKQLIYB8ZZU tag=3BG3PRVOHXQK type=write size=3978010 2024-09-19T13:42:57.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.722+0000 7f6ab10d2780 1 < suggested update operation key=A14YTABJ1Z3Z tag=830IXBW1TNID type=write size=299913 2024-09-19T13:42:57.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.723+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=NL2P9COD1VXO type=write size=310798 2024-09-19T13:42:57.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.724+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=3RWNET1XAWCH type=del 2024-09-19T13:42:57.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.725+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=FFBKAZ9DKGS9 type=del size=4151590 2024-09-19T13:42:57.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.726+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~CQ1CU0GB4L98.0 size=597940 2024-09-19T13:42:57.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.728+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=CQ1CU0GB4L98 tag=3CS5V9ZXNL4B type=write size=1646516 2024-09-19T13:42:57.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.730+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=E753DI0TCNDQ type=write size=85696 2024-09-19T13:42:57.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.731+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~6S552QC27CL9.0 size=1048576 2024-09-19T13:42:57.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.732+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~6S552QC27CL9.1 size=438733 2024-09-19T13:42:57.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.734+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=6S552QC27CL9 tag=FD7TPGIUE8JX type=write size=2535885 2024-09-19T13:42:57.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.735+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=OLTD2LAESOTC type=write size=178036 2024-09-19T13:42:57.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.736+0000 7f6ab10d2780 1 < canceled operation key=B0J7E7A0NP4J tag=IJ821L0QU96E type=del size=730489 2024-09-19T13:42:57.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.737+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=L3L7OJ48JMYL type=del size=1279368 2024-09-19T13:42:57.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.738+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~JJLXMHWSH411.0 size=635702 2024-09-19T13:42:57.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.740+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=JJLXMHWSH411 tag=J8UMMXE0A45A type=write size=1684278 2024-09-19T13:42:57.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.742+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~ZA2K2IE4BKF8.0 size=1048576 2024-09-19T13:42:57.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.743+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~ZA2K2IE4BKF8.1 size=184991 2024-09-19T13:42:57.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.743+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=ZA2K2IE4BKF8 tag=15AVLVG1GEH5 type=write size=2282143 2024-09-19T13:42:57.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.745+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~K4V9PP3O437U.0 size=1048576 2024-09-19T13:42:57.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.745+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~K4V9PP3O437U.1 size=581412 2024-09-19T13:42:57.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.747+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=K4V9PP3O437U tag=C9V1D9T9A1ET type=write size=2678564 2024-09-19T13:42:57.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.749+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~FWTDOTE663SG.0 size=1048576 2024-09-19T13:42:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.750+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~FWTDOTE663SG.1 size=516406 2024-09-19T13:42:57.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.750+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=FWTDOTE663SG tag=NJDJP8H8DAL2 type=write size=2613558 2024-09-19T13:42:57.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.751+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=51AODTVQ6D5R type=del 2024-09-19T13:42:57.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.752+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=TRAKBAQITQZH type=del size=3176291 2024-09-19T13:42:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.755+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~0CTPVNCPNPP4.0 size=1048576 2024-09-19T13:42:57.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.756+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~0CTPVNCPNPP4.1 size=1048576 2024-09-19T13:42:57.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.756+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~0CTPVNCPNPP4.2 size=998651 2024-09-19T13:42:57.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.758+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=0CTPVNCPNPP4 tag=C657URTSRO41 type=write size=4144379 2024-09-19T13:42:57.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.760+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~0Z3T8GVOI4SF.0 size=218527 2024-09-19T13:42:57.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.760+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=0Z3T8GVOI4SF tag=00ITN1OWTWS2 type=write size=1267103 2024-09-19T13:42:57.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.762+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~1YSQ1W3KJPYP.0 size=1048576 2024-09-19T13:42:57.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.762+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~1YSQ1W3KJPYP.1 size=1048576 2024-09-19T13:42:57.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.764+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~1YSQ1W3KJPYP.2 size=291834 2024-09-19T13:42:57.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.766+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=1YSQ1W3KJPYP tag=U1TZQFDB0A00 type=write size=3437562 2024-09-19T13:42:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.768+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~84COULQO3PYB.0 size=1048576 2024-09-19T13:42:57.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.769+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~84COULQO3PYB.1 size=763998 2024-09-19T13:42:57.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.769+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=84COULQO3PYB tag=1QRYXZTERT3A type=write size=2861150 2024-09-19T13:42:57.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.770+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=QIWXWUDPZJ5A type=del 2024-09-19T13:42:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.772+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~ORDW4RV1GPDN.0 size=569400 2024-09-19T13:42:57.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.772+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=ORDW4RV1GPDN tag=AE9TGNHWQ1F5 type=write size=1617976 2024-09-19T13:42:57.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.773+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~RECCEXG0C6QU.0 size=1048576 2024-09-19T13:42:57.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.774+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~RECCEXG0C6QU.1 size=785346 2024-09-19T13:42:57.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.776+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=RECCEXG0C6QU tag=7136IKWS4YZE type=write size=2882498 2024-09-19T13:42:57.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.777+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=YO7HE4692SFQ type=write size=746488 2024-09-19T13:42:57.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.778+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=ER6QUYSAPR03 type=del 2024-09-19T13:42:57.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.780+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~78OD344F8S5I.0 size=298292 2024-09-19T13:42:57.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.780+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=78OD344F8S5I tag=K6R7Y1OI9N5O type=write size=1346868 2024-09-19T13:42:57.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.781+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=TQM6V3VQM9RV type=write size=37190 2024-09-19T13:42:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.783+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=UP14FVLJPKX8 type=del size=885928 2024-09-19T13:42:57.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.783+0000 7f6ab10d2780 1 < canceled part key=_multipart_PUXLW9NBBQJX.2~KDZZH4FBXQK6.0 size=571806 2024-09-19T13:42:57.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.785+0000 7f6ab10d2780 1 < canceled multipart upload key=PUXLW9NBBQJX upload=KDZZH4FBXQK6 tag=5Y7WDMNEXHMR type=write size=1620382 2024-09-19T13:42:57.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.786+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=0IYIOOX2LQEQ type=del size=34906 2024-09-19T13:42:57.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.787+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~LHKQLIYB8ZZU.0 size=1048576 2024-09-19T13:42:57.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.788+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~LHKQLIYB8ZZU.1 size=1048576 2024-09-19T13:42:57.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.789+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~LHKQLIYB8ZZU.2 size=832282 2024-09-19T13:42:57.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.791+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=LHKQLIYB8ZZU tag=3BG3PRVOHXQK type=write size=3978010 2024-09-19T13:42:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.793+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~IT3I04QPC1BT.0 size=1048576 2024-09-19T13:42:57.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.794+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~IT3I04QPC1BT.1 size=218959 2024-09-19T13:42:57.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.794+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=IT3I04QPC1BT tag=OF0M1BQ88VNY type=write size=2316111 2024-09-19T13:42:57.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.795+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=NL2P9COD1VXO type=write size=310798 2024-09-19T13:42:57.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.797+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~RV0EAHTSGZ15.0 size=1048576 2024-09-19T13:42:57.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.798+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~RV0EAHTSGZ15.1 size=138862 2024-09-19T13:42:57.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.798+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=RV0EAHTSGZ15 tag=TYO047731M46 type=write size=2236014 2024-09-19T13:42:57.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.799+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=FFBKAZ9DKGS9 type=del 2024-09-19T13:42:57.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.800+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=4ZHTNN6MSCJF type=del size=2567871 2024-09-19T13:42:57.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.801+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=E753DI0TCNDQ type=write size=85696 2024-09-19T13:42:57.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.802+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=55Q2MJUGPRYQ type=del size=3103028 2024-09-19T13:42:57.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.803+0000 7f6ab10d2780 1 < completed write operation key=A14YTABJ1Z3Z tag=OLTD2LAESOTC type=write size=178036 2024-09-19T13:42:57.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.805+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~L87AN1F0N792.0 size=963532 2024-09-19T13:42:57.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.805+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=L87AN1F0N792 tag=S1VW13FO5OJS type=write size=2012108 2024-09-19T13:42:57.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.806+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=L3L7OJ48JMYL type=del 2024-09-19T13:42:57.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.808+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=Z9VEB5ZVAKES type=del size=3267629 2024-09-19T13:42:57.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.809+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~ZA2K2IE4BKF8.0 size=1048576 2024-09-19T13:42:57.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.810+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~ZA2K2IE4BKF8.1 size=184991 2024-09-19T13:42:57.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.812+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=ZA2K2IE4BKF8 tag=15AVLVG1GEH5 type=write size=2282143 2024-09-19T13:42:57.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.813+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=LTT3T0NKPPMZ type=del size=3059635 2024-09-19T13:42:57.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.814+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~FWTDOTE663SG.0 size=1048576 2024-09-19T13:42:57.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.815+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~FWTDOTE663SG.1 size=516406 2024-09-19T13:42:57.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.817+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=FWTDOTE663SG tag=NJDJP8H8DAL2 type=write size=2613558 2024-09-19T13:42:57.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.818+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=GDJBZYWS260T type=del size=3178943 2024-09-19T13:42:57.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.820+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=TRAKBAQITQZH type=del 2024-09-19T13:42:57.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.821+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=S4LTR9VVYSB9 type=del size=63649 2024-09-19T13:42:57.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.822+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~0Z3T8GVOI4SF.0 size=218527 2024-09-19T13:42:57.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.824+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=0Z3T8GVOI4SF tag=00ITN1OWTWS2 type=write size=1267103 2024-09-19T13:42:57.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.825+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=MUCVM03LDCKR type=del size=4160433 2024-09-19T13:42:57.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.826+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~84COULQO3PYB.0 size=1048576 2024-09-19T13:42:57.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.826+0000 7f6ab10d2780 1 < canceled part key=_multipart_9Q9DGUSDSE49.2~84COULQO3PYB.1 size=763998 2024-09-19T13:42:57.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.828+0000 7f6ab10d2780 1 < canceled multipart upload key=9Q9DGUSDSE49 upload=84COULQO3PYB tag=1QRYXZTERT3A type=write size=2861150 2024-09-19T13:42:57.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.830+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~WTU4HUUAHK8Z.0 size=1048576 2024-09-19T13:42:57.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.831+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~WTU4HUUAHK8Z.1 size=383720 2024-09-19T13:42:57.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.831+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=WTU4HUUAHK8Z tag=8FAOE9M1LI7C type=write size=2480872 2024-09-19T13:42:57.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.832+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~ORDW4RV1GPDN.0 size=569400 2024-09-19T13:42:57.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.834+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=ORDW4RV1GPDN tag=AE9TGNHWQ1F5 type=write size=1617976 2024-09-19T13:42:57.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.836+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~IQ34QVCE0029.0 size=1048576 2024-09-19T13:42:57.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~IQ34QVCE0029.1 size=830056 2024-09-19T13:42:57.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.837+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=IQ34QVCE0029 tag=4S0HES82SSZC type=write size=2927208 2024-09-19T13:42:57.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.838+0000 7f6ab10d2780 1 < completed write operation key=4OSJA1879NQO tag=YO7HE4692SFQ type=write size=746488 2024-09-19T13:42:57.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.839+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=BVB46X3ND0HY type=del size=963234 2024-09-19T13:42:57.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.841+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~78OD344F8S5I.0 size=298292 2024-09-19T13:42:57.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.842+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=78OD344F8S5I tag=K6R7Y1OI9N5O type=write size=1346868 2024-09-19T13:42:57.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.844+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=F7293TT0OKF5 type=del size=2582546 2024-09-19T13:42:57.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.845+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=UP14FVLJPKX8 type=del 2024-09-19T13:42:57.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.846+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=FINOHV83M3RX type=del size=2064136 2024-09-19T13:42:57.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.847+0000 7f6ab10d2780 1 < canceled operation key=9WTLWBONAOET tag=0IYIOOX2LQEQ type=del size=34906 2024-09-19T13:42:57.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.849+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=PPQUEV69K342 type=write size=848635 2024-09-19T13:42:57.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.850+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~IT3I04QPC1BT.0 size=1048576 2024-09-19T13:42:57.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.851+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~IT3I04QPC1BT.1 size=218959 2024-09-19T13:42:57.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.852+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=IT3I04QPC1BT tag=OF0M1BQ88VNY type=write size=2316111 2024-09-19T13:42:57.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.854+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=7Q3M31VADXB2 type=del size=4057679 2024-09-19T13:42:57.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.855+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~RV0EAHTSGZ15.0 size=1048576 2024-09-19T13:42:57.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.855+0000 7f6ab10d2780 1 < canceled part key=_multipart_RU6OR8SM72GU.2~RV0EAHTSGZ15.1 size=138862 2024-09-19T13:42:57.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.857+0000 7f6ab10d2780 1 < canceled multipart upload key=RU6OR8SM72GU upload=RV0EAHTSGZ15 tag=TYO047731M46 type=write size=2236014 2024-09-19T13:42:57.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.859+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~A74PLL49J13O.0 size=1048576 2024-09-19T13:42:57.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.861+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~A74PLL49J13O.1 size=1048576 2024-09-19T13:42:57.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.862+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~A74PLL49J13O.2 size=799363 2024-09-19T13:42:57.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.862+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=A74PLL49J13O tag=R8X94CKNANP1 type=write size=3945091 2024-09-19T13:42:57.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.863+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=4ZHTNN6MSCJF type=del 2024-09-19T13:42:57.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.864+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=S3Q3T4YG1FBD type=del size=1927705 2024-09-19T13:42:57.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.865+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=55Q2MJUGPRYQ type=del 2024-09-19T13:42:57.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.867+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~QTS4DJKMV9JH.0 size=1048576 2024-09-19T13:42:57.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.868+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~QTS4DJKMV9JH.1 size=630179 2024-09-19T13:42:57.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.868+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=QTS4DJKMV9JH tag=VG8XAN6MRNUF type=write size=2727331 2024-09-19T13:42:57.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.869+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~L87AN1F0N792.0 size=963532 2024-09-19T13:42:57.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.871+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=L87AN1F0N792 tag=S1VW13FO5OJS type=write size=2012108 2024-09-19T13:42:57.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.872+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=0O0MWAB81OHG type=del size=1033067 2024-09-19T13:42:57.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.873+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=Z9VEB5ZVAKES type=del 2024-09-19T13:42:57.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.874+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=2N18UG6Y2CIF type=write size=251617 2024-09-19T13:42:57.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.876+0000 7f6ab10d2780 1 < suggested remove operation key=535R757HSXMB tag=LTT3T0NKPPMZ type=del 2024-09-19T13:42:57.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.877+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=25C9EE211CZI type=del size=3763218 2024-09-19T13:42:57.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.879+0000 7f6ab10d2780 1 < suggested update operation key=QTGKMAOX2A6U tag=GDJBZYWS260T type=del size=3178943 2024-09-19T13:42:57.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.882+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~Z5Z05IYHD0EK.0 size=1048576 2024-09-19T13:42:57.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.882+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~Z5Z05IYHD0EK.1 size=321124 2024-09-19T13:42:57.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.882+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=Z5Z05IYHD0EK tag=SOGYGKJUMYV1 type=write size=2418276 2024-09-19T13:42:57.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.884+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=S4LTR9VVYSB9 type=del 2024-09-19T13:42:57.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.885+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=332CD6S7YWDI type=del size=1627308 2024-09-19T13:42:57.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.886+0000 7f6ab10d2780 1 < canceled operation key=RXXCDV0LTCKS tag=MUCVM03LDCKR type=del size=4160433 2024-09-19T13:42:57.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.887+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=FRFT8HR5Q22N type=del size=1536570 2024-09-19T13:42:57.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.888+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~WTU4HUUAHK8Z.0 size=1048576 2024-09-19T13:42:57.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.889+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~WTU4HUUAHK8Z.1 size=383720 2024-09-19T13:42:57.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.891+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=WTU4HUUAHK8Z tag=8FAOE9M1LI7C type=write size=2480872 2024-09-19T13:42:57.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.892+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=VZ348Z6OFJ7N type=del size=2895964 2024-09-19T13:42:57.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.893+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~IQ34QVCE0029.0 size=1048576 2024-09-19T13:42:57.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.894+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~IQ34QVCE0029.1 size=830056 2024-09-19T13:42:57.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.896+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=IQ34QVCE0029 tag=4S0HES82SSZC type=write size=2927208 2024-09-19T13:42:57.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.898+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~95OPPZWP42XC.0 size=11183 2024-09-19T13:42:57.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.898+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=95OPPZWP42XC tag=3I6ZZA2523Y2 type=write size=1059759 2024-09-19T13:42:57.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.900+0000 7f6ab10d2780 1 < suggested remove operation key=TCXAYADSCTZI tag=BVB46X3ND0HY type=del 2024-09-19T13:42:57.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.901+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=U1NN3VGAEQLF type=del size=349631 2024-09-19T13:42:57.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.903+0000 7f6ab10d2780 1 < suggested remove operation key=9IN6E0JQFNAU tag=F7293TT0OKF5 type=del 2024-09-19T13:42:57.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.904+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=DX6UF7B574Y9 type=del size=3425394 2024-09-19T13:42:57.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.905+0000 7f6ab10d2780 1 < canceled operation key=RU6OR8SM72GU tag=FINOHV83M3RX type=del size=2064136 2024-09-19T13:42:57.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.906+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=0DIUBF097UYE type=del size=541423 2024-09-19T13:42:57.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.909+0000 7f6ab10d2780 1 < suggested remove operation key=A14YTABJ1Z3Z tag=PPQUEV69K342 type=write 2024-09-19T13:42:57.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.910+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=TOZ3XU4809L2 type=del size=1501650 2024-09-19T13:42:57.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.911+0000 7f6ab10d2780 -1 < failed to complete operation key=9IN6E0JQFNAU tag=7Q3M31VADXB2 type=del size=4057679: (22) Invalid argument 2024-09-19T13:42:57.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.914+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~A9KF7ORJXG3J.0 size=1048576 2024-09-19T13:42:57.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.915+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~A9KF7ORJXG3J.1 size=431236 2024-09-19T13:42:57.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.915+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=A9KF7ORJXG3J tag=8BOJSO0I3XR4 type=write size=2528388 2024-09-19T13:42:57.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.916+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~A74PLL49J13O.0 size=1048576 2024-09-19T13:42:57.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.917+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~A74PLL49J13O.1 size=1048576 2024-09-19T13:42:57.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.918+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~A74PLL49J13O.2 size=799363 2024-09-19T13:42:57.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.920+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=A74PLL49J13O tag=R8X94CKNANP1 type=write size=3945091 2024-09-19T13:42:57.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.922+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~H64JTIUNN6VK.0 size=1048576 2024-09-19T13:42:57.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.922+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~H64JTIUNN6VK.1 size=1048576 2024-09-19T13:42:57.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.923+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~H64JTIUNN6VK.2 size=786240 2024-09-19T13:42:57.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.923+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=H64JTIUNN6VK tag=RTIW1N8VGIRF type=write size=3931968 2024-09-19T13:42:57.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.924+0000 7f6ab10d2780 1 < canceled operation key=DTSRVH526PE7 tag=S3Q3T4YG1FBD type=del size=1927705 2024-09-19T13:42:57.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.927+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~JIIP75Q9JE2I.0 size=1021092 2024-09-19T13:42:57.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.927+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=JIIP75Q9JE2I tag=LBOBORYKBWIW type=write size=2069668 2024-09-19T13:42:57.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.928+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~QTS4DJKMV9JH.0 size=1048576 2024-09-19T13:42:57.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.929+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~QTS4DJKMV9JH.1 size=630179 2024-09-19T13:42:57.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.931+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=QTS4DJKMV9JH tag=VG8XAN6MRNUF type=write size=2727331 2024-09-19T13:42:57.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.932+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=TITXUOFQKXVO type=write size=273300 2024-09-19T13:42:57.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.933+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=0O0MWAB81OHG type=del 2024-09-19T13:42:57.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.935+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~NUI9LJS22WN4.0 size=234707 2024-09-19T13:42:57.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.935+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=NUI9LJS22WN4 tag=OQG2MTWDVDA0 type=write size=1283283 2024-09-19T13:42:57.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.937+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=2N18UG6Y2CIF type=write 2024-09-19T13:42:57.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.939+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~FLLJY7Q2G3C1.0 size=868133 2024-09-19T13:42:57.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.939+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=FLLJY7Q2G3C1 tag=H6VK2D6VUYCN type=write size=1916709 2024-09-19T13:42:57.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.940+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=25C9EE211CZI type=del 2024-09-19T13:42:57.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.942+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~C4UMKMMXNR3A.0 size=1048576 2024-09-19T13:42:57.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.943+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~C4UMKMMXNR3A.1 size=1048576 2024-09-19T13:42:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.944+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~C4UMKMMXNR3A.2 size=110872 2024-09-19T13:42:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.944+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=C4UMKMMXNR3A tag=Y9Z0CJUVSX0D type=write size=3256600 2024-09-19T13:42:57.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.944+0000 7f6ab10d2780 1 < canceled part key=_multipart_2KX2NSY41STV.2~Z5Z05IYHD0EK.0 size=1048576 2024-09-19T13:42:57.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.945+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~Z5Z05IYHD0EK.1 size=321124 2024-09-19T13:42:57.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.947+0000 7f6ab10d2780 1 < canceled multipart upload key=2KX2NSY41STV upload=Z5Z05IYHD0EK tag=SOGYGKJUMYV1 type=write size=2418276 2024-09-19T13:42:57.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.948+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=QQJMQDCPWJFO type=del size=1582651 2024-09-19T13:42:57.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.950+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=332CD6S7YWDI type=del 2024-09-19T13:42:57.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.952+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~31NRP8NWWB9U.0 size=1048576 2024-09-19T13:42:57.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.952+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~31NRP8NWWB9U.1 size=951164 2024-09-19T13:42:57.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.952+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=31NRP8NWWB9U tag=HFC9FRAY24W2 type=write size=3048316 2024-09-19T13:42:57.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.953+0000 7f6ab10d2780 -1 < failed to complete operation key=9IN6E0JQFNAU tag=FRFT8HR5Q22N type=del size=1536570: (22) Invalid argument 2024-09-19T13:42:57.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.955+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=JNJSLQ1KSLZC type=write size=130481 2024-09-19T13:42:57.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.956+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=VZ348Z6OFJ7N type=del 2024-09-19T13:42:57.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.958+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UODHUWDG8050.0 size=1048576 2024-09-19T13:42:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.959+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UODHUWDG8050.1 size=207228 2024-09-19T13:42:57.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.959+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=UODHUWDG8050 tag=J87Z7O1E6Z2Y type=write size=2304380 2024-09-19T13:42:57.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.960+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~95OPPZWP42XC.0 size=11183 2024-09-19T13:42:57.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.962+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=95OPPZWP42XC tag=3I6ZZA2523Y2 type=write size=1059759 2024-09-19T13:42:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.964+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~E1CEFYN3RE6W.0 size=809909 2024-09-19T13:42:57.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.964+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=E1CEFYN3RE6W tag=GT6GX4ZW338M type=write size=1858485 2024-09-19T13:42:57.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.966+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=U1NN3VGAEQLF type=del 2024-09-19T13:42:57.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.967+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=4YCJ1JADE2PQ type=write size=82026 2024-09-19T13:42:57.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.968+0000 7f6ab10d2780 1 < canceled operation key=2KX2NSY41STV tag=DX6UF7B574Y9 type=del size=3425394 2024-09-19T13:42:57.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.971+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~QQ3D5CUBQ6ZD.0 size=1048576 2024-09-19T13:42:57.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.972+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~QQ3D5CUBQ6ZD.1 size=597712 2024-09-19T13:42:57.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.972+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=QQ3D5CUBQ6ZD tag=KP05IWPYIK36 type=write size=2694864 2024-09-19T13:42:57.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.973+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=0DIUBF097UYE type=del 2024-09-19T13:42:57.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.975+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~BH8202JGK8O4.0 size=1048576 2024-09-19T13:42:57.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.976+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~BH8202JGK8O4.1 size=578327 2024-09-19T13:42:57.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.976+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=BH8202JGK8O4 tag=U4NXG99C9PL2 type=write size=2675479 2024-09-19T13:42:57.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.977+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=TOZ3XU4809L2 type=del 2024-09-19T13:42:57.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.978+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=J49X2E31J3EI type=write size=110302 2024-09-19T13:42:57.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.979+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~A9KF7ORJXG3J.0 size=1048576 2024-09-19T13:42:57.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.980+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~A9KF7ORJXG3J.1 size=431236 2024-09-19T13:42:57.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.982+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=A9KF7ORJXG3J tag=8BOJSO0I3XR4 type=write size=2528388 2024-09-19T13:42:57.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.984+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=38OB3KN4CU2B type=del size=3183872 2024-09-19T13:42:57.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.985+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~H64JTIUNN6VK.0 size=1048576 2024-09-19T13:42:57.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.986+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~H64JTIUNN6VK.1 size=1048576 2024-09-19T13:42:57.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.987+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~H64JTIUNN6VK.2 size=786240 2024-09-19T13:42:57.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.989+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=H64JTIUNN6VK tag=RTIW1N8VGIRF type=write size=3931968 2024-09-19T13:42:57.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.990+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=9DOT8ECZQYNP type=write size=626940 2024-09-19T13:42:57.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.991+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~JIIP75Q9JE2I.0 size=1021092 2024-09-19T13:42:57.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.993+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=JIIP75Q9JE2I tag=LBOBORYKBWIW type=write size=2069668 2024-09-19T13:42:57.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.995+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~3C5JKHF54BED.0 size=1048576 2024-09-19T13:42:57.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.996+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~3C5JKHF54BED.1 size=930103 2024-09-19T13:42:57.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.996+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=3C5JKHF54BED tag=P6EGW5C898A1 type=write size=3027255 2024-09-19T13:42:57.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.998+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=TITXUOFQKXVO type=write size=273300 2024-09-19T13:42:58.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:57.999+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=99NGUWBN2LZY type=del size=3323673 2024-09-19T13:42:58.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.000+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~NUI9LJS22WN4.0 size=234707 2024-09-19T13:42:58.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.002+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=NUI9LJS22WN4 tag=OQG2MTWDVDA0 type=write size=1283283 2024-09-19T13:42:58.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.003+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=XZ373WRURIZ0 type=del size=3641443 2024-09-19T13:42:58.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.004+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~FLLJY7Q2G3C1.0 size=868133 2024-09-19T13:42:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.006+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=FLLJY7Q2G3C1 tag=H6VK2D6VUYCN type=write size=1916709 2024-09-19T13:42:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.007+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=3EL6GHEZU0KB type=del size=142557 2024-09-19T13:42:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.008+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~C4UMKMMXNR3A.0 size=1048576 2024-09-19T13:42:58.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.009+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~C4UMKMMXNR3A.1 size=1048576 2024-09-19T13:42:58.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.010+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~C4UMKMMXNR3A.2 size=110872 2024-09-19T13:42:58.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.012+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=C4UMKMMXNR3A tag=Y9Z0CJUVSX0D type=write size=3256600 2024-09-19T13:42:58.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.013+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=NH377DY8P8EE type=write size=194998 2024-09-19T13:42:58.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.014+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=QQJMQDCPWJFO type=del 2024-09-19T13:42:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.015+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=BELZOOIVL725 type=del size=2209780 2024-09-19T13:42:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.016+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~31NRP8NWWB9U.0 size=1048576 2024-09-19T13:42:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.016+0000 7f6ab10d2780 1 < canceled part key=_multipart_WDRUV5ERI000.2~31NRP8NWWB9U.1 size=951164 2024-09-19T13:42:58.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.018+0000 7f6ab10d2780 1 < canceled multipart upload key=WDRUV5ERI000 upload=31NRP8NWWB9U tag=HFC9FRAY24W2 type=write size=3048316 2024-09-19T13:42:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.019+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=POO64T3ID0TZ type=del size=4058488 2024-09-19T13:42:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.020+0000 7f6ab10d2780 1 < canceled operation key=TCXAYADSCTZI tag=JNJSLQ1KSLZC type=write size=130481 2024-09-19T13:42:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.021+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=LIJY8Y7NM8F3 type=del size=2659862 2024-09-19T13:42:58.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.022+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UODHUWDG8050.0 size=1048576 2024-09-19T13:42:58.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.023+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UODHUWDG8050.1 size=207228 2024-09-19T13:42:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.025+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=UODHUWDG8050 tag=J87Z7O1E6Z2Y type=write size=2304380 2024-09-19T13:42:58.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.026+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=JAKHDIBZB7RO type=del size=3179636 2024-09-19T13:42:58.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.027+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~E1CEFYN3RE6W.0 size=809909 2024-09-19T13:42:58.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.029+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=E1CEFYN3RE6W tag=GT6GX4ZW338M type=write size=1858485 2024-09-19T13:42:58.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.031+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=3Q43KIKJVNWP type=del size=3522474 2024-09-19T13:42:58.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.032+0000 7f6ab10d2780 1 < completed write operation key=RU6OR8SM72GU tag=4YCJ1JADE2PQ type=write size=82026 2024-09-19T13:42:58.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.033+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=OFY0XEZER2QP type=del size=2245915 2024-09-19T13:42:58.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.033+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~QQ3D5CUBQ6ZD.0 size=1048576 2024-09-19T13:42:58.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.034+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~QQ3D5CUBQ6ZD.1 size=597712 2024-09-19T13:42:58.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.036+0000 7f6ab10d2780 1 < canceled multipart upload key=9MCE8PXHBGNF upload=QQ3D5CUBQ6ZD tag=KP05IWPYIK36 type=write size=2694864 2024-09-19T13:42:58.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.038+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~4U5RPXOW1UDX.0 size=612906 2024-09-19T13:42:58.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.038+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=4U5RPXOW1UDX tag=8UIIZ102E6XF type=write size=1661482 2024-09-19T13:42:58.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.039+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~BH8202JGK8O4.0 size=1048576 2024-09-19T13:42:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.040+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~BH8202JGK8O4.1 size=578327 2024-09-19T13:42:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.042+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=BH8202JGK8O4 tag=U4NXG99C9PL2 type=write size=2675479 2024-09-19T13:42:58.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.043+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=9USU8RYHH6UM type=del size=368923 2024-09-19T13:42:58.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.044+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=J49X2E31J3EI type=write size=110302 2024-09-19T13:42:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.046+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FFMJE1FUJ442.0 size=675110 2024-09-19T13:42:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.046+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=FFMJE1FUJ442 tag=44XDXLEWYC66 type=write size=1723686 2024-09-19T13:42:58.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.048+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=38OB3KN4CU2B type=del 2024-09-19T13:42:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.050+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~CSQR2MGMTHA9.0 size=1048576 2024-09-19T13:42:58.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.051+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~CSQR2MGMTHA9.1 size=1048576 2024-09-19T13:42:58.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.051+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~CSQR2MGMTHA9.2 size=544619 2024-09-19T13:42:58.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.051+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=CSQR2MGMTHA9 tag=P7UPZLV2LKU7 type=write size=3690347 2024-09-19T13:42:58.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.053+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=9DOT8ECZQYNP type=write size=626940 2024-09-19T13:42:58.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.055+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~C27ED55ZFYAT.0 size=1048576 2024-09-19T13:42:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.056+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~C27ED55ZFYAT.1 size=826544 2024-09-19T13:42:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.056+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=C27ED55ZFYAT tag=OLBCXGV8RQ99 type=write size=2923696 2024-09-19T13:42:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.057+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~3C5JKHF54BED.0 size=1048576 2024-09-19T13:42:58.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.058+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~3C5JKHF54BED.1 size=930103 2024-09-19T13:42:58.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.060+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=3C5JKHF54BED tag=P6EGW5C898A1 type=write size=3027255 2024-09-19T13:42:58.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.061+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=YKIMGRD4F0FF type=del size=1792322 2024-09-19T13:42:58.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.062+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=99NGUWBN2LZY type=del 2024-09-19T13:42:58.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.063+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=92SNEDM77TU3 type=del size=3825951 2024-09-19T13:42:58.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.064+0000 7f6ab10d2780 1 < canceled operation key=9IN6E0JQFNAU tag=XZ373WRURIZ0 type=del size=3641443 2024-09-19T13:42:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.066+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=XOMOQ4SR9F0V type=del size=3075903 2024-09-19T13:42:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.067+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=3EL6GHEZU0KB type=del 2024-09-19T13:42:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.069+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~GCQO9NQT2382.0 size=438291 2024-09-19T13:42:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.069+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=GCQO9NQT2382 tag=E6AO4PZ8GD8P type=write size=1486867 2024-09-19T13:42:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.070+0000 7f6ab10d2780 1 < completed write operation key=RU6OR8SM72GU tag=NH377DY8P8EE type=write size=194998 2024-09-19T13:42:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.071+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=662NUY72NN68 type=del size=1615328 2024-09-19T13:42:58.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.074+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=BELZOOIVL725 type=del size=2209780 2024-09-19T13:42:58.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.076+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~P2AAFJI8S240.0 size=1048576 2024-09-19T13:42:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.077+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~P2AAFJI8S240.1 size=1048576 2024-09-19T13:42:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.078+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~P2AAFJI8S240.2 size=59666 2024-09-19T13:42:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.078+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=P2AAFJI8S240 tag=UAS19SJE83HU type=write size=3205394 2024-09-19T13:42:58.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.080+0000 7f6ab10d2780 1 < suggested remove operation key=4OSJA1879NQO tag=POO64T3ID0TZ type=del 2024-09-19T13:42:58.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.082+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~85BIR6T6RC6G.0 size=1048576 2024-09-19T13:42:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.083+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~85BIR6T6RC6G.1 size=1048576 2024-09-19T13:42:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.084+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~85BIR6T6RC6G.2 size=627441 2024-09-19T13:42:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.084+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=85BIR6T6RC6G tag=MSRD4K6YU5V2 type=write size=3773169 2024-09-19T13:42:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.085+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=LIJY8Y7NM8F3 type=del 2024-09-19T13:42:58.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.086+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=FBCQVDHYBA7I type=del size=441725 2024-09-19T13:42:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.087+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=JAKHDIBZB7RO type=del 2024-09-19T13:42:58.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.088+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=1XJDRQGOWUGA type=del size=3573806 2024-09-19T13:42:58.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.089+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=3Q43KIKJVNWP type=del 2024-09-19T13:42:58.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.090+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=A1GCHGPNB5VO type=write size=535240 2024-09-19T13:42:58.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.091+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=OFY0XEZER2QP type=del 2024-09-19T13:42:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.092+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=7YE54SE144RR type=del size=1842854 2024-09-19T13:42:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.093+0000 7f6ab10d2780 1 < canceled part key=_multipart_A14YTABJ1Z3Z.2~4U5RPXOW1UDX.0 size=612906 2024-09-19T13:42:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.094+0000 7f6ab10d2780 1 < canceled multipart upload key=A14YTABJ1Z3Z upload=4U5RPXOW1UDX tag=8UIIZ102E6XF type=write size=1661482 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.095+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=6VG1OKC6OPSB type=del size=445408 2024-09-19T13:42:58.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.096+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=9USU8RYHH6UM type=del 2024-09-19T13:42:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.099+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~ICAI9UWNBK3F.0 size=215419 2024-09-19T13:42:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.099+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=ICAI9UWNBK3F tag=8CCFFT1KE30T type=write size=1263995 2024-09-19T13:42:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.099+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~FFMJE1FUJ442.0 size=675110 2024-09-19T13:42:58.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.101+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=FFMJE1FUJ442 tag=44XDXLEWYC66 type=write size=1723686 2024-09-19T13:42:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.103+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~TXJ4DING7DWO.0 size=198440 2024-09-19T13:42:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.103+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=TXJ4DING7DWO tag=Y80QGEP00XW8 type=write size=1247016 2024-09-19T13:42:58.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.104+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~CSQR2MGMTHA9.0 size=1048576 2024-09-19T13:42:58.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.105+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~CSQR2MGMTHA9.1 size=1048576 2024-09-19T13:42:58.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.105+0000 7f6ab10d2780 1 < canceled part key=_multipart_9IN6E0JQFNAU.2~CSQR2MGMTHA9.2 size=544619 2024-09-19T13:42:58.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.107+0000 7f6ab10d2780 1 < canceled multipart upload key=9IN6E0JQFNAU upload=CSQR2MGMTHA9 tag=P7UPZLV2LKU7 type=write size=3690347 2024-09-19T13:42:58.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.108+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=UC629DXI6K6X type=del size=3195365 2024-09-19T13:42:58.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.109+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~C27ED55ZFYAT.0 size=1048576 2024-09-19T13:42:58.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.110+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~C27ED55ZFYAT.1 size=826544 2024-09-19T13:42:58.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.112+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=C27ED55ZFYAT tag=OLBCXGV8RQ99 type=write size=2923696 2024-09-19T13:42:58.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.113+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=B6MM1XQPI20I type=write size=303885 2024-09-19T13:42:58.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.114+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=YKIMGRD4F0FF type=del 2024-09-19T13:42:58.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.115+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=KNX7KOYYZUAU type=del size=4117328 2024-09-19T13:42:58.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.116+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=92SNEDM77TU3 type=del 2024-09-19T13:42:58.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.118+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=DZCFHANYZ6IY type=del size=2371753 2024-09-19T13:42:58.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.120+0000 7f6ab10d2780 1 < suggested remove operation key=WDRUV5ERI000 tag=XOMOQ4SR9F0V type=del 2024-09-19T13:42:58.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.121+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=OKKOWZY4JFZR type=write size=643877 2024-09-19T13:42:58.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.121+0000 7f6ab10d2780 1 < canceled part key=_multipart_RU6OR8SM72GU.2~GCQO9NQT2382.0 size=438291 2024-09-19T13:42:58.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.123+0000 7f6ab10d2780 1 < canceled multipart upload key=RU6OR8SM72GU upload=GCQO9NQT2382 tag=E6AO4PZ8GD8P type=write size=1486867 2024-09-19T13:42:58.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.124+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=NKUMCCP1WYCZ type=write size=133811 2024-09-19T13:42:58.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.126+0000 7f6ab10d2780 1 < suggested update operation key=PUXLW9NBBQJX tag=662NUY72NN68 type=del size=1615328 2024-09-19T13:42:58.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.127+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=YQ35ABCKJ77F type=del size=2321707 2024-09-19T13:42:58.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.128+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~P2AAFJI8S240.0 size=1048576 2024-09-19T13:42:58.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.129+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~P2AAFJI8S240.1 size=1048576 2024-09-19T13:42:58.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.130+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~P2AAFJI8S240.2 size=59666 2024-09-19T13:42:58.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.132+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=P2AAFJI8S240 tag=UAS19SJE83HU type=write size=3205394 2024-09-19T13:42:58.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.134+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~KDOUFIU4LDU2.0 size=1048576 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.135+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~KDOUFIU4LDU2.1 size=813015 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.135+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=KDOUFIU4LDU2 tag=JXVMWEC4QCZP type=write size=2910167 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.136+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~85BIR6T6RC6G.0 size=1048576 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.137+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~85BIR6T6RC6G.1 size=1048576 2024-09-19T13:42:58.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.137+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~85BIR6T6RC6G.2 size=627441 2024-09-19T13:42:58.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.139+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=85BIR6T6RC6G tag=MSRD4K6YU5V2 type=write size=3773169 2024-09-19T13:42:58.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.140+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=5FDTLIUNMTSN type=write size=999855 2024-09-19T13:42:58.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.141+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=FBCQVDHYBA7I type=del 2024-09-19T13:42:58.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.143+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=34W6RH3VH2FC type=del size=1867208 2024-09-19T13:42:58.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.144+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=1XJDRQGOWUGA type=del 2024-09-19T13:42:58.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.146+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~NLW6IM4CVRFH.0 size=1048576 2024-09-19T13:42:58.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.147+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~NLW6IM4CVRFH.1 size=1048576 2024-09-19T13:42:58.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.148+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~NLW6IM4CVRFH.2 size=510131 2024-09-19T13:42:58.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.148+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=NLW6IM4CVRFH tag=H3IMPCMKH6YC type=write size=3655859 2024-09-19T13:42:58.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.149+0000 7f6ab10d2780 1 < completed write operation key=B0J7E7A0NP4J tag=A1GCHGPNB5VO type=write size=535240 2024-09-19T13:42:58.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.151+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~BMMCPLDN41JD.0 size=1048576 2024-09-19T13:42:58.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.152+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~BMMCPLDN41JD.1 size=392480 2024-09-19T13:42:58.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.152+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=BMMCPLDN41JD tag=H7X2F76E77VI type=write size=2489632 2024-09-19T13:42:58.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.153+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=7YE54SE144RR type=del 2024-09-19T13:42:58.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.154+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=Z0YH4XDQNLDI type=del size=1564888 2024-09-19T13:42:58.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.156+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=6VG1OKC6OPSB type=del 2024-09-19T13:42:58.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.157+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=AQYW0TY96RFA type=del size=1245396 2024-09-19T13:42:58.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.158+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~ICAI9UWNBK3F.0 size=215419 2024-09-19T13:42:58.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.160+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=ICAI9UWNBK3F tag=8CCFFT1KE30T type=write size=1263995 2024-09-19T13:42:58.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.162+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~12Y0ETT7K6TO.0 size=1048576 2024-09-19T13:42:58.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.163+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~12Y0ETT7K6TO.1 size=205709 2024-09-19T13:42:58.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.163+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=12Y0ETT7K6TO tag=5ZUSF6DS9HBY type=write size=2302861 2024-09-19T13:42:58.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.165+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~TXJ4DING7DWO.0 size=198440 2024-09-19T13:42:58.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.167+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=TXJ4DING7DWO tag=Y80QGEP00XW8 type=write size=1247016 2024-09-19T13:42:58.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.168+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=LEP974HFHFB0 type=write size=504292 2024-09-19T13:42:58.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.169+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=UC629DXI6K6X type=del 2024-09-19T13:42:58.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.171+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~QT3AC6XGB7HZ.0 size=1048576 2024-09-19T13:42:58.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.172+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~QT3AC6XGB7HZ.1 size=341435 2024-09-19T13:42:58.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.172+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=QT3AC6XGB7HZ tag=WGD114HS2PU3 type=write size=2438587 2024-09-19T13:42:58.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.173+0000 7f6ab10d2780 1 < completed write operation key=DF003ORZ1HOM tag=B6MM1XQPI20I type=write size=303885 2024-09-19T13:42:58.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.175+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~LMZ4NB1MZS58.0 size=247768 2024-09-19T13:42:58.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.175+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=LMZ4NB1MZS58 tag=GPPJYTX0POU4 type=write size=1296344 2024-09-19T13:42:58.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.176+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=KNX7KOYYZUAU type=del 2024-09-19T13:42:58.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.178+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=BILBKH2JRRWW type=write size=602190 2024-09-19T13:42:58.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.180+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=DZCFHANYZ6IY type=del 2024-09-19T13:42:58.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.181+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=PKW850W4IRFW type=del size=2105346 2024-09-19T13:42:58.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.182+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=OKKOWZY4JFZR type=write size=643877 2024-09-19T13:42:58.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.183+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=YL84020O8MLU type=del size=582592 2024-09-19T13:42:58.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.184+0000 7f6ab10d2780 1 < completed write operation key=XQLWZA2X91GF tag=NKUMCCP1WYCZ type=write size=133811 2024-09-19T13:42:58.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.186+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=82XPQDGGNMSV type=del size=3547734 2024-09-19T13:42:58.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.187+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=YQ35ABCKJ77F type=del 2024-09-19T13:42:58.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.189+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~XD44YB6Y99F3.0 size=1048576 2024-09-19T13:42:58.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.190+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~XD44YB6Y99F3.1 size=1048576 2024-09-19T13:42:58.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.191+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~XD44YB6Y99F3.2 size=168208 2024-09-19T13:42:58.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.191+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=XD44YB6Y99F3 tag=GT109YSY9NAL type=write size=3313936 2024-09-19T13:42:58.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.192+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~KDOUFIU4LDU2.0 size=1048576 2024-09-19T13:42:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.193+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~KDOUFIU4LDU2.1 size=813015 2024-09-19T13:42:58.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.195+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=KDOUFIU4LDU2 tag=JXVMWEC4QCZP type=write size=2910167 2024-09-19T13:42:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.196+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=1U1UAHKM4H2M type=del size=608329 2024-09-19T13:42:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.197+0000 7f6ab10d2780 1 < completed write operation key=13GXIDWI4J9F tag=5FDTLIUNMTSN type=write size=999855 2024-09-19T13:42:58.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.199+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=2EBCOCBGHWD1 type=del size=293582 2024-09-19T13:42:58.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.201+0000 7f6ab10d2780 1 < suggested update operation key=9MCE8PXHBGNF tag=34W6RH3VH2FC type=del size=1867208 2024-09-19T13:42:58.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.202+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=SAMBY9M4LKTG type=del size=4147745 2024-09-19T13:42:58.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.203+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~NLW6IM4CVRFH.0 size=1048576 2024-09-19T13:42:58.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.204+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~NLW6IM4CVRFH.1 size=1048576 2024-09-19T13:42:58.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.205+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~NLW6IM4CVRFH.2 size=510131 2024-09-19T13:42:58.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.207+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=NLW6IM4CVRFH tag=H3IMPCMKH6YC type=write size=3655859 2024-09-19T13:42:58.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.208+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=QMOAI5X24CVB type=write size=1011921 2024-09-19T13:42:58.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.209+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~BMMCPLDN41JD.0 size=1048576 2024-09-19T13:42:58.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.210+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~BMMCPLDN41JD.1 size=392480 2024-09-19T13:42:58.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.212+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=BMMCPLDN41JD tag=H7X2F76E77VI type=write size=2489632 2024-09-19T13:42:58.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.214+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~TA6Z9RO3IPJT.0 size=665419 2024-09-19T13:42:58.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.214+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=TA6Z9RO3IPJT tag=OT4G7CBLXNRP type=write size=1713995 2024-09-19T13:42:58.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.215+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=Z0YH4XDQNLDI type=del 2024-09-19T13:42:58.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.216+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=03HNPRG28CJZ type=del size=842559 2024-09-19T13:42:58.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.218+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=AQYW0TY96RFA type=del 2024-09-19T13:42:58.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.219+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=0TGL2EF08C6P type=write size=618748 2024-09-19T13:42:58.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.220+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~12Y0ETT7K6TO.0 size=1048576 2024-09-19T13:42:58.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.221+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~12Y0ETT7K6TO.1 size=205709 2024-09-19T13:42:58.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.223+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=12Y0ETT7K6TO tag=5ZUSF6DS9HBY type=write size=2302861 2024-09-19T13:42:58.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.225+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~564D2QRHCLG6.0 size=1048576 2024-09-19T13:42:58.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.226+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~564D2QRHCLG6.1 size=1048576 2024-09-19T13:42:58.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.226+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~564D2QRHCLG6.2 size=571893 2024-09-19T13:42:58.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.226+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=564D2QRHCLG6 tag=UNG029OQUG1P type=write size=3717621 2024-09-19T13:42:58.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.228+0000 7f6ab10d2780 1 < completed write operation key=13GXIDWI4J9F tag=LEP974HFHFB0 type=write size=504292 2024-09-19T13:42:58.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.229+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=NZX8KFF9YF9R type=del size=150592 2024-09-19T13:42:58.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.230+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~QT3AC6XGB7HZ.0 size=1048576 2024-09-19T13:42:58.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.231+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~QT3AC6XGB7HZ.1 size=341435 2024-09-19T13:42:58.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.233+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=QT3AC6XGB7HZ tag=WGD114HS2PU3 type=write size=2438587 2024-09-19T13:42:58.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.234+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=GSDIY6DG723T type=del size=660793 2024-09-19T13:42:58.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.235+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~LMZ4NB1MZS58.0 size=247768 2024-09-19T13:42:58.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.237+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=LMZ4NB1MZS58 tag=GPPJYTX0POU4 type=write size=1296344 2024-09-19T13:42:58.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.238+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=7SBD59T9RU6V type=del size=1451347 2024-09-19T13:42:58.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.239+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=BILBKH2JRRWW type=write size=602190 2024-09-19T13:42:58.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.240+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=4YTD1WPAEJHK type=del size=2203112 2024-09-19T13:42:58.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.242+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=PKW850W4IRFW type=del 2024-09-19T13:42:58.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.243+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=FVKWYJKWHJMX type=del size=1274538 2024-09-19T13:42:58.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.245+0000 7f6ab10d2780 1 < suggested remove operation key=9Q9DGUSDSE49 tag=YL84020O8MLU type=del 2024-09-19T13:42:58.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.247+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~8933L3EHZ5QT.0 size=698610 2024-09-19T13:42:58.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.247+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=8933L3EHZ5QT tag=HY5EAPFYZ3B9 type=write size=1747186 2024-09-19T13:42:58.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.248+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=82XPQDGGNMSV type=del 2024-09-19T13:42:58.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.249+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=JHZ2VAYLY4LX type=del size=2349600 2024-09-19T13:42:58.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.250+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~XD44YB6Y99F3.0 size=1048576 2024-09-19T13:42:58.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.250+0000 7f6ab10d2780 1 < canceled part key=_multipart_9WTLWBONAOET.2~XD44YB6Y99F3.1 size=1048576 2024-09-19T13:42:58.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.251+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~XD44YB6Y99F3.2 size=168208 2024-09-19T13:42:58.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.253+0000 7f6ab10d2780 1 < canceled multipart upload key=9WTLWBONAOET upload=XD44YB6Y99F3 tag=GT109YSY9NAL type=write size=3313936 2024-09-19T13:42:58.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.255+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~AO46ZJZH86RO.0 size=1048576 2024-09-19T13:42:58.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.256+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~AO46ZJZH86RO.1 size=1048576 2024-09-19T13:42:58.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.257+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~AO46ZJZH86RO.2 size=571493 2024-09-19T13:42:58.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.257+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=AO46ZJZH86RO tag=QMG5900OTVI0 type=write size=3717221 2024-09-19T13:42:58.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.259+0000 7f6ab10d2780 1 < suggested update operation key=X1JYDG1ASYAR tag=1U1UAHKM4H2M type=del size=608329 2024-09-19T13:42:58.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.260+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=FKQDA5PH24DR type=del size=1928410 2024-09-19T13:42:58.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.262+0000 7f6ab10d2780 1 < suggested remove operation key=DF003ORZ1HOM tag=2EBCOCBGHWD1 type=del 2024-09-19T13:42:58.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.264+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~PT8PZNBL5B59.0 size=739846 2024-09-19T13:42:58.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.264+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=PT8PZNBL5B59 tag=8YFVN1JHPGYQ type=write size=1788422 2024-09-19T13:42:58.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.265+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=SAMBY9M4LKTG type=del 2024-09-19T13:42:58.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.266+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=U7KQQJH2XFB2 type=del size=3104911 2024-09-19T13:42:58.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.268+0000 7f6ab10d2780 1 < completed write operation key=UX2ICIT36Q3R tag=QMOAI5X24CVB type=write size=1011921 2024-09-19T13:42:58.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.269+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=Y8ZRP5J9BAOM type=del size=2825504 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.270+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~TA6Z9RO3IPJT.0 size=665419 2024-09-19T13:42:58.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.272+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=TA6Z9RO3IPJT tag=OT4G7CBLXNRP type=write size=1713995 2024-09-19T13:42:58.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.273+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=DLK2TLEBWIV3 type=write size=20410 2024-09-19T13:42:58.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.274+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=03HNPRG28CJZ type=del 2024-09-19T13:42:58.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.276+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~D0FT5DCG45A7.0 size=503642 2024-09-19T13:42:58.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.276+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=D0FT5DCG45A7 tag=ZO8CQFSUZH7H type=write size=1552218 2024-09-19T13:42:58.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.277+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=0TGL2EF08C6P type=write size=618748 2024-09-19T13:42:58.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.278+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=SSUM4AE02QVX type=write size=489660 2024-09-19T13:42:58.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.279+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~564D2QRHCLG6.0 size=1048576 2024-09-19T13:42:58.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.280+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~564D2QRHCLG6.1 size=1048576 2024-09-19T13:42:58.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.280+0000 7f6ab10d2780 1 < canceled part key=_multipart_9WTLWBONAOET.2~564D2QRHCLG6.2 size=571893 2024-09-19T13:42:58.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.282+0000 7f6ab10d2780 1 < canceled multipart upload key=9WTLWBONAOET upload=564D2QRHCLG6 tag=UNG029OQUG1P type=write size=3717621 2024-09-19T13:42:58.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.283+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=Y06ZC2T3R5L3 type=write size=459721 2024-09-19T13:42:58.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.285+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=NZX8KFF9YF9R type=del 2024-09-19T13:42:58.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.287+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~CGGU9BRWOSW2.0 size=1048576 2024-09-19T13:42:58.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.288+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~CGGU9BRWOSW2.1 size=1048576 2024-09-19T13:42:58.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.288+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~CGGU9BRWOSW2.2 size=412335 2024-09-19T13:42:58.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.288+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=CGGU9BRWOSW2 tag=209BUAVSZCAF type=write size=3558063 2024-09-19T13:42:58.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.289+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=GSDIY6DG723T type=del 2024-09-19T13:42:58.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.291+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=9PQ9NBCMU5RN type=del size=437158 2024-09-19T13:42:58.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.292+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=7SBD59T9RU6V type=del 2024-09-19T13:42:58.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.294+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~12X40RN8JMB7.0 size=371512 2024-09-19T13:42:58.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.294+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=12X40RN8JMB7 tag=BMQFH6AML7W6 type=write size=1420088 2024-09-19T13:42:58.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.295+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=4YTD1WPAEJHK type=del 2024-09-19T13:42:58.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.296+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~99LKC8U14409.0 size=1048576 2024-09-19T13:42:58.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.297+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~99LKC8U14409.1 size=1048576 2024-09-19T13:42:58.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.298+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~99LKC8U14409.2 size=786461 2024-09-19T13:42:58.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.298+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=99LKC8U14409 tag=Q7AY3O1ITIZ5 type=write size=3932189 2024-09-19T13:42:58.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.299+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=FVKWYJKWHJMX type=del 2024-09-19T13:42:58.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.301+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~2A3ZJ32XPTCQ.0 size=765711 2024-09-19T13:42:58.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.301+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=2A3ZJ32XPTCQ tag=FACF4N0K48HB type=write size=1814287 2024-09-19T13:42:58.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.302+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~8933L3EHZ5QT.0 size=698610 2024-09-19T13:42:58.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.304+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=8933L3EHZ5QT tag=HY5EAPFYZ3B9 type=write size=1747186 2024-09-19T13:42:58.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.305+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=81GI6FHWEG21 type=del size=2840813 2024-09-19T13:42:58.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.307+0000 7f6ab10d2780 1 < suggested update operation key=9IN6E0JQFNAU tag=JHZ2VAYLY4LX type=del size=2349600 2024-09-19T13:42:58.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.309+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~WF9XSZLMPQEX.0 size=1048576 2024-09-19T13:42:58.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.310+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~WF9XSZLMPQEX.1 size=506227 2024-09-19T13:42:58.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.310+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=WF9XSZLMPQEX tag=N6VSOPT21MSB type=write size=2603379 2024-09-19T13:42:58.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.311+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~AO46ZJZH86RO.0 size=1048576 2024-09-19T13:42:58.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.312+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~AO46ZJZH86RO.1 size=1048576 2024-09-19T13:42:58.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.312+0000 7f6ab10d2780 1 < canceled part key=_multipart_XQLWZA2X91GF.2~AO46ZJZH86RO.2 size=571493 2024-09-19T13:42:58.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.314+0000 7f6ab10d2780 1 < canceled multipart upload key=XQLWZA2X91GF upload=AO46ZJZH86RO tag=QMG5900OTVI0 type=write size=3717221 2024-09-19T13:42:58.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.316+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~E50YV9RM9GGZ.0 size=1048576 2024-09-19T13:42:58.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.317+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~E50YV9RM9GGZ.1 size=1005426 2024-09-19T13:42:58.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.317+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=E50YV9RM9GGZ tag=245OYFO8HFSC type=write size=3102578 2024-09-19T13:42:58.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.318+0000 7f6ab10d2780 1 < canceled operation key=RU6OR8SM72GU tag=FKQDA5PH24DR type=del size=1928410 2024-09-19T13:42:58.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.319+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=SNX1PT400S55 type=del size=1455201 2024-09-19T13:42:58.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.320+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~PT8PZNBL5B59.0 size=739846 2024-09-19T13:42:58.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.322+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=PT8PZNBL5B59 tag=8YFVN1JHPGYQ type=write size=1788422 2024-09-19T13:42:58.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.323+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=J09SFVJI8ZF1 type=del size=964482 2024-09-19T13:42:58.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.325+0000 7f6ab10d2780 1 < suggested remove operation key=P2U09V0G7UUU tag=U7KQQJH2XFB2 type=del 2024-09-19T13:42:58.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.327+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~8VBFES8QIB06.0 size=1048576 2024-09-19T13:42:58.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.327+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~8VBFES8QIB06.1 size=1048576 2024-09-19T13:42:58.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.328+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~8VBFES8QIB06.2 size=549189 2024-09-19T13:42:58.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.328+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=8VBFES8QIB06 tag=2FH9KJ3SJHA3 type=write size=3694917 2024-09-19T13:42:58.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.329+0000 7f6ab10d2780 -1 < failed to complete operation key=9IN6E0JQFNAU tag=Y8ZRP5J9BAOM type=del size=2825504: (22) Invalid argument 2024-09-19T13:42:58.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.331+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=21NONOMG3BZG type=del size=670884 2024-09-19T13:42:58.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.332+0000 7f6ab10d2780 1 < canceled operation key=RXXCDV0LTCKS tag=DLK2TLEBWIV3 type=write size=20410 2024-09-19T13:42:58.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.333+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=W9G29FUXKIZF type=del size=2521317 2024-09-19T13:42:58.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.334+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~D0FT5DCG45A7.0 size=503642 2024-09-19T13:42:58.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.336+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=D0FT5DCG45A7 tag=ZO8CQFSUZH7H type=write size=1552218 2024-09-19T13:42:58.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.338+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~S0LZDNX9QNIE.0 size=837202 2024-09-19T13:42:58.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.338+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=S0LZDNX9QNIE tag=HFVN9SG7XIC0 type=write size=1885778 2024-09-19T13:42:58.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.339+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=SSUM4AE02QVX type=write size=489660 2024-09-19T13:42:58.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.341+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~ZWXZYY8GNA05.0 size=1048576 2024-09-19T13:42:58.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.341+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~ZWXZYY8GNA05.1 size=1048576 2024-09-19T13:42:58.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.342+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~ZWXZYY8GNA05.2 size=19278 2024-09-19T13:42:58.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.342+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=ZWXZYY8GNA05 tag=ZC343UKWCQVX type=write size=3165006 2024-09-19T13:42:58.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.343+0000 7f6ab10d2780 1 < completed write operation key=A14YTABJ1Z3Z tag=Y06ZC2T3R5L3 type=write size=459721 2024-09-19T13:42:58.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.344+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=713C0C631SE5 type=del size=2340652 2024-09-19T13:42:58.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.346+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~CGGU9BRWOSW2.0 size=1048576 2024-09-19T13:42:58.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.346+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~CGGU9BRWOSW2.1 size=1048576 2024-09-19T13:42:58.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.347+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~CGGU9BRWOSW2.2 size=412335 2024-09-19T13:42:58.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.349+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=CGGU9BRWOSW2 tag=209BUAVSZCAF type=write size=3558063 2024-09-19T13:42:58.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.351+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~J3R12W2R02S1.0 size=1048576 2024-09-19T13:42:58.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.352+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~J3R12W2R02S1.1 size=1048576 2024-09-19T13:42:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.353+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~J3R12W2R02S1.2 size=714058 2024-09-19T13:42:58.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.353+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=J3R12W2R02S1 tag=7J21HUH1RPI9 type=write size=3859786 2024-09-19T13:42:58.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.354+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=9PQ9NBCMU5RN type=del 2024-09-19T13:42:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.356+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~0BDU4X5P1YLQ.0 size=821187 2024-09-19T13:42:58.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.356+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=0BDU4X5P1YLQ tag=QOVJAKS8FYS8 type=write size=1869763 2024-09-19T13:42:58.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.357+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~12X40RN8JMB7.0 size=371512 2024-09-19T13:42:58.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.359+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=12X40RN8JMB7 tag=BMQFH6AML7W6 type=write size=1420088 2024-09-19T13:42:58.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.360+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=RALCOHR39239 type=del size=4045700 2024-09-19T13:42:58.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.362+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~99LKC8U14409.0 size=1048576 2024-09-19T13:42:58.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.362+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~99LKC8U14409.1 size=1048576 2024-09-19T13:42:58.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.363+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~99LKC8U14409.2 size=786461 2024-09-19T13:42:58.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.365+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=99LKC8U14409 tag=Q7AY3O1ITIZ5 type=write size=3932189 2024-09-19T13:42:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.367+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~F908A854BANE.0 size=509769 2024-09-19T13:42:58.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.367+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=F908A854BANE tag=OYQH050H3GJ0 type=write size=1558345 2024-09-19T13:42:58.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.368+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~2A3ZJ32XPTCQ.0 size=765711 2024-09-19T13:42:58.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.370+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=2A3ZJ32XPTCQ tag=FACF4N0K48HB type=write size=1814287 2024-09-19T13:42:58.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.372+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~X3RDN95A8ICD.0 size=1048576 2024-09-19T13:42:58.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.373+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~X3RDN95A8ICD.1 size=31696 2024-09-19T13:42:58.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.373+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=X3RDN95A8ICD tag=AH6IVTUCBKDC type=write size=2128848 2024-09-19T13:42:58.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.375+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=81GI6FHWEG21 type=del 2024-09-19T13:42:58.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.376+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=Y1YGCFW27A27 type=del size=3717659 2024-09-19T13:42:58.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.377+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~WF9XSZLMPQEX.0 size=1048576 2024-09-19T13:42:58.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.378+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~WF9XSZLMPQEX.1 size=506227 2024-09-19T13:42:58.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.380+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=WF9XSZLMPQEX tag=N6VSOPT21MSB type=write size=2603379 2024-09-19T13:42:58.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.382+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~NXHGAM3N3EYL.0 size=314280 2024-09-19T13:42:58.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.382+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=NXHGAM3N3EYL tag=3H5Q85YVN300 type=write size=1362856 2024-09-19T13:42:58.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.383+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~E50YV9RM9GGZ.0 size=1048576 2024-09-19T13:42:58.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.385+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~E50YV9RM9GGZ.1 size=1005426 2024-09-19T13:42:58.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.387+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=E50YV9RM9GGZ tag=245OYFO8HFSC type=write size=3102578 2024-09-19T13:42:58.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.388+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=17GC6IFTP1Z3 type=del size=4081003 2024-09-19T13:42:58.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.389+0000 7f6ab10d2780 1 < canceled operation key=9MCE8PXHBGNF tag=SNX1PT400S55 type=del size=1455201 2024-09-19T13:42:58.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.390+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=6LFY87CX1KVN type=del size=4054838 2024-09-19T13:42:58.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.391+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=J09SFVJI8ZF1 type=del 2024-09-19T13:42:58.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.392+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=EQI49RBE1RM5 type=del size=1679839 2024-09-19T13:42:58.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.394+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~8VBFES8QIB06.0 size=1048576 2024-09-19T13:42:58.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.394+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~8VBFES8QIB06.1 size=1048576 2024-09-19T13:42:58.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.395+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~8VBFES8QIB06.2 size=549189 2024-09-19T13:42:58.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.397+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=8VBFES8QIB06 tag=2FH9KJ3SJHA3 type=write size=3694917 2024-09-19T13:42:58.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.399+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~96O32G4AIJBS.0 size=1048576 2024-09-19T13:42:58.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.400+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~96O32G4AIJBS.1 size=1048576 2024-09-19T13:42:58.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.401+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~96O32G4AIJBS.2 size=750454 2024-09-19T13:42:58.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.401+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=96O32G4AIJBS tag=CASLFV8L30SH type=write size=3896182 2024-09-19T13:42:58.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.402+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=21NONOMG3BZG type=del 2024-09-19T13:42:58.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.403+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=NKULU035OP73 type=del size=876954 2024-09-19T13:42:58.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.405+0000 7f6ab10d2780 1 < suggested update operation key=9WTLWBONAOET tag=W9G29FUXKIZF type=del size=2521317 2024-09-19T13:42:58.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.406+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=2C6WZYBP7XFX type=del size=890616 2024-09-19T13:42:58.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.408+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~S0LZDNX9QNIE.0 size=837202 2024-09-19T13:42:58.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.409+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=S0LZDNX9QNIE tag=HFVN9SG7XIC0 type=write size=1885778 2024-09-19T13:42:58.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.410+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=2H1PNKZ0XXT0 type=del size=3322024 2024-09-19T13:42:58.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.412+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~ZWXZYY8GNA05.0 size=1048576 2024-09-19T13:42:58.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.412+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~ZWXZYY8GNA05.1 size=1048576 2024-09-19T13:42:58.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.413+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~ZWXZYY8GNA05.2 size=19278 2024-09-19T13:42:58.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.415+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=ZWXZYY8GNA05 tag=ZC343UKWCQVX type=write size=3165006 2024-09-19T13:42:58.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.416+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=CPL8YT0O9I1X type=write size=221428 2024-09-19T13:42:58.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.417+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=713C0C631SE5 type=del 2024-09-19T13:42:58.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.419+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~Y0OV2DEXKDVT.0 size=1048576 2024-09-19T13:42:58.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.420+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~Y0OV2DEXKDVT.1 size=1048576 2024-09-19T13:42:58.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.421+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~Y0OV2DEXKDVT.2 size=157498 2024-09-19T13:42:58.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.421+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=Y0OV2DEXKDVT tag=BMYPVJ2W40B0 type=write size=3303226 2024-09-19T13:42:58.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.422+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~J3R12W2R02S1.0 size=1048576 2024-09-19T13:42:58.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.423+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~J3R12W2R02S1.1 size=1048576 2024-09-19T13:42:58.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.424+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~J3R12W2R02S1.2 size=714058 2024-09-19T13:42:58.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.426+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=J3R12W2R02S1 tag=7J21HUH1RPI9 type=write size=3859786 2024-09-19T13:42:58.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.428+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~V2NHJTCAD7TG.0 size=1048576 2024-09-19T13:42:58.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.429+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~V2NHJTCAD7TG.1 size=1048576 2024-09-19T13:42:58.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.430+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~V2NHJTCAD7TG.2 size=459623 2024-09-19T13:42:58.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.430+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=V2NHJTCAD7TG tag=T0F0LQ0IRRRN type=write size=3605351 2024-09-19T13:42:58.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.431+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~0BDU4X5P1YLQ.0 size=821187 2024-09-19T13:42:58.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.433+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=0BDU4X5P1YLQ tag=QOVJAKS8FYS8 type=write size=1869763 2024-09-19T13:42:58.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.435+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~9116O33DIIC5.0 size=456237 2024-09-19T13:42:58.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.435+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=9116O33DIIC5 tag=QN702GXR6BCM type=write size=1504813 2024-09-19T13:42:58.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.437+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=RALCOHR39239 type=del size=4045700 2024-09-19T13:42:58.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.439+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=9E03FPWUCCXF type=del size=1378163 2024-09-19T13:42:58.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.440+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~F908A854BANE.0 size=509769 2024-09-19T13:42:58.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.442+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=F908A854BANE tag=OYQH050H3GJ0 type=write size=1558345 2024-09-19T13:42:58.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.443+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=TPLD90622QJE type=write size=570429 2024-09-19T13:42:58.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.444+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~X3RDN95A8ICD.0 size=1048576 2024-09-19T13:42:58.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.445+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~X3RDN95A8ICD.1 size=31696 2024-09-19T13:42:58.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.447+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=X3RDN95A8ICD tag=AH6IVTUCBKDC type=write size=2128848 2024-09-19T13:42:58.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.449+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~POE3I3XKFMTY.0 size=319241 2024-09-19T13:42:58.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.450+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=POE3I3XKFMTY tag=E4BVJD9W984T type=write size=1367817 2024-09-19T13:42:58.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.452+0000 7f6ab10d2780 1 < suggested remove operation key=DTSRVH526PE7 tag=Y1YGCFW27A27 type=del 2024-09-19T13:42:58.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.454+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~3TEQ1QOI95KQ.0 size=1048576 2024-09-19T13:42:58.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.455+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~3TEQ1QOI95KQ.1 size=906744 2024-09-19T13:42:58.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.455+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=3TEQ1QOI95KQ tag=SZJWPWTJDFBP type=write size=3003896 2024-09-19T13:42:58.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.456+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~NXHGAM3N3EYL.0 size=314280 2024-09-19T13:42:58.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.458+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=NXHGAM3N3EYL tag=3H5Q85YVN300 type=write size=1362856 2024-09-19T13:42:58.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.461+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~AD0F3O2RA378.0 size=1048576 2024-09-19T13:42:58.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.462+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~AD0F3O2RA378.1 size=94820 2024-09-19T13:42:58.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.462+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=AD0F3O2RA378 tag=4B2LZPWB6HWK type=write size=2191972 2024-09-19T13:42:58.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.464+0000 7f6ab10d2780 1 < suggested remove operation key=WDRUV5ERI000 tag=17GC6IFTP1Z3 type=del 2024-09-19T13:42:58.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.466+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~3M0YNITQEIBI.0 size=399635 2024-09-19T13:42:58.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.466+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=3M0YNITQEIBI tag=7HT1ZJ1UJU42 type=write size=1448211 2024-09-19T13:42:58.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.467+0000 7f6ab10d2780 -1 < failed to complete operation key=9WTLWBONAOET tag=6LFY87CX1KVN type=del size=4054838: (22) Invalid argument 2024-09-19T13:42:58.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.468+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=D6O2WAEXK1L9 type=del size=1566295 2024-09-19T13:42:58.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.469+0000 7f6ab10d2780 1 < canceled operation key=P2U09V0G7UUU tag=EQI49RBE1RM5 type=del size=1679839 2024-09-19T13:42:58.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.470+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=BOMKTSYSRMWE type=del size=3781967 2024-09-19T13:42:58.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.472+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~96O32G4AIJBS.0 size=1048576 2024-09-19T13:42:58.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.472+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~96O32G4AIJBS.1 size=1048576 2024-09-19T13:42:58.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.473+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~96O32G4AIJBS.2 size=750454 2024-09-19T13:42:58.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.475+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=96O32G4AIJBS tag=CASLFV8L30SH type=write size=3896182 2024-09-19T13:42:58.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.476+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=4V2405Q151K1 type=del size=4097083 2024-09-19T13:42:58.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.478+0000 7f6ab10d2780 -1 < failed to complete operation key=WDRUV5ERI000 tag=NKULU035OP73 type=del size=876954: (22) Invalid argument 2024-09-19T13:42:58.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.479+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=VJ6M1XYUTSM1 type=del size=703097 2024-09-19T13:42:58.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.480+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=2C6WZYBP7XFX type=del 2024-09-19T13:42:58.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.481+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=5FQ6IZDMM7RM type=del size=1735673 2024-09-19T13:42:58.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.482+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=2H1PNKZ0XXT0 type=del 2024-09-19T13:42:58.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.484+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~DAQV09ALEMA0.0 size=1048576 2024-09-19T13:42:58.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.485+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~DAQV09ALEMA0.1 size=770339 2024-09-19T13:42:58.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.485+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=DAQV09ALEMA0 tag=LNC4QDAZOAY0 type=write size=2867491 2024-09-19T13:42:58.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.486+0000 7f6ab10d2780 1 < completed write operation key=X1JYDG1ASYAR tag=CPL8YT0O9I1X type=write size=221428 2024-09-19T13:42:58.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.487+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=3UB02RBSPY45 type=del size=96595 2024-09-19T13:42:58.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.488+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~Y0OV2DEXKDVT.0 size=1048576 2024-09-19T13:42:58.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.490+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~Y0OV2DEXKDVT.1 size=1048576 2024-09-19T13:42:58.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.491+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~Y0OV2DEXKDVT.2 size=157498 2024-09-19T13:42:58.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.493+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=Y0OV2DEXKDVT tag=BMYPVJ2W40B0 type=write size=3303226 2024-09-19T13:42:58.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.495+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~VYQ8L8QV1RN1.0 size=1048576 2024-09-19T13:42:58.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.496+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~VYQ8L8QV1RN1.1 size=1048576 2024-09-19T13:42:58.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.497+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~VYQ8L8QV1RN1.2 size=772260 2024-09-19T13:42:58.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.497+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=VYQ8L8QV1RN1 tag=9UIQUZS6EKMS type=write size=3917988 2024-09-19T13:42:58.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.498+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~V2NHJTCAD7TG.0 size=1048576 2024-09-19T13:42:58.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.499+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~V2NHJTCAD7TG.1 size=1048576 2024-09-19T13:42:58.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.500+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~V2NHJTCAD7TG.2 size=459623 2024-09-19T13:42:58.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.501+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=V2NHJTCAD7TG tag=T0F0LQ0IRRRN type=write size=3605351 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.503+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~ZC94N4AV5FNS.0 size=1048576 2024-09-19T13:42:58.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.504+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~ZC94N4AV5FNS.1 size=1048576 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.505+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~ZC94N4AV5FNS.2 size=523916 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.505+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=ZC94N4AV5FNS tag=0TBVQ5IXYH0A type=write size=3669644 2024-09-19T13:42:58.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.506+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~9116O33DIIC5.0 size=456237 2024-09-19T13:42:58.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.508+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=9116O33DIIC5 tag=QN702GXR6BCM type=write size=1504813 2024-09-19T13:42:58.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.510+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~K4KB15L2RIAW.0 size=1048576 2024-09-19T13:42:58.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.511+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~K4KB15L2RIAW.1 size=1048576 2024-09-19T13:42:58.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.512+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~K4KB15L2RIAW.2 size=970891 2024-09-19T13:42:58.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.512+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=K4KB15L2RIAW tag=6Z7TL5STDLLO type=write size=4116619 2024-09-19T13:42:58.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.513+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=9E03FPWUCCXF type=del 2024-09-19T13:42:58.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.515+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~UEXSCSUWC25A.0 size=299236 2024-09-19T13:42:58.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.515+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=UEXSCSUWC25A tag=K1SKRJSYS7TB type=write size=1347812 2024-09-19T13:42:58.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.517+0000 7f6ab10d2780 1 < suggested remove operation key=V8P17ZSOQUSM tag=TPLD90622QJE type=write 2024-09-19T13:42:58.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.519+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~6GPCHODU4PLM.0 size=1048576 2024-09-19T13:42:58.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.520+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~6GPCHODU4PLM.1 size=1048576 2024-09-19T13:42:58.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.521+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~6GPCHODU4PLM.2 size=128929 2024-09-19T13:42:58.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.521+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=6GPCHODU4PLM tag=ILOL5A2LWFK5 type=write size=3274657 2024-09-19T13:42:58.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.522+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~POE3I3XKFMTY.0 size=319241 2024-09-19T13:42:58.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.523+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=POE3I3XKFMTY tag=E4BVJD9W984T type=write size=1367817 2024-09-19T13:42:58.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.525+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~I27L349A28I5.0 size=704568 2024-09-19T13:42:58.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.525+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=I27L349A28I5 tag=EDGGCLLATHQ5 type=write size=1753144 2024-09-19T13:42:58.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.527+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~3TEQ1QOI95KQ.0 size=1048576 2024-09-19T13:42:58.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.527+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~3TEQ1QOI95KQ.1 size=906744 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.529+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=3TEQ1QOI95KQ tag=SZJWPWTJDFBP type=write size=3003896 2024-09-19T13:42:58.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.530+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=9LPD46AX4BMH type=del size=1081725 2024-09-19T13:42:58.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.531+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~AD0F3O2RA378.0 size=1048576 2024-09-19T13:42:58.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.532+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~AD0F3O2RA378.1 size=94820 2024-09-19T13:42:58.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.534+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=AD0F3O2RA378 tag=4B2LZPWB6HWK type=write size=2191972 2024-09-19T13:42:58.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.535+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=47UMLG3ZPYWR type=write size=94077 2024-09-19T13:42:58.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.536+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~3M0YNITQEIBI.0 size=399635 2024-09-19T13:42:58.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.538+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=3M0YNITQEIBI tag=7HT1ZJ1UJU42 type=write size=1448211 2024-09-19T13:42:58.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.539+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=0GJLQJE20EHA type=del size=3136491 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.540+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=D6O2WAEXK1L9 type=del 2024-09-19T13:42:58.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.542+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~IW6W15M7M95O.0 size=1048576 2024-09-19T13:42:58.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.543+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~IW6W15M7M95O.1 size=1048576 2024-09-19T13:42:58.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.544+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~IW6W15M7M95O.2 size=121690 2024-09-19T13:42:58.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.544+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=IW6W15M7M95O tag=BNGSVM57CY1T type=write size=3267418 2024-09-19T13:42:58.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.546+0000 7f6ab10d2780 1 < suggested remove operation key=VFJIKOLYI0HN tag=BOMKTSYSRMWE type=del 2024-09-19T13:42:58.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.548+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~RXA5PKEER6LL.0 size=878130 2024-09-19T13:42:58.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.548+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=RXA5PKEER6LL tag=U7QORHO01MGP type=write size=1926706 2024-09-19T13:42:58.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.549+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=4V2405Q151K1 type=del 2024-09-19T13:42:58.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.550+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=MXWDUH6L4VVN type=write size=493264 2024-09-19T13:42:58.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.551+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=VJ6M1XYUTSM1 type=del 2024-09-19T13:42:58.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.553+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~L1H21S29U2N8.0 size=39655 2024-09-19T13:42:58.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.553+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=L1H21S29U2N8 tag=YCA0MS1N2BHY type=write size=1088231 2024-09-19T13:42:58.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.555+0000 7f6ab10d2780 1 < suggested update operation key=UPMXNNYUUJR7 tag=5FQ6IZDMM7RM type=del size=1735673 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.557+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~NEGR962ESYKZ.0 size=1048576 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.558+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~NEGR962ESYKZ.1 size=542847 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.558+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=NEGR962ESYKZ tag=MRK9QFE932Y6 type=write size=2639999 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.558+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~DAQV09ALEMA0.0 size=1048576 2024-09-19T13:42:58.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.559+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~DAQV09ALEMA0.1 size=770339 2024-09-19T13:42:58.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.561+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=DAQV09ALEMA0 tag=LNC4QDAZOAY0 type=write size=2867491 2024-09-19T13:42:58.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.562+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=9FVCQEUQOMUY type=write size=748005 2024-09-19T13:42:58.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.563+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=3UB02RBSPY45 type=del 2024-09-19T13:42:58.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.564+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=Q4NBVZ12RL1Y type=del size=4081424 2024-09-19T13:42:58.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.565+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~VYQ8L8QV1RN1.0 size=1048576 2024-09-19T13:42:58.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.566+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~VYQ8L8QV1RN1.1 size=1048576 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.567+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~VYQ8L8QV1RN1.2 size=772260 2024-09-19T13:42:58.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.569+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=VYQ8L8QV1RN1 tag=9UIQUZS6EKMS type=write size=3917988 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.571+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~A1X9SYCEZW3S.0 size=1048576 2024-09-19T13:42:58.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.572+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~A1X9SYCEZW3S.1 size=110826 2024-09-19T13:42:58.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.572+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=A1X9SYCEZW3S tag=0JK9B71PJPBM type=write size=2207978 2024-09-19T13:42:58.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.573+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~ZC94N4AV5FNS.0 size=1048576 2024-09-19T13:42:58.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.574+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~ZC94N4AV5FNS.1 size=1048576 2024-09-19T13:42:58.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.575+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~ZC94N4AV5FNS.2 size=523916 2024-09-19T13:42:58.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.577+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=ZC94N4AV5FNS tag=0TBVQ5IXYH0A type=write size=3669644 2024-09-19T13:42:58.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.578+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=R9GNNSB8TVYD type=del size=2628473 2024-09-19T13:42:58.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.579+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~K4KB15L2RIAW.0 size=1048576 2024-09-19T13:42:58.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.580+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~K4KB15L2RIAW.1 size=1048576 2024-09-19T13:42:58.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.581+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~K4KB15L2RIAW.2 size=970891 2024-09-19T13:42:58.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.582+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=K4KB15L2RIAW tag=6Z7TL5STDLLO type=write size=4116619 2024-09-19T13:42:58.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.584+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=703OUH9EYH7X type=del size=342899 2024-09-19T13:42:58.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.585+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~UEXSCSUWC25A.0 size=299236 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.587+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=UEXSCSUWC25A tag=K1SKRJSYS7TB type=write size=1347812 2024-09-19T13:42:58.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.589+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=PM6RSBVO65E9 type=del size=2588887 2024-09-19T13:42:58.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.590+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~6GPCHODU4PLM.0 size=1048576 2024-09-19T13:42:58.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.590+0000 7f6ab10d2780 1 < canceled part key=_multipart_EE8F84K0ZAGJ.2~6GPCHODU4PLM.1 size=1048576 2024-09-19T13:42:58.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.591+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~6GPCHODU4PLM.2 size=128929 2024-09-19T13:42:58.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.593+0000 7f6ab10d2780 1 < canceled multipart upload key=EE8F84K0ZAGJ upload=6GPCHODU4PLM tag=ILOL5A2LWFK5 type=write size=3274657 2024-09-19T13:42:58.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.595+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~3YR5U6XSXYGS.0 size=1048576 2024-09-19T13:42:58.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.595+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~3YR5U6XSXYGS.1 size=1048576 2024-09-19T13:42:58.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.596+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~3YR5U6XSXYGS.2 size=375278 2024-09-19T13:42:58.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.596+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=3YR5U6XSXYGS tag=GNWB37554043 type=write size=3521006 2024-09-19T13:42:58.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.597+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~I27L349A28I5.0 size=704568 2024-09-19T13:42:58.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.600+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=I27L349A28I5 tag=EDGGCLLATHQ5 type=write size=1753144 2024-09-19T13:42:58.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.601+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=55S6CBR42J59 type=del size=733645 2024-09-19T13:42:58.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.602+0000 7f6ab10d2780 -1 < failed to complete operation key=UPMXNNYUUJR7 tag=9LPD46AX4BMH type=del size=1081725: (22) Invalid argument 2024-09-19T13:42:58.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.604+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~UAVTWBUK6RBU.0 size=255329 2024-09-19T13:42:58.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.604+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=UAVTWBUK6RBU tag=7UG8AMDZ0I3D type=write size=1303905 2024-09-19T13:42:58.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.605+0000 7f6ab10d2780 1 < completed write operation key=9WTLWBONAOET tag=47UMLG3ZPYWR type=write size=94077 2024-09-19T13:42:58.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.607+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~8HJEK1S8Z8U1.0 size=991619 2024-09-19T13:42:58.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.607+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=8HJEK1S8Z8U1 tag=MJFCABLR5MKQ type=write size=2040195 2024-09-19T13:42:58.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.610+0000 7f6ab10d2780 1 < suggested remove operation key=XQLWZA2X91GF tag=0GJLQJE20EHA type=del 2024-09-19T13:42:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.611+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~32HOBHAIJ28V.0 size=1048576 2024-09-19T13:42:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.612+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~32HOBHAIJ28V.1 size=1048576 2024-09-19T13:42:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.613+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~32HOBHAIJ28V.2 size=297181 2024-09-19T13:42:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.613+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=32HOBHAIJ28V tag=2O29MMIHR0DH type=write size=3442909 2024-09-19T13:42:58.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.615+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~IW6W15M7M95O.0 size=1048576 2024-09-19T13:42:58.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.616+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~IW6W15M7M95O.1 size=1048576 2024-09-19T13:42:58.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.617+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~IW6W15M7M95O.2 size=121690 2024-09-19T13:42:58.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.624+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=IW6W15M7M95O tag=BNGSVM57CY1T type=write size=3267418 2024-09-19T13:42:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.626+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=UQ3XQ2NIT0G2 type=del size=3018937 2024-09-19T13:42:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.627+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~RXA5PKEER6LL.0 size=878130 2024-09-19T13:42:58.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.628+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=RXA5PKEER6LL tag=U7QORHO01MGP type=write size=1926706 2024-09-19T13:42:58.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.629+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=KVN4EF631RY4 type=write size=252432 2024-09-19T13:42:58.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.631+0000 7f6ab10d2780 -1 < failed to complete operation key=UPMXNNYUUJR7 tag=MXWDUH6L4VVN type=write size=493264: (22) Invalid argument 2024-09-19T13:42:58.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.632+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~OCOKXI1ZTF54.0 size=1048576 2024-09-19T13:42:58.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.633+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~OCOKXI1ZTF54.1 size=1048576 2024-09-19T13:42:58.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.634+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~OCOKXI1ZTF54.2 size=261959 2024-09-19T13:42:58.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.634+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=OCOKXI1ZTF54 tag=1MSS4ULKC8YF type=write size=3407687 2024-09-19T13:42:58.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.635+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~L1H21S29U2N8.0 size=39655 2024-09-19T13:42:58.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.637+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=L1H21S29U2N8 tag=YCA0MS1N2BHY type=write size=1088231 2024-09-19T13:42:58.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.638+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=C7P4K8P39DC3 type=del size=557031 2024-09-19T13:42:58.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.639+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~NEGR962ESYKZ.0 size=1048576 2024-09-19T13:42:58.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.640+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~NEGR962ESYKZ.1 size=542847 2024-09-19T13:42:58.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.642+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=NEGR962ESYKZ tag=MRK9QFE932Y6 type=write size=2639999 2024-09-19T13:42:58.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.644+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~2XLTRYXIOCDU.0 size=1048576 2024-09-19T13:42:58.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.645+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~2XLTRYXIOCDU.1 size=162670 2024-09-19T13:42:58.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.645+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=2XLTRYXIOCDU tag=4CVK16ZU1GL2 type=write size=2259822 2024-09-19T13:42:58.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.646+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=9FVCQEUQOMUY type=write size=748005 2024-09-19T13:42:58.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.647+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=TA2YCC1OXFRU type=del size=134105 2024-09-19T13:42:58.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.648+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=Q4NBVZ12RL1Y type=del 2024-09-19T13:42:58.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.649+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=QXTC4C6PVJDW type=del size=1573849 2024-09-19T13:42:58.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.650+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~A1X9SYCEZW3S.0 size=1048576 2024-09-19T13:42:58.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.651+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~A1X9SYCEZW3S.1 size=110826 2024-09-19T13:42:58.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.653+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=A1X9SYCEZW3S tag=0JK9B71PJPBM type=write size=2207978 2024-09-19T13:42:58.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.654+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=8U1V1713KRMX type=del size=2003283 2024-09-19T13:42:58.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.655+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=R9GNNSB8TVYD type=del 2024-09-19T13:42:58.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.656+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=B3D1Y4QGCMYD type=write size=441565 2024-09-19T13:42:58.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.658+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=703OUH9EYH7X type=del 2024-09-19T13:42:58.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.659+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=F4WV9LWBYW04 type=del size=1476640 2024-09-19T13:42:58.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.661+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=PM6RSBVO65E9 type=del 2024-09-19T13:42:58.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.662+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=3B5BNNVOFJNG type=write size=242813 2024-09-19T13:42:58.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.662+0000 7f6ab10d2780 1 < canceled part key=_multipart_XQLWZA2X91GF.2~3YR5U6XSXYGS.0 size=1048576 2024-09-19T13:42:58.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.663+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~3YR5U6XSXYGS.1 size=1048576 2024-09-19T13:42:58.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.664+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~3YR5U6XSXYGS.2 size=375278 2024-09-19T13:42:58.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.666+0000 7f6ab10d2780 1 < canceled multipart upload key=XQLWZA2X91GF upload=3YR5U6XSXYGS tag=GNWB37554043 type=write size=3521006 2024-09-19T13:42:58.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.669+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~Q5XGYIHGCB3G.0 size=526039 2024-09-19T13:42:58.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.669+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=Q5XGYIHGCB3G tag=2J3F8QMQSYKH type=write size=1574615 2024-09-19T13:42:58.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.670+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=55S6CBR42J59 type=del 2024-09-19T13:42:58.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.672+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~726WLBUCSEEJ.0 size=1048576 2024-09-19T13:42:58.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.673+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~726WLBUCSEEJ.1 size=820952 2024-09-19T13:42:58.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.673+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=726WLBUCSEEJ tag=700OKAQB6ZVB type=write size=2918104 2024-09-19T13:42:58.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.675+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~UAVTWBUK6RBU.0 size=255329 2024-09-19T13:42:58.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.677+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=UAVTWBUK6RBU tag=7UG8AMDZ0I3D type=write size=1303905 2024-09-19T13:42:58.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.678+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=NYTLVA304U04 type=del size=4122227 2024-09-19T13:42:58.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.679+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~8HJEK1S8Z8U1.0 size=991619 2024-09-19T13:42:58.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.682+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=8HJEK1S8Z8U1 tag=MJFCABLR5MKQ type=write size=2040195 2024-09-19T13:42:58.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.683+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=JPAMX8L044CE type=del size=992609 2024-09-19T13:42:58.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.684+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~32HOBHAIJ28V.0 size=1048576 2024-09-19T13:42:58.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.685+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~32HOBHAIJ28V.1 size=1048576 2024-09-19T13:42:58.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.686+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~32HOBHAIJ28V.2 size=297181 2024-09-19T13:42:58.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.688+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=32HOBHAIJ28V tag=2O29MMIHR0DH type=write size=3442909 2024-09-19T13:42:58.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.689+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=AMPANY3W20ON type=del size=1827728 2024-09-19T13:42:58.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.690+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=UQ3XQ2NIT0G2 type=del 2024-09-19T13:42:58.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.692+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~1L0V3QUPZB26.0 size=1048576 2024-09-19T13:42:58.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.692+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~1L0V3QUPZB26.1 size=1048576 2024-09-19T13:42:58.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.693+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~1L0V3QUPZB26.2 size=176645 2024-09-19T13:42:58.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.693+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=1L0V3QUPZB26 tag=45BJ477E1JY7 type=write size=3322373 2024-09-19T13:42:58.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.694+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=KVN4EF631RY4 type=write size=252432 2024-09-19T13:42:58.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.696+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=1O57AQM7XFMF type=del size=1536863 2024-09-19T13:42:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.697+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~OCOKXI1ZTF54.0 size=1048576 2024-09-19T13:42:58.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.697+0000 7f6ab10d2780 1 < canceled part key=_multipart_9WTLWBONAOET.2~OCOKXI1ZTF54.1 size=1048576 2024-09-19T13:42:58.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.698+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~OCOKXI1ZTF54.2 size=261959 2024-09-19T13:42:58.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.700+0000 7f6ab10d2780 1 < canceled multipart upload key=9WTLWBONAOET upload=OCOKXI1ZTF54 tag=1MSS4ULKC8YF type=write size=3407687 2024-09-19T13:42:58.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.702+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=8U7CK2RU8Y7M type=write size=81033 2024-09-19T13:42:58.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.703+0000 7f6ab10d2780 1 < canceled operation key=CD4XXORKVS6J tag=C7P4K8P39DC3 type=del size=557031 2024-09-19T13:42:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.705+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~GWBMH4EQMSYG.0 size=1048576 2024-09-19T13:42:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.705+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~GWBMH4EQMSYG.1 size=935555 2024-09-19T13:42:58.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.705+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=GWBMH4EQMSYG tag=EE1T3KSCHLWI type=write size=3032707 2024-09-19T13:42:58.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.706+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~2XLTRYXIOCDU.0 size=1048576 2024-09-19T13:42:58.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.707+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~2XLTRYXIOCDU.1 size=162670 2024-09-19T13:42:58.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.709+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=2XLTRYXIOCDU tag=4CVK16ZU1GL2 type=write size=2259822 2024-09-19T13:42:58.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.711+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~C8P0RQCZO4Q2.0 size=1048576 2024-09-19T13:42:58.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.712+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~C8P0RQCZO4Q2.1 size=475225 2024-09-19T13:42:58.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.712+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=C8P0RQCZO4Q2 tag=G03TISJXXG05 type=write size=2572377 2024-09-19T13:42:58.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.713+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=TA2YCC1OXFRU type=del 2024-09-19T13:42:58.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.715+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=4KT7FG218HIZ type=del size=2200449 2024-09-19T13:42:58.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.717+0000 7f6ab10d2780 1 < suggested update operation key=QTGKMAOX2A6U tag=QXTC4C6PVJDW type=del size=1573849 2024-09-19T13:42:58.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.718+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=PMD5UBKONPBY type=del size=2122605 2024-09-19T13:42:58.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.719+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=8U1V1713KRMX type=del 2024-09-19T13:42:58.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.720+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=ZSWMCAPS4KKG type=del size=1198210 2024-09-19T13:42:58.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.721+0000 7f6ab10d2780 1 < completed write operation key=TCXAYADSCTZI tag=B3D1Y4QGCMYD type=write size=441565 2024-09-19T13:42:58.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.723+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~Z8BODR8X3CZ6.0 size=1048576 2024-09-19T13:42:58.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.724+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~Z8BODR8X3CZ6.1 size=1048576 2024-09-19T13:42:58.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.725+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~Z8BODR8X3CZ6.2 size=659379 2024-09-19T13:42:58.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.725+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=Z8BODR8X3CZ6 tag=RTU9BAB78WWJ type=write size=3805107 2024-09-19T13:42:58.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.726+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=F4WV9LWBYW04 type=del 2024-09-19T13:42:58.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.728+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~YHUUYMUDA44P.0 size=1048576 2024-09-19T13:42:58.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.729+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~YHUUYMUDA44P.1 size=1048576 2024-09-19T13:42:58.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.729+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~YHUUYMUDA44P.2 size=757163 2024-09-19T13:42:58.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.729+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=YHUUYMUDA44P tag=ZXJY9EG1FUY5 type=write size=3902891 2024-09-19T13:42:58.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.730+0000 7f6ab10d2780 -1 < failed to complete operation key=QTGKMAOX2A6U tag=3B5BNNVOFJNG type=write size=242813: (22) Invalid argument 2024-09-19T13:42:58.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.732+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~PAAUOAHKH40O.0 size=328286 2024-09-19T13:42:58.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.732+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=PAAUOAHKH40O tag=XDGQY2N7UMQK type=write size=1376862 2024-09-19T13:42:58.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.734+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~Q5XGYIHGCB3G.0 size=526039 2024-09-19T13:42:58.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.736+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=Q5XGYIHGCB3G tag=2J3F8QMQSYKH type=write size=1574615 2024-09-19T13:42:58.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.738+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~UVPVFBP2Q49K.0 size=1048576 2024-09-19T13:42:58.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.738+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~UVPVFBP2Q49K.1 size=936954 2024-09-19T13:42:58.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.738+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=UVPVFBP2Q49K tag=PFE90UW2WZC6 type=write size=3034106 2024-09-19T13:42:58.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.740+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~726WLBUCSEEJ.0 size=1048576 2024-09-19T13:42:58.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.740+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~726WLBUCSEEJ.1 size=820952 2024-09-19T13:42:58.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.743+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=726WLBUCSEEJ tag=700OKAQB6ZVB type=write size=2918104 2024-09-19T13:42:58.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.744+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=WHQY9W4J29QW type=write size=775184 2024-09-19T13:42:58.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.746+0000 7f6ab10d2780 1 < suggested update operation key=9WTLWBONAOET tag=NYTLVA304U04 type=del size=4122227 2024-09-19T13:42:58.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.747+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=V0JZIWL8NI4T type=del size=1378163 2024-09-19T13:42:58.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.748+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=JPAMX8L044CE type=del 2024-09-19T13:42:58.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.749+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=EF5DQAB5YT4A type=del size=442619 2024-09-19T13:42:58.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.751+0000 7f6ab10d2780 1 < suggested update operation key=9MCE8PXHBGNF tag=AMPANY3W20ON type=del size=1827728 2024-09-19T13:42:58.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.752+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=9ZN5DQEQ57BP type=del size=4097272 2024-09-19T13:42:58.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.754+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~1L0V3QUPZB26.0 size=1048576 2024-09-19T13:42:58.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.755+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~1L0V3QUPZB26.1 size=1048576 2024-09-19T13:42:58.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.755+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~1L0V3QUPZB26.2 size=176645 2024-09-19T13:42:58.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.757+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=1L0V3QUPZB26 tag=45BJ477E1JY7 type=write size=3322373 2024-09-19T13:42:58.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.759+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=EE3SUCU273PO type=del size=349730 2024-09-19T13:42:58.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.760+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=1O57AQM7XFMF type=del 2024-09-19T13:42:58.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.762+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~656VO1KZOHT2.0 size=1048576 2024-09-19T13:42:58.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.763+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~656VO1KZOHT2.1 size=241302 2024-09-19T13:42:58.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.763+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=656VO1KZOHT2 tag=IUDAVQ30NO4I type=write size=2338454 2024-09-19T13:42:58.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.765+0000 7f6ab10d2780 1 < suggested update operation key=P2U09V0G7UUU tag=8U7CK2RU8Y7M type=write size=81033 2024-09-19T13:42:58.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.767+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~LY1AZUOA42UQ.0 size=1048576 2024-09-19T13:42:58.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.768+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~LY1AZUOA42UQ.1 size=1048576 2024-09-19T13:42:58.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.769+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~LY1AZUOA42UQ.2 size=476885 2024-09-19T13:42:58.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.769+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=LY1AZUOA42UQ tag=NLPMN3MQW8YQ type=write size=3622613 2024-09-19T13:42:58.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.770+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~GWBMH4EQMSYG.0 size=1048576 2024-09-19T13:42:58.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.771+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~GWBMH4EQMSYG.1 size=935555 2024-09-19T13:42:58.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.773+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=GWBMH4EQMSYG tag=EE1T3KSCHLWI type=write size=3032707 2024-09-19T13:42:58.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.775+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~JBIV2D7AF9Q8.0 size=1048576 2024-09-19T13:42:58.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.776+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~JBIV2D7AF9Q8.1 size=1048576 2024-09-19T13:42:58.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.777+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~JBIV2D7AF9Q8.2 size=966503 2024-09-19T13:42:58.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.777+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=JBIV2D7AF9Q8 tag=X2AXVBIG1EEH type=write size=4112231 2024-09-19T13:42:58.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.778+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~C8P0RQCZO4Q2.0 size=1048576 2024-09-19T13:42:58.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.779+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~C8P0RQCZO4Q2.1 size=475225 2024-09-19T13:42:58.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.781+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=C8P0RQCZO4Q2 tag=G03TISJXXG05 type=write size=2572377 2024-09-19T13:42:58.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.782+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=QUGQJLWSSJQ8 type=del size=2391348 2024-09-19T13:42:58.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.783+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=4KT7FG218HIZ type=del 2024-09-19T13:42:58.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.785+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~YVYC92WTTYUR.0 size=1048576 2024-09-19T13:42:58.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.786+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~YVYC92WTTYUR.1 size=1048576 2024-09-19T13:42:58.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.787+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~YVYC92WTTYUR.2 size=420514 2024-09-19T13:42:58.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.787+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=YVYC92WTTYUR tag=ZA4M7WP0AIZF type=write size=3566242 2024-09-19T13:42:58.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.788+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=PMD5UBKONPBY type=del 2024-09-19T13:42:58.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.790+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~Q16WQHR8K82G.0 size=1048576 2024-09-19T13:42:58.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.791+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~Q16WQHR8K82G.1 size=1048576 2024-09-19T13:42:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.792+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~Q16WQHR8K82G.2 size=230228 2024-09-19T13:42:58.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.792+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=Q16WQHR8K82G tag=HPC3S6DOGJUA type=write size=3375956 2024-09-19T13:42:58.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.793+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=ZSWMCAPS4KKG type=del 2024-09-19T13:42:58.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.794+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=NYR3EKH3D0VE type=write size=455643 2024-09-19T13:42:58.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.795+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~Z8BODR8X3CZ6.0 size=1048576 2024-09-19T13:42:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.796+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~Z8BODR8X3CZ6.1 size=1048576 2024-09-19T13:42:58.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.796+0000 7f6ab10d2780 1 < canceled part key=_multipart_DF003ORZ1HOM.2~Z8BODR8X3CZ6.2 size=659379 2024-09-19T13:42:58.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.798+0000 7f6ab10d2780 1 < canceled multipart upload key=DF003ORZ1HOM upload=Z8BODR8X3CZ6 tag=RTU9BAB78WWJ type=write size=3805107 2024-09-19T13:42:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.800+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~JDM1UVANPGU4.0 size=1048576 2024-09-19T13:42:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.801+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~JDM1UVANPGU4.1 size=1048576 2024-09-19T13:42:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.803+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~JDM1UVANPGU4.2 size=246998 2024-09-19T13:42:58.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.803+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=JDM1UVANPGU4 tag=6GFKZOWJN0KX type=write size=3392726 2024-09-19T13:42:58.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.804+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~YHUUYMUDA44P.0 size=1048576 2024-09-19T13:42:58.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.805+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~YHUUYMUDA44P.1 size=1048576 2024-09-19T13:42:58.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.805+0000 7f6ab10d2780 1 < canceled part key=_multipart_B0J7E7A0NP4J.2~YHUUYMUDA44P.2 size=757163 2024-09-19T13:42:58.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.807+0000 7f6ab10d2780 1 < canceled multipart upload key=B0J7E7A0NP4J upload=YHUUYMUDA44P tag=ZXJY9EG1FUY5 type=write size=3902891 2024-09-19T13:42:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.809+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~565SGZMHT59J.0 size=224462 2024-09-19T13:42:58.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.809+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=565SGZMHT59J tag=SLJ66Z8MF13S type=write size=1273038 2024-09-19T13:42:58.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.810+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~PAAUOAHKH40O.0 size=328286 2024-09-19T13:42:58.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.812+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=PAAUOAHKH40O tag=XDGQY2N7UMQK type=write size=1376862 2024-09-19T13:42:58.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.813+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=W8ESZ35RG1HQ type=del size=186916 2024-09-19T13:42:58.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.814+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~UVPVFBP2Q49K.0 size=1048576 2024-09-19T13:42:58.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.815+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~UVPVFBP2Q49K.1 size=936954 2024-09-19T13:42:58.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.817+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=UVPVFBP2Q49K tag=PFE90UW2WZC6 type=write size=3034106 2024-09-19T13:42:58.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.819+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~7RIST7NNXXNR.0 size=1048576 2024-09-19T13:42:58.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.820+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~7RIST7NNXXNR.1 size=112417 2024-09-19T13:42:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.820+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=7RIST7NNXXNR tag=5BSX674P3QJK type=write size=2209569 2024-09-19T13:42:58.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.821+0000 7f6ab10d2780 -1 < failed to complete operation key=9MCE8PXHBGNF tag=WHQY9W4J29QW type=write size=775184: (22) Invalid argument 2024-09-19T13:42:58.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.822+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=RJO3IF92YBXO type=del size=30251 2024-09-19T13:42:58.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.823+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=V0JZIWL8NI4T type=del 2024-09-19T13:42:58.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.825+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~SEK2GT1O0UCG.0 size=386363 2024-09-19T13:42:58.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.825+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=SEK2GT1O0UCG tag=2MAB6DQKQS5V type=write size=1434939 2024-09-19T13:42:58.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.826+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=EF5DQAB5YT4A type=del 2024-09-19T13:42:58.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.827+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=BRDXYEJWQ3ZH type=del size=1918495 2024-09-19T13:42:58.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.828+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=9ZN5DQEQ57BP type=del 2024-09-19T13:42:58.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.830+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~470G2WUZIA9P.0 size=1002055 2024-09-19T13:42:58.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.830+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=470G2WUZIA9P tag=F6CBD5ABTIAN type=write size=2050631 2024-09-19T13:42:58.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.831+0000 7f6ab10d2780 1 < canceled operation key=7LHSAN5BBQRW tag=EE3SUCU273PO type=del size=349730 2024-09-19T13:42:58.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.833+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~UISW98V2467D.0 size=1048576 2024-09-19T13:42:58.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.834+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~UISW98V2467D.1 size=1048576 2024-09-19T13:42:58.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.834+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~UISW98V2467D.2 size=53695 2024-09-19T13:42:58.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.834+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=UISW98V2467D tag=FG2JKGOWZLQV type=write size=3199423 2024-09-19T13:42:58.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.835+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~656VO1KZOHT2.0 size=1048576 2024-09-19T13:42:58.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.835+0000 7f6ab10d2780 1 < canceled part key=_multipart_CD4XXORKVS6J.2~656VO1KZOHT2.1 size=241302 2024-09-19T13:42:58.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.837+0000 7f6ab10d2780 1 < canceled multipart upload key=CD4XXORKVS6J upload=656VO1KZOHT2 tag=IUDAVQ30NO4I type=write size=2338454 2024-09-19T13:42:58.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.839+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~1UKG0SQMGWV7.0 size=1048576 2024-09-19T13:42:58.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.840+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~1UKG0SQMGWV7.1 size=1048576 2024-09-19T13:42:58.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.841+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~1UKG0SQMGWV7.2 size=775174 2024-09-19T13:42:58.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.841+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=1UKG0SQMGWV7 tag=OGIOA7C6YP9L type=write size=3920902 2024-09-19T13:42:58.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.842+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~LY1AZUOA42UQ.0 size=1048576 2024-09-19T13:42:58.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.843+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~LY1AZUOA42UQ.1 size=1048576 2024-09-19T13:42:58.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.843+0000 7f6ab10d2780 1 < canceled part key=_multipart_V8P17ZSOQUSM.2~LY1AZUOA42UQ.2 size=476885 2024-09-19T13:42:58.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.844+0000 7f6ab10d2780 1 < canceled multipart upload key=V8P17ZSOQUSM upload=LY1AZUOA42UQ tag=NLPMN3MQW8YQ type=write size=3622613 2024-09-19T13:42:58.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.846+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=8H3R5N4N3NSN type=del size=3557950 2024-09-19T13:42:58.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.847+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~JBIV2D7AF9Q8.0 size=1048576 2024-09-19T13:42:58.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.848+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~JBIV2D7AF9Q8.1 size=1048576 2024-09-19T13:42:58.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.848+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~JBIV2D7AF9Q8.2 size=966503 2024-09-19T13:42:58.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.850+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=JBIV2D7AF9Q8 tag=X2AXVBIG1EEH type=write size=4112231 2024-09-19T13:42:58.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.851+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=ZESDZ9FRK4MA type=del size=2120515 2024-09-19T13:42:58.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.852+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=QUGQJLWSSJQ8 type=del 2024-09-19T13:42:58.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.854+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~O2S72MLDI8MK.0 size=1048576 2024-09-19T13:42:58.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.855+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~O2S72MLDI8MK.1 size=1048576 2024-09-19T13:42:58.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.856+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~O2S72MLDI8MK.2 size=285086 2024-09-19T13:42:58.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.856+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=O2S72MLDI8MK tag=C0ME1PP70K6C type=write size=3430814 2024-09-19T13:42:58.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.857+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~YVYC92WTTYUR.0 size=1048576 2024-09-19T13:42:58.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.858+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~YVYC92WTTYUR.1 size=1048576 2024-09-19T13:42:58.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.859+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~YVYC92WTTYUR.2 size=420514 2024-09-19T13:42:58.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.861+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=YVYC92WTTYUR tag=ZA4M7WP0AIZF type=write size=3566242 2024-09-19T13:42:58.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.862+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=32L9UIRZTUSV type=del size=2115231 2024-09-19T13:42:58.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.863+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~Q16WQHR8K82G.0 size=1048576 2024-09-19T13:42:58.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.864+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~Q16WQHR8K82G.1 size=1048576 2024-09-19T13:42:58.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.865+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~Q16WQHR8K82G.2 size=230228 2024-09-19T13:42:58.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.867+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=Q16WQHR8K82G tag=HPC3S6DOGJUA type=write size=3375956 2024-09-19T13:42:58.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.868+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=6RY3ETT2QVON type=del size=3168041 2024-09-19T13:42:58.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.869+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=NYR3EKH3D0VE type=write size=455643 2024-09-19T13:42:58.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.870+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=ECZL8EQWCB57 type=del size=2566577 2024-09-19T13:42:58.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.871+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~JDM1UVANPGU4.0 size=1048576 2024-09-19T13:42:58.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.872+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~JDM1UVANPGU4.1 size=1048576 2024-09-19T13:42:58.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.873+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~JDM1UVANPGU4.2 size=246998 2024-09-19T13:42:58.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.875+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=JDM1UVANPGU4 tag=6GFKZOWJN0KX type=write size=3392726 2024-09-19T13:42:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.877+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~D3NITRWT2UCM.0 size=1027287 2024-09-19T13:42:58.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.877+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=D3NITRWT2UCM tag=5N6HPVISX1ZS type=write size=2075863 2024-09-19T13:42:58.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.878+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~565SGZMHT59J.0 size=224462 2024-09-19T13:42:58.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.880+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=565SGZMHT59J tag=SLJ66Z8MF13S type=write size=1273038 2024-09-19T13:42:58.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.882+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~T1HP00MSUHSK.0 size=1048576 2024-09-19T13:42:58.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.883+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~T1HP00MSUHSK.1 size=1048576 2024-09-19T13:42:58.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.884+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~T1HP00MSUHSK.2 size=156406 2024-09-19T13:42:58.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.884+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=T1HP00MSUHSK tag=K2OGG5L5CKOP type=write size=3302134 2024-09-19T13:42:58.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.886+0000 7f6ab10d2780 1 < suggested update operation key=B0J7E7A0NP4J tag=W8ESZ35RG1HQ type=del size=186916 2024-09-19T13:42:58.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.887+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=GRTSQM3026U9 type=del size=2631832 2024-09-19T13:42:58.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.888+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~7RIST7NNXXNR.0 size=1048576 2024-09-19T13:42:58.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.889+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~7RIST7NNXXNR.1 size=112417 2024-09-19T13:42:58.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.891+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=7RIST7NNXXNR tag=5BSX674P3QJK type=write size=2209569 2024-09-19T13:42:58.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.892+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=OFID73TQXPQR type=del size=2921878 2024-09-19T13:42:58.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.893+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=RJO3IF92YBXO type=del 2024-09-19T13:42:58.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.895+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~EU6LEYAOMKXA.0 size=91345 2024-09-19T13:42:58.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.895+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=EU6LEYAOMKXA tag=VGE1N03PO93F type=write size=1139921 2024-09-19T13:42:58.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.896+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~SEK2GT1O0UCG.0 size=386363 2024-09-19T13:42:58.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.898+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=SEK2GT1O0UCG tag=2MAB6DQKQS5V type=write size=1434939 2024-09-19T13:42:58.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.899+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=AOH0MUNX0924 type=del size=4172242 2024-09-19T13:42:58.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.900+0000 7f6ab10d2780 -1 < failed to complete operation key=B0J7E7A0NP4J tag=BRDXYEJWQ3ZH type=del size=1918495: (22) Invalid argument 2024-09-19T13:42:58.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.902+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=8TNQZ2XMA50T type=del size=2272662 2024-09-19T13:42:58.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.904+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~470G2WUZIA9P.0 size=1002055 2024-09-19T13:42:58.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.906+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=470G2WUZIA9P tag=F6CBD5ABTIAN type=write size=2050631 2024-09-19T13:42:58.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.907+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=VG16IOYK2LO7 type=write size=948370 2024-09-19T13:42:58.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.908+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~UISW98V2467D.0 size=1048576 2024-09-19T13:42:58.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.909+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~UISW98V2467D.1 size=1048576 2024-09-19T13:42:58.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.910+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~UISW98V2467D.2 size=53695 2024-09-19T13:42:58.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.912+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=UISW98V2467D tag=FG2JKGOWZLQV type=write size=3199423 2024-09-19T13:42:58.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.913+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=4Q9OP46XH1NN type=del size=3885370 2024-09-19T13:42:58.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.914+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~1UKG0SQMGWV7.0 size=1048576 2024-09-19T13:42:58.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.915+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~1UKG0SQMGWV7.1 size=1048576 2024-09-19T13:42:58.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.916+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~1UKG0SQMGWV7.2 size=775174 2024-09-19T13:42:58.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.918+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=1UKG0SQMGWV7 tag=OGIOA7C6YP9L type=write size=3920902 2024-09-19T13:42:58.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.919+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=ZRLND42ZT4DI type=del size=1294105 2024-09-19T13:42:58.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.920+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=8H3R5N4N3NSN type=del 2024-09-19T13:42:58.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.921+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=NPHR1I89CXXH type=del size=2975232 2024-09-19T13:42:58.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.922+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=ZESDZ9FRK4MA type=del 2024-09-19T13:42:58.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.924+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=5IIUVAD78IYQ type=del size=1044121 2024-09-19T13:42:58.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.925+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~O2S72MLDI8MK.0 size=1048576 2024-09-19T13:42:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.926+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~O2S72MLDI8MK.1 size=1048576 2024-09-19T13:42:58.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.926+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~O2S72MLDI8MK.2 size=285086 2024-09-19T13:42:58.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.928+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=O2S72MLDI8MK tag=C0ME1PP70K6C type=write size=3430814 2024-09-19T13:42:58.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.929+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=A4VHR71E256P type=write size=495013 2024-09-19T13:42:58.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.930+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=32L9UIRZTUSV type=del 2024-09-19T13:42:58.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.932+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=6FQYTT3KFIYZ type=del size=2319719 2024-09-19T13:42:58.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.934+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=6RY3ETT2QVON type=del size=3168041 2024-09-19T13:42:58.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.935+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=B760PSXDB8US type=write size=145378 2024-09-19T13:42:58.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.936+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=ECZL8EQWCB57 type=del 2024-09-19T13:42:58.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.937+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=2WSYBTDPZ1EG type=del size=3538790 2024-09-19T13:42:58.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.939+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~D3NITRWT2UCM.0 size=1027287 2024-09-19T13:42:58.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.941+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=D3NITRWT2UCM tag=5N6HPVISX1ZS type=write size=2075863 2024-09-19T13:42:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.942+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=8FYUIVCO913Z type=del size=3386882 2024-09-19T13:42:58.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.942+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~T1HP00MSUHSK.0 size=1048576 2024-09-19T13:42:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.943+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~T1HP00MSUHSK.1 size=1048576 2024-09-19T13:42:58.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.943+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~T1HP00MSUHSK.2 size=156406 2024-09-19T13:42:58.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.945+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=T1HP00MSUHSK tag=K2OGG5L5CKOP type=write size=3302134 2024-09-19T13:42:58.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.947+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~H1WBRNWBIXXA.0 size=282749 2024-09-19T13:42:58.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.947+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=H1WBRNWBIXXA tag=32EMK752YD5R type=write size=1331325 2024-09-19T13:42:58.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.948+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=GRTSQM3026U9 type=del 2024-09-19T13:42:58.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.949+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=FD4FID6DEZD2 type=del size=205689 2024-09-19T13:42:58.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.951+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=OFID73TQXPQR type=del 2024-09-19T13:42:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.952+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=N62382B5PXJA type=write size=608111 2024-09-19T13:42:58.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.952+0000 7f6ab10d2780 1 < canceled part key=_multipart_RXXCDV0LTCKS.2~EU6LEYAOMKXA.0 size=91345 2024-09-19T13:42:58.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.954+0000 7f6ab10d2780 1 < canceled multipart upload key=RXXCDV0LTCKS upload=EU6LEYAOMKXA tag=VGE1N03PO93F type=write size=1139921 2024-09-19T13:42:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.956+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~LVMSAH1XCVM5.0 size=1048576 2024-09-19T13:42:58.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.957+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~LVMSAH1XCVM5.1 size=852170 2024-09-19T13:42:58.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.957+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=LVMSAH1XCVM5 tag=7F0X1BKMR334 type=write size=2949322 2024-09-19T13:42:58.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.959+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=AOH0MUNX0924 type=del size=4172242 2024-09-19T13:42:58.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.960+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=VIEQ8KDULTIE type=del size=1072013 2024-09-19T13:42:58.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.963+0000 7f6ab10d2780 1 < suggested remove operation key=B0J7E7A0NP4J tag=8TNQZ2XMA50T type=del 2024-09-19T13:42:58.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.965+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~USSGIWR6W7WB.0 size=1048576 2024-09-19T13:42:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.966+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~USSGIWR6W7WB.1 size=1048576 2024-09-19T13:42:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.967+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~USSGIWR6W7WB.2 size=260579 2024-09-19T13:42:58.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.967+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=USSGIWR6W7WB tag=O8HNP3EUBKYI type=write size=3406307 2024-09-19T13:42:58.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.968+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=VG16IOYK2LO7 type=write size=948370 2024-09-19T13:42:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.969+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=7Z4UQINSTNX9 type=del size=3182387 2024-09-19T13:42:58.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.972+0000 7f6ab10d2780 1 < suggested remove operation key=X8CWBFNCJG6M tag=4Q9OP46XH1NN type=del 2024-09-19T13:42:58.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.973+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=5U6WCX06KM8M type=del size=2078121 2024-09-19T13:42:58.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.975+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=ZRLND42ZT4DI type=del 2024-09-19T13:42:58.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.976+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=HUZWX2H7UR7A type=write size=1010588 2024-09-19T13:42:58.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.977+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=NPHR1I89CXXH type=del 2024-09-19T13:42:58.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.979+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~750KLFSJVOPG.0 size=1048576 2024-09-19T13:42:58.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.980+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~750KLFSJVOPG.1 size=759761 2024-09-19T13:42:58.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.980+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=750KLFSJVOPG tag=58I2242MCUYS type=write size=2856913 2024-09-19T13:42:58.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.981+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=5IIUVAD78IYQ type=del 2024-09-19T13:42:58.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.983+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~YLV9IQ2CWTMM.0 size=999061 2024-09-19T13:42:58.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.983+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=YLV9IQ2CWTMM tag=OL2CDW4RMV4T type=write size=2047637 2024-09-19T13:42:58.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.984+0000 7f6ab10d2780 1 < canceled operation key=2KX2NSY41STV tag=A4VHR71E256P type=write size=495013 2024-09-19T13:42:58.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.986+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~QXEHE2ZY1OJR.0 size=1048576 2024-09-19T13:42:58.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.987+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~QXEHE2ZY1OJR.1 size=1048576 2024-09-19T13:42:58.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.988+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~QXEHE2ZY1OJR.2 size=895252 2024-09-19T13:42:58.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.988+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=QXEHE2ZY1OJR tag=MHW3TH3NV9DO type=write size=4040980 2024-09-19T13:42:58.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.990+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=6FQYTT3KFIYZ type=del 2024-09-19T13:42:58.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.991+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=0E60A0I65U49 type=del size=3487429 2024-09-19T13:42:58.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.993+0000 7f6ab10d2780 1 < suggested update operation key=4OSJA1879NQO tag=B760PSXDB8US type=write size=145378 2024-09-19T13:42:58.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.994+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=0FMDLMLBD06W type=del size=447383 2024-09-19T13:42:58.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.997+0000 7f6ab10d2780 1 < suggested remove operation key=QTGKMAOX2A6U tag=2WSYBTDPZ1EG type=del 2024-09-19T13:42:59.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:58.999+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~EBN37PBGMQ3D.0 size=1048576 2024-09-19T13:42:59.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.000+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~EBN37PBGMQ3D.1 size=238293 2024-09-19T13:42:59.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.000+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=EBN37PBGMQ3D tag=EC91603JS6E2 type=write size=2335445 2024-09-19T13:42:59.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.001+0000 7f6ab10d2780 1 < canceled operation key=A14YTABJ1Z3Z tag=8FYUIVCO913Z type=del size=3386882 2024-09-19T13:42:59.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.002+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=4CW23KOMQD0P type=del size=752827 2024-09-19T13:42:59.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.003+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~H1WBRNWBIXXA.0 size=282749 2024-09-19T13:42:59.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.005+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=H1WBRNWBIXXA tag=32EMK752YD5R type=write size=1331325 2024-09-19T13:42:59.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.007+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~OVPV8KAZCQ0P.0 size=1048576 2024-09-19T13:42:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.008+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~OVPV8KAZCQ0P.1 size=942287 2024-09-19T13:42:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.008+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=OVPV8KAZCQ0P tag=Z2PF79VWC3HR type=write size=3039439 2024-09-19T13:42:59.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.009+0000 7f6ab10d2780 -1 < failed to complete operation key=X8CWBFNCJG6M tag=FD4FID6DEZD2 type=del size=205689: (22) Invalid argument 2024-09-19T13:42:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.011+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=W49PQ02BH13U type=del size=3610687 2024-09-19T13:42:59.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.014+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=N62382B5PXJA type=write size=608111 2024-09-19T13:42:59.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.015+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=G6ZBUJBJ3BRQ type=del size=1371353 2024-09-19T13:42:59.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.016+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~LVMSAH1XCVM5.0 size=1048576 2024-09-19T13:42:59.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.017+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~LVMSAH1XCVM5.1 size=852170 2024-09-19T13:42:59.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.019+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=LVMSAH1XCVM5 tag=7F0X1BKMR334 type=write size=2949322 2024-09-19T13:42:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.020+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~2WMVL94V7FYU.0 size=1048576 2024-09-19T13:42:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.021+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~2WMVL94V7FYU.1 size=607595 2024-09-19T13:42:59.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.021+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=2WMVL94V7FYU tag=UP4HVREGYPCG type=write size=2704747 2024-09-19T13:42:59.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.022+0000 7f6ab10d2780 1 < canceled operation key=SERUGCO68R9W tag=VIEQ8KDULTIE type=del size=1072013 2024-09-19T13:42:59.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.023+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=HCIA4GMS73F3 type=del size=3160151 2024-09-19T13:42:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.024+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~USSGIWR6W7WB.0 size=1048576 2024-09-19T13:42:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.024+0000 7f6ab10d2780 1 < canceled part key=_multipart_EE8F84K0ZAGJ.2~USSGIWR6W7WB.1 size=1048576 2024-09-19T13:42:59.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.024+0000 7f6ab10d2780 1 < canceled part key=_multipart_EE8F84K0ZAGJ.2~USSGIWR6W7WB.2 size=260579 2024-09-19T13:42:59.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.026+0000 7f6ab10d2780 1 < canceled multipart upload key=EE8F84K0ZAGJ upload=USSGIWR6W7WB tag=O8HNP3EUBKYI type=write size=3406307 2024-09-19T13:42:59.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.027+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=ATFE8D1K45NB type=del size=1345079 2024-09-19T13:42:59.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.028+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=7Z4UQINSTNX9 type=del 2024-09-19T13:42:59.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.029+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=B4UEAY2T5EEX type=del size=2172035 2024-09-19T13:42:59.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.031+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=5U6WCX06KM8M type=del 2024-09-19T13:42:59.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.032+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=V0GF6QQXMMDP type=del size=2864956 2024-09-19T13:42:59.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.033+0000 7f6ab10d2780 1 < completed write operation key=P2U09V0G7UUU tag=HUZWX2H7UR7A type=write size=1010588 2024-09-19T13:42:59.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.034+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=EOXTWGWGJ4UB type=del size=2888146 2024-09-19T13:42:59.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.035+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~750KLFSJVOPG.0 size=1048576 2024-09-19T13:42:59.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.036+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~750KLFSJVOPG.1 size=759761 2024-09-19T13:42:59.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.038+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=750KLFSJVOPG tag=58I2242MCUYS type=write size=2856913 2024-09-19T13:42:59.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.039+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=S89B7ZVO70WR type=del size=822659 2024-09-19T13:42:59.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.039+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~YLV9IQ2CWTMM.0 size=999061 2024-09-19T13:42:59.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.041+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=YLV9IQ2CWTMM tag=OL2CDW4RMV4T type=write size=2047637 2024-09-19T13:42:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.042+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=DGPUXO5V9L06 type=del size=2058884 2024-09-19T13:42:59.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.042+0000 7f6ab10d2780 1 < canceled part key=_multipart_RU6OR8SM72GU.2~QXEHE2ZY1OJR.0 size=1048576 2024-09-19T13:42:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.043+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~QXEHE2ZY1OJR.1 size=1048576 2024-09-19T13:42:59.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.043+0000 7f6ab10d2780 1 < canceled part key=_multipart_RU6OR8SM72GU.2~QXEHE2ZY1OJR.2 size=895252 2024-09-19T13:42:59.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.045+0000 7f6ab10d2780 1 < canceled multipart upload key=RU6OR8SM72GU upload=QXEHE2ZY1OJR tag=MHW3TH3NV9DO type=write size=4040980 2024-09-19T13:42:59.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.047+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~VUDJD1UZTAOX.0 size=1048576 2024-09-19T13:42:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.048+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~VUDJD1UZTAOX.1 size=738433 2024-09-19T13:42:59.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.048+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=VUDJD1UZTAOX tag=6B7OTS7Q1NCW type=write size=2835585 2024-09-19T13:42:59.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.050+0000 7f6ab10d2780 1 < suggested remove operation key=QTGKMAOX2A6U tag=0E60A0I65U49 type=del 2024-09-19T13:42:59.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.051+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=5FET34ONPEUK type=write size=827931 2024-09-19T13:42:59.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.053+0000 7f6ab10d2780 1 < suggested update operation key=DTSRVH526PE7 tag=0FMDLMLBD06W type=del size=447383 2024-09-19T13:42:59.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.054+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=PVHSRTSQ3LC2 type=write size=559189 2024-09-19T13:42:59.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.055+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~EBN37PBGMQ3D.0 size=1048576 2024-09-19T13:42:59.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.056+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~EBN37PBGMQ3D.1 size=238293 2024-09-19T13:42:59.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.058+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=EBN37PBGMQ3D tag=EC91603JS6E2 type=write size=2335445 2024-09-19T13:42:59.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.059+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=9ALD3167Y359 type=del size=1936247 2024-09-19T13:42:59.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.061+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=4CW23KOMQD0P type=del 2024-09-19T13:42:59.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.062+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=9BIYVVW9YSMH type=del size=3383668 2024-09-19T13:42:59.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.063+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~OVPV8KAZCQ0P.0 size=1048576 2024-09-19T13:42:59.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.064+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~OVPV8KAZCQ0P.1 size=942287 2024-09-19T13:42:59.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.066+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=OVPV8KAZCQ0P tag=Z2PF79VWC3HR type=write size=3039439 2024-09-19T13:42:59.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.068+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~07YISJ920C38.0 size=1048576 2024-09-19T13:42:59.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.069+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~07YISJ920C38.1 size=198812 2024-09-19T13:42:59.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.069+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=07YISJ920C38 tag=TFKS6OXBCB6F type=write size=2295964 2024-09-19T13:42:59.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.071+0000 7f6ab10d2780 1 < suggested update operation key=CD4XXORKVS6J tag=W49PQ02BH13U type=del size=3610687 2024-09-19T13:42:59.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.073+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~05S9T5XWM8H1.0 size=1048576 2024-09-19T13:42:59.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.074+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~05S9T5XWM8H1.1 size=1048576 2024-09-19T13:42:59.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.075+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~05S9T5XWM8H1.2 size=433485 2024-09-19T13:42:59.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.075+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=05S9T5XWM8H1 tag=Y6W5Y9ACXBML type=write size=3579213 2024-09-19T13:42:59.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.077+0000 7f6ab10d2780 1 < suggested remove operation key=XQLWZA2X91GF tag=G6ZBUJBJ3BRQ type=del 2024-09-19T13:42:59.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.078+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=2RAM26RYZ37P type=del size=2394245 2024-09-19T13:42:59.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.079+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~2WMVL94V7FYU.0 size=1048576 2024-09-19T13:42:59.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.080+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~2WMVL94V7FYU.1 size=607595 2024-09-19T13:42:59.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.082+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=2WMVL94V7FYU tag=UP4HVREGYPCG type=write size=2704747 2024-09-19T13:42:59.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.083+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=QETPX6P6YTYE type=del size=678754 2024-09-19T13:42:59.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.084+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=HCIA4GMS73F3 type=del 2024-09-19T13:42:59.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.086+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=309LYR6T1YV2 type=write size=159660 2024-09-19T13:42:59.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.087+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=ATFE8D1K45NB type=del 2024-09-19T13:42:59.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.088+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=GEB90ZB17LYY type=del size=3575699 2024-09-19T13:42:59.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.090+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=B4UEAY2T5EEX type=del 2024-09-19T13:42:59.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.092+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~XX4WR0UDXRXT.0 size=1048576 2024-09-19T13:42:59.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.093+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~XX4WR0UDXRXT.1 size=694208 2024-09-19T13:42:59.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.093+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=XX4WR0UDXRXT tag=ALY0ITMTOCHH type=write size=2791360 2024-09-19T13:42:59.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.094+0000 7f6ab10d2780 -1 < failed to complete operation key=QTGKMAOX2A6U tag=V0GF6QQXMMDP type=del size=2864956: (22) Invalid argument 2024-09-19T13:42:59.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.095+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=M0O2B6C5MYUS type=del size=1552711 2024-09-19T13:42:59.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.097+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=EOXTWGWGJ4UB type=del 2024-09-19T13:42:59.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.099+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~2F339Z7AFZCN.0 size=1048576 2024-09-19T13:42:59.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.100+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~2F339Z7AFZCN.1 size=184518 2024-09-19T13:42:59.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.100+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=2F339Z7AFZCN tag=94UQ2JZ94FTW type=write size=2281670 2024-09-19T13:42:59.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.101+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=S89B7ZVO70WR type=del size=822659 2024-09-19T13:42:59.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.103+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~6RYUMV5KCBFQ.0 size=823408 2024-09-19T13:42:59.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.103+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=6RYUMV5KCBFQ tag=8X13FU8WMSIJ type=write size=1871984 2024-09-19T13:42:59.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.104+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=DGPUXO5V9L06 type=del 2024-09-19T13:42:59.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.106+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~ALXWMALEPWS3.0 size=550446 2024-09-19T13:42:59.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.106+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=ALXWMALEPWS3 tag=X84MGRS0FHAX type=write size=1599022 2024-09-19T13:42:59.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.108+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~VUDJD1UZTAOX.0 size=1048576 2024-09-19T13:42:59.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.108+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~VUDJD1UZTAOX.1 size=738433 2024-09-19T13:42:59.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.110+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=VUDJD1UZTAOX tag=6B7OTS7Q1NCW type=write size=2835585 2024-09-19T13:42:59.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.112+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=WCV37TR95TQG type=del size=2051188 2024-09-19T13:42:59.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.114+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=5FET34ONPEUK type=write 2024-09-19T13:42:59.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.115+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=6L6CHPOMF65A type=del size=3705105 2024-09-19T13:42:59.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.116+0000 7f6ab10d2780 1 < completed write operation key=SRABG45EPVN2 tag=PVHSRTSQ3LC2 type=write size=559189 2024-09-19T13:42:59.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.118+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=FUYISB359L7T type=write size=328495 2024-09-19T13:42:59.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.119+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=9ALD3167Y359 type=del 2024-09-19T13:42:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.121+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~EEOZRCYBIG16.0 size=897474 2024-09-19T13:42:59.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.121+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=EEOZRCYBIG16 tag=BFORBDLQE3T3 type=write size=1946050 2024-09-19T13:42:59.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.122+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=9BIYVVW9YSMH type=del 2024-09-19T13:42:59.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.124+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=RPP1DGHHN812 type=write size=383000 2024-09-19T13:42:59.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.125+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~07YISJ920C38.0 size=1048576 2024-09-19T13:42:59.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.125+0000 7f6ab10d2780 1 < canceled part key=_multipart_9Q9DGUSDSE49.2~07YISJ920C38.1 size=198812 2024-09-19T13:42:59.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.127+0000 7f6ab10d2780 1 < canceled multipart upload key=9Q9DGUSDSE49 upload=07YISJ920C38 tag=TFKS6OXBCB6F type=write size=2295964 2024-09-19T13:42:59.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.128+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=ZLSX30FZ21P0 type=del size=2415220 2024-09-19T13:42:59.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.129+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~05S9T5XWM8H1.0 size=1048576 2024-09-19T13:42:59.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.130+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~05S9T5XWM8H1.1 size=1048576 2024-09-19T13:42:59.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.131+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~05S9T5XWM8H1.2 size=433485 2024-09-19T13:42:59.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.133+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=05S9T5XWM8H1 tag=Y6W5Y9ACXBML type=write size=3579213 2024-09-19T13:42:59.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.135+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~F3JNB2C3S36T.0 size=1048576 2024-09-19T13:42:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.136+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~F3JNB2C3S36T.1 size=550975 2024-09-19T13:42:59.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.136+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=F3JNB2C3S36T tag=HPYU88XYQGZA type=write size=2648127 2024-09-19T13:42:59.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.137+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=2RAM26RYZ37P type=del 2024-09-19T13:42:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.139+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~H4IIQXOOD4LX.0 size=172743 2024-09-19T13:42:59.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.139+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=H4IIQXOOD4LX tag=N3N1BVZMRD2Q type=write size=1221319 2024-09-19T13:42:59.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.140+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=QETPX6P6YTYE type=del 2024-09-19T13:42:59.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.141+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=0VCG36WSI7I6 type=del size=3364165 2024-09-19T13:42:59.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.143+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=309LYR6T1YV2 type=write 2024-09-19T13:42:59.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.144+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=6RJWWVN2EZA4 type=write size=269172 2024-09-19T13:42:59.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.146+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=GEB90ZB17LYY type=del 2024-09-19T13:42:59.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.147+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~3INC5VZ5148F.0 size=293105 2024-09-19T13:42:59.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.147+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=3INC5VZ5148F tag=B6RR0KCSF5S2 type=write size=1341681 2024-09-19T13:42:59.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.149+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~XX4WR0UDXRXT.0 size=1048576 2024-09-19T13:42:59.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.149+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~XX4WR0UDXRXT.1 size=694208 2024-09-19T13:42:59.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.151+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=XX4WR0UDXRXT tag=ALY0ITMTOCHH type=write size=2791360 2024-09-19T13:42:59.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.152+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=E88S41CQF0N3 type=del size=1467927 2024-09-19T13:42:59.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.153+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=M0O2B6C5MYUS type=del 2024-09-19T13:42:59.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.155+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~5AS34S0Y3PEC.0 size=844364 2024-09-19T13:42:59.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.155+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=5AS34S0Y3PEC tag=6FWHUGI2AKRG type=write size=1892940 2024-09-19T13:42:59.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.156+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~2F339Z7AFZCN.0 size=1048576 2024-09-19T13:42:59.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.157+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~2F339Z7AFZCN.1 size=184518 2024-09-19T13:42:59.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.159+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=2F339Z7AFZCN tag=94UQ2JZ94FTW type=write size=2281670 2024-09-19T13:42:59.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.161+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~IOL5XKHTLM7S.0 size=514050 2024-09-19T13:42:59.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.161+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=IOL5XKHTLM7S tag=RSD6I23R4ZJN type=write size=1562626 2024-09-19T13:42:59.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.162+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~6RYUMV5KCBFQ.0 size=823408 2024-09-19T13:42:59.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.164+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=6RYUMV5KCBFQ tag=8X13FU8WMSIJ type=write size=1871984 2024-09-19T13:42:59.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.165+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=5NT5CSZ1E611 type=del size=3639209 2024-09-19T13:42:59.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.166+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~ALXWMALEPWS3.0 size=550446 2024-09-19T13:42:59.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.168+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=ALXWMALEPWS3 tag=X84MGRS0FHAX type=write size=1599022 2024-09-19T13:42:59.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.170+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~O8FPH9EVB8E9.0 size=1048576 2024-09-19T13:42:59.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.171+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~O8FPH9EVB8E9.1 size=1048576 2024-09-19T13:42:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.172+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~O8FPH9EVB8E9.2 size=671545 2024-09-19T13:42:59.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.172+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=O8FPH9EVB8E9 tag=F7NY5R5VPFU8 type=write size=3817273 2024-09-19T13:42:59.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.173+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=WCV37TR95TQG type=del 2024-09-19T13:42:59.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.174+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=5YVK3E4EZT0Q type=del size=1395871 2024-09-19T13:42:59.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.175+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=6L6CHPOMF65A type=del 2024-09-19T13:42:59.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.176+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=QN1YJRCRLCKT type=write size=49477 2024-09-19T13:42:59.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.177+0000 7f6ab10d2780 1 < completed write operation key=VFJIKOLYI0HN tag=FUYISB359L7T type=write size=328495 2024-09-19T13:42:59.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.178+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=V8URPK1SNVWL type=write size=1005805 2024-09-19T13:42:59.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.179+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~EEOZRCYBIG16.0 size=897474 2024-09-19T13:42:59.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.181+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=EEOZRCYBIG16 tag=BFORBDLQE3T3 type=write size=1946050 2024-09-19T13:42:59.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.183+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~J27E9G6MVFQS.0 size=1048576 2024-09-19T13:42:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.184+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~J27E9G6MVFQS.1 size=386765 2024-09-19T13:42:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.184+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=J27E9G6MVFQS tag=2F2W2F118RYM type=write size=2483917 2024-09-19T13:42:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.185+0000 7f6ab10d2780 -1 < failed to complete operation key=CD4XXORKVS6J tag=RPP1DGHHN812 type=write size=383000: (22) Invalid argument 2024-09-19T13:42:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.186+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=ZGJJ1ZF9AUU9 type=del size=1078613 2024-09-19T13:42:59.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.187+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=ZLSX30FZ21P0 type=del 2024-09-19T13:42:59.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.188+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=MNSSS0KPKC8V type=del size=1097442 2024-09-19T13:42:59.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.189+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~F3JNB2C3S36T.0 size=1048576 2024-09-19T13:42:59.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.190+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~F3JNB2C3S36T.1 size=550975 2024-09-19T13:42:59.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.192+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=F3JNB2C3S36T tag=HPYU88XYQGZA type=write size=2648127 2024-09-19T13:42:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.193+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=3GAPTRI41XZY type=del size=1044753 2024-09-19T13:42:59.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.194+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~H4IIQXOOD4LX.0 size=172743 2024-09-19T13:42:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.196+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=H4IIQXOOD4LX tag=N3N1BVZMRD2Q type=write size=1221319 2024-09-19T13:42:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.197+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=2GHKG2W4XL67 type=write size=439161 2024-09-19T13:42:59.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.198+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=0VCG36WSI7I6 type=del 2024-09-19T13:42:59.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.199+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=C6Z4HOIPMKRU type=del size=2132530 2024-09-19T13:42:59.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.200+0000 7f6ab10d2780 1 < completed write operation key=9WTLWBONAOET tag=6RJWWVN2EZA4 type=write size=269172 2024-09-19T13:42:59.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.202+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=RF79DC3L3A44 type=del size=1426047 2024-09-19T13:42:59.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.203+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~3INC5VZ5148F.0 size=293105 2024-09-19T13:42:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.205+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=3INC5VZ5148F tag=B6RR0KCSF5S2 type=write size=1341681 2024-09-19T13:42:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.207+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~S4UUFIMEUDYJ.0 size=1048576 2024-09-19T13:42:59.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.208+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~S4UUFIMEUDYJ.1 size=722807 2024-09-19T13:42:59.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.208+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=S4UUFIMEUDYJ tag=1B6EQ3OU1XF0 type=write size=2819959 2024-09-19T13:42:59.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.209+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=E88S41CQF0N3 type=del 2024-09-19T13:42:59.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.211+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~BFFQ6XMO5I5D.0 size=1048576 2024-09-19T13:42:59.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.212+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~BFFQ6XMO5I5D.1 size=907073 2024-09-19T13:42:59.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.212+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=BFFQ6XMO5I5D tag=8MTXAEKBODKX type=write size=3004225 2024-09-19T13:42:59.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.213+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~5AS34S0Y3PEC.0 size=844364 2024-09-19T13:42:59.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.215+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=5AS34S0Y3PEC tag=6FWHUGI2AKRG type=write size=1892940 2024-09-19T13:42:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.216+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=UC2AFQ3MWCA0 type=del size=2752011 2024-09-19T13:42:59.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.216+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~IOL5XKHTLM7S.0 size=514050 2024-09-19T13:42:59.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.218+0000 7f6ab10d2780 1 < canceled multipart upload key=9MCE8PXHBGNF upload=IOL5XKHTLM7S tag=RSD6I23R4ZJN type=write size=1562626 2024-09-19T13:42:59.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.221+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~A1MQIBJ1OZXO.0 size=1048576 2024-09-19T13:42:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.222+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~A1MQIBJ1OZXO.1 size=210188 2024-09-19T13:42:59.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.222+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=A1MQIBJ1OZXO tag=AE033SD2LOWD type=write size=2307340 2024-09-19T13:42:59.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.223+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=5NT5CSZ1E611 type=del 2024-09-19T13:42:59.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.224+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=ZTW9SPUXAMBM type=del size=601733 2024-09-19T13:42:59.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.226+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~O8FPH9EVB8E9.0 size=1048576 2024-09-19T13:42:59.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.226+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~O8FPH9EVB8E9.1 size=1048576 2024-09-19T13:42:59.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.227+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~O8FPH9EVB8E9.2 size=671545 2024-09-19T13:42:59.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.229+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=O8FPH9EVB8E9 tag=F7NY5R5VPFU8 type=write size=3817273 2024-09-19T13:42:59.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.231+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~YNVOYASDLBXU.0 size=1048576 2024-09-19T13:42:59.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.232+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~YNVOYASDLBXU.1 size=353822 2024-09-19T13:42:59.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.232+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=YNVOYASDLBXU tag=5TP0D1Q8KQNM type=write size=2450974 2024-09-19T13:42:59.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.234+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=5YVK3E4EZT0Q type=del size=1395871 2024-09-19T13:42:59.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.235+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=BJFWQQ1T3DCA type=del size=2958157 2024-09-19T13:42:59.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.236+0000 7f6ab10d2780 1 < completed write operation key=WDRUV5ERI000 tag=QN1YJRCRLCKT type=write size=49477 2024-09-19T13:42:59.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.238+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=ZECFBKIYAOCX type=del size=3589313 2024-09-19T13:42:59.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.239+0000 7f6ab10d2780 1 < completed write operation key=9MCE8PXHBGNF tag=V8URPK1SNVWL type=write size=1005805 2024-09-19T13:42:59.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.241+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~T8ZO63VHN3IA.0 size=1048576 2024-09-19T13:42:59.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.241+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~T8ZO63VHN3IA.1 size=1048576 2024-09-19T13:42:59.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.242+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~T8ZO63VHN3IA.2 size=139498 2024-09-19T13:42:59.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.242+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=T8ZO63VHN3IA tag=0AOFLMJF8VL7 type=write size=3285226 2024-09-19T13:42:59.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.244+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~J27E9G6MVFQS.0 size=1048576 2024-09-19T13:42:59.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.244+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~J27E9G6MVFQS.1 size=386765 2024-09-19T13:42:59.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.246+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=J27E9G6MVFQS tag=2F2W2F118RYM type=write size=2483917 2024-09-19T13:42:59.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.247+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=EG1DT8Y714V3 type=del size=591488 2024-09-19T13:42:59.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.248+0000 7f6ab10d2780 -1 < failed to complete operation key=DF003ORZ1HOM tag=ZGJJ1ZF9AUU9 type=del size=1078613: (22) Invalid argument 2024-09-19T13:42:59.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.250+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=O206T98X84JY type=write size=878034 2024-09-19T13:42:59.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.251+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=MNSSS0KPKC8V type=del 2024-09-19T13:42:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.252+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=P89HB7EVFLXP type=del size=2848949 2024-09-19T13:42:59.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.253+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=3GAPTRI41XZY type=del 2024-09-19T13:42:59.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.256+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~EQSL6BMSVORO.0 size=1048576 2024-09-19T13:42:59.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.257+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~EQSL6BMSVORO.1 size=498245 2024-09-19T13:42:59.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.257+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=EQSL6BMSVORO tag=22TH2FK9L7B7 type=write size=2595397 2024-09-19T13:42:59.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.258+0000 7f6ab10d2780 1 < completed write operation key=13GXIDWI4J9F tag=2GHKG2W4XL67 type=write size=439161 2024-09-19T13:42:59.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.259+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=KQDC1CEDEWBA type=del size=18825 2024-09-19T13:42:59.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.261+0000 7f6ab10d2780 1 < suggested remove operation key=SDQ64HOD22EM tag=C6Z4HOIPMKRU type=del 2024-09-19T13:42:59.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.262+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=90PR0CEUG26D type=del size=1880085 2024-09-19T13:42:59.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.264+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=RF79DC3L3A44 type=del 2024-09-19T13:42:59.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.265+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=C9L6KHFAIVOI type=del size=5397 2024-09-19T13:42:59.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.266+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~S4UUFIMEUDYJ.0 size=1048576 2024-09-19T13:42:59.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.267+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~S4UUFIMEUDYJ.1 size=722807 2024-09-19T13:42:59.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.269+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=S4UUFIMEUDYJ tag=1B6EQ3OU1XF0 type=write size=2819959 2024-09-19T13:42:59.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.270+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=66E45XS02UFV type=del size=2522016 2024-09-19T13:42:59.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.272+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~BFFQ6XMO5I5D.0 size=1048576 2024-09-19T13:42:59.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.272+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~BFFQ6XMO5I5D.1 size=907073 2024-09-19T13:42:59.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.274+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=BFFQ6XMO5I5D tag=8MTXAEKBODKX type=write size=3004225 2024-09-19T13:42:59.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.276+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~CYKG9SG6Q2QH.0 size=1048576 2024-09-19T13:42:59.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.277+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~CYKG9SG6Q2QH.1 size=1048576 2024-09-19T13:42:59.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.278+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~CYKG9SG6Q2QH.2 size=93475 2024-09-19T13:42:59.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.278+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=CYKG9SG6Q2QH tag=BKYEH0TGKF2R type=write size=3239203 2024-09-19T13:42:59.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.279+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=UC2AFQ3MWCA0 type=del 2024-09-19T13:42:59.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.280+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=CRDBEGZWZP4W type=del size=29643 2024-09-19T13:42:59.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.281+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~A1MQIBJ1OZXO.0 size=1048576 2024-09-19T13:42:59.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.282+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~A1MQIBJ1OZXO.1 size=210188 2024-09-19T13:42:59.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.284+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=A1MQIBJ1OZXO tag=AE033SD2LOWD type=write size=2307340 2024-09-19T13:42:59.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.285+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=O7JCQAAEHP2Z type=del size=583690 2024-09-19T13:42:59.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.286+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=ZTW9SPUXAMBM type=del 2024-09-19T13:42:59.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.287+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=SUPDNHVOCSP8 type=write size=336516 2024-09-19T13:42:59.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.288+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~YNVOYASDLBXU.0 size=1048576 2024-09-19T13:42:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.289+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~YNVOYASDLBXU.1 size=353822 2024-09-19T13:42:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.291+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=YNVOYASDLBXU tag=5TP0D1Q8KQNM type=write size=2450974 2024-09-19T13:42:59.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.292+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=M52ZC41IZKFG type=del size=1773111 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.294+0000 7f6ab10d2780 1 < suggested update operation key=RXXCDV0LTCKS tag=BJFWQQ1T3DCA type=del size=2958157 2024-09-19T13:42:59.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.295+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=Q72I6VN00E6K type=write size=576022 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.296+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=ZECFBKIYAOCX type=del 2024-09-19T13:42:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.299+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~LJXNN5GTEXBM.0 size=206176 2024-09-19T13:42:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.299+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=LJXNN5GTEXBM tag=66TB9D007Y4P type=write size=1254752 2024-09-19T13:42:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.299+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~T8ZO63VHN3IA.0 size=1048576 2024-09-19T13:42:59.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.299+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~T8ZO63VHN3IA.1 size=1048576 2024-09-19T13:42:59.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.300+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~T8ZO63VHN3IA.2 size=139498 2024-09-19T13:42:59.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.302+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=T8ZO63VHN3IA tag=0AOFLMJF8VL7 type=write size=3285226 2024-09-19T13:42:59.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.303+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=GARBTHA116QJ type=del size=2987485 2024-09-19T13:42:59.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.304+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=EG1DT8Y714V3 type=del 2024-09-19T13:42:59.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.306+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=U1DM1HBF4DBE type=write size=363816 2024-09-19T13:42:59.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.307+0000 7f6ab10d2780 1 < completed write operation key=CD4XXORKVS6J tag=O206T98X84JY type=write size=878034 2024-09-19T13:42:59.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.308+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=30CDB6018T65 type=write size=134855 2024-09-19T13:42:59.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.310+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=P89HB7EVFLXP type=del 2024-09-19T13:42:59.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.311+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=MW53B54BADXD type=del size=3944984 2024-09-19T13:42:59.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.311+0000 7f6ab10d2780 1 < canceled part key=_multipart_SDQ64HOD22EM.2~EQSL6BMSVORO.0 size=1048576 2024-09-19T13:42:59.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.312+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~EQSL6BMSVORO.1 size=498245 2024-09-19T13:42:59.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.314+0000 7f6ab10d2780 1 < canceled multipart upload key=SDQ64HOD22EM upload=EQSL6BMSVORO tag=22TH2FK9L7B7 type=write size=2595397 2024-09-19T13:42:59.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.315+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=R4MQ9SV40ZJN type=del size=3713950 2024-09-19T13:42:59.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.317+0000 7f6ab10d2780 1 < suggested update operation key=XQLWZA2X91GF tag=KQDC1CEDEWBA type=del size=18825 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.320+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~V20S4JWFGNIJ.0 size=265891 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.320+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=V20S4JWFGNIJ tag=5136TZYYTF5E type=write size=1314467 2024-09-19T13:42:59.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.321+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=90PR0CEUG26D type=del 2024-09-19T13:42:59.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.323+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~4XENK9JLOYCD.0 size=1048576 2024-09-19T13:42:59.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.324+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~4XENK9JLOYCD.1 size=1048576 2024-09-19T13:42:59.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.325+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~4XENK9JLOYCD.2 size=864353 2024-09-19T13:42:59.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.325+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=4XENK9JLOYCD tag=AAIPQQ6AQ0NN type=write size=4010081 2024-09-19T13:42:59.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.326+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=C9L6KHFAIVOI type=del 2024-09-19T13:42:59.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.327+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=MB7E3KBGFPVL type=del size=1268591 2024-09-19T13:42:59.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.329+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=66E45XS02UFV type=del 2024-09-19T13:42:59.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.331+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~2MD4CQZRCLEQ.0 size=768621 2024-09-19T13:42:59.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.331+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=2MD4CQZRCLEQ tag=O1CC2FEEL49T type=write size=1817197 2024-09-19T13:42:59.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.332+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~CYKG9SG6Q2QH.0 size=1048576 2024-09-19T13:42:59.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.333+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~CYKG9SG6Q2QH.1 size=1048576 2024-09-19T13:42:59.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.334+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~CYKG9SG6Q2QH.2 size=93475 2024-09-19T13:42:59.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.336+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=CYKG9SG6Q2QH tag=BKYEH0TGKF2R type=write size=3239203 2024-09-19T13:42:59.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.337+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=3M309KEFDPUE type=del size=557075 2024-09-19T13:42:59.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.339+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=CRDBEGZWZP4W type=del 2024-09-19T13:42:59.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.340+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=V4RL6OII0AJR type=del size=2965356 2024-09-19T13:42:59.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.342+0000 7f6ab10d2780 1 < suggested remove operation key=TCXAYADSCTZI tag=O7JCQAAEHP2Z type=del 2024-09-19T13:42:59.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.344+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=3N6EAA1YLLAS type=write size=464528 2024-09-19T13:42:59.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.345+0000 7f6ab10d2780 1 < completed write operation key=CD4XXORKVS6J tag=SUPDNHVOCSP8 type=write size=336516 2024-09-19T13:42:59.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.347+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ILX37SN9JKDK.0 size=1048576 2024-09-19T13:42:59.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.348+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ILX37SN9JKDK.1 size=336917 2024-09-19T13:42:59.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.348+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=ILX37SN9JKDK tag=TN5Z1LVMG0Z5 type=write size=2434069 2024-09-19T13:42:59.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.349+0000 7f6ab10d2780 -1 < failed to complete operation key=XQLWZA2X91GF tag=M52ZC41IZKFG type=del size=1773111: (22) Invalid argument 2024-09-19T13:42:59.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.350+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=M0LVLXDNFZS0 type=del size=3023369 2024-09-19T13:42:59.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.352+0000 7f6ab10d2780 1 < suggested remove operation key=XQLWZA2X91GF tag=Q72I6VN00E6K type=write 2024-09-19T13:42:59.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.353+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=6355CAYQOBPN type=del size=2430989 2024-09-19T13:42:59.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.354+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~LJXNN5GTEXBM.0 size=206176 2024-09-19T13:42:59.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.356+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=LJXNN5GTEXBM tag=66TB9D007Y4P type=write size=1254752 2024-09-19T13:42:59.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.357+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=5VXQ3Q4PAT5S type=del size=939527 2024-09-19T13:42:59.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.358+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=GARBTHA116QJ type=del 2024-09-19T13:42:59.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.360+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~M33GSM2KJ2I4.0 size=427806 2024-09-19T13:42:59.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.360+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=M33GSM2KJ2I4 tag=Q74KEEKUGHPD type=write size=1476382 2024-09-19T13:42:59.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.361+0000 7f6ab10d2780 1 < completed write operation key=B0J7E7A0NP4J tag=U1DM1HBF4DBE type=write size=363816 2024-09-19T13:42:59.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.364+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~1VL9W0UEEBNZ.0 size=1048576 2024-09-19T13:42:59.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.364+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~1VL9W0UEEBNZ.1 size=145371 2024-09-19T13:42:59.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.364+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=1VL9W0UEEBNZ tag=7NQXLPNH722G type=write size=2242523 2024-09-19T13:42:59.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.365+0000 7f6ab10d2780 1 < completed write operation key=SDQ64HOD22EM tag=30CDB6018T65 type=write size=134855 2024-09-19T13:42:59.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.367+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=0FYCIWBCC4XB type=del size=955595 2024-09-19T13:42:59.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.368+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=MW53B54BADXD type=del 2024-09-19T13:42:59.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.369+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=WMG5XUV570XA type=del size=1288021 2024-09-19T13:42:59.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.371+0000 7f6ab10d2780 1 < suggested update operation key=RU6OR8SM72GU tag=R4MQ9SV40ZJN type=del size=3713950 2024-09-19T13:42:59.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.372+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=4N8BD5ZUJFL4 type=del size=3845313 2024-09-19T13:42:59.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.374+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~V20S4JWFGNIJ.0 size=265891 2024-09-19T13:42:59.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.375+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=V20S4JWFGNIJ tag=5136TZYYTF5E type=write size=1314467 2024-09-19T13:42:59.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.377+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=6UMO151CYAD1 type=del size=1653019 2024-09-19T13:42:59.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.378+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~4XENK9JLOYCD.0 size=1048576 2024-09-19T13:42:59.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.379+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~4XENK9JLOYCD.1 size=1048576 2024-09-19T13:42:59.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.380+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~4XENK9JLOYCD.2 size=864353 2024-09-19T13:42:59.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.381+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=4XENK9JLOYCD tag=AAIPQQ6AQ0NN type=write size=4010081 2024-09-19T13:42:59.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.382+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=4SK0N4AHVXBP type=del size=2045128 2024-09-19T13:42:59.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.384+0000 7f6ab10d2780 1 < canceled operation key=VFJIKOLYI0HN tag=MB7E3KBGFPVL type=del size=1268591 2024-09-19T13:42:59.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.385+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=E2HKXE8EKIND type=del size=551477 2024-09-19T13:42:59.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.386+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~2MD4CQZRCLEQ.0 size=768621 2024-09-19T13:42:59.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.388+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=2MD4CQZRCLEQ tag=O1CC2FEEL49T type=write size=1817197 2024-09-19T13:42:59.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.389+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=IWIKCBTOMYO7 type=del size=2196752 2024-09-19T13:42:59.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.390+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=3M309KEFDPUE type=del 2024-09-19T13:42:59.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.392+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~DGOKEY7YRNC8.0 size=1048576 2024-09-19T13:42:59.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.393+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~DGOKEY7YRNC8.1 size=461440 2024-09-19T13:42:59.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.393+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=DGOKEY7YRNC8 tag=952HLJT1TPGI type=write size=2558592 2024-09-19T13:42:59.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.394+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=V4RL6OII0AJR type=del 2024-09-19T13:42:59.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.395+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=XNE1WUO9H7KL type=del size=1236603 2024-09-19T13:42:59.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.396+0000 7f6ab10d2780 1 < completed write operation key=DF003ORZ1HOM tag=3N6EAA1YLLAS type=write size=464528 2024-09-19T13:42:59.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.398+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~BQPJNP8XAJR1.0 size=1048576 2024-09-19T13:42:59.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.399+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~BQPJNP8XAJR1.1 size=208017 2024-09-19T13:42:59.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.399+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=BQPJNP8XAJR1 tag=Q0RBEM8FN5O8 type=write size=2305169 2024-09-19T13:42:59.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.399+0000 7f6ab10d2780 1 < canceled part key=_multipart_B0J7E7A0NP4J.2~ILX37SN9JKDK.0 size=1048576 2024-09-19T13:42:59.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.400+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~ILX37SN9JKDK.1 size=336917 2024-09-19T13:42:59.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.402+0000 7f6ab10d2780 1 < canceled multipart upload key=B0J7E7A0NP4J upload=ILX37SN9JKDK tag=TN5Z1LVMG0Z5 type=write size=2434069 2024-09-19T13:42:59.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.403+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=T8OU4IIV8B06 type=write size=562711 2024-09-19T13:42:59.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.404+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=M0LVLXDNFZS0 type=del 2024-09-19T13:42:59.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.406+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~0GKZXJB9JSSS.0 size=391456 2024-09-19T13:42:59.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.406+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=0GKZXJB9JSSS tag=AMOGIABUEL0Z type=write size=1440032 2024-09-19T13:42:59.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.407+0000 7f6ab10d2780 1 < canceled operation key=VFJIKOLYI0HN tag=6355CAYQOBPN type=del size=2430989 2024-09-19T13:42:59.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.409+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~1WQPFV37E3DU.0 size=1048576 2024-09-19T13:42:59.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.410+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~1WQPFV37E3DU.1 size=347464 2024-09-19T13:42:59.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.410+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=1WQPFV37E3DU tag=PRKJ0QGZTD4S type=write size=2444616 2024-09-19T13:42:59.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.411+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=5VXQ3Q4PAT5S type=del 2024-09-19T13:42:59.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.413+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~GYF48YT6T2PL.0 size=327228 2024-09-19T13:42:59.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.413+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=GYF48YT6T2PL tag=SFT13P6T70Y1 type=write size=1375804 2024-09-19T13:42:59.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.414+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~M33GSM2KJ2I4.0 size=427806 2024-09-19T13:42:59.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.416+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=M33GSM2KJ2I4 tag=Q74KEEKUGHPD type=write size=1476382 2024-09-19T13:42:59.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.418+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=J7PS09Q09H2V type=del size=677468 2024-09-19T13:42:59.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.419+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~1VL9W0UEEBNZ.0 size=1048576 2024-09-19T13:42:59.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.420+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~1VL9W0UEEBNZ.1 size=145371 2024-09-19T13:42:59.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.422+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=1VL9W0UEEBNZ tag=7NQXLPNH722G type=write size=2242523 2024-09-19T13:42:59.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.424+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~277207470I7V.0 size=1048576 2024-09-19T13:42:59.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.425+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~277207470I7V.1 size=1048576 2024-09-19T13:42:59.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.425+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~277207470I7V.2 size=582455 2024-09-19T13:42:59.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.425+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=277207470I7V tag=X3JXTQOPAV8Z type=write size=3728183 2024-09-19T13:42:59.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.427+0000 7f6ab10d2780 1 < canceled operation key=7LHSAN5BBQRW tag=0FYCIWBCC4XB type=del size=955595 2024-09-19T13:42:59.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.429+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~X9SEON5R4WOW.0 size=1048576 2024-09-19T13:42:59.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.430+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~X9SEON5R4WOW.1 size=1048576 2024-09-19T13:42:59.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.431+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~X9SEON5R4WOW.2 size=716413 2024-09-19T13:42:59.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.431+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=X9SEON5R4WOW tag=H4BONRZYUSUL type=write size=3862141 2024-09-19T13:42:59.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.432+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=WMG5XUV570XA type=del 2024-09-19T13:42:59.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.433+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=FDLF9LHIU3IB type=del size=309147 2024-09-19T13:42:59.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.435+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=4N8BD5ZUJFL4 type=del 2024-09-19T13:42:59.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.436+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=RSTD5FYFKNI5 type=del size=2214625 2024-09-19T13:42:59.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.437+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=6UMO151CYAD1 type=del 2024-09-19T13:42:59.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.439+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=OHC5J8GJR4DJ type=del size=2400488 2024-09-19T13:42:59.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.441+0000 7f6ab10d2780 1 < suggested remove operation key=X8CWBFNCJG6M tag=4SK0N4AHVXBP type=del 2024-09-19T13:42:59.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.442+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=XTATHU7TMX19 type=write size=652343 2024-09-19T13:42:59.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.443+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=E2HKXE8EKIND type=del 2024-09-19T13:42:59.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.444+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=W1DUDUGXO1I9 type=del size=2685115 2024-09-19T13:42:59.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.445+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=IWIKCBTOMYO7 type=del 2024-09-19T13:42:59.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.446+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=2VYXDD20D7EJ type=del size=1253104 2024-09-19T13:42:59.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.448+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~DGOKEY7YRNC8.0 size=1048576 2024-09-19T13:42:59.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.448+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~DGOKEY7YRNC8.1 size=461440 2024-09-19T13:42:59.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.450+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=DGOKEY7YRNC8 tag=952HLJT1TPGI type=write size=2558592 2024-09-19T13:42:59.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.453+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TXZZ76KFDAJI.0 size=1048576 2024-09-19T13:42:59.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.454+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TXZZ76KFDAJI.1 size=1048576 2024-09-19T13:42:59.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.454+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TXZZ76KFDAJI.2 size=312394 2024-09-19T13:42:59.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.454+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=TXZZ76KFDAJI tag=XS8IIOD3RHBH type=write size=3458122 2024-09-19T13:42:59.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.456+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=XNE1WUO9H7KL type=del 2024-09-19T13:42:59.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.457+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=8G0ICB1GA91R type=del size=2349921 2024-09-19T13:42:59.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.458+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~BQPJNP8XAJR1.0 size=1048576 2024-09-19T13:42:59.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.459+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~BQPJNP8XAJR1.1 size=208017 2024-09-19T13:42:59.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.460+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=BQPJNP8XAJR1 tag=Q0RBEM8FN5O8 type=write size=2305169 2024-09-19T13:42:59.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.462+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=OTMIGXLCP5VE type=del size=2366429 2024-09-19T13:42:59.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.463+0000 7f6ab10d2780 1 < completed write operation key=WDRUV5ERI000 tag=T8OU4IIV8B06 type=write size=562711 2024-09-19T13:42:59.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.465+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~I81REW91XTA6.0 size=1048576 2024-09-19T13:42:59.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.465+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~I81REW91XTA6.1 size=726074 2024-09-19T13:42:59.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.465+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=I81REW91XTA6 tag=YQA7KZLTDFF7 type=write size=2823226 2024-09-19T13:42:59.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.466+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~0GKZXJB9JSSS.0 size=391456 2024-09-19T13:42:59.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.468+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=0GKZXJB9JSSS tag=AMOGIABUEL0Z type=write size=1440032 2024-09-19T13:42:59.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.470+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~C0UIVCGW207O.0 size=1048576 2024-09-19T13:42:59.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.471+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~C0UIVCGW207O.1 size=1012257 2024-09-19T13:42:59.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.471+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=C0UIVCGW207O tag=PMTSDGYMBGYE type=write size=3109409 2024-09-19T13:42:59.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.472+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~1WQPFV37E3DU.0 size=1048576 2024-09-19T13:42:59.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.473+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~1WQPFV37E3DU.1 size=347464 2024-09-19T13:42:59.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.475+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=1WQPFV37E3DU tag=PRKJ0QGZTD4S type=write size=2444616 2024-09-19T13:42:59.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.477+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~L2FYHDGXHC0F.0 size=101577 2024-09-19T13:42:59.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.477+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=L2FYHDGXHC0F tag=VL4COOXVFG2M type=write size=1150153 2024-09-19T13:42:59.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.478+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~GYF48YT6T2PL.0 size=327228 2024-09-19T13:42:59.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.479+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=GYF48YT6T2PL tag=SFT13P6T70Y1 type=write size=1375804 2024-09-19T13:42:59.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.481+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=12L19R0V79O9 type=del size=2963443 2024-09-19T13:42:59.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.482+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=J7PS09Q09H2V type=del 2024-09-19T13:42:59.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.483+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=T6W94LG1QAXX type=del size=1822117 2024-09-19T13:42:59.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.484+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~277207470I7V.0 size=1048576 2024-09-19T13:42:59.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.485+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~277207470I7V.1 size=1048576 2024-09-19T13:42:59.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.485+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~277207470I7V.2 size=582455 2024-09-19T13:42:59.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.487+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=277207470I7V tag=X3JXTQOPAV8Z type=write size=3728183 2024-09-19T13:42:59.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.488+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=O7Y6E5TP1PSZ type=del size=2753705 2024-09-19T13:42:59.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.489+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~X9SEON5R4WOW.0 size=1048576 2024-09-19T13:42:59.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.490+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~X9SEON5R4WOW.1 size=1048576 2024-09-19T13:42:59.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.490+0000 7f6ab10d2780 1 < canceled part key=_multipart_EE8F84K0ZAGJ.2~X9SEON5R4WOW.2 size=716413 2024-09-19T13:42:59.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.492+0000 7f6ab10d2780 1 < canceled multipart upload key=EE8F84K0ZAGJ upload=X9SEON5R4WOW tag=H4BONRZYUSUL type=write size=3862141 2024-09-19T13:42:59.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.493+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=014NTIEM4T1N type=del size=191096 2024-09-19T13:42:59.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.495+0000 7f6ab10d2780 1 < suggested remove operation key=QTGKMAOX2A6U tag=FDLF9LHIU3IB type=del 2024-09-19T13:42:59.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.497+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~3N1YWDZ6JZU8.0 size=1048576 2024-09-19T13:42:59.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.498+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~3N1YWDZ6JZU8.1 size=422439 2024-09-19T13:42:59.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.498+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=3N1YWDZ6JZU8 tag=OQKYVNKZZXFI type=write size=2519591 2024-09-19T13:42:59.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.499+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=RSTD5FYFKNI5 type=del 2024-09-19T13:42:59.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.500+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=F0CCNGQ23M43 type=del size=289902 2024-09-19T13:42:59.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.502+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=OHC5J8GJR4DJ type=del 2024-09-19T13:42:59.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.503+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=KDS5METP02EH type=del size=2813953 2024-09-19T13:42:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.504+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=XTATHU7TMX19 type=write size=652343 2024-09-19T13:42:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.506+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~2DCFJAEUENKU.0 size=630888 2024-09-19T13:42:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.506+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=2DCFJAEUENKU tag=SJWUK44SHPT5 type=write size=1679464 2024-09-19T13:42:59.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.507+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=W1DUDUGXO1I9 type=del 2024-09-19T13:42:59.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.509+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~Q9J6QKD18GYD.0 size=1048576 2024-09-19T13:42:59.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.510+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~Q9J6QKD18GYD.1 size=1048576 2024-09-19T13:42:59.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.510+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~Q9J6QKD18GYD.2 size=156445 2024-09-19T13:42:59.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.510+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=Q9J6QKD18GYD tag=ZC1CUNV4I7FA type=write size=3302173 2024-09-19T13:42:59.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.512+0000 7f6ab10d2780 1 < suggested remove operation key=X8CWBFNCJG6M tag=2VYXDD20D7EJ type=del 2024-09-19T13:42:59.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.514+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=684DKN66J1WB type=del size=242047 2024-09-19T13:42:59.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.514+0000 7f6ab10d2780 1 < canceled part key=_multipart_UPMXNNYUUJR7.2~TXZZ76KFDAJI.0 size=1048576 2024-09-19T13:42:59.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.515+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TXZZ76KFDAJI.1 size=1048576 2024-09-19T13:42:59.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.516+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TXZZ76KFDAJI.2 size=312394 2024-09-19T13:42:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.517+0000 7f6ab10d2780 1 < canceled multipart upload key=UPMXNNYUUJR7 upload=TXZZ76KFDAJI tag=XS8IIOD3RHBH type=write size=3458122 2024-09-19T13:42:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.519+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~L7B6T2IQ7KM0.0 size=1048576 2024-09-19T13:42:59.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.520+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~L7B6T2IQ7KM0.1 size=1048576 2024-09-19T13:42:59.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.521+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~L7B6T2IQ7KM0.2 size=80651 2024-09-19T13:42:59.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.521+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=L7B6T2IQ7KM0 tag=68AGETFGFX8H type=write size=3226379 2024-09-19T13:42:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.523+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=8G0ICB1GA91R type=del size=2349921 2024-09-19T13:42:59.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.525+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~N770Z2K4XGCP.0 size=1048576 2024-09-19T13:42:59.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.526+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~N770Z2K4XGCP.1 size=463826 2024-09-19T13:42:59.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.526+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=N770Z2K4XGCP tag=8W712N1GA9I4 type=write size=2560978 2024-09-19T13:42:59.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.527+0000 7f6ab10d2780 1 < canceled operation key=2KX2NSY41STV tag=OTMIGXLCP5VE type=del size=2366429 2024-09-19T13:42:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.528+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=Q74VZOR32OSG type=write size=826601 2024-09-19T13:42:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.530+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~I81REW91XTA6.0 size=1048576 2024-09-19T13:42:59.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.531+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~I81REW91XTA6.1 size=726074 2024-09-19T13:42:59.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.532+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=I81REW91XTA6 tag=YQA7KZLTDFF7 type=write size=2823226 2024-09-19T13:42:59.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.534+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=3XXQVDIY7J8Y type=del size=1305049 2024-09-19T13:42:59.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.535+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~C0UIVCGW207O.0 size=1048576 2024-09-19T13:42:59.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.537+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~C0UIVCGW207O.1 size=1012257 2024-09-19T13:42:59.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.539+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=C0UIVCGW207O tag=PMTSDGYMBGYE type=write size=3109409 2024-09-19T13:42:59.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.540+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=60C010M9ODL1 type=del size=837194 2024-09-19T13:42:59.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.541+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~L2FYHDGXHC0F.0 size=101577 2024-09-19T13:42:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.543+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=L2FYHDGXHC0F tag=VL4COOXVFG2M type=write size=1150153 2024-09-19T13:42:59.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.544+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=TW3W8J8GEDHB type=del size=2461590 2024-09-19T13:42:59.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.545+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=12L19R0V79O9 type=del 2024-09-19T13:42:59.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.546+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=VIRRI0Y2OJQF type=del size=4166286 2024-09-19T13:42:59.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.548+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=T6W94LG1QAXX type=del size=1822117 2024-09-19T13:42:59.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.550+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~SFB29Y1F1FE4.0 size=432411 2024-09-19T13:42:59.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.550+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=SFB29Y1F1FE4 tag=6BRYJJM7S0VY type=write size=1480987 2024-09-19T13:42:59.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.551+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=O7Y6E5TP1PSZ type=del 2024-09-19T13:42:59.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.552+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=13ICR2WSUEOE type=del size=3075153 2024-09-19T13:42:59.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.553+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=014NTIEM4T1N type=del 2024-09-19T13:42:59.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.554+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=RN71YR39P2LG type=del size=3625979 2024-09-19T13:42:59.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.556+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~3N1YWDZ6JZU8.0 size=1048576 2024-09-19T13:42:59.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.556+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~3N1YWDZ6JZU8.1 size=422439 2024-09-19T13:42:59.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.558+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=3N1YWDZ6JZU8 tag=OQKYVNKZZXFI type=write size=2519591 2024-09-19T13:42:59.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.561+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1DP7AOZUZRHM.0 size=1048576 2024-09-19T13:42:59.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.561+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1DP7AOZUZRHM.1 size=776985 2024-09-19T13:42:59.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.561+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=1DP7AOZUZRHM tag=WJL6Q919PPW0 type=write size=2874137 2024-09-19T13:42:59.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.563+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=F0CCNGQ23M43 type=del 2024-09-19T13:42:59.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.564+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=BM0S4WM8R0HE type=del size=1517086 2024-09-19T13:42:59.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.566+0000 7f6ab10d2780 1 < suggested remove operation key=DTSRVH526PE7 tag=KDS5METP02EH type=del 2024-09-19T13:42:59.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.567+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=PQR5G7INTXDK type=del size=3499752 2024-09-19T13:42:59.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.568+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~2DCFJAEUENKU.0 size=630888 2024-09-19T13:42:59.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.570+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=2DCFJAEUENKU tag=SJWUK44SHPT5 type=write size=1679464 2024-09-19T13:42:59.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.572+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~7P1NF4FS2FHI.0 size=539416 2024-09-19T13:42:59.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.572+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=7P1NF4FS2FHI tag=VFSP24W4FB39 type=write size=1587992 2024-09-19T13:42:59.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.573+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~Q9J6QKD18GYD.0 size=1048576 2024-09-19T13:42:59.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.574+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~Q9J6QKD18GYD.1 size=1048576 2024-09-19T13:42:59.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.575+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~Q9J6QKD18GYD.2 size=156445 2024-09-19T13:42:59.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.577+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=Q9J6QKD18GYD tag=ZC1CUNV4I7FA type=write size=3302173 2024-09-19T13:42:59.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.578+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=ML930S1SPBOW type=del size=328765 2024-09-19T13:42:59.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.580+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=684DKN66J1WB type=del 2024-09-19T13:42:59.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.582+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~KK2CTQXL7SBZ.0 size=725881 2024-09-19T13:42:59.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.582+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=KK2CTQXL7SBZ tag=QVE5ATEAW96F type=write size=1774457 2024-09-19T13:42:59.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.583+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~L7B6T2IQ7KM0.0 size=1048576 2024-09-19T13:42:59.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.584+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~L7B6T2IQ7KM0.1 size=1048576 2024-09-19T13:42:59.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.585+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~L7B6T2IQ7KM0.2 size=80651 2024-09-19T13:42:59.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.586+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=L7B6T2IQ7KM0 tag=68AGETFGFX8H type=write size=3226379 2024-09-19T13:42:59.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.588+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=71V5IA45IR11 type=del size=3982991 2024-09-19T13:42:59.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.588+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~N770Z2K4XGCP.0 size=1048576 2024-09-19T13:42:59.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.589+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~N770Z2K4XGCP.1 size=463826 2024-09-19T13:42:59.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.590+0000 7f6ab10d2780 1 < canceled multipart upload key=9MCE8PXHBGNF upload=N770Z2K4XGCP tag=8W712N1GA9I4 type=write size=2560978 2024-09-19T13:42:59.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.592+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=8LJW9M9G75QA type=del size=3947385 2024-09-19T13:42:59.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.593+0000 7f6ab10d2780 1 < completed write operation key=A14YTABJ1Z3Z tag=Q74VZOR32OSG type=write size=826601 2024-09-19T13:42:59.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.595+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~CHQ6QPJ2DODL.0 size=975967 2024-09-19T13:42:59.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.595+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=CHQ6QPJ2DODL tag=7KE4T0Y5Q8R8 type=write size=2024543 2024-09-19T13:42:59.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.596+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=3XXQVDIY7J8Y type=del 2024-09-19T13:42:59.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.598+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~Y553Y3YESM9O.0 size=1048576 2024-09-19T13:42:59.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.599+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~Y553Y3YESM9O.1 size=978771 2024-09-19T13:42:59.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.599+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=Y553Y3YESM9O tag=X83QHJYCNQ9Q type=write size=3075923 2024-09-19T13:42:59.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.600+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=60C010M9ODL1 type=del 2024-09-19T13:42:59.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.602+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~H0YOUCJ4PZ9W.0 size=749348 2024-09-19T13:42:59.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.602+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=H0YOUCJ4PZ9W tag=6TFBF1D8B7VN type=write size=1797924 2024-09-19T13:42:59.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.603+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=TW3W8J8GEDHB type=del 2024-09-19T13:42:59.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.604+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=XXXJ0BDWM03U type=del size=427410 2024-09-19T13:42:59.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.605+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=VIRRI0Y2OJQF type=del 2024-09-19T13:42:59.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.607+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~2VX68CZD13O0.0 size=782726 2024-09-19T13:42:59.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.607+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=2VX68CZD13O0 tag=OHXXFHAM03TD type=write size=1831302 2024-09-19T13:42:59.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.609+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~SFB29Y1F1FE4.0 size=432411 2024-09-19T13:42:59.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.610+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=SFB29Y1F1FE4 tag=6BRYJJM7S0VY type=write size=1480987 2024-09-19T13:42:59.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.611+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=NUK6FKXBCXS2 type=del size=510772 2024-09-19T13:42:59.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.612+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=13ICR2WSUEOE type=del 2024-09-19T13:42:59.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.614+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~EJOZSAVVB0DP.0 size=1048576 2024-09-19T13:42:59.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.615+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~EJOZSAVVB0DP.1 size=666137 2024-09-19T13:42:59.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.615+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=EJOZSAVVB0DP tag=GLE9MW88IX78 type=write size=2763289 2024-09-19T13:42:59.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.617+0000 7f6ab10d2780 1 < suggested update operation key=SERUGCO68R9W tag=RN71YR39P2LG type=del size=3625979 2024-09-19T13:42:59.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.619+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=XRYUCCNOTSPQ type=write size=432520 2024-09-19T13:42:59.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.620+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~1DP7AOZUZRHM.0 size=1048576 2024-09-19T13:42:59.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.621+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~1DP7AOZUZRHM.1 size=776985 2024-09-19T13:42:59.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.623+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=1DP7AOZUZRHM tag=WJL6Q919PPW0 type=write size=2874137 2024-09-19T13:42:59.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.626+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~TEWZS4FK19B3.0 size=1048576 2024-09-19T13:42:59.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.627+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~TEWZS4FK19B3.1 size=1015220 2024-09-19T13:42:59.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.627+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=TEWZS4FK19B3 tag=T3CQPEOA9FFO type=write size=3112372 2024-09-19T13:42:59.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.629+0000 7f6ab10d2780 1 < suggested remove operation key=4OSJA1879NQO tag=BM0S4WM8R0HE type=del 2024-09-19T13:42:59.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.630+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=SA8NDLE6QAAJ type=del size=1487625 2024-09-19T13:42:59.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.632+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=PQR5G7INTXDK type=del 2024-09-19T13:42:59.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.633+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=CHL8RG1QDYAJ type=del size=320218 2024-09-19T13:42:59.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.634+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~7P1NF4FS2FHI.0 size=539416 2024-09-19T13:42:59.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.636+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=7P1NF4FS2FHI tag=VFSP24W4FB39 type=write size=1587992 2024-09-19T13:42:59.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.637+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=GBQTLI9QM0BO type=del size=2656794 2024-09-19T13:42:59.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.639+0000 7f6ab10d2780 1 < suggested remove operation key=TCXAYADSCTZI tag=ML930S1SPBOW type=del 2024-09-19T13:42:59.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.640+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=6V8ZJ74ZUZFT type=del size=2283496 2024-09-19T13:42:59.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.641+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~KK2CTQXL7SBZ.0 size=725881 2024-09-19T13:42:59.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.644+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=KK2CTQXL7SBZ tag=QVE5ATEAW96F type=write size=1774457 2024-09-19T13:42:59.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.645+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=QUOM8V1AHAFD type=del size=770995 2024-09-19T13:42:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.646+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=71V5IA45IR11 type=del 2024-09-19T13:42:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.647+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=X6C4BZQ1SQ1N type=write size=659223 2024-09-19T13:42:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.649+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=8LJW9M9G75QA type=del 2024-09-19T13:42:59.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.651+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~8QO5F7334LSE.0 size=79708 2024-09-19T13:42:59.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.651+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=8QO5F7334LSE tag=6VF34T2CZ45B type=write size=1128284 2024-09-19T13:42:59.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.652+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~CHQ6QPJ2DODL.0 size=975967 2024-09-19T13:42:59.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.653+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=CHQ6QPJ2DODL tag=7KE4T0Y5Q8R8 type=write size=2024543 2024-09-19T13:42:59.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.655+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~NP0KJDJUXS7N.0 size=776833 2024-09-19T13:42:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.655+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=NP0KJDJUXS7N tag=2N2WR2WOYNOL type=write size=1825409 2024-09-19T13:42:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.657+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~Y553Y3YESM9O.0 size=1048576 2024-09-19T13:42:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.657+0000 7f6ab10d2780 1 < canceled part key=_multipart_4OSJA1879NQO.2~Y553Y3YESM9O.1 size=978771 2024-09-19T13:42:59.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.658+0000 7f6ab10d2780 1 < canceled multipart upload key=4OSJA1879NQO upload=Y553Y3YESM9O tag=X83QHJYCNQ9Q type=write size=3075923 2024-09-19T13:42:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.660+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=F2DUQWQGD3LS type=del size=1247125 2024-09-19T13:42:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.661+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~H0YOUCJ4PZ9W.0 size=749348 2024-09-19T13:42:59.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.663+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=H0YOUCJ4PZ9W tag=6TFBF1D8B7VN type=write size=1797924 2024-09-19T13:42:59.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.664+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=KP2L4YFF2QWZ type=del size=1038225 2024-09-19T13:42:59.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.666+0000 7f6ab10d2780 1 < suggested update operation key=CD4XXORKVS6J tag=XXXJ0BDWM03U type=del size=427410 2024-09-19T13:42:59.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.667+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=C86A9A4E0Y2F type=del size=2097752 2024-09-19T13:42:59.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.668+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~2VX68CZD13O0.0 size=782726 2024-09-19T13:42:59.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.670+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=2VX68CZD13O0 tag=OHXXFHAM03TD type=write size=1831302 2024-09-19T13:42:59.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.671+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=KY6DFLCDNW7Q type=del size=1299852 2024-09-19T13:42:59.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.672+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=NUK6FKXBCXS2 type=del 2024-09-19T13:42:59.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.674+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~BZICBIO34LMQ.0 size=1048576 2024-09-19T13:42:59.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.675+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~BZICBIO34LMQ.1 size=437548 2024-09-19T13:42:59.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.675+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=BZICBIO34LMQ tag=5QIIHQRFBGYJ type=write size=2534700 2024-09-19T13:42:59.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.676+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~EJOZSAVVB0DP.0 size=1048576 2024-09-19T13:42:59.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.677+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~EJOZSAVVB0DP.1 size=666137 2024-09-19T13:42:59.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.679+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=EJOZSAVVB0DP tag=GLE9MW88IX78 type=write size=2763289 2024-09-19T13:42:59.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.681+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~GT9URT5OLR7G.0 size=21927 2024-09-19T13:42:59.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.681+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=GT9URT5OLR7G tag=P2HN0MMPEMPO type=write size=1070503 2024-09-19T13:42:59.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.683+0000 7f6ab10d2780 1 < suggested remove operation key=A14YTABJ1Z3Z tag=XRYUCCNOTSPQ type=write 2024-09-19T13:42:59.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.684+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=VOH229W1DN41 type=del size=283363 2024-09-19T13:42:59.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.685+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~TEWZS4FK19B3.0 size=1048576 2024-09-19T13:42:59.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.686+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~TEWZS4FK19B3.1 size=1015220 2024-09-19T13:42:59.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.688+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=TEWZS4FK19B3 tag=T3CQPEOA9FFO type=write size=3112372 2024-09-19T13:42:59.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.689+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=JEW1CP82QKMP type=del size=356653 2024-09-19T13:42:59.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.691+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=SA8NDLE6QAAJ type=del 2024-09-19T13:42:59.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.692+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=9NB5JI0W9WHK type=del size=2084560 2024-09-19T13:42:59.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.693+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=CHL8RG1QDYAJ type=del 2024-09-19T13:42:59.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.694+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=0NE399AH5EFZ type=del size=108047 2024-09-19T13:42:59.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.696+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=GBQTLI9QM0BO type=del size=2656794 2024-09-19T13:42:59.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.698+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~6T9Y4L9VQDCJ.0 size=1048576 2024-09-19T13:42:59.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.699+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~6T9Y4L9VQDCJ.1 size=1048576 2024-09-19T13:42:59.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.700+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~6T9Y4L9VQDCJ.2 size=74635 2024-09-19T13:42:59.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.700+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=6T9Y4L9VQDCJ tag=YU76V01T1HLL type=write size=3220363 2024-09-19T13:42:59.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.702+0000 7f6ab10d2780 1 < suggested update operation key=RXXCDV0LTCKS tag=6V8ZJ74ZUZFT type=del size=2283496 2024-09-19T13:42:59.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.703+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=TW9P59GWXDF4 type=del size=2555667 2024-09-19T13:42:59.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.704+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=QUOM8V1AHAFD type=del 2024-09-19T13:42:59.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.707+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~PWN91GPOLMOW.0 size=1020837 2024-09-19T13:42:59.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.707+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=PWN91GPOLMOW tag=7VPB4MOC5FP5 type=write size=2069413 2024-09-19T13:42:59.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.709+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=X6C4BZQ1SQ1N type=write size=659223 2024-09-19T13:42:59.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.711+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~M4A3JXL1OHB2.0 size=1048576 2024-09-19T13:42:59.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.712+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~M4A3JXL1OHB2.1 size=1048576 2024-09-19T13:42:59.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.713+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~M4A3JXL1OHB2.2 size=792568 2024-09-19T13:42:59.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.713+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=M4A3JXL1OHB2 tag=LVD9VC0X5C56 type=write size=3938296 2024-09-19T13:42:59.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.714+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~8QO5F7334LSE.0 size=79708 2024-09-19T13:42:59.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.716+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=8QO5F7334LSE tag=6VF34T2CZ45B type=write size=1128284 2024-09-19T13:42:59.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.719+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~SJKVRLH501ZN.0 size=1048576 2024-09-19T13:42:59.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.719+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~SJKVRLH501ZN.1 size=1048576 2024-09-19T13:42:59.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.720+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~SJKVRLH501ZN.2 size=220357 2024-09-19T13:42:59.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.720+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=SJKVRLH501ZN tag=Q42RQKNH700O type=write size=3366085 2024-09-19T13:42:59.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.722+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~NP0KJDJUXS7N.0 size=776833 2024-09-19T13:42:59.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.724+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=NP0KJDJUXS7N tag=2N2WR2WOYNOL type=write size=1825409 2024-09-19T13:42:59.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.726+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~C5KA0I3YMSQY.0 size=1048576 2024-09-19T13:42:59.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.727+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~C5KA0I3YMSQY.1 size=1048576 2024-09-19T13:42:59.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.728+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~C5KA0I3YMSQY.2 size=464823 2024-09-19T13:42:59.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.728+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=C5KA0I3YMSQY tag=PZWOS9I7HCJ8 type=write size=3610551 2024-09-19T13:42:59.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.730+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=F2DUQWQGD3LS type=del 2024-09-19T13:42:59.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.731+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=Z0V781PJIULL type=del size=2021486 2024-09-19T13:42:59.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.732+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=KP2L4YFF2QWZ type=del 2024-09-19T13:42:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.734+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~GQQN4BS0XNRD.0 size=467889 2024-09-19T13:42:59.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.734+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=GQQN4BS0XNRD tag=U7CRSXJAKI58 type=write size=1516465 2024-09-19T13:42:59.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.735+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=C86A9A4E0Y2F type=del 2024-09-19T13:42:59.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.737+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=40NBZ9D7YLQ1 type=del size=3587270 2024-09-19T13:42:59.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.738+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=KY6DFLCDNW7Q type=del 2024-09-19T13:42:59.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.740+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~258JZ2GY0VDW.0 size=1048576 2024-09-19T13:42:59.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.741+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~258JZ2GY0VDW.1 size=1048576 2024-09-19T13:42:59.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.742+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~258JZ2GY0VDW.2 size=161212 2024-09-19T13:42:59.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.742+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=258JZ2GY0VDW tag=MV8L5EY4PCJM type=write size=3306940 2024-09-19T13:42:59.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.743+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~BZICBIO34LMQ.0 size=1048576 2024-09-19T13:42:59.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.744+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~BZICBIO34LMQ.1 size=437548 2024-09-19T13:42:59.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.746+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=BZICBIO34LMQ tag=5QIIHQRFBGYJ type=write size=2534700 2024-09-19T13:42:59.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.748+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=V8OALNJVE7K5 type=del size=1792168 2024-09-19T13:42:59.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.749+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~GT9URT5OLR7G.0 size=21927 2024-09-19T13:42:59.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.752+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=GT9URT5OLR7G tag=P2HN0MMPEMPO type=write size=1070503 2024-09-19T13:42:59.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.753+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=R7S395RP5907 type=del size=3677367 2024-09-19T13:42:59.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.754+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=VOH229W1DN41 type=del 2024-09-19T13:42:59.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.755+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=GPEB3AKJW1FP type=del size=3579052 2024-09-19T13:42:59.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.756+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=JEW1CP82QKMP type=del 2024-09-19T13:42:59.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.757+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=30ST3I08TN17 type=write size=708531 2024-09-19T13:42:59.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.759+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=9NB5JI0W9WHK type=del 2024-09-19T13:42:59.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.760+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=O0MQW4JG0NSY type=del size=3862929 2024-09-19T13:42:59.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.761+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=0NE399AH5EFZ type=del 2024-09-19T13:42:59.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.762+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=423CF4AARH8O type=del size=2719393 2024-09-19T13:42:59.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.764+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~6T9Y4L9VQDCJ.0 size=1048576 2024-09-19T13:42:59.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.765+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~6T9Y4L9VQDCJ.1 size=1048576 2024-09-19T13:42:59.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.766+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~6T9Y4L9VQDCJ.2 size=74635 2024-09-19T13:42:59.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.768+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=6T9Y4L9VQDCJ tag=YU76V01T1HLL type=write size=3220363 2024-09-19T13:42:59.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.769+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=Q112T3MI8K1Z type=del size=3282202 2024-09-19T13:42:59.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.770+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=TW9P59GWXDF4 type=del 2024-09-19T13:42:59.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.771+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=1ZHD6SX3P5R3 type=del size=3954170 2024-09-19T13:42:59.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.772+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~PWN91GPOLMOW.0 size=1020837 2024-09-19T13:42:59.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.774+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=PWN91GPOLMOW tag=7VPB4MOC5FP5 type=write size=2069413 2024-09-19T13:42:59.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.776+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~VWZ8UXH0IH30.0 size=1048576 2024-09-19T13:42:59.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.777+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~VWZ8UXH0IH30.1 size=1048576 2024-09-19T13:42:59.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.778+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~VWZ8UXH0IH30.2 size=901211 2024-09-19T13:42:59.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.778+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=VWZ8UXH0IH30 tag=PIVRV8RINM8A type=write size=4046939 2024-09-19T13:42:59.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.779+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~M4A3JXL1OHB2.0 size=1048576 2024-09-19T13:42:59.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.780+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~M4A3JXL1OHB2.1 size=1048576 2024-09-19T13:42:59.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.781+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~M4A3JXL1OHB2.2 size=792568 2024-09-19T13:42:59.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.783+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=M4A3JXL1OHB2 tag=LVD9VC0X5C56 type=write size=3938296 2024-09-19T13:42:59.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.785+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~S821YX2L1V70.0 size=434325 2024-09-19T13:42:59.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.785+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=S821YX2L1V70 tag=1OW159N3Z8OD type=write size=1482901 2024-09-19T13:42:59.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.786+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~SJKVRLH501ZN.0 size=1048576 2024-09-19T13:42:59.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.787+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~SJKVRLH501ZN.1 size=1048576 2024-09-19T13:42:59.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.788+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~SJKVRLH501ZN.2 size=220357 2024-09-19T13:42:59.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.790+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=SJKVRLH501ZN tag=Q42RQKNH700O type=write size=3366085 2024-09-19T13:42:59.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.792+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~VVA3236S1XIA.0 size=1048576 2024-09-19T13:42:59.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.792+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~VVA3236S1XIA.1 size=539109 2024-09-19T13:42:59.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.792+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=VVA3236S1XIA tag=5LUQ6V7B0RHD type=write size=2636261 2024-09-19T13:42:59.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.794+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~C5KA0I3YMSQY.0 size=1048576 2024-09-19T13:42:59.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.794+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~C5KA0I3YMSQY.1 size=1048576 2024-09-19T13:42:59.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.795+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~C5KA0I3YMSQY.2 size=464823 2024-09-19T13:42:59.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.797+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=C5KA0I3YMSQY tag=PZWOS9I7HCJ8 type=write size=3610551 2024-09-19T13:42:59.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.799+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~RP3KBA08LFZI.0 size=435660 2024-09-19T13:42:59.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.799+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=RP3KBA08LFZI tag=JPVQAWXWY1RI type=write size=1484236 2024-09-19T13:42:59.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.800+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=Z0V781PJIULL type=del 2024-09-19T13:42:59.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.801+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=F286Z4CR2J52 type=del size=1438767 2024-09-19T13:42:59.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.802+0000 7f6ab10d2780 1 < canceled part key=_multipart_13GXIDWI4J9F.2~GQQN4BS0XNRD.0 size=467889 2024-09-19T13:42:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.803+0000 7f6ab10d2780 1 < canceled multipart upload key=13GXIDWI4J9F upload=GQQN4BS0XNRD tag=U7CRSXJAKI58 type=write size=1516465 2024-09-19T13:42:59.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.804+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=D2W1ZS8RYQA3 type=write size=856983 2024-09-19T13:42:59.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.805+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=40NBZ9D7YLQ1 type=del 2024-09-19T13:42:59.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.807+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=IJCP1HEJWXXD type=write size=971441 2024-09-19T13:42:59.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.807+0000 7f6ab10d2780 1 < canceled part key=_multipart_9WTLWBONAOET.2~258JZ2GY0VDW.0 size=1048576 2024-09-19T13:42:59.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.808+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~258JZ2GY0VDW.1 size=1048576 2024-09-19T13:42:59.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.809+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~258JZ2GY0VDW.2 size=161212 2024-09-19T13:42:59.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.811+0000 7f6ab10d2780 1 < canceled multipart upload key=9WTLWBONAOET upload=258JZ2GY0VDW tag=MV8L5EY4PCJM type=write size=3306940 2024-09-19T13:42:59.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.812+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=E2HEJG73F1Z1 type=del size=2712311 2024-09-19T13:42:59.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.814+0000 7f6ab10d2780 1 < suggested remove operation key=A14YTABJ1Z3Z tag=V8OALNJVE7K5 type=del 2024-09-19T13:42:59.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.816+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~W2171U9AR4ER.0 size=1048576 2024-09-19T13:42:59.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.817+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~W2171U9AR4ER.1 size=151731 2024-09-19T13:42:59.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.817+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=W2171U9AR4ER tag=ZB2J0QLCL6BA type=write size=2248883 2024-09-19T13:42:59.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.818+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=R7S395RP5907 type=del 2024-09-19T13:42:59.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.820+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~ACHCOJZFW5SX.0 size=1048576 2024-09-19T13:42:59.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.821+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~ACHCOJZFW5SX.1 size=172873 2024-09-19T13:42:59.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.821+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=ACHCOJZFW5SX tag=XO229P24CJ2I type=write size=2270025 2024-09-19T13:42:59.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.822+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=GPEB3AKJW1FP type=del 2024-09-19T13:42:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.824+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~34KSA0498WJ0.0 size=21658 2024-09-19T13:42:59.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.824+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=34KSA0498WJ0 tag=AY1S3D0HFGLL type=write size=1070234 2024-09-19T13:42:59.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.826+0000 7f6ab10d2780 1 < suggested update operation key=TCXAYADSCTZI tag=30ST3I08TN17 type=write size=708531 2024-09-19T13:42:59.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.827+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=JJQBH821EIEE type=del size=970124 2024-09-19T13:42:59.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.828+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=O0MQW4JG0NSY type=del 2024-09-19T13:42:59.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.830+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=4F9W3LSJYV81 type=del size=3251529 2024-09-19T13:42:59.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.831+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=423CF4AARH8O type=del 2024-09-19T13:42:59.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.832+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=PC0TIY98BPC3 type=del size=1419462 2024-09-19T13:42:59.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.833+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=Q112T3MI8K1Z type=del 2024-09-19T13:42:59.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.835+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~EWKWSTOTRJUV.0 size=1048576 2024-09-19T13:42:59.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.836+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~EWKWSTOTRJUV.1 size=1048576 2024-09-19T13:42:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~EWKWSTOTRJUV.2 size=549075 2024-09-19T13:42:59.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.837+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=EWKWSTOTRJUV tag=JE16MF369R7U type=write size=3694803 2024-09-19T13:42:59.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.838+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=1ZHD6SX3P5R3 type=del 2024-09-19T13:42:59.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.840+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~3TD2MPCLDLJ5.0 size=1048576 2024-09-19T13:42:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.841+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~3TD2MPCLDLJ5.1 size=906910 2024-09-19T13:42:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.841+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=3TD2MPCLDLJ5 tag=CP5DL46OCTT9 type=write size=3004062 2024-09-19T13:42:59.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.842+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~VWZ8UXH0IH30.0 size=1048576 2024-09-19T13:42:59.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.842+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~VWZ8UXH0IH30.1 size=1048576 2024-09-19T13:42:59.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.843+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~VWZ8UXH0IH30.2 size=901211 2024-09-19T13:42:59.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.845+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=VWZ8UXH0IH30 tag=PIVRV8RINM8A type=write size=4046939 2024-09-19T13:42:59.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.847+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~B33NPHPJMRUO.0 size=1048576 2024-09-19T13:42:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.848+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~B33NPHPJMRUO.1 size=1048576 2024-09-19T13:42:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.849+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~B33NPHPJMRUO.2 size=521789 2024-09-19T13:42:59.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.849+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=B33NPHPJMRUO tag=F37KIY7YKJL2 type=write size=3667517 2024-09-19T13:42:59.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.850+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~S821YX2L1V70.0 size=434325 2024-09-19T13:42:59.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.852+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=S821YX2L1V70 tag=1OW159N3Z8OD type=write size=1482901 2024-09-19T13:42:59.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.855+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~1S6ANL0MO6UT.0 size=629374 2024-09-19T13:42:59.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.855+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=1S6ANL0MO6UT tag=UOXL93MOBEIV type=write size=1677950 2024-09-19T13:42:59.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.856+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~VVA3236S1XIA.0 size=1048576 2024-09-19T13:42:59.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.857+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~VVA3236S1XIA.1 size=539109 2024-09-19T13:42:59.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.859+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=VVA3236S1XIA tag=5LUQ6V7B0RHD type=write size=2636261 2024-09-19T13:42:59.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.861+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~UR6POOQ20HUU.0 size=1048576 2024-09-19T13:42:59.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.862+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~UR6POOQ20HUU.1 size=1048576 2024-09-19T13:42:59.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.863+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~UR6POOQ20HUU.2 size=760387 2024-09-19T13:42:59.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.863+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=UR6POOQ20HUU tag=EVL58JA2C7SY type=write size=3906115 2024-09-19T13:42:59.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.864+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~RP3KBA08LFZI.0 size=435660 2024-09-19T13:42:59.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.866+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=RP3KBA08LFZI tag=JPVQAWXWY1RI type=write size=1484236 2024-09-19T13:42:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.867+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=21O2F7C25KTQ type=write size=123062 2024-09-19T13:42:59.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.867+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=A14YTABJ1Z3Z tag=F286Z4CR2J52 type=del size=1438767: (2) No such file or directory 2024-09-19T13:42:59.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.868+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=8LZE62XPKZSJ type=write size=41696 2024-09-19T13:42:59.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.869+0000 7f6ab10d2780 1 < completed write operation key=2KX2NSY41STV tag=D2W1ZS8RYQA3 type=write size=856983 2024-09-19T13:42:59.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.871+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=BZI8EL3IAU6I type=del size=1037371 2024-09-19T13:42:59.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.872+0000 7f6ab10d2780 -1 < failed to complete operation key=A14YTABJ1Z3Z tag=IJCP1HEJWXXD type=write size=971441: (22) Invalid argument 2024-09-19T13:42:59.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.873+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=0T1PQNM9XAKL type=del size=550593 2024-09-19T13:42:59.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.874+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=E2HEJG73F1Z1 type=del 2024-09-19T13:42:59.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.875+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=CXQTHV5AU7S6 type=del size=2730616 2024-09-19T13:42:59.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.876+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~W2171U9AR4ER.0 size=1048576 2024-09-19T13:42:59.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.877+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~W2171U9AR4ER.1 size=151731 2024-09-19T13:42:59.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.879+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=W2171U9AR4ER tag=ZB2J0QLCL6BA type=write size=2248883 2024-09-19T13:42:59.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.881+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~QSWG3VNEK80A.0 size=265783 2024-09-19T13:42:59.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.881+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=QSWG3VNEK80A tag=QQNDOQDHWBIL type=write size=1314359 2024-09-19T13:42:59.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.882+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~ACHCOJZFW5SX.0 size=1048576 2024-09-19T13:42:59.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.883+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~ACHCOJZFW5SX.1 size=172873 2024-09-19T13:42:59.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.885+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=ACHCOJZFW5SX tag=XO229P24CJ2I type=write size=2270025 2024-09-19T13:42:59.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.887+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UUCYLGFT96DB.0 size=1048576 2024-09-19T13:42:59.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.888+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UUCYLGFT96DB.1 size=1048576 2024-09-19T13:42:59.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.889+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UUCYLGFT96DB.2 size=821816 2024-09-19T13:42:59.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.889+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=UUCYLGFT96DB tag=FC6FUD0N3GBU type=write size=3967544 2024-09-19T13:42:59.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.890+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~34KSA0498WJ0.0 size=21658 2024-09-19T13:42:59.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.892+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=34KSA0498WJ0 tag=AY1S3D0HFGLL type=write size=1070234 2024-09-19T13:42:59.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.894+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~ZMJVXWNXCCTW.0 size=1048576 2024-09-19T13:42:59.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.895+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~ZMJVXWNXCCTW.1 size=1048576 2024-09-19T13:42:59.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.896+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~ZMJVXWNXCCTW.2 size=88814 2024-09-19T13:42:59.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.896+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=ZMJVXWNXCCTW tag=PWFCR0672EUZ type=write size=3234542 2024-09-19T13:42:59.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.897+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=JJQBH821EIEE type=del 2024-09-19T13:42:59.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.898+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=NTC4BLQZNNGT type=del size=2383738 2024-09-19T13:42:59.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.900+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=4F9W3LSJYV81 type=del 2024-09-19T13:42:59.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.902+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~PT97HL3IYIGK.0 size=238839 2024-09-19T13:42:59.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.902+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=PT97HL3IYIGK tag=Z7Y6MUH9LFNC type=write size=1287415 2024-09-19T13:42:59.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.903+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=PC0TIY98BPC3 type=del 2024-09-19T13:42:59.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.905+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~Z79NDHPK4BL5.0 size=1048576 2024-09-19T13:42:59.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.906+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~Z79NDHPK4BL5.1 size=1048576 2024-09-19T13:42:59.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.907+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~Z79NDHPK4BL5.2 size=705421 2024-09-19T13:42:59.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.907+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=Z79NDHPK4BL5 tag=XLNL8SQ7X81Y type=write size=3851149 2024-09-19T13:42:59.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.908+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~EWKWSTOTRJUV.0 size=1048576 2024-09-19T13:42:59.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.909+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~EWKWSTOTRJUV.1 size=1048576 2024-09-19T13:42:59.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.910+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~EWKWSTOTRJUV.2 size=549075 2024-09-19T13:42:59.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.912+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=EWKWSTOTRJUV tag=JE16MF369R7U type=write size=3694803 2024-09-19T13:42:59.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.914+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~14HI2OZMWFPB.0 size=1048576 2024-09-19T13:42:59.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.915+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~14HI2OZMWFPB.1 size=289463 2024-09-19T13:42:59.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.915+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=14HI2OZMWFPB tag=DS8I308S9XEV type=write size=2386615 2024-09-19T13:42:59.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.916+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~3TD2MPCLDLJ5.0 size=1048576 2024-09-19T13:42:59.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.917+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~3TD2MPCLDLJ5.1 size=906910 2024-09-19T13:42:59.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.919+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=3TD2MPCLDLJ5 tag=CP5DL46OCTT9 type=write size=3004062 2024-09-19T13:42:59.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.920+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=T7SA49XWDUBK type=write size=362494 2024-09-19T13:42:59.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.922+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~B33NPHPJMRUO.0 size=1048576 2024-09-19T13:42:59.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.922+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~B33NPHPJMRUO.1 size=1048576 2024-09-19T13:42:59.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.923+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~B33NPHPJMRUO.2 size=521789 2024-09-19T13:42:59.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.925+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=B33NPHPJMRUO tag=F37KIY7YKJL2 type=write size=3667517 2024-09-19T13:42:59.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.927+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~GTFA9Y4V0QYP.0 size=1048576 2024-09-19T13:42:59.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.928+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~GTFA9Y4V0QYP.1 size=334784 2024-09-19T13:42:59.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.928+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=GTFA9Y4V0QYP tag=1H5N2P3GD1HO type=write size=2431936 2024-09-19T13:42:59.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.929+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~1S6ANL0MO6UT.0 size=629374 2024-09-19T13:42:59.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.931+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=1S6ANL0MO6UT tag=UOXL93MOBEIV type=write size=1677950 2024-09-19T13:42:59.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.933+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~ZYHSLNA5XFV5.0 size=1048576 2024-09-19T13:42:59.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.934+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~ZYHSLNA5XFV5.1 size=873218 2024-09-19T13:42:59.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.934+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=ZYHSLNA5XFV5 tag=6DWA0KOMK1HH type=write size=2970370 2024-09-19T13:42:59.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.935+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~UR6POOQ20HUU.0 size=1048576 2024-09-19T13:42:59.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.936+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~UR6POOQ20HUU.1 size=1048576 2024-09-19T13:42:59.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.937+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~UR6POOQ20HUU.2 size=760387 2024-09-19T13:42:59.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.939+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=UR6POOQ20HUU tag=EVL58JA2C7SY type=write size=3906115 2024-09-19T13:42:59.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.941+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~VXOQ2KCVBTEZ.0 size=168494 2024-09-19T13:42:59.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.941+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=VXOQ2KCVBTEZ tag=9IF2LQWR2O7A type=write size=1217070 2024-09-19T13:42:59.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.942+0000 7f6ab10d2780 -1 < failed to complete operation key=2KX2NSY41STV tag=21O2F7C25KTQ type=write size=123062: (22) Invalid argument 2024-09-19T13:42:59.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.945+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~HUZBEE9I4VJ0.0 size=1048576 2024-09-19T13:42:59.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.946+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~HUZBEE9I4VJ0.1 size=755365 2024-09-19T13:42:59.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.946+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=HUZBEE9I4VJ0 tag=5V43KZ5NSZQ4 type=write size=2852517 2024-09-19T13:42:59.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.947+0000 7f6ab10d2780 1 < completed write operation key=V8P17ZSOQUSM tag=8LZE62XPKZSJ type=write size=41696 2024-09-19T13:42:59.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.948+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=496BPHGAL3HK type=write size=711445 2024-09-19T13:42:59.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.950+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=BZI8EL3IAU6I type=del 2024-09-19T13:42:59.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.951+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=MWWTZSR991CY type=del size=518697 2024-09-19T13:42:59.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.952+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=0T1PQNM9XAKL type=del 2024-09-19T13:42:59.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.953+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=JIFSGF61FLB4 type=write size=850136 2024-09-19T13:42:59.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.955+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=CXQTHV5AU7S6 type=del 2024-09-19T13:42:59.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.956+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=Q0AP6F19SQ2C type=write size=283044 2024-09-19T13:42:59.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.957+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~QSWG3VNEK80A.0 size=265783 2024-09-19T13:42:59.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.960+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=QSWG3VNEK80A tag=QQNDOQDHWBIL type=write size=1314359 2024-09-19T13:42:59.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.961+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=357NY4FGIDEO type=write size=936488 2024-09-19T13:42:59.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.962+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UUCYLGFT96DB.0 size=1048576 2024-09-19T13:42:59.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.963+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UUCYLGFT96DB.1 size=1048576 2024-09-19T13:42:59.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.963+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UUCYLGFT96DB.2 size=821816 2024-09-19T13:42:59.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.965+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=UUCYLGFT96DB tag=FC6FUD0N3GBU type=write size=3967544 2024-09-19T13:42:59.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.966+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=231V1RVEIH53 type=del size=1269368 2024-09-19T13:42:59.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.968+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~ZMJVXWNXCCTW.0 size=1048576 2024-09-19T13:42:59.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.968+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~ZMJVXWNXCCTW.1 size=1048576 2024-09-19T13:42:59.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.969+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~ZMJVXWNXCCTW.2 size=88814 2024-09-19T13:42:59.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.971+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=ZMJVXWNXCCTW tag=PWFCR0672EUZ type=write size=3234542 2024-09-19T13:42:59.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.972+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=9FZ7PRUFXE72 type=del size=1588519 2024-09-19T13:42:59.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.973+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=NTC4BLQZNNGT type=del 2024-09-19T13:42:59.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.975+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=92G4PV19PUMP type=write size=892977 2024-09-19T13:42:59.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.976+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~PT97HL3IYIGK.0 size=238839 2024-09-19T13:42:59.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.977+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=PT97HL3IYIGK tag=Z7Y6MUH9LFNC type=write size=1287415 2024-09-19T13:42:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.979+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~S3J79L7AV0M2.0 size=478312 2024-09-19T13:42:59.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.979+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=S3J79L7AV0M2 tag=DUHLFMMVX3WH type=write size=1526888 2024-09-19T13:42:59.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.981+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~Z79NDHPK4BL5.0 size=1048576 2024-09-19T13:42:59.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.981+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~Z79NDHPK4BL5.1 size=1048576 2024-09-19T13:42:59.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.982+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~Z79NDHPK4BL5.2 size=705421 2024-09-19T13:42:59.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.984+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=Z79NDHPK4BL5 tag=XLNL8SQ7X81Y type=write size=3851149 2024-09-19T13:42:59.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.985+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=AMFVKV2P0AGB type=del size=3802912 2024-09-19T13:42:59.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.986+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~14HI2OZMWFPB.0 size=1048576 2024-09-19T13:42:59.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.986+0000 7f6ab10d2780 1 < canceled part key=_multipart_9IN6E0JQFNAU.2~14HI2OZMWFPB.1 size=289463 2024-09-19T13:42:59.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.988+0000 7f6ab10d2780 1 < canceled multipart upload key=9IN6E0JQFNAU upload=14HI2OZMWFPB tag=DS8I308S9XEV type=write size=2386615 2024-09-19T13:42:59.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.990+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=3PNRV3WZ74LP type=del size=3004632 2024-09-19T13:42:59.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.991+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=T7SA49XWDUBK type=write size=362494 2024-09-19T13:42:59.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.993+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~YTJM3BG1UR1C.0 size=697854 2024-09-19T13:42:59.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.993+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=YTJM3BG1UR1C tag=Z15E1KOG5HQ6 type=write size=1746430 2024-09-19T13:42:59.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.994+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~GTFA9Y4V0QYP.0 size=1048576 2024-09-19T13:42:59.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.995+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~GTFA9Y4V0QYP.1 size=334784 2024-09-19T13:42:59.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.997+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=GTFA9Y4V0QYP tag=1H5N2P3GD1HO type=write size=2431936 2024-09-19T13:43:00.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:42:59.999+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=O079LZ51ZEL5 type=write size=28153 2024-09-19T13:43:00.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.000+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~ZYHSLNA5XFV5.0 size=1048576 2024-09-19T13:43:00.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.001+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~ZYHSLNA5XFV5.1 size=873218 2024-09-19T13:43:00.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.003+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=ZYHSLNA5XFV5 tag=6DWA0KOMK1HH type=write size=2970370 2024-09-19T13:43:00.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.004+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=B0KWW0E1SHJE type=del size=2067625 2024-09-19T13:43:00.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.005+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~VXOQ2KCVBTEZ.0 size=168494 2024-09-19T13:43:00.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.007+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=VXOQ2KCVBTEZ tag=9IF2LQWR2O7A type=write size=1217070 2024-09-19T13:43:00.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.009+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~Q7DA1IOVSCGW.0 size=1048576 2024-09-19T13:43:00.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.010+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~Q7DA1IOVSCGW.1 size=380796 2024-09-19T13:43:00.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.010+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=Q7DA1IOVSCGW tag=AP5WQZAIJ7F9 type=write size=2477948 2024-09-19T13:43:00.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.011+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~HUZBEE9I4VJ0.0 size=1048576 2024-09-19T13:43:00.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.012+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~HUZBEE9I4VJ0.1 size=755365 2024-09-19T13:43:00.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.014+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=HUZBEE9I4VJ0 tag=5V43KZ5NSZQ4 type=write size=2852517 2024-09-19T13:43:00.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.016+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=36S2DM9UYZ1N type=del size=2364679 2024-09-19T13:43:00.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.017+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=496BPHGAL3HK type=write size=711445 2024-09-19T13:43:00.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.018+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=19X5ZFQ82B7U type=del size=3425328 2024-09-19T13:43:00.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.019+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=MWWTZSR991CY type=del 2024-09-19T13:43:00.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.021+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=8BVFHEP29JB7 type=del size=1778115 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.023+0000 7f6ab10d2780 1 < suggested update operation key=9IN6E0JQFNAU tag=JIFSGF61FLB4 type=write size=850136 2024-09-19T13:43:00.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.024+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=NQ9Z0BH6CAIB type=del size=3663760 2024-09-19T13:43:00.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.025+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=Q0AP6F19SQ2C type=write size=283044 2024-09-19T13:43:00.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.028+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~4S4JWELX3T9P.0 size=637534 2024-09-19T13:43:00.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.028+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=4S4JWELX3T9P tag=27TZPQPZLBQK type=write size=1686110 2024-09-19T13:43:00.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.030+0000 7f6ab10d2780 1 < suggested remove operation key=X1JYDG1ASYAR tag=357NY4FGIDEO type=write 2024-09-19T13:43:00.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.032+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=4X16CYIGHBXP type=del size=3618084 2024-09-19T13:43:00.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.033+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=231V1RVEIH53 type=del 2024-09-19T13:43:00.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.034+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=17DGLMAVHKCO type=del size=3532892 2024-09-19T13:43:00.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.035+0000 7f6ab10d2780 1 < canceled operation key=P2U09V0G7UUU tag=9FZ7PRUFXE72 type=del size=1588519 2024-09-19T13:43:00.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.038+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~FFGVHEDIBFQH.0 size=1048576 2024-09-19T13:43:00.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.038+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~FFGVHEDIBFQH.1 size=1048576 2024-09-19T13:43:00.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.039+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~FFGVHEDIBFQH.2 size=267144 2024-09-19T13:43:00.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.039+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=FFGVHEDIBFQH tag=Q3FVA6Z04UGN type=write size=3412872 2024-09-19T13:43:00.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.041+0000 7f6ab10d2780 1 < canceled operation key=V8P17ZSOQUSM tag=92G4PV19PUMP type=write size=892977 2024-09-19T13:43:00.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.043+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~Q7VP6GQ1UCMJ.0 size=1048576 2024-09-19T13:43:00.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.043+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~Q7VP6GQ1UCMJ.1 size=1048576 2024-09-19T13:43:00.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.044+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~Q7VP6GQ1UCMJ.2 size=212923 2024-09-19T13:43:00.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.044+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=Q7VP6GQ1UCMJ tag=MBMX8EPT8M29 type=write size=3358651 2024-09-19T13:43:00.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.045+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~S3J79L7AV0M2.0 size=478312 2024-09-19T13:43:00.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.047+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=S3J79L7AV0M2 tag=DUHLFMMVX3WH type=write size=1526888 2024-09-19T13:43:00.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.048+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=9JPPS8BLLL6A type=del size=2654080 2024-09-19T13:43:00.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.049+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=AMFVKV2P0AGB type=del 2024-09-19T13:43:00.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.051+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=IHVSR18UZE7F type=del size=403585 2024-09-19T13:43:00.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.052+0000 7f6ab10d2780 1 < canceled operation key=B0J7E7A0NP4J tag=3PNRV3WZ74LP type=del size=3004632 2024-09-19T13:43:00.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.053+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=MU9CMDYMNL5L type=del size=3877803 2024-09-19T13:43:00.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.054+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~YTJM3BG1UR1C.0 size=697854 2024-09-19T13:43:00.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.056+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=YTJM3BG1UR1C tag=Z15E1KOG5HQ6 type=write size=1746430 2024-09-19T13:43:00.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.058+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=7YRDPJ50ASZN type=del size=3277517 2024-09-19T13:43:00.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.059+0000 7f6ab10d2780 1 < completed write operation key=WDRUV5ERI000 tag=O079LZ51ZEL5 type=write size=28153 2024-09-19T13:43:00.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.060+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=MT6BB6VH7CCP type=write size=151369 2024-09-19T13:43:00.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.061+0000 7f6ab10d2780 -1 < failed to complete operation key=X1JYDG1ASYAR tag=B0KWW0E1SHJE type=del size=2067625: (22) Invalid argument 2024-09-19T13:43:00.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.062+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=KMJ6QOYXT0VM type=del size=4122331 2024-09-19T13:43:00.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.063+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~Q7DA1IOVSCGW.0 size=1048576 2024-09-19T13:43:00.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.064+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~Q7DA1IOVSCGW.1 size=380796 2024-09-19T13:43:00.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.066+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=Q7DA1IOVSCGW tag=AP5WQZAIJ7F9 type=write size=2477948 2024-09-19T13:43:00.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.067+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=76UZ0V5AI6G2 type=del size=3120158 2024-09-19T13:43:00.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.069+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=36S2DM9UYZ1N type=del 2024-09-19T13:43:00.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.070+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=UE2MWT82PEJR type=del size=988047 2024-09-19T13:43:00.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.071+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=19X5ZFQ82B7U type=del 2024-09-19T13:43:00.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.072+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=20TPFWKLNG89 type=del size=883986 2024-09-19T13:43:00.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.073+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=8BVFHEP29JB7 type=del 2024-09-19T13:43:00.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.074+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=SDJF1OSN8JEH type=del size=2502641 2024-09-19T13:43:00.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.076+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=NQ9Z0BH6CAIB type=del 2024-09-19T13:43:00.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.077+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=BOBEF4AK4Y9A type=del size=4097754 2024-09-19T13:43:00.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.077+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~4S4JWELX3T9P.0 size=637534 2024-09-19T13:43:00.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.079+0000 7f6ab10d2780 1 < canceled multipart upload key=X8CWBFNCJG6M upload=4S4JWELX3T9P tag=27TZPQPZLBQK type=write size=1686110 2024-09-19T13:43:00.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.080+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=HMOKXXUCNFI5 type=del size=1599929 2024-09-19T13:43:00.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.081+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=4X16CYIGHBXP type=del 2024-09-19T13:43:00.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.082+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=T6QT2YMT0ZP1 type=write size=234082 2024-09-19T13:43:00.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.084+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=17DGLMAVHKCO type=del size=3532892 2024-09-19T13:43:00.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.086+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~NNJDC2478T05.0 size=1048576 2024-09-19T13:43:00.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.087+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~NNJDC2478T05.1 size=423744 2024-09-19T13:43:00.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.087+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=NNJDC2478T05 tag=3AZAJK6SBM2H type=write size=2520896 2024-09-19T13:43:00.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.089+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~FFGVHEDIBFQH.0 size=1048576 2024-09-19T13:43:00.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.089+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~FFGVHEDIBFQH.1 size=1048576 2024-09-19T13:43:00.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.090+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~FFGVHEDIBFQH.2 size=267144 2024-09-19T13:43:00.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.092+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=FFGVHEDIBFQH tag=Q3FVA6Z04UGN type=write size=3412872 2024-09-19T13:43:00.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.094+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~Q49JDD3XDGLK.0 size=1048576 2024-09-19T13:43:00.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.095+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~Q49JDD3XDGLK.1 size=357507 2024-09-19T13:43:00.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.095+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=Q49JDD3XDGLK tag=PHKZ1VNM1I2C type=write size=2454659 2024-09-19T13:43:00.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.096+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~Q7VP6GQ1UCMJ.0 size=1048576 2024-09-19T13:43:00.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.097+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~Q7VP6GQ1UCMJ.1 size=1048576 2024-09-19T13:43:00.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.098+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~Q7VP6GQ1UCMJ.2 size=212923 2024-09-19T13:43:00.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.100+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=Q7VP6GQ1UCMJ tag=MBMX8EPT8M29 type=write size=3358651 2024-09-19T13:43:00.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.102+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~0JPI4560K2M8.0 size=596306 2024-09-19T13:43:00.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.102+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=0JPI4560K2M8 tag=XXIEMJ88GBXD type=write size=1644882 2024-09-19T13:43:00.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.103+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=9JPPS8BLLL6A type=del 2024-09-19T13:43:00.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.104+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=PL32Y7TPZO2U type=del size=1465663 2024-09-19T13:43:00.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.105+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=IHVSR18UZE7F type=del 2024-09-19T13:43:00.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.107+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~WCLWAE51Q44F.0 size=1048576 2024-09-19T13:43:00.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.108+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~WCLWAE51Q44F.1 size=152507 2024-09-19T13:43:00.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.108+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=WCLWAE51Q44F tag=S1YPVWETNMD1 type=write size=2249659 2024-09-19T13:43:00.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.109+0000 7f6ab10d2780 1 < canceled operation key=9Q9DGUSDSE49 tag=MU9CMDYMNL5L type=del size=3877803 2024-09-19T13:43:00.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.110+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=6BYFZNCWNERM type=del size=3511365 2024-09-19T13:43:00.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.111+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=7YRDPJ50ASZN type=del 2024-09-19T13:43:00.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.113+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=QU5UWL0K92YU type=del size=1129517 2024-09-19T13:43:00.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.115+0000 7f6ab10d2780 1 < suggested remove operation key=9IN6E0JQFNAU tag=MT6BB6VH7CCP type=write 2024-09-19T13:43:00.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.117+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~P1JBU17F98EZ.0 size=1048576 2024-09-19T13:43:00.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.117+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~P1JBU17F98EZ.1 size=1048576 2024-09-19T13:43:00.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.118+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~P1JBU17F98EZ.2 size=311242 2024-09-19T13:43:00.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.118+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=P1JBU17F98EZ tag=32X51B535Y3O type=write size=3456970 2024-09-19T13:43:00.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.119+0000 7f6ab10d2780 -1 < failed to complete operation key=535R757HSXMB tag=KMJ6QOYXT0VM type=del size=4122331: (22) Invalid argument 2024-09-19T13:43:00.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.121+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~KX2OGFH94JXA.0 size=1048576 2024-09-19T13:43:00.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.122+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~KX2OGFH94JXA.1 size=1048576 2024-09-19T13:43:00.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.123+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~KX2OGFH94JXA.2 size=141176 2024-09-19T13:43:00.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.123+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=KX2OGFH94JXA tag=7ZIETI7L1T8L type=write size=3286904 2024-09-19T13:43:00.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.125+0000 7f6ab10d2780 1 < suggested remove operation key=UX2ICIT36Q3R tag=76UZ0V5AI6G2 type=del 2024-09-19T13:43:00.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.127+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~IEEY21D90CVG.0 size=1048576 2024-09-19T13:43:00.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.128+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~IEEY21D90CVG.1 size=68992 2024-09-19T13:43:00.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.128+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=IEEY21D90CVG tag=ZBABZGEESDPN type=write size=2166144 2024-09-19T13:43:00.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.129+0000 7f6ab10d2780 1 < canceled operation key=P2U09V0G7UUU tag=UE2MWT82PEJR type=del size=988047 2024-09-19T13:43:00.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.131+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~H5J9SER81IP9.0 size=125735 2024-09-19T13:43:00.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.131+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=H5J9SER81IP9 tag=9DXZV6V8NK9N type=write size=1174311 2024-09-19T13:43:00.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.132+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=20TPFWKLNG89 type=del 2024-09-19T13:43:00.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.134+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~340MMRMEUOUX.0 size=1048576 2024-09-19T13:43:00.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.135+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~340MMRMEUOUX.1 size=1048576 2024-09-19T13:43:00.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.136+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~340MMRMEUOUX.2 size=535969 2024-09-19T13:43:00.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.136+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=340MMRMEUOUX tag=4YQ4R0EUYHYY type=write size=3681697 2024-09-19T13:43:00.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.138+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=SDJF1OSN8JEH type=del size=2502641 2024-09-19T13:43:00.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.140+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=D65KGQ0H5YEU type=write size=754882 2024-09-19T13:43:00.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.141+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=BOBEF4AK4Y9A type=del 2024-09-19T13:43:00.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.143+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~YDV786SZBLAI.0 size=156143 2024-09-19T13:43:00.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.143+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=YDV786SZBLAI tag=A6EHN0LHPL1F type=write size=1204719 2024-09-19T13:43:00.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.144+0000 7f6ab10d2780 1 < canceled operation key=DTSRVH526PE7 tag=HMOKXXUCNFI5 type=del size=1599929 2024-09-19T13:43:00.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.145+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=LT1VENGSC3P1 type=del size=1943106 2024-09-19T13:43:00.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.146+0000 7f6ab10d2780 1 < canceled operation key=9Q9DGUSDSE49 tag=T6QT2YMT0ZP1 type=write size=234082 2024-09-19T13:43:00.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.147+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=BG2SUTG2KAX9 type=del size=91676 2024-09-19T13:43:00.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.148+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~NNJDC2478T05.0 size=1048576 2024-09-19T13:43:00.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.150+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~NNJDC2478T05.1 size=423744 2024-09-19T13:43:00.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.151+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=NNJDC2478T05 tag=3AZAJK6SBM2H type=write size=2520896 2024-09-19T13:43:00.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.153+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~D0MQK2DQ9DRM.0 size=1048576 2024-09-19T13:43:00.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.154+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~D0MQK2DQ9DRM.1 size=1048576 2024-09-19T13:43:00.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.155+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~D0MQK2DQ9DRM.2 size=833074 2024-09-19T13:43:00.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.155+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=D0MQK2DQ9DRM tag=JUAK7F0IBI4X type=write size=3978802 2024-09-19T13:43:00.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.157+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~Q49JDD3XDGLK.0 size=1048576 2024-09-19T13:43:00.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.157+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~Q49JDD3XDGLK.1 size=357507 2024-09-19T13:43:00.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.159+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=Q49JDD3XDGLK tag=PHKZ1VNM1I2C type=write size=2454659 2024-09-19T13:43:00.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.161+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=SH7Z56OCYNJV type=del size=2157842 2024-09-19T13:43:00.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.162+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~0JPI4560K2M8.0 size=596306 2024-09-19T13:43:00.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.164+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=0JPI4560K2M8 tag=XXIEMJ88GBXD type=write size=1644882 2024-09-19T13:43:00.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.166+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~T6EZ8MW4DNJG.0 size=1048576 2024-09-19T13:43:00.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.167+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~T6EZ8MW4DNJG.1 size=12693 2024-09-19T13:43:00.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.167+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=T6EZ8MW4DNJG tag=7F2GQK39FDC0 type=write size=2109845 2024-09-19T13:43:00.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.168+0000 7f6ab10d2780 -1 < failed to complete operation key=UX2ICIT36Q3R tag=PL32Y7TPZO2U type=del size=1465663: (22) Invalid argument 2024-09-19T13:43:00.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.169+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=CG32JGJ8FRSV type=del size=421841 2024-09-19T13:43:00.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.169+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~WCLWAE51Q44F.0 size=1048576 2024-09-19T13:43:00.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.171+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~WCLWAE51Q44F.1 size=152507 2024-09-19T13:43:00.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.173+0000 7f6ab10d2780 1 < canceled multipart upload key=X8CWBFNCJG6M upload=WCLWAE51Q44F tag=S1YPVWETNMD1 type=write size=2249659 2024-09-19T13:43:00.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.174+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=6S4W7K9WB3CU type=del size=3356413 2024-09-19T13:43:00.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.176+0000 7f6ab10d2780 1 < suggested remove operation key=VFJIKOLYI0HN tag=6BYFZNCWNERM type=del 2024-09-19T13:43:00.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.177+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=CE1Z8ZYG9VR5 type=del size=2979689 2024-09-19T13:43:00.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.179+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=QU5UWL0K92YU type=del 2024-09-19T13:43:00.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.180+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=NIRUCN9GKERB type=del size=628967 2024-09-19T13:43:00.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.181+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~P1JBU17F98EZ.0 size=1048576 2024-09-19T13:43:00.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.182+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~P1JBU17F98EZ.1 size=1048576 2024-09-19T13:43:00.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.183+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~P1JBU17F98EZ.2 size=311242 2024-09-19T13:43:00.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.185+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=P1JBU17F98EZ tag=32X51B535Y3O type=write size=3456970 2024-09-19T13:43:00.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.186+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=233HA7778D1O type=del size=2506396 2024-09-19T13:43:00.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.187+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~KX2OGFH94JXA.0 size=1048576 2024-09-19T13:43:00.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.188+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~KX2OGFH94JXA.1 size=1048576 2024-09-19T13:43:00.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.189+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~KX2OGFH94JXA.2 size=141176 2024-09-19T13:43:00.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.191+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=KX2OGFH94JXA tag=7ZIETI7L1T8L type=write size=3286904 2024-09-19T13:43:00.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.193+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~C0MHGJKHI9DT.0 size=1048576 2024-09-19T13:43:00.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.194+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~C0MHGJKHI9DT.1 size=1048576 2024-09-19T13:43:00.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.195+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~C0MHGJKHI9DT.2 size=424329 2024-09-19T13:43:00.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.195+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=C0MHGJKHI9DT tag=S97OHIA7AJY1 type=write size=3570057 2024-09-19T13:43:00.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.196+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~IEEY21D90CVG.0 size=1048576 2024-09-19T13:43:00.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.196+0000 7f6ab10d2780 1 < canceled part key=_multipart_535R757HSXMB.2~IEEY21D90CVG.1 size=68992 2024-09-19T13:43:00.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.198+0000 7f6ab10d2780 1 < canceled multipart upload key=535R757HSXMB upload=IEEY21D90CVG tag=ZBABZGEESDPN type=write size=2166144 2024-09-19T13:43:00.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.199+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=1B4PBROBOVEF type=write size=442197 2024-09-19T13:43:00.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.200+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~H5J9SER81IP9.0 size=125735 2024-09-19T13:43:00.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.202+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=H5J9SER81IP9 tag=9DXZV6V8NK9N type=write size=1174311 2024-09-19T13:43:00.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.203+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=HL71KZ5JV3F2 type=write size=596628 2024-09-19T13:43:00.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.204+0000 7f6ab10d2780 1 < canceled part key=_multipart_X1JYDG1ASYAR.2~340MMRMEUOUX.0 size=1048576 2024-09-19T13:43:00.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.205+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~340MMRMEUOUX.1 size=1048576 2024-09-19T13:43:00.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.206+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~340MMRMEUOUX.2 size=535969 2024-09-19T13:43:00.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.207+0000 7f6ab10d2780 1 < canceled multipart upload key=X1JYDG1ASYAR upload=340MMRMEUOUX tag=4YQ4R0EUYHYY type=write size=3681697 2024-09-19T13:43:00.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.209+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=KSPIWMBV5MNK type=write size=587175 2024-09-19T13:43:00.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.211+0000 7f6ab10d2780 1 < suggested remove operation key=535R757HSXMB tag=D65KGQ0H5YEU type=write 2024-09-19T13:43:00.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.213+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~1SBETLZX30T7.0 size=1048576 2024-09-19T13:43:00.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.214+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~1SBETLZX30T7.1 size=1048576 2024-09-19T13:43:00.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.215+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~1SBETLZX30T7.2 size=847885 2024-09-19T13:43:00.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.215+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=1SBETLZX30T7 tag=J8J599GUBB5C type=write size=3993613 2024-09-19T13:43:00.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.216+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~YDV786SZBLAI.0 size=156143 2024-09-19T13:43:00.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.218+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=YDV786SZBLAI tag=A6EHN0LHPL1F type=write size=1204719 2024-09-19T13:43:00.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.219+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=NQMM36WE5OJU type=del size=1626811 2024-09-19T13:43:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.220+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=LT1VENGSC3P1 type=del size=1943106 2024-09-19T13:43:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.221+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=FHICG8MY2M6H type=del size=3881717 2024-09-19T13:43:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.222+0000 7f6ab10d2780 1 < canceled operation key=SRABG45EPVN2 tag=BG2SUTG2KAX9 type=del size=91676 2024-09-19T13:43:00.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.224+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~DV4OU42XY485.0 size=431543 2024-09-19T13:43:00.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.224+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=DV4OU42XY485 tag=P9088LWC0FAW type=write size=1480119 2024-09-19T13:43:00.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.225+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~D0MQK2DQ9DRM.0 size=1048576 2024-09-19T13:43:00.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.226+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~D0MQK2DQ9DRM.1 size=1048576 2024-09-19T13:43:00.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.227+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~D0MQK2DQ9DRM.2 size=833074 2024-09-19T13:43:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.229+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=D0MQK2DQ9DRM tag=JUAK7F0IBI4X type=write size=3978802 2024-09-19T13:43:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.230+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=36627QCV7PZD type=write size=436123 2024-09-19T13:43:00.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.232+0000 7f6ab10d2780 1 < suggested update operation key=SRABG45EPVN2 tag=SH7Z56OCYNJV type=del size=2157842 2024-09-19T13:43:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.234+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~5A0L8S3F6M0V.0 size=363024 2024-09-19T13:43:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.234+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=5A0L8S3F6M0V tag=TR1BGIZOKBYS type=write size=1411600 2024-09-19T13:43:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.235+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~T6EZ8MW4DNJG.0 size=1048576 2024-09-19T13:43:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.236+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~T6EZ8MW4DNJG.1 size=12693 2024-09-19T13:43:00.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.238+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=T6EZ8MW4DNJG tag=7F2GQK39FDC0 type=write size=2109845 2024-09-19T13:43:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.240+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~W9OA6CHX1H2M.0 size=1048576 2024-09-19T13:43:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.241+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~W9OA6CHX1H2M.1 size=1048576 2024-09-19T13:43:00.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.242+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~W9OA6CHX1H2M.2 size=251842 2024-09-19T13:43:00.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.242+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=W9OA6CHX1H2M tag=FKIMU38QAWSB type=write size=3397570 2024-09-19T13:43:00.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.243+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=CG32JGJ8FRSV type=del 2024-09-19T13:43:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.245+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~OT139V9NCU0G.0 size=389218 2024-09-19T13:43:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.245+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=OT139V9NCU0G tag=AKEYGNICTLQB type=write size=1437794 2024-09-19T13:43:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.247+0000 7f6ab10d2780 1 < suggested update operation key=SDQ64HOD22EM tag=6S4W7K9WB3CU type=del size=3356413 2024-09-19T13:43:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.248+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=ERF9PJJIX7YQ type=del size=3243616 2024-09-19T13:43:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.250+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=CE1Z8ZYG9VR5 type=del size=2979689 2024-09-19T13:43:00.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.252+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~7W4LJS1Q5SXG.0 size=1048576 2024-09-19T13:43:00.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.253+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~7W4LJS1Q5SXG.1 size=1048576 2024-09-19T13:43:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.254+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~7W4LJS1Q5SXG.2 size=658735 2024-09-19T13:43:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.254+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=7W4LJS1Q5SXG tag=GAHLKC6YBT2W type=write size=3804463 2024-09-19T13:43:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.255+0000 7f6ab10d2780 1 < canceled operation key=VFJIKOLYI0HN tag=NIRUCN9GKERB type=del size=628967 2024-09-19T13:43:00.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.256+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=LDOM8TI9V6ND type=del size=1820218 2024-09-19T13:43:00.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.258+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=233HA7778D1O type=del 2024-09-19T13:43:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.259+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=4EQHWR0J5ZX9 type=del size=725428 2024-09-19T13:43:00.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.260+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~C0MHGJKHI9DT.0 size=1048576 2024-09-19T13:43:00.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.261+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~C0MHGJKHI9DT.1 size=1048576 2024-09-19T13:43:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.262+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~C0MHGJKHI9DT.2 size=424329 2024-09-19T13:43:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.264+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=C0MHGJKHI9DT tag=S97OHIA7AJY1 type=write size=3570057 2024-09-19T13:43:00.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.265+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=JCKW3GKOZB1G type=del size=1176057 2024-09-19T13:43:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.266+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=1B4PBROBOVEF type=write size=442197 2024-09-19T13:43:00.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.267+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=3UREJQTJHDJX type=del size=4190584 2024-09-19T13:43:00.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.270+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=HL71KZ5JV3F2 type=write 2024-09-19T13:43:00.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.271+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=UB7OFM2W0VC2 type=del size=1073238 2024-09-19T13:43:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.273+0000 7f6ab10d2780 1 < suggested update operation key=CD4XXORKVS6J tag=KSPIWMBV5MNK type=write size=587175 2024-09-19T13:43:00.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.274+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=IA4WZOZMSQGM type=del size=3962340 2024-09-19T13:43:00.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.276+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~1SBETLZX30T7.0 size=1048576 2024-09-19T13:43:00.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.277+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~1SBETLZX30T7.1 size=1048576 2024-09-19T13:43:00.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.278+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~1SBETLZX30T7.2 size=847885 2024-09-19T13:43:00.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.280+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=1SBETLZX30T7 tag=J8J599GUBB5C type=write size=3993613 2024-09-19T13:43:00.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.282+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~H61X9W7ME6GC.0 size=1048576 2024-09-19T13:43:00.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.282+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~H61X9W7ME6GC.1 size=613377 2024-09-19T13:43:00.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.282+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=H61X9W7ME6GC tag=NW0F21GBOIKT type=write size=2710529 2024-09-19T13:43:00.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.285+0000 7f6ab10d2780 1 < suggested update operation key=2KX2NSY41STV tag=NQMM36WE5OJU type=del size=1626811 2024-09-19T13:43:00.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.286+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=U4NYFLQ1A16N type=del size=3833837 2024-09-19T13:43:00.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.287+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=FHICG8MY2M6H type=del 2024-09-19T13:43:00.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.288+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=C6HFCSAF4U57 type=del size=3840107 2024-09-19T13:43:00.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.289+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~DV4OU42XY485.0 size=431543 2024-09-19T13:43:00.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.291+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=DV4OU42XY485 tag=P9088LWC0FAW type=write size=1480119 2024-09-19T13:43:00.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.292+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=XB53YPUL4PE0 type=del size=3621802 2024-09-19T13:43:00.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.293+0000 7f6ab10d2780 1 < completed write operation key=9MCE8PXHBGNF tag=36627QCV7PZD type=write size=436123 2024-09-19T13:43:00.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.294+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=501IEFOXLIJB type=del size=1488339 2024-09-19T13:43:00.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.295+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~5A0L8S3F6M0V.0 size=363024 2024-09-19T13:43:00.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.297+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=5A0L8S3F6M0V tag=TR1BGIZOKBYS type=write size=1411600 2024-09-19T13:43:00.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.298+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=A3VCJR0CT00V type=del size=4191852 2024-09-19T13:43:00.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.299+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~W9OA6CHX1H2M.0 size=1048576 2024-09-19T13:43:00.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.300+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~W9OA6CHX1H2M.1 size=1048576 2024-09-19T13:43:00.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.301+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~W9OA6CHX1H2M.2 size=251842 2024-09-19T13:43:00.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.303+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=W9OA6CHX1H2M tag=FKIMU38QAWSB type=write size=3397570 2024-09-19T13:43:00.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.304+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=1RKCG7CVJ7O0 type=del size=36485 2024-09-19T13:43:00.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.305+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~OT139V9NCU0G.0 size=389218 2024-09-19T13:43:00.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.307+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=OT139V9NCU0G tag=AKEYGNICTLQB type=write size=1437794 2024-09-19T13:43:00.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.309+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~QD6JAWE1LKNN.0 size=1048576 2024-09-19T13:43:00.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.310+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~QD6JAWE1LKNN.1 size=1048576 2024-09-19T13:43:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.311+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~QD6JAWE1LKNN.2 size=955697 2024-09-19T13:43:00.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.311+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=QD6JAWE1LKNN tag=ZKRJP16SULPT type=write size=4101425 2024-09-19T13:43:00.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.312+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=ERF9PJJIX7YQ type=del 2024-09-19T13:43:00.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.313+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~4WM0DB75UR6X.0 size=1048576 2024-09-19T13:43:00.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.314+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~4WM0DB75UR6X.1 size=260490 2024-09-19T13:43:00.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.314+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=4WM0DB75UR6X tag=IT4P11XC83FB type=write size=2357642 2024-09-19T13:43:00.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.315+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~7W4LJS1Q5SXG.0 size=1048576 2024-09-19T13:43:00.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.316+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~7W4LJS1Q5SXG.1 size=1048576 2024-09-19T13:43:00.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.317+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~7W4LJS1Q5SXG.2 size=658735 2024-09-19T13:43:00.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.319+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=7W4LJS1Q5SXG tag=GAHLKC6YBT2W type=write size=3804463 2024-09-19T13:43:00.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.321+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=FKGLM8ZC5C0L type=del size=1267633 2024-09-19T13:43:00.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.322+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=LDOM8TI9V6ND type=del 2024-09-19T13:43:00.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.323+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=T501K7HBF2FT type=del size=3998268 2024-09-19T13:43:00.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.325+0000 7f6ab10d2780 1 < suggested update operation key=A14YTABJ1Z3Z tag=4EQHWR0J5ZX9 type=del size=725428 2024-09-19T13:43:00.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.326+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=HNFVB6719JKM type=write size=593618 2024-09-19T13:43:00.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.327+0000 7f6ab10d2780 1 < canceled operation key=4OSJA1879NQO tag=JCKW3GKOZB1G type=del size=1176057 2024-09-19T13:43:00.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.328+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=JUSMRDLJYQOI type=write size=84552 2024-09-19T13:43:00.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.330+0000 7f6ab10d2780 1 < suggested update operation key=DTSRVH526PE7 tag=3UREJQTJHDJX type=del size=4190584 2024-09-19T13:43:00.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.332+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~19CF4NXE9WUP.0 size=331985 2024-09-19T13:43:00.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.332+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=19CF4NXE9WUP tag=ULB1K5P3FOLW type=write size=1380561 2024-09-19T13:43:00.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.334+0000 7f6ab10d2780 1 < suggested remove operation key=535R757HSXMB tag=UB7OFM2W0VC2 type=del 2024-09-19T13:43:00.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.336+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~B517FGGZQL69.0 size=1048576 2024-09-19T13:43:00.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.337+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~B517FGGZQL69.1 size=1048576 2024-09-19T13:43:00.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.338+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~B517FGGZQL69.2 size=480763 2024-09-19T13:43:00.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.338+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=B517FGGZQL69 tag=405SJO3WDK4A type=write size=3626491 2024-09-19T13:43:00.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.339+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=IA4WZOZMSQGM type=del 2024-09-19T13:43:00.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.341+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~QV6IE6WO45OG.0 size=664831 2024-09-19T13:43:00.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.341+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=QV6IE6WO45OG tag=ZHVZHKRTJAZP type=write size=1713407 2024-09-19T13:43:00.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.342+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~H61X9W7ME6GC.0 size=1048576 2024-09-19T13:43:00.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.343+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~H61X9W7ME6GC.1 size=613377 2024-09-19T13:43:00.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.345+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=H61X9W7ME6GC tag=NW0F21GBOIKT type=write size=2710529 2024-09-19T13:43:00.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.347+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~YOULZYV782AO.0 size=1048576 2024-09-19T13:43:00.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.348+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~YOULZYV782AO.1 size=969480 2024-09-19T13:43:00.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.348+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=YOULZYV782AO tag=Y0LYO3UZNC7R type=write size=3066632 2024-09-19T13:43:00.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.349+0000 7f6ab10d2780 -1 < failed to complete operation key=A14YTABJ1Z3Z tag=U4NYFLQ1A16N type=del size=3833837: (22) Invalid argument 2024-09-19T13:43:00.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.351+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~HFHJWDDF40RB.0 size=1048576 2024-09-19T13:43:00.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.352+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~HFHJWDDF40RB.1 size=1048576 2024-09-19T13:43:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.353+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~HFHJWDDF40RB.2 size=774019 2024-09-19T13:43:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.353+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=HFHJWDDF40RB tag=573P39490SP8 type=write size=3919747 2024-09-19T13:43:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.355+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=C6HFCSAF4U57 type=del size=3840107 2024-09-19T13:43:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.358+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~FWUN58R07FWU.0 size=145367 2024-09-19T13:43:00.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.358+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=FWUN58R07FWU tag=L2M7UJ7CMEAE type=write size=1193943 2024-09-19T13:43:00.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.359+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=XB53YPUL4PE0 type=del 2024-09-19T13:43:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.360+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=70S0PY79GJ60 type=del size=1799648 2024-09-19T13:43:00.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.362+0000 7f6ab10d2780 1 < suggested remove operation key=V8P17ZSOQUSM tag=501IEFOXLIJB type=del 2024-09-19T13:43:00.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.363+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=WMBW21AP1MB0 type=del size=3429706 2024-09-19T13:43:00.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.365+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=A3VCJR0CT00V type=del 2024-09-19T13:43:00.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.366+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=P42MDGUUOWWC type=del size=290286 2024-09-19T13:43:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.367+0000 7f6ab10d2780 -1 < failed to complete operation key=DTSRVH526PE7 tag=1RKCG7CVJ7O0 type=del size=36485: (22) Invalid argument 2024-09-19T13:43:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.368+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=UD7WBJEGZJ0K type=del size=3910494 2024-09-19T13:43:00.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.369+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~QD6JAWE1LKNN.0 size=1048576 2024-09-19T13:43:00.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.370+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~QD6JAWE1LKNN.1 size=1048576 2024-09-19T13:43:00.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.371+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~QD6JAWE1LKNN.2 size=955697 2024-09-19T13:43:00.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.373+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=QD6JAWE1LKNN tag=ZKRJP16SULPT type=write size=4101425 2024-09-19T13:43:00.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.374+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=ZTREE1OMM5CL type=del size=3929248 2024-09-19T13:43:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.375+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~4WM0DB75UR6X.0 size=1048576 2024-09-19T13:43:00.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.376+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~4WM0DB75UR6X.1 size=260490 2024-09-19T13:43:00.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.379+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=4WM0DB75UR6X tag=IT4P11XC83FB type=write size=2357642 2024-09-19T13:43:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.380+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=2YEIJ96B1ML5 type=del size=2396151 2024-09-19T13:43:00.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.381+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=FKGLM8ZC5C0L type=del 2024-09-19T13:43:00.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.383+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~3DCJKCCXSWSL.0 size=1048576 2024-09-19T13:43:00.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.384+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~3DCJKCCXSWSL.1 size=1048576 2024-09-19T13:43:00.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.385+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~3DCJKCCXSWSL.2 size=914817 2024-09-19T13:43:00.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.385+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=3DCJKCCXSWSL tag=SA2620RB8M3U type=write size=4060545 2024-09-19T13:43:00.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.387+0000 7f6ab10d2780 1 < suggested remove operation key=DF003ORZ1HOM tag=T501K7HBF2FT type=del 2024-09-19T13:43:00.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.389+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~GQ28XWJ1KO95.0 size=143761 2024-09-19T13:43:00.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.389+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=GQ28XWJ1KO95 tag=B7UJQWNHOVW8 type=write size=1192337 2024-09-19T13:43:00.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.391+0000 7f6ab10d2780 1 < completed write operation key=TCXAYADSCTZI tag=HNFVB6719JKM type=write size=593618 2024-09-19T13:43:00.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.392+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=SVA43VIMX09X type=del size=3228773 2024-09-19T13:43:00.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.393+0000 7f6ab10d2780 1 < completed write operation key=X8CWBFNCJG6M tag=JUSMRDLJYQOI type=write size=84552 2024-09-19T13:43:00.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.394+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=IC1U2726R2ND type=del size=1682450 2024-09-19T13:43:00.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.395+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~19CF4NXE9WUP.0 size=331985 2024-09-19T13:43:00.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.397+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=19CF4NXE9WUP tag=ULB1K5P3FOLW type=write size=1380561 2024-09-19T13:43:00.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.398+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=VG3SHNCL9BE3 type=write size=853686 2024-09-19T13:43:00.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.399+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~B517FGGZQL69.0 size=1048576 2024-09-19T13:43:00.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.400+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~B517FGGZQL69.1 size=1048576 2024-09-19T13:43:00.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.401+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~B517FGGZQL69.2 size=480763 2024-09-19T13:43:00.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.403+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=B517FGGZQL69 tag=405SJO3WDK4A type=write size=3626491 2024-09-19T13:43:00.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.404+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=5FO49A4D39QI type=del size=2662651 2024-09-19T13:43:00.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.405+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~QV6IE6WO45OG.0 size=664831 2024-09-19T13:43:00.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.407+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=QV6IE6WO45OG tag=ZHVZHKRTJAZP type=write size=1713407 2024-09-19T13:43:00.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.408+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=AM3I7TMSQMTA type=del size=1977045 2024-09-19T13:43:00.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.409+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~YOULZYV782AO.0 size=1048576 2024-09-19T13:43:00.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.411+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~YOULZYV782AO.1 size=969480 2024-09-19T13:43:00.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.412+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=YOULZYV782AO tag=Y0LYO3UZNC7R type=write size=3066632 2024-09-19T13:43:00.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.414+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=4UPOL4QZ9DAP type=del size=3599765 2024-09-19T13:43:00.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.415+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~HFHJWDDF40RB.0 size=1048576 2024-09-19T13:43:00.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.416+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~HFHJWDDF40RB.1 size=1048576 2024-09-19T13:43:00.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.417+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~HFHJWDDF40RB.2 size=774019 2024-09-19T13:43:00.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.418+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=HFHJWDDF40RB tag=573P39490SP8 type=write size=3919747 2024-09-19T13:43:00.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.420+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~VL4EH0C4ROSX.0 size=1048576 2024-09-19T13:43:00.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.421+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~VL4EH0C4ROSX.1 size=1048576 2024-09-19T13:43:00.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.422+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~VL4EH0C4ROSX.2 size=865609 2024-09-19T13:43:00.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.422+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=VL4EH0C4ROSX tag=90DM3R3CIYBH type=write size=4011337 2024-09-19T13:43:00.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.423+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~FWUN58R07FWU.0 size=145367 2024-09-19T13:43:00.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.425+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=FWUN58R07FWU tag=L2M7UJ7CMEAE type=write size=1193943 2024-09-19T13:43:00.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.426+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=RXZ6RPXAD678 type=del size=3228893 2024-09-19T13:43:00.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.428+0000 7f6ab10d2780 1 < suggested remove operation key=535R757HSXMB tag=70S0PY79GJ60 type=del 2024-09-19T13:43:00.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.431+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~P6TBC7OSEY08.0 size=1048576 2024-09-19T13:43:00.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.432+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~P6TBC7OSEY08.1 size=613017 2024-09-19T13:43:00.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.432+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=P6TBC7OSEY08 tag=UNUVJ5LIZIX2 type=write size=2710169 2024-09-19T13:43:00.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.433+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=WMBW21AP1MB0 type=del 2024-09-19T13:43:00.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.435+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~YQ8RN3T0T3K9.0 size=1048576 2024-09-19T13:43:00.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.436+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~YQ8RN3T0T3K9.1 size=1010661 2024-09-19T13:43:00.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.436+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=YQ8RN3T0T3K9 tag=EBSPZ7SUZ4XE type=write size=3107813 2024-09-19T13:43:00.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.437+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=P42MDGUUOWWC type=del 2024-09-19T13:43:00.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.438+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=A6LM8QL7G3S6 type=del size=2021323 2024-09-19T13:43:00.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.439+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=UD7WBJEGZJ0K type=del 2024-09-19T13:43:00.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.441+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~Q19Y9JX10I4P.0 size=570059 2024-09-19T13:43:00.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.441+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=Q19Y9JX10I4P tag=OXTS1O5CJGZA type=write size=1618635 2024-09-19T13:43:00.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.442+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=ZTREE1OMM5CL type=del 2024-09-19T13:43:00.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.443+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=IMLQWC7Z3QMO type=del size=3301502 2024-09-19T13:43:00.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.444+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=2YEIJ96B1ML5 type=del 2024-09-19T13:43:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.446+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~14D1OL7BQ6S6.0 size=541680 2024-09-19T13:43:00.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.446+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=14D1OL7BQ6S6 tag=I704DKU2MRRM type=write size=1590256 2024-09-19T13:43:00.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.447+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~3DCJKCCXSWSL.0 size=1048576 2024-09-19T13:43:00.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.448+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~3DCJKCCXSWSL.1 size=1048576 2024-09-19T13:43:00.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.449+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~3DCJKCCXSWSL.2 size=914817 2024-09-19T13:43:00.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.451+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=3DCJKCCXSWSL tag=SA2620RB8M3U type=write size=4060545 2024-09-19T13:43:00.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.452+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=UXPLPHANNTOO type=write size=318430 2024-09-19T13:43:00.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.453+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~GQ28XWJ1KO95.0 size=143761 2024-09-19T13:43:00.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.455+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=GQ28XWJ1KO95 tag=B7UJQWNHOVW8 type=write size=1192337 2024-09-19T13:43:00.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.456+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=W4Y2DH8WOUHX type=write size=157736 2024-09-19T13:43:00.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.457+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=SVA43VIMX09X type=del 2024-09-19T13:43:00.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.458+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=U0YR1AB5K515 type=del size=1309428 2024-09-19T13:43:00.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.459+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=IC1U2726R2ND type=del 2024-09-19T13:43:00.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.460+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=YNIJLYKLQG08 type=del size=1641716 2024-09-19T13:43:00.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.461+0000 7f6ab10d2780 1 < completed write operation key=SDQ64HOD22EM tag=VG3SHNCL9BE3 type=write size=853686 2024-09-19T13:43:00.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.462+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=XAF5327C399Y type=del size=1645527 2024-09-19T13:43:00.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.463+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=5FO49A4D39QI type=del 2024-09-19T13:43:00.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.465+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~IBNBXVX5FKCE.0 size=1048576 2024-09-19T13:43:00.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.466+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~IBNBXVX5FKCE.1 size=1048576 2024-09-19T13:43:00.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.467+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~IBNBXVX5FKCE.2 size=312645 2024-09-19T13:43:00.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.467+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=IBNBXVX5FKCE tag=F9T01IWM884L type=write size=3458373 2024-09-19T13:43:00.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.468+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=AM3I7TMSQMTA type=del 2024-09-19T13:43:00.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.470+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~JJM2CUI0NEK2.0 size=1048576 2024-09-19T13:43:00.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.471+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~JJM2CUI0NEK2.1 size=756714 2024-09-19T13:43:00.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.471+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=JJM2CUI0NEK2 tag=CAW1AARB0W3P type=write size=2853866 2024-09-19T13:43:00.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.472+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=4UPOL4QZ9DAP type=del 2024-09-19T13:43:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.473+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=NKRE5XP7X84B type=del size=3696658 2024-09-19T13:43:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.474+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~VL4EH0C4ROSX.0 size=1048576 2024-09-19T13:43:00.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.475+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~VL4EH0C4ROSX.1 size=1048576 2024-09-19T13:43:00.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.475+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~VL4EH0C4ROSX.2 size=865609 2024-09-19T13:43:00.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.478+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=VL4EH0C4ROSX tag=90DM3R3CIYBH type=write size=4011337 2024-09-19T13:43:00.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.480+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~BLULBP85AEOL.0 size=1048576 2024-09-19T13:43:00.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.481+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~BLULBP85AEOL.1 size=797292 2024-09-19T13:43:00.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.481+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=BLULBP85AEOL tag=SHEAYSESU5ME type=write size=2894444 2024-09-19T13:43:00.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.482+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=RXZ6RPXAD678 type=del 2024-09-19T13:43:00.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.484+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=OWT3QIYZ2CYD type=del size=1849777 2024-09-19T13:43:00.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.485+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~P6TBC7OSEY08.0 size=1048576 2024-09-19T13:43:00.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.486+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~P6TBC7OSEY08.1 size=613017 2024-09-19T13:43:00.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.488+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=P6TBC7OSEY08 tag=UNUVJ5LIZIX2 type=write size=2710169 2024-09-19T13:43:00.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.490+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~55OTFI5M12XG.0 size=471846 2024-09-19T13:43:00.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.490+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=55OTFI5M12XG tag=9G7E3CBLXOM9 type=write size=1520422 2024-09-19T13:43:00.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.491+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~YQ8RN3T0T3K9.0 size=1048576 2024-09-19T13:43:00.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.492+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~YQ8RN3T0T3K9.1 size=1010661 2024-09-19T13:43:00.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.494+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=YQ8RN3T0T3K9 tag=EBSPZ7SUZ4XE type=write size=3107813 2024-09-19T13:43:00.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.495+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~GICW1AZZF347.0 size=14962 2024-09-19T13:43:00.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.496+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=GICW1AZZF347 tag=V689W3F11ET8 type=write size=1063538 2024-09-19T13:43:00.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.497+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=A6LM8QL7G3S6 type=del 2024-09-19T13:43:00.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.499+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TCCXFH37MMBY.0 size=1048576 2024-09-19T13:43:00.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.500+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TCCXFH37MMBY.1 size=1048576 2024-09-19T13:43:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.501+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TCCXFH37MMBY.2 size=896233 2024-09-19T13:43:00.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.501+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=TCCXFH37MMBY tag=K165487SZ60W type=write size=4041961 2024-09-19T13:43:00.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.502+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~Q19Y9JX10I4P.0 size=570059 2024-09-19T13:43:00.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.504+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=Q19Y9JX10I4P tag=OXTS1O5CJGZA type=write size=1618635 2024-09-19T13:43:00.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.506+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~52TOXZ8T1N1O.0 size=1048576 2024-09-19T13:43:00.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.507+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~52TOXZ8T1N1O.1 size=1048576 2024-09-19T13:43:00.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.508+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~52TOXZ8T1N1O.2 size=416853 2024-09-19T13:43:00.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.508+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=52TOXZ8T1N1O tag=3V19F1D9PPN3 type=write size=3562581 2024-09-19T13:43:00.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.509+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=IMLQWC7Z3QMO type=del 2024-09-19T13:43:00.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.510+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=8ZMQXAEQXJED type=del size=2499228 2024-09-19T13:43:00.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.511+0000 7f6ab10d2780 1 < canceled part key=_multipart_DTSRVH526PE7.2~14D1OL7BQ6S6.0 size=541680 2024-09-19T13:43:00.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.513+0000 7f6ab10d2780 1 < canceled multipart upload key=DTSRVH526PE7 upload=14D1OL7BQ6S6 tag=I704DKU2MRRM type=write size=1590256 2024-09-19T13:43:00.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.514+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=KCEHSSC5ZJ3X type=del size=1622009 2024-09-19T13:43:00.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.515+0000 7f6ab10d2780 1 < completed write operation key=X1JYDG1ASYAR tag=UXPLPHANNTOO type=write size=318430 2024-09-19T13:43:00.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.516+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=O0UEV1AJXEVI type=del size=998329 2024-09-19T13:43:00.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.517+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=W4Y2DH8WOUHX type=write size=157736 2024-09-19T13:43:00.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.519+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~KE5ZVAGOKAPD.0 size=643777 2024-09-19T13:43:00.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.519+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=KE5ZVAGOKAPD tag=WCU4ZMG30SQN type=write size=1692353 2024-09-19T13:43:00.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.522+0000 7f6ab10d2780 1 < suggested update operation key=X1JYDG1ASYAR tag=U0YR1AB5K515 type=del size=1309428 2024-09-19T13:43:00.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.523+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=DP83AUS9UXXN type=del size=91606 2024-09-19T13:43:00.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.524+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=YNIJLYKLQG08 type=del 2024-09-19T13:43:00.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.526+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~01IWP37OHI6U.0 size=1048576 2024-09-19T13:43:00.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.527+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~01IWP37OHI6U.1 size=561034 2024-09-19T13:43:00.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.527+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=01IWP37OHI6U tag=5P3F3T1PZVC8 type=write size=2658186 2024-09-19T13:43:00.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.529+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=XAF5327C399Y type=del 2024-09-19T13:43:00.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.531+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~X7GNWSSL3XTU.0 size=523714 2024-09-19T13:43:00.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.531+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=X7GNWSSL3XTU tag=OKGKW290R2IQ type=write size=1572290 2024-09-19T13:43:00.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.531+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~IBNBXVX5FKCE.0 size=1048576 2024-09-19T13:43:00.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.532+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~IBNBXVX5FKCE.1 size=1048576 2024-09-19T13:43:00.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.532+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~IBNBXVX5FKCE.2 size=312645 2024-09-19T13:43:00.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.534+0000 7f6ab10d2780 1 < canceled multipart upload key=X8CWBFNCJG6M upload=IBNBXVX5FKCE tag=F9T01IWM884L type=write size=3458373 2024-09-19T13:43:00.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.535+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=H8Q0QEC5JC65 type=write size=436855 2024-09-19T13:43:00.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.536+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~JJM2CUI0NEK2.0 size=1048576 2024-09-19T13:43:00.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.537+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~JJM2CUI0NEK2.1 size=756714 2024-09-19T13:43:00.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.539+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=JJM2CUI0NEK2 tag=CAW1AARB0W3P type=write size=2853866 2024-09-19T13:43:00.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.540+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~WYNS144L5C5S.0 size=488166 2024-09-19T13:43:00.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.540+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=WYNS144L5C5S tag=6CFRBJ142OIP type=write size=1536742 2024-09-19T13:43:00.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.542+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=NKRE5XP7X84B type=del 2024-09-19T13:43:00.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.543+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=JK99GG1LPIBD type=del size=3542099 2024-09-19T13:43:00.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.544+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~BLULBP85AEOL.0 size=1048576 2024-09-19T13:43:00.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.545+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~BLULBP85AEOL.1 size=797292 2024-09-19T13:43:00.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.546+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=BLULBP85AEOL tag=SHEAYSESU5ME type=write size=2894444 2024-09-19T13:43:00.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.547+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=A7FSBOLK55BK type=del size=1211210 2024-09-19T13:43:00.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.548+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=OWT3QIYZ2CYD type=del 2024-09-19T13:43:00.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.550+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~ZMTM2LMAG2AT.0 size=1048576 2024-09-19T13:43:00.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.551+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~ZMTM2LMAG2AT.1 size=908463 2024-09-19T13:43:00.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.551+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=ZMTM2LMAG2AT tag=RC0PCD4H76SZ type=write size=3005615 2024-09-19T13:43:00.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.552+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~55OTFI5M12XG.0 size=471846 2024-09-19T13:43:00.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.554+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=55OTFI5M12XG tag=9G7E3CBLXOM9 type=write size=1520422 2024-09-19T13:43:00.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.556+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~XB2J8ZV1IROJ.0 size=1048576 2024-09-19T13:43:00.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.557+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~XB2J8ZV1IROJ.1 size=1048576 2024-09-19T13:43:00.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.558+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~XB2J8ZV1IROJ.2 size=175652 2024-09-19T13:43:00.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.558+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=XB2J8ZV1IROJ tag=SBHKQALA1OE4 type=write size=3321380 2024-09-19T13:43:00.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.559+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~GICW1AZZF347.0 size=14962 2024-09-19T13:43:00.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.560+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=GICW1AZZF347 tag=V689W3F11ET8 type=write size=1063538 2024-09-19T13:43:00.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.561+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=CR0O19DWIBS4 type=write size=454533 2024-09-19T13:43:00.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.563+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TCCXFH37MMBY.0 size=1048576 2024-09-19T13:43:00.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.563+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TCCXFH37MMBY.1 size=1048576 2024-09-19T13:43:00.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.564+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TCCXFH37MMBY.2 size=896233 2024-09-19T13:43:00.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.566+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=TCCXFH37MMBY tag=K165487SZ60W type=write size=4041961 2024-09-19T13:43:00.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.567+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=JZI2N60GP5OW type=del size=3014858 2024-09-19T13:43:00.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.568+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~52TOXZ8T1N1O.0 size=1048576 2024-09-19T13:43:00.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.569+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~52TOXZ8T1N1O.1 size=1048576 2024-09-19T13:43:00.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.570+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~52TOXZ8T1N1O.2 size=416853 2024-09-19T13:43:00.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.572+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=52TOXZ8T1N1O tag=3V19F1D9PPN3 type=write size=3562581 2024-09-19T13:43:00.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.573+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=S3SA9M6IO60K type=del size=1497958 2024-09-19T13:43:00.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.574+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=8ZMQXAEQXJED type=del 2024-09-19T13:43:00.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.575+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=WFXM980IW0P0 type=del size=3980443 2024-09-19T13:43:00.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.576+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=KCEHSSC5ZJ3X type=del 2024-09-19T13:43:00.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.577+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=AUUDH7LJF0JV type=del size=3284570 2024-09-19T13:43:00.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.578+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=O0UEV1AJXEVI type=del 2024-09-19T13:43:00.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.580+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~GZ4C6XC8P50X.0 size=1048576 2024-09-19T13:43:00.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.581+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~GZ4C6XC8P50X.1 size=522455 2024-09-19T13:43:00.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.581+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=GZ4C6XC8P50X tag=KAHXFYZXU862 type=write size=2619607 2024-09-19T13:43:00.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.582+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~KE5ZVAGOKAPD.0 size=643777 2024-09-19T13:43:00.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.585+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=KE5ZVAGOKAPD tag=WCU4ZMG30SQN type=write size=1692353 2024-09-19T13:43:00.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.586+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=Q332IOCTVX37 type=write size=624708 2024-09-19T13:43:00.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.587+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=DP83AUS9UXXN type=del 2024-09-19T13:43:00.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.588+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=GQL4GD33XOL3 type=del size=747457 2024-09-19T13:43:00.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.589+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~01IWP37OHI6U.0 size=1048576 2024-09-19T13:43:00.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.589+0000 7f6ab10d2780 1 < canceled part key=_multipart_9Q9DGUSDSE49.2~01IWP37OHI6U.1 size=561034 2024-09-19T13:43:00.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.591+0000 7f6ab10d2780 1 < canceled multipart upload key=9Q9DGUSDSE49 upload=01IWP37OHI6U tag=5P3F3T1PZVC8 type=write size=2658186 2024-09-19T13:43:00.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.592+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=DPGSHREHZE5B type=del size=166289 2024-09-19T13:43:00.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.592+0000 7f6ab10d2780 1 < canceled part key=_multipart_9WTLWBONAOET.2~X7GNWSSL3XTU.0 size=523714 2024-09-19T13:43:00.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.594+0000 7f6ab10d2780 1 < canceled multipart upload key=9WTLWBONAOET upload=X7GNWSSL3XTU tag=OKGKW290R2IQ type=write size=1572290 2024-09-19T13:43:00.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.595+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=YV1KBTRRX1NI type=del size=913721 2024-09-19T13:43:00.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.597+0000 7f6ab10d2780 1 < suggested remove operation key=UPMXNNYUUJR7 tag=H8Q0QEC5JC65 type=write 2024-09-19T13:43:00.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.598+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=MWGDP2AMYH2H type=del size=298833 2024-09-19T13:43:00.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.599+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~WYNS144L5C5S.0 size=488166 2024-09-19T13:43:00.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.601+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=WYNS144L5C5S tag=6CFRBJ142OIP type=write size=1536742 2024-09-19T13:43:00.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.603+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~JDIX45KLI6XJ.0 size=1048576 2024-09-19T13:43:00.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.604+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~JDIX45KLI6XJ.1 size=1048576 2024-09-19T13:43:00.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.605+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~JDIX45KLI6XJ.2 size=893117 2024-09-19T13:43:00.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.605+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=JDIX45KLI6XJ tag=4K8AXWG6RGQF type=write size=4038845 2024-09-19T13:43:00.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.606+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=JK99GG1LPIBD type=del 2024-09-19T13:43:00.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.608+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~SC4T3WD9OKPN.0 size=314842 2024-09-19T13:43:00.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.608+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=SC4T3WD9OKPN tag=AW4GC1GSYURD type=write size=1363418 2024-09-19T13:43:00.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.609+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=A7FSBOLK55BK type=del 2024-09-19T13:43:00.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.611+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~8RFRO3KQX8XP.0 size=507552 2024-09-19T13:43:00.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.611+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=8RFRO3KQX8XP tag=X0FON96JC6SM type=write size=1556128 2024-09-19T13:43:00.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.612+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~ZMTM2LMAG2AT.0 size=1048576 2024-09-19T13:43:00.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.613+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~ZMTM2LMAG2AT.1 size=908463 2024-09-19T13:43:00.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.614+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=ZMTM2LMAG2AT tag=RC0PCD4H76SZ type=write size=3005615 2024-09-19T13:43:00.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.616+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=SBAQ1UOHO00A type=write size=157266 2024-09-19T13:43:00.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.617+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~XB2J8ZV1IROJ.0 size=1048576 2024-09-19T13:43:00.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.618+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~XB2J8ZV1IROJ.1 size=1048576 2024-09-19T13:43:00.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.619+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~XB2J8ZV1IROJ.2 size=175652 2024-09-19T13:43:00.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.621+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=XB2J8ZV1IROJ tag=SBHKQALA1OE4 type=write size=3321380 2024-09-19T13:43:00.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.622+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=CPVGDSZ6BP0V type=del size=3612554 2024-09-19T13:43:00.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.623+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=CR0O19DWIBS4 type=write size=454533 2024-09-19T13:43:00.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.625+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=828EJ1LTRY6A type=del size=1565443 2024-09-19T13:43:00.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.626+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=JZI2N60GP5OW type=del 2024-09-19T13:43:00.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.627+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=TGTEMA1Y6GLA type=del size=4016283 2024-09-19T13:43:00.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.629+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=S3SA9M6IO60K type=del 2024-09-19T13:43:00.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.631+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~GMRRBZL89B0J.0 size=749292 2024-09-19T13:43:00.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.631+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=GMRRBZL89B0J tag=K9I3GPWRPLQ6 type=write size=1797868 2024-09-19T13:43:00.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.633+0000 7f6ab10d2780 1 < suggested update operation key=SRABG45EPVN2 tag=WFXM980IW0P0 type=del size=3980443 2024-09-19T13:43:00.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.635+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~QN0PN5EUO043.0 size=1048576 2024-09-19T13:43:00.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.636+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~QN0PN5EUO043.1 size=436495 2024-09-19T13:43:00.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.636+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=QN0PN5EUO043 tag=J9BIRJGWTSLM type=write size=2533647 2024-09-19T13:43:00.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.637+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=AUUDH7LJF0JV type=del 2024-09-19T13:43:00.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.638+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=MLKGQTRLI0BR type=del size=2829713 2024-09-19T13:43:00.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.639+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~GZ4C6XC8P50X.0 size=1048576 2024-09-19T13:43:00.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.640+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~GZ4C6XC8P50X.1 size=522455 2024-09-19T13:43:00.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.642+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=GZ4C6XC8P50X tag=KAHXFYZXU862 type=write size=2619607 2024-09-19T13:43:00.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.643+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=MALIINPKODCH type=del size=1923316 2024-09-19T13:43:00.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.644+0000 7f6ab10d2780 1 < completed write operation key=X1JYDG1ASYAR tag=Q332IOCTVX37 type=write size=624708 2024-09-19T13:43:00.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.645+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=1RB939VPGL1L type=del size=2359021 2024-09-19T13:43:00.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.647+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=GQL4GD33XOL3 type=del 2024-09-19T13:43:00.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.648+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=SLK49GJBIRN3 type=del size=4062488 2024-09-19T13:43:00.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.649+0000 7f6ab10d2780 1 < canceled operation key=EE8F84K0ZAGJ tag=DPGSHREHZE5B type=del size=166289 2024-09-19T13:43:00.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.650+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=8J806YBLDT4G type=del size=2841081 2024-09-19T13:43:00.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.652+0000 7f6ab10d2780 1 < suggested remove operation key=DTSRVH526PE7 tag=YV1KBTRRX1NI type=del 2024-09-19T13:43:00.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.653+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=1NOQ7W5QIF78 type=del size=4119883 2024-09-19T13:43:00.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.654+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=MWGDP2AMYH2H type=del 2024-09-19T13:43:00.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.656+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~TL2BG1K3LYZA.0 size=864057 2024-09-19T13:43:00.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.656+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=TL2BG1K3LYZA tag=9QK0PACVUJB0 type=write size=1912633 2024-09-19T13:43:00.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.657+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~JDIX45KLI6XJ.0 size=1048576 2024-09-19T13:43:00.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.657+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~JDIX45KLI6XJ.1 size=1048576 2024-09-19T13:43:00.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.658+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~JDIX45KLI6XJ.2 size=893117 2024-09-19T13:43:00.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.660+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=JDIX45KLI6XJ tag=4K8AXWG6RGQF type=write size=4038845 2024-09-19T13:43:00.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.661+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=X7Q3DL4DBW3Z type=del size=1261516 2024-09-19T13:43:00.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.662+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~SC4T3WD9OKPN.0 size=314842 2024-09-19T13:43:00.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.664+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=SC4T3WD9OKPN tag=AW4GC1GSYURD type=write size=1363418 2024-09-19T13:43:00.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.666+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~6RTXWJU8O5JC.0 size=1048576 2024-09-19T13:43:00.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.667+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~6RTXWJU8O5JC.1 size=1048576 2024-09-19T13:43:00.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.668+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~6RTXWJU8O5JC.2 size=618228 2024-09-19T13:43:00.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.668+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=6RTXWJU8O5JC tag=26FKIRVTHTSR type=write size=3763956 2024-09-19T13:43:00.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.668+0000 7f6ab10d2780 1 < canceled part key=_multipart_QTGKMAOX2A6U.2~8RFRO3KQX8XP.0 size=507552 2024-09-19T13:43:00.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.670+0000 7f6ab10d2780 1 < canceled multipart upload key=QTGKMAOX2A6U upload=8RFRO3KQX8XP tag=X0FON96JC6SM type=write size=1556128 2024-09-19T13:43:00.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.672+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~4WN6JV34Z89Q.0 size=1048576 2024-09-19T13:43:00.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.673+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~4WN6JV34Z89Q.1 size=1048576 2024-09-19T13:43:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.674+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~4WN6JV34Z89Q.2 size=358757 2024-09-19T13:43:00.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.674+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=4WN6JV34Z89Q tag=80V3LDPDWG8M type=write size=3504485 2024-09-19T13:43:00.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.675+0000 7f6ab10d2780 1 < completed write operation key=V8P17ZSOQUSM tag=SBAQ1UOHO00A type=write size=157266 2024-09-19T13:43:00.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.676+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=QAL2P3F7S946 type=del size=4014595 2024-09-19T13:43:00.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.678+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=CPVGDSZ6BP0V type=del 2024-09-19T13:43:00.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.680+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~1IV6S4USAM4A.0 size=1048576 2024-09-19T13:43:00.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.680+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~1IV6S4USAM4A.1 size=1048576 2024-09-19T13:43:00.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.681+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~1IV6S4USAM4A.2 size=884471 2024-09-19T13:43:00.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.681+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=1IV6S4USAM4A tag=9EZAF5WN9KNN type=write size=4030199 2024-09-19T13:43:00.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.683+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=828EJ1LTRY6A type=del 2024-09-19T13:43:00.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.684+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=UQRLB78PAJZP type=del size=48944 2024-09-19T13:43:00.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.685+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=TGTEMA1Y6GLA type=del 2024-09-19T13:43:00.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.686+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=G3OSTJWHL06R type=del size=710878 2024-09-19T13:43:00.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.688+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~GMRRBZL89B0J.0 size=749292 2024-09-19T13:43:00.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.690+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=GMRRBZL89B0J tag=K9I3GPWRPLQ6 type=write size=1797868 2024-09-19T13:43:00.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.691+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=K8O4G5CXFSQI type=del size=755358 2024-09-19T13:43:00.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.692+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~QN0PN5EUO043.0 size=1048576 2024-09-19T13:43:00.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.693+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~QN0PN5EUO043.1 size=436495 2024-09-19T13:43:00.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.695+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=QN0PN5EUO043 tag=J9BIRJGWTSLM type=write size=2533647 2024-09-19T13:43:00.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.696+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=9H7DU8VV8WQL type=del size=1727952 2024-09-19T13:43:00.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.697+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=MLKGQTRLI0BR type=del 2024-09-19T13:43:00.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.699+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~50X5GJ4VH4NS.0 size=1048576 2024-09-19T13:43:00.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.700+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~50X5GJ4VH4NS.1 size=1048576 2024-09-19T13:43:00.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.701+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~50X5GJ4VH4NS.2 size=175261 2024-09-19T13:43:00.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.701+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=50X5GJ4VH4NS tag=718WQ363ZQWI type=write size=3320989 2024-09-19T13:43:00.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.702+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=MALIINPKODCH type=del 2024-09-19T13:43:00.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.703+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=BS3S38140WZP type=del size=129808 2024-09-19T13:43:00.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.705+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=1RB939VPGL1L type=del size=2359021 2024-09-19T13:43:00.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.707+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UCACMFCMLXHL.0 size=1048576 2024-09-19T13:43:00.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.708+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UCACMFCMLXHL.1 size=1048576 2024-09-19T13:43:00.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.709+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~UCACMFCMLXHL.2 size=143596 2024-09-19T13:43:00.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.709+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=UCACMFCMLXHL tag=1SNJDKO6GH6Z type=write size=3289324 2024-09-19T13:43:00.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.710+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=SLK49GJBIRN3 type=del 2024-09-19T13:43:00.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.711+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=P65U1WW7GP6Q type=write size=683329 2024-09-19T13:43:00.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.712+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=8J806YBLDT4G type=del 2024-09-19T13:43:00.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.714+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~1LLBRC89QIUB.0 size=1048576 2024-09-19T13:43:00.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.715+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~1LLBRC89QIUB.1 size=335147 2024-09-19T13:43:00.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.715+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=1LLBRC89QIUB tag=ARW8TX7I4K2C type=write size=2432299 2024-09-19T13:43:00.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.716+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=1NOQ7W5QIF78 type=del 2024-09-19T13:43:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.718+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~O7K7GVWBQQ0N.0 size=1048576 2024-09-19T13:43:00.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.719+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~O7K7GVWBQQ0N.1 size=929692 2024-09-19T13:43:00.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.719+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=O7K7GVWBQQ0N tag=VKQWGN3S3G2T type=write size=3026844 2024-09-19T13:43:00.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.720+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~TL2BG1K3LYZA.0 size=864057 2024-09-19T13:43:00.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.722+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=TL2BG1K3LYZA tag=9QK0PACVUJB0 type=write size=1912633 2024-09-19T13:43:00.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.724+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~THPQ78IKKMQK.0 size=1048576 2024-09-19T13:43:00.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.725+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~THPQ78IKKMQK.1 size=1048576 2024-09-19T13:43:00.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.726+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~THPQ78IKKMQK.2 size=676731 2024-09-19T13:43:00.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.726+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=THPQ78IKKMQK tag=LQUTSKL89Y80 type=write size=3822459 2024-09-19T13:43:00.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.727+0000 7f6ab10d2780 1 < canceled operation key=TCXAYADSCTZI tag=X7Q3DL4DBW3Z type=del size=1261516 2024-09-19T13:43:00.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.729+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~HW050NWM6F0S.0 size=1048576 2024-09-19T13:43:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.730+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~HW050NWM6F0S.1 size=1048576 2024-09-19T13:43:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.730+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~HW050NWM6F0S.2 size=336506 2024-09-19T13:43:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.730+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=HW050NWM6F0S tag=GECWH5E42E9T type=write size=3482234 2024-09-19T13:43:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.732+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~6RTXWJU8O5JC.0 size=1048576 2024-09-19T13:43:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.732+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~6RTXWJU8O5JC.1 size=1048576 2024-09-19T13:43:00.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.732+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~6RTXWJU8O5JC.2 size=618228 2024-09-19T13:43:00.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.734+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=6RTXWJU8O5JC tag=26FKIRVTHTSR type=write size=3763956 2024-09-19T13:43:00.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.735+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=9OC2WT2K0ERE type=write size=545106 2024-09-19T13:43:00.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.736+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~4WN6JV34Z89Q.0 size=1048576 2024-09-19T13:43:00.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.737+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~4WN6JV34Z89Q.1 size=1048576 2024-09-19T13:43:00.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.737+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~4WN6JV34Z89Q.2 size=358757 2024-09-19T13:43:00.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.739+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=4WN6JV34Z89Q tag=80V3LDPDWG8M type=write size=3504485 2024-09-19T13:43:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.741+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ZSYY0FXE9PVW.0 size=1048576 2024-09-19T13:43:00.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.742+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ZSYY0FXE9PVW.1 size=645856 2024-09-19T13:43:00.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.742+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=ZSYY0FXE9PVW tag=UGJNKAL77TKG type=write size=2743008 2024-09-19T13:43:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.743+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=QAL2P3F7S946 type=del size=4014595 2024-09-19T13:43:00.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.745+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=32HSODNIQTPA type=del size=3354436 2024-09-19T13:43:00.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.746+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~1IV6S4USAM4A.0 size=1048576 2024-09-19T13:43:00.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.747+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~1IV6S4USAM4A.1 size=1048576 2024-09-19T13:43:00.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.748+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~1IV6S4USAM4A.2 size=884471 2024-09-19T13:43:00.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.749+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=1IV6S4USAM4A tag=9EZAF5WN9KNN type=write size=4030199 2024-09-19T13:43:00.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.751+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=XCJ2XS3JPB2Q type=del size=3060555 2024-09-19T13:43:00.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.752+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=UQRLB78PAJZP type=del 2024-09-19T13:43:00.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.754+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~OU27LT7FJ933.0 size=1048576 2024-09-19T13:43:00.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.755+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~OU27LT7FJ933.1 size=878220 2024-09-19T13:43:00.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.755+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=OU27LT7FJ933 tag=QAHYW5MKFWPX type=write size=2975372 2024-09-19T13:43:00.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.756+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=G3OSTJWHL06R type=del 2024-09-19T13:43:00.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.757+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=5V1FONUO593D type=del size=2356838 2024-09-19T13:43:00.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.759+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=K8O4G5CXFSQI type=del 2024-09-19T13:43:00.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.761+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~YX2DCDXYHAJ2.0 size=1048576 2024-09-19T13:43:00.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.762+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~YX2DCDXYHAJ2.1 size=212730 2024-09-19T13:43:00.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.762+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=YX2DCDXYHAJ2 tag=4382D0I7XN53 type=write size=2309882 2024-09-19T13:43:00.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.763+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=9H7DU8VV8WQL type=del 2024-09-19T13:43:00.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.764+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=N0PXXJ3GNLM0 type=write size=869238 2024-09-19T13:43:00.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.765+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~50X5GJ4VH4NS.0 size=1048576 2024-09-19T13:43:00.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.766+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~50X5GJ4VH4NS.1 size=1048576 2024-09-19T13:43:00.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.767+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~50X5GJ4VH4NS.2 size=175261 2024-09-19T13:43:00.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.769+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=50X5GJ4VH4NS tag=718WQ363ZQWI type=write size=3320989 2024-09-19T13:43:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.771+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~MV9AB3LZ5NS1.0 size=416676 2024-09-19T13:43:00.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.771+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=MV9AB3LZ5NS1 tag=MQVKC3W1BEOX type=write size=1465252 2024-09-19T13:43:00.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.772+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=BS3S38140WZP type=del 2024-09-19T13:43:00.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.773+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=RRNVVMP00C6W type=del size=155856 2024-09-19T13:43:00.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.774+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UCACMFCMLXHL.0 size=1048576 2024-09-19T13:43:00.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.775+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UCACMFCMLXHL.1 size=1048576 2024-09-19T13:43:00.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.776+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~UCACMFCMLXHL.2 size=143596 2024-09-19T13:43:00.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.778+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=UCACMFCMLXHL tag=1SNJDKO6GH6Z type=write size=3289324 2024-09-19T13:43:00.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.780+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~HZQ7W103U18V.0 size=1048576 2024-09-19T13:43:00.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.781+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~HZQ7W103U18V.1 size=1048576 2024-09-19T13:43:00.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.782+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~HZQ7W103U18V.2 size=135456 2024-09-19T13:43:00.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.782+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=HZQ7W103U18V tag=P7L10NF21XJC type=write size=3281184 2024-09-19T13:43:00.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.783+0000 7f6ab10d2780 1 < completed write operation key=X1JYDG1ASYAR tag=P65U1WW7GP6Q type=write size=683329 2024-09-19T13:43:00.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.785+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~HGSD12YHJM1G.0 size=1048576 2024-09-19T13:43:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.786+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~HGSD12YHJM1G.1 size=1048576 2024-09-19T13:43:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.787+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~HGSD12YHJM1G.2 size=961588 2024-09-19T13:43:00.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.787+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=HGSD12YHJM1G tag=M9RG7QUF21JE type=write size=4107316 2024-09-19T13:43:00.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.788+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~1LLBRC89QIUB.0 size=1048576 2024-09-19T13:43:00.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.789+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~1LLBRC89QIUB.1 size=335147 2024-09-19T13:43:00.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.791+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=1LLBRC89QIUB tag=ARW8TX7I4K2C type=write size=2432299 2024-09-19T13:43:00.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.792+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=816IJF4XYEVH type=del size=3745817 2024-09-19T13:43:00.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.793+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~O7K7GVWBQQ0N.0 size=1048576 2024-09-19T13:43:00.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.794+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~O7K7GVWBQQ0N.1 size=929692 2024-09-19T13:43:00.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.796+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=O7K7GVWBQQ0N tag=VKQWGN3S3G2T type=write size=3026844 2024-09-19T13:43:00.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.798+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~3DQQS989FBWK.0 size=1048576 2024-09-19T13:43:00.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.799+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~3DQQS989FBWK.1 size=749392 2024-09-19T13:43:00.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.799+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=3DQQS989FBWK tag=39XUFMNULJB4 type=write size=2846544 2024-09-19T13:43:00.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.800+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~THPQ78IKKMQK.0 size=1048576 2024-09-19T13:43:00.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.801+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~THPQ78IKKMQK.1 size=1048576 2024-09-19T13:43:00.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.801+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~THPQ78IKKMQK.2 size=676731 2024-09-19T13:43:00.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.803+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=THPQ78IKKMQK tag=LQUTSKL89Y80 type=write size=3822459 2024-09-19T13:43:00.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.804+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=O8O93HT5S975 type=del size=1902626 2024-09-19T13:43:00.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.805+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~HW050NWM6F0S.0 size=1048576 2024-09-19T13:43:00.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.806+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~HW050NWM6F0S.1 size=1048576 2024-09-19T13:43:00.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.807+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~HW050NWM6F0S.2 size=336506 2024-09-19T13:43:00.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.809+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=HW050NWM6F0S tag=GECWH5E42E9T type=write size=3482234 2024-09-19T13:43:00.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.810+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=FK1EJK3GKNPT type=write size=808229 2024-09-19T13:43:00.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.811+0000 7f6ab10d2780 1 < completed write operation key=X8CWBFNCJG6M tag=9OC2WT2K0ERE type=write size=545106 2024-09-19T13:43:00.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.812+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=EBN2V6RREAGT type=del size=244755 2024-09-19T13:43:00.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.814+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~ZSYY0FXE9PVW.0 size=1048576 2024-09-19T13:43:00.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.815+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~ZSYY0FXE9PVW.1 size=645856 2024-09-19T13:43:00.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.816+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=ZSYY0FXE9PVW tag=UGJNKAL77TKG type=write size=2743008 2024-09-19T13:43:00.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.818+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=0OGN11LH2ILF type=del size=1492166 2024-09-19T13:43:00.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.819+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=32HSODNIQTPA type=del 2024-09-19T13:43:00.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.820+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=3UC9FFPDXZG2 type=write size=757488 2024-09-19T13:43:00.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.821+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=XCJ2XS3JPB2Q type=del 2024-09-19T13:43:00.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.823+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~JC6108168ZEU.0 size=1048576 2024-09-19T13:43:00.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.824+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~JC6108168ZEU.1 size=1048576 2024-09-19T13:43:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.825+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~JC6108168ZEU.2 size=611491 2024-09-19T13:43:00.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.825+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=JC6108168ZEU tag=UM28QK3SQ80A type=write size=3757219 2024-09-19T13:43:00.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.826+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~OU27LT7FJ933.0 size=1048576 2024-09-19T13:43:00.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.827+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~OU27LT7FJ933.1 size=878220 2024-09-19T13:43:00.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.829+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=OU27LT7FJ933 tag=QAHYW5MKFWPX type=write size=2975372 2024-09-19T13:43:00.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.830+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=HQAMK7Z1Z3M7 type=del size=385454 2024-09-19T13:43:00.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.831+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=5V1FONUO593D type=del 2024-09-19T13:43:00.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.832+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=D7BXSM2XJ7LN type=del size=3888397 2024-09-19T13:43:00.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.833+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~YX2DCDXYHAJ2.0 size=1048576 2024-09-19T13:43:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.833+0000 7f6ab10d2780 1 < canceled part key=_multipart_13GXIDWI4J9F.2~YX2DCDXYHAJ2.1 size=212730 2024-09-19T13:43:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.835+0000 7f6ab10d2780 1 < canceled multipart upload key=13GXIDWI4J9F upload=YX2DCDXYHAJ2 tag=4382D0I7XN53 type=write size=2309882 2024-09-19T13:43:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~VILP21Q780KQ.0 size=910277 2024-09-19T13:43:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.837+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=VILP21Q780KQ tag=3RN26T3PLD26 type=write size=1958853 2024-09-19T13:43:00.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.838+0000 7f6ab10d2780 1 < completed write operation key=V8P17ZSOQUSM tag=N0PXXJ3GNLM0 type=write size=869238 2024-09-19T13:43:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.839+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=PRJQAXQ83KQZ type=del size=792409 2024-09-19T13:43:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.840+0000 7f6ab10d2780 1 < canceled part key=_multipart_QTGKMAOX2A6U.2~MV9AB3LZ5NS1.0 size=416676 2024-09-19T13:43:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.841+0000 7f6ab10d2780 1 < canceled multipart upload key=QTGKMAOX2A6U upload=MV9AB3LZ5NS1 tag=MQVKC3W1BEOX type=write size=1465252 2024-09-19T13:43:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.843+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=NBDC3CL0TWBR type=del size=2938786 2024-09-19T13:43:00.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.844+0000 7f6ab10d2780 1 < canceled operation key=A14YTABJ1Z3Z tag=RRNVVMP00C6W type=del size=155856 2024-09-19T13:43:00.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.845+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=ESQQI73GROJT type=del size=2929912 2024-09-19T13:43:00.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.846+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~HZQ7W103U18V.0 size=1048576 2024-09-19T13:43:00.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.847+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~HZQ7W103U18V.1 size=1048576 2024-09-19T13:43:00.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.848+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~HZQ7W103U18V.2 size=135456 2024-09-19T13:43:00.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.849+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=HZQ7W103U18V tag=P7L10NF21XJC type=write size=3281184 2024-09-19T13:43:00.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.851+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=0HROQACKHSK3 type=write size=406481 2024-09-19T13:43:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.852+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~HGSD12YHJM1G.0 size=1048576 2024-09-19T13:43:00.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.853+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~HGSD12YHJM1G.1 size=1048576 2024-09-19T13:43:00.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.853+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~HGSD12YHJM1G.2 size=961588 2024-09-19T13:43:00.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.855+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=HGSD12YHJM1G tag=M9RG7QUF21JE type=write size=4107316 2024-09-19T13:43:00.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.856+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=2YS7TN7ANXKO type=del size=1184710 2024-09-19T13:43:00.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.858+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=816IJF4XYEVH type=del 2024-09-19T13:43:00.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.859+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=6SDBC3K85XWW type=del size=3886245 2024-09-19T13:43:00.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.860+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~3DQQS989FBWK.0 size=1048576 2024-09-19T13:43:00.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.861+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~3DQQS989FBWK.1 size=749392 2024-09-19T13:43:00.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.863+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=3DQQS989FBWK tag=39XUFMNULJB4 type=write size=2846544 2024-09-19T13:43:00.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.864+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=Y2FI1LEDP5OL type=del size=2755225 2024-09-19T13:43:00.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.865+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=O8O93HT5S975 type=del 2024-09-19T13:43:00.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.866+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=611ZXXX1YN74 type=del size=1456196 2024-09-19T13:43:00.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.867+0000 7f6ab10d2780 1 < completed write operation key=XQLWZA2X91GF tag=FK1EJK3GKNPT type=write size=808229 2024-09-19T13:43:00.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.868+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=F5W5DUYV1YZX type=del size=2316186 2024-09-19T13:43:00.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.870+0000 7f6ab10d2780 1 < canceled operation key=SRABG45EPVN2 tag=EBN2V6RREAGT type=del size=244755 2024-09-19T13:43:00.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.871+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=FDXVFHHQ7SU9 type=write size=301235 2024-09-19T13:43:00.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.872+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=0OGN11LH2ILF type=del 2024-09-19T13:43:00.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.873+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=C7YSS9S8TKHG type=write size=780542 2024-09-19T13:43:00.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.874+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=3UC9FFPDXZG2 type=write size=757488 2024-09-19T13:43:00.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.876+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~YK2I01QCS4LI.0 size=1048576 2024-09-19T13:43:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.877+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~YK2I01QCS4LI.1 size=584802 2024-09-19T13:43:00.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.877+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=YK2I01QCS4LI tag=ONLOVZMEA7Z4 type=write size=2681954 2024-09-19T13:43:00.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.878+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~JC6108168ZEU.0 size=1048576 2024-09-19T13:43:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.879+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~JC6108168ZEU.1 size=1048576 2024-09-19T13:43:00.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.880+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~JC6108168ZEU.2 size=611491 2024-09-19T13:43:00.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.881+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=JC6108168ZEU tag=UM28QK3SQ80A type=write size=3757219 2024-09-19T13:43:00.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.883+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~2WFK8X1C7IWE.0 size=1048576 2024-09-19T13:43:00.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.884+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~2WFK8X1C7IWE.1 size=700682 2024-09-19T13:43:00.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.884+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=2WFK8X1C7IWE tag=SFR4EAUP159P type=write size=2797834 2024-09-19T13:43:00.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.885+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=HQAMK7Z1Z3M7 type=del 2024-09-19T13:43:00.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.887+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~K36SELIP8DZW.0 size=1048576 2024-09-19T13:43:00.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.888+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~K36SELIP8DZW.1 size=1048576 2024-09-19T13:43:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.889+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~K36SELIP8DZW.2 size=929571 2024-09-19T13:43:00.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.889+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=K36SELIP8DZW tag=JA9IB7V51TEX type=write size=4075299 2024-09-19T13:43:00.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.892+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=D7BXSM2XJ7LN type=del 2024-09-19T13:43:00.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.894+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~R8OWK8KTLDAU.0 size=1048576 2024-09-19T13:43:00.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.895+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~R8OWK8KTLDAU.1 size=922747 2024-09-19T13:43:00.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.895+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=R8OWK8KTLDAU tag=NRE4EW2380M5 type=write size=3019899 2024-09-19T13:43:00.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.896+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~VILP21Q780KQ.0 size=910277 2024-09-19T13:43:00.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.898+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=VILP21Q780KQ tag=3RN26T3PLD26 type=write size=1958853 2024-09-19T13:43:00.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.900+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~VECDLNDV8ZMP.0 size=1048576 2024-09-19T13:43:00.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.901+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~VECDLNDV8ZMP.1 size=1048576 2024-09-19T13:43:00.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.902+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~VECDLNDV8ZMP.2 size=232210 2024-09-19T13:43:00.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.902+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=VECDLNDV8ZMP tag=B37JHLDJMQFR type=write size=3377938 2024-09-19T13:43:00.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.904+0000 7f6ab10d2780 1 < suggested remove operation key=9IN6E0JQFNAU tag=PRJQAXQ83KQZ type=del 2024-09-19T13:43:00.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.906+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~9GFQQ4EVGCZV.0 size=1048576 2024-09-19T13:43:00.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.907+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~9GFQQ4EVGCZV.1 size=1048576 2024-09-19T13:43:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.908+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~9GFQQ4EVGCZV.2 size=453826 2024-09-19T13:43:00.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.908+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=9GFQQ4EVGCZV tag=W3Z55KBVQB9C type=write size=3599554 2024-09-19T13:43:00.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.909+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=NBDC3CL0TWBR type=del 2024-09-19T13:43:00.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.910+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=X1BGJCOSNFAP type=del size=2580742 2024-09-19T13:43:00.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.911+0000 7f6ab10d2780 1 < canceled operation key=A14YTABJ1Z3Z tag=ESQQI73GROJT type=del size=2929912 2024-09-19T13:43:00.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.913+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~R2SE4SX28R3Y.0 size=1048576 2024-09-19T13:43:00.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.914+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~R2SE4SX28R3Y.1 size=1048576 2024-09-19T13:43:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.915+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~R2SE4SX28R3Y.2 size=1003419 2024-09-19T13:43:00.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.915+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=R2SE4SX28R3Y tag=SMOZZFP7VADP type=write size=4149147 2024-09-19T13:43:00.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.916+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=0HROQACKHSK3 type=write size=406481 2024-09-19T13:43:00.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.918+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=XUUSXFMNLUZR type=del size=2436278 2024-09-19T13:43:00.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.919+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=2YS7TN7ANXKO type=del 2024-09-19T13:43:00.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.920+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=6LWT5B2DO4GU type=write size=771915 2024-09-19T13:43:00.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.921+0000 7f6ab10d2780 1 < canceled operation key=SERUGCO68R9W tag=6SDBC3K85XWW type=del size=3886245 2024-09-19T13:43:00.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.923+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=FMLREA55FJA1 type=del size=997712 2024-09-19T13:43:00.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.925+0000 7f6ab10d2780 1 < suggested update operation key=SRABG45EPVN2 tag=Y2FI1LEDP5OL type=del size=2755225 2024-09-19T13:43:00.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.926+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=Z9ZTENEHKOEM type=write size=539107 2024-09-19T13:43:00.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.927+0000 7f6ab10d2780 -1 < failed to complete operation key=SRABG45EPVN2 tag=611ZXXX1YN74 type=del size=1456196: (22) Invalid argument 2024-09-19T13:43:00.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.928+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=0FJ46QN2KJ26 type=write size=890252 2024-09-19T13:43:00.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.929+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=F5W5DUYV1YZX type=del 2024-09-19T13:43:00.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.931+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~CZ3XDB4AMILQ.0 size=257540 2024-09-19T13:43:00.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.931+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=CZ3XDB4AMILQ tag=5D2RR3JTDNOF type=write size=1306116 2024-09-19T13:43:00.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.932+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=FDXVFHHQ7SU9 type=write size=301235 2024-09-19T13:43:00.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.933+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=DEFI4KDQ6O1C type=del size=3339901 2024-09-19T13:43:00.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.935+0000 7f6ab10d2780 1 < suggested update operation key=UPMXNNYUUJR7 tag=C7YSS9S8TKHG type=write size=780542 2024-09-19T13:43:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.937+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=ZSE0M21VLRA9 type=write size=926460 2024-09-19T13:43:00.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.938+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~YK2I01QCS4LI.0 size=1048576 2024-09-19T13:43:00.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.939+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~YK2I01QCS4LI.1 size=584802 2024-09-19T13:43:00.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.940+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=YK2I01QCS4LI tag=ONLOVZMEA7Z4 type=write size=2681954 2024-09-19T13:43:00.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.942+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=EPXN482O3P4J type=del size=2685701 2024-09-19T13:43:00.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.943+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~2WFK8X1C7IWE.0 size=1048576 2024-09-19T13:43:00.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.943+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~2WFK8X1C7IWE.1 size=700682 2024-09-19T13:43:00.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.945+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=2WFK8X1C7IWE tag=SFR4EAUP159P type=write size=2797834 2024-09-19T13:43:00.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.947+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~SKAVARFY15GR.0 size=1048576 2024-09-19T13:43:00.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.948+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~SKAVARFY15GR.1 size=1048576 2024-09-19T13:43:00.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.949+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~SKAVARFY15GR.2 size=282422 2024-09-19T13:43:00.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.949+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=SKAVARFY15GR tag=Z7TF2QJWOLU3 type=write size=3428150 2024-09-19T13:43:00.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.950+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~K36SELIP8DZW.0 size=1048576 2024-09-19T13:43:00.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.951+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~K36SELIP8DZW.1 size=1048576 2024-09-19T13:43:00.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.951+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~K36SELIP8DZW.2 size=929571 2024-09-19T13:43:00.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.953+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=K36SELIP8DZW tag=JA9IB7V51TEX type=write size=4075299 2024-09-19T13:43:00.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.955+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~Z9D2JNSF4W4V.0 size=1048576 2024-09-19T13:43:00.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.956+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~Z9D2JNSF4W4V.1 size=342092 2024-09-19T13:43:00.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.956+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=Z9D2JNSF4W4V tag=V8G0VBKRQ99I type=write size=2439244 2024-09-19T13:43:00.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.957+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~R8OWK8KTLDAU.0 size=1048576 2024-09-19T13:43:00.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.958+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~R8OWK8KTLDAU.1 size=922747 2024-09-19T13:43:00.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.960+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=R8OWK8KTLDAU tag=NRE4EW2380M5 type=write size=3019899 2024-09-19T13:43:00.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.961+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=AFSHJU3J3WO8 type=del size=1791782 2024-09-19T13:43:00.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.963+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~VECDLNDV8ZMP.0 size=1048576 2024-09-19T13:43:00.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.964+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~VECDLNDV8ZMP.1 size=1048576 2024-09-19T13:43:00.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.965+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~VECDLNDV8ZMP.2 size=232210 2024-09-19T13:43:00.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.967+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=VECDLNDV8ZMP tag=B37JHLDJMQFR type=write size=3377938 2024-09-19T13:43:00.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.968+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=15LRIVEA0U4E type=write size=367762 2024-09-19T13:43:00.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.969+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~9GFQQ4EVGCZV.0 size=1048576 2024-09-19T13:43:00.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.970+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~9GFQQ4EVGCZV.1 size=1048576 2024-09-19T13:43:00.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.971+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~9GFQQ4EVGCZV.2 size=453826 2024-09-19T13:43:00.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.974+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=9GFQQ4EVGCZV tag=W3Z55KBVQB9C type=write size=3599554 2024-09-19T13:43:00.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.976+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~AU97D2H016OE.0 size=637557 2024-09-19T13:43:00.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.976+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=AU97D2H016OE tag=YEV35C2TIXLT type=write size=1686133 2024-09-19T13:43:00.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.977+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=X1BGJCOSNFAP type=del 2024-09-19T13:43:00.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.979+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=5H4MQ7OD9EZG type=del size=1196439 2024-09-19T13:43:00.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.980+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~R2SE4SX28R3Y.0 size=1048576 2024-09-19T13:43:00.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.981+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~R2SE4SX28R3Y.1 size=1048576 2024-09-19T13:43:00.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.981+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~R2SE4SX28R3Y.2 size=1003419 2024-09-19T13:43:00.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.983+0000 7f6ab10d2780 1 < canceled multipart upload key=X8CWBFNCJG6M upload=R2SE4SX28R3Y tag=SMOZZFP7VADP type=write size=4149147 2024-09-19T13:43:00.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.985+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~H9THXKKP1OXO.0 size=1048576 2024-09-19T13:43:00.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.986+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~H9THXKKP1OXO.1 size=1048576 2024-09-19T13:43:00.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.987+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~H9THXKKP1OXO.2 size=982268 2024-09-19T13:43:00.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.987+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=H9THXKKP1OXO tag=7BWEWZM1UKJW type=write size=4127996 2024-09-19T13:43:00.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.988+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=XUUSXFMNLUZR type=del 2024-09-19T13:43:00.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.990+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~90WZPVMWGT3X.0 size=1048576 2024-09-19T13:43:00.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.991+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~90WZPVMWGT3X.1 size=928921 2024-09-19T13:43:00.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.991+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=90WZPVMWGT3X tag=RFGGL0SA0QKQ type=write size=3026073 2024-09-19T13:43:00.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.993+0000 7f6ab10d2780 1 < canceled operation key=WDRUV5ERI000 tag=6LWT5B2DO4GU type=write size=771915 2024-09-19T13:43:00.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.994+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=XBR0448HKXEH type=del size=1699692 2024-09-19T13:43:00.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.995+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=FMLREA55FJA1 type=del 2024-09-19T13:43:00.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.996+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=53LOVEHD7IUE type=del size=4084115 2024-09-19T13:43:01.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:00.999+0000 7f6ab10d2780 1 < completed write operation key=UX2ICIT36Q3R tag=Z9ZTENEHKOEM type=write size=539107 2024-09-19T13:43:01.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.000+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=XV3H2393C0E8 type=write size=597911 2024-09-19T13:43:01.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.002+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=0FJ46QN2KJ26 type=write 2024-09-19T13:43:01.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.003+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=5KRKR23ZO756 type=del size=580716 2024-09-19T13:43:01.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.004+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~CZ3XDB4AMILQ.0 size=257540 2024-09-19T13:43:01.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.006+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=CZ3XDB4AMILQ tag=5D2RR3JTDNOF type=write size=1306116 2024-09-19T13:43:01.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.007+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=1YRU32XLFYYL type=del size=1778666 2024-09-19T13:43:01.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.009+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=DEFI4KDQ6O1C type=del 2024-09-19T13:43:01.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.010+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=HIY2HTUS4T0L type=del size=81500 2024-09-19T13:43:01.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.011+0000 7f6ab10d2780 1 < completed write operation key=P2U09V0G7UUU tag=ZSE0M21VLRA9 type=write size=926460 2024-09-19T13:43:01.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.012+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=OT2UTH9UT37V type=del size=931062 2024-09-19T13:43:01.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.013+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=EPXN482O3P4J type=del 2024-09-19T13:43:01.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.016+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~W5Y18HDOTUR2.0 size=1048576 2024-09-19T13:43:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.016+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~W5Y18HDOTUR2.1 size=888359 2024-09-19T13:43:01.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.016+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=W5Y18HDOTUR2 tag=H4R70JY3A1B7 type=write size=2985511 2024-09-19T13:43:01.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.018+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~SKAVARFY15GR.0 size=1048576 2024-09-19T13:43:01.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.018+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~SKAVARFY15GR.1 size=1048576 2024-09-19T13:43:01.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.019+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~SKAVARFY15GR.2 size=282422 2024-09-19T13:43:01.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.022+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=SKAVARFY15GR tag=Z7TF2QJWOLU3 type=write size=3428150 2024-09-19T13:43:01.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.023+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=I5FLLAV93PTK type=del size=91091 2024-09-19T13:43:01.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.024+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~Z9D2JNSF4W4V.0 size=1048576 2024-09-19T13:43:01.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.025+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~Z9D2JNSF4W4V.1 size=342092 2024-09-19T13:43:01.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.027+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=Z9D2JNSF4W4V tag=V8G0VBKRQ99I type=write size=2439244 2024-09-19T13:43:01.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.028+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=7JV57E04YW02 type=del size=2173989 2024-09-19T13:43:01.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.029+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=AFSHJU3J3WO8 type=del 2024-09-19T13:43:01.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.030+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=8T2AEUMBE4WG type=del size=3457727 2024-09-19T13:43:01.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.031+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=15LRIVEA0U4E type=write size=367762 2024-09-19T13:43:01.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.033+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=C1TBVHR0FVX4 type=write size=977177 2024-09-19T13:43:01.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.034+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~AU97D2H016OE.0 size=637557 2024-09-19T13:43:01.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.036+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=AU97D2H016OE tag=YEV35C2TIXLT type=write size=1686133 2024-09-19T13:43:01.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.037+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=BIM1W0R9IOUN type=del size=726304 2024-09-19T13:43:01.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.039+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=5H4MQ7OD9EZG type=del 2024-09-19T13:43:01.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.040+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=W2UXMCKMMF0M type=del size=1440180 2024-09-19T13:43:01.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.041+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~H9THXKKP1OXO.0 size=1048576 2024-09-19T13:43:01.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.042+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~H9THXKKP1OXO.1 size=1048576 2024-09-19T13:43:01.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.043+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~H9THXKKP1OXO.2 size=982268 2024-09-19T13:43:01.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.045+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=H9THXKKP1OXO tag=7BWEWZM1UKJW type=write size=4127996 2024-09-19T13:43:01.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.046+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=ULTTFTA9KDSW type=del size=1450325 2024-09-19T13:43:01.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.048+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~90WZPVMWGT3X.0 size=1048576 2024-09-19T13:43:01.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.049+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~90WZPVMWGT3X.1 size=928921 2024-09-19T13:43:01.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.051+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=90WZPVMWGT3X tag=RFGGL0SA0QKQ type=write size=3026073 2024-09-19T13:43:01.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.053+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~JMU01PF2X20Y.0 size=1030763 2024-09-19T13:43:01.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.053+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=JMU01PF2X20Y tag=AGOA5G7ONSFJ type=write size=2079339 2024-09-19T13:43:01.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.054+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=XBR0448HKXEH type=del 2024-09-19T13:43:01.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.056+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~H4XJVFUEY75D.0 size=1048576 2024-09-19T13:43:01.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.057+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~H4XJVFUEY75D.1 size=904426 2024-09-19T13:43:01.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.057+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=H4XJVFUEY75D tag=BR804OAS6V9X type=write size=3001578 2024-09-19T13:43:01.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.060+0000 7f6ab10d2780 1 < suggested update operation key=SRABG45EPVN2 tag=53LOVEHD7IUE type=del size=4084115 2024-09-19T13:43:01.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.061+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=WG9VX0CYA2IP type=del size=1410988 2024-09-19T13:43:01.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.062+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=XV3H2393C0E8 type=write size=597911 2024-09-19T13:43:01.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.064+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=UE2SCSDME797 type=del size=609196 2024-09-19T13:43:01.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.065+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=5KRKR23ZO756 type=del 2024-09-19T13:43:01.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.066+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=Y05PBN4AAWJ6 type=del size=2040735 2024-09-19T13:43:01.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.067+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=1YRU32XLFYYL type=del 2024-09-19T13:43:01.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.069+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=0994C9S3LW6D type=del size=3539198 2024-09-19T13:43:01.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.071+0000 7f6ab10d2780 1 < suggested remove operation key=9IN6E0JQFNAU tag=HIY2HTUS4T0L type=del 2024-09-19T13:43:01.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.073+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~PHTNZL1B2H1A.0 size=295981 2024-09-19T13:43:01.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.073+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=PHTNZL1B2H1A tag=KJ03XC4R3FBQ type=write size=1344557 2024-09-19T13:43:01.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.075+0000 7f6ab10d2780 1 < suggested remove operation key=DF003ORZ1HOM tag=OT2UTH9UT37V type=del 2024-09-19T13:43:01.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.077+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=IZ76X227JA3D type=del size=1891798 2024-09-19T13:43:01.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.078+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~W5Y18HDOTUR2.0 size=1048576 2024-09-19T13:43:01.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.079+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~W5Y18HDOTUR2.1 size=888359 2024-09-19T13:43:01.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.081+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=W5Y18HDOTUR2 tag=H4R70JY3A1B7 type=write size=2985511 2024-09-19T13:43:01.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.082+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=UEHGD03DOJUN type=write size=59158 2024-09-19T13:43:01.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.083+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=I5FLLAV93PTK type=del 2024-09-19T13:43:01.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.085+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=RLQV91DE347S type=del size=337379 2024-09-19T13:43:01.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.087+0000 7f6ab10d2780 1 < suggested remove operation key=UPMXNNYUUJR7 tag=7JV57E04YW02 type=del 2024-09-19T13:43:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.089+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~47RMADF8SHCO.0 size=280680 2024-09-19T13:43:01.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.089+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=47RMADF8SHCO tag=79XGD2ZJ26DH type=write size=1329256 2024-09-19T13:43:01.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.090+0000 7f6ab10d2780 -1 < failed to complete operation key=UPMXNNYUUJR7 tag=8T2AEUMBE4WG type=del size=3457727: (22) Invalid argument 2024-09-19T13:43:01.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.091+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=XXGGGT1RDIGG type=del size=1085345 2024-09-19T13:43:01.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.092+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=C1TBVHR0FVX4 type=write size=977177 2024-09-19T13:43:01.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.093+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=LS6MUYP6QXXN type=del size=226204 2024-09-19T13:43:01.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.094+0000 7f6ab10d2780 -1 < failed to complete operation key=9IN6E0JQFNAU tag=BIM1W0R9IOUN type=del size=726304: (22) Invalid argument 2024-09-19T13:43:01.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.097+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~EDIM17XIZLZI.0 size=1048576 2024-09-19T13:43:01.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.097+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~EDIM17XIZLZI.1 size=225795 2024-09-19T13:43:01.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.097+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=EDIM17XIZLZI tag=ANBHXNS808FS type=write size=2322947 2024-09-19T13:43:01.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.099+0000 7f6ab10d2780 1 < canceled operation key=A14YTABJ1Z3Z tag=W2UXMCKMMF0M type=del size=1440180 2024-09-19T13:43:01.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.100+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=23VD9D1RZ2BD type=del size=3690847 2024-09-19T13:43:01.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.101+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=ULTTFTA9KDSW type=del 2024-09-19T13:43:01.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.102+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=PWQURJVS6XH6 type=del size=2431789 2024-09-19T13:43:01.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.103+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~JMU01PF2X20Y.0 size=1030763 2024-09-19T13:43:01.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.105+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=JMU01PF2X20Y tag=AGOA5G7ONSFJ type=write size=2079339 2024-09-19T13:43:01.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.106+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=1WPZO6FQB00Y type=write size=693701 2024-09-19T13:43:01.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.107+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~H4XJVFUEY75D.0 size=1048576 2024-09-19T13:43:01.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.108+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~H4XJVFUEY75D.1 size=904426 2024-09-19T13:43:01.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.111+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=H4XJVFUEY75D tag=BR804OAS6V9X type=write size=3001578 2024-09-19T13:43:01.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.113+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~P5Q9JQI23TCI.0 size=1048576 2024-09-19T13:43:01.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.113+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~P5Q9JQI23TCI.1 size=1048576 2024-09-19T13:43:01.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.114+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~P5Q9JQI23TCI.2 size=439997 2024-09-19T13:43:01.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.114+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=P5Q9JQI23TCI tag=DB7PQZYF2DAY type=write size=3585725 2024-09-19T13:43:01.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.116+0000 7f6ab10d2780 1 < suggested remove operation key=UPMXNNYUUJR7 tag=WG9VX0CYA2IP type=del 2024-09-19T13:43:01.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.118+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~B1DYRTLM2KAZ.0 size=995256 2024-09-19T13:43:01.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.118+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=B1DYRTLM2KAZ tag=EDK8H0B9NEXH type=write size=2043832 2024-09-19T13:43:01.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.119+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=UE2SCSDME797 type=del 2024-09-19T13:43:01.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.120+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=IQXB8M30FV67 type=del size=246056 2024-09-19T13:43:01.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.122+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=Y05PBN4AAWJ6 type=del size=2040735 2024-09-19T13:43:01.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.123+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=6A4EEA5D2KUI type=del size=2041236 2024-09-19T13:43:01.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.124+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=0994C9S3LW6D type=del 2024-09-19T13:43:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.126+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~L0IVUA74TB51.0 size=1048576 2024-09-19T13:43:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.127+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~L0IVUA74TB51.1 size=922116 2024-09-19T13:43:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.127+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=L0IVUA74TB51 tag=7BOCEDNQNBVL type=write size=3019268 2024-09-19T13:43:01.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.128+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~PHTNZL1B2H1A.0 size=295981 2024-09-19T13:43:01.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.129+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=PHTNZL1B2H1A tag=KJ03XC4R3FBQ type=write size=1344557 2024-09-19T13:43:01.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.130+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=F0G54QC8DDBE type=del size=852282 2024-09-19T13:43:01.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.132+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=IZ76X227JA3D type=del 2024-09-19T13:43:01.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.133+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~5W5PGVG62EGI.0 size=901742 2024-09-19T13:43:01.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.133+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=5W5PGVG62EGI tag=JT5D6FWX4067 type=write size=1950318 2024-09-19T13:43:01.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.135+0000 7f6ab10d2780 1 < completed write operation key=CD4XXORKVS6J tag=UEHGD03DOJUN type=write size=59158 2024-09-19T13:43:01.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.136+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=W3PYV7OH4T9U type=del size=2935579 2024-09-19T13:43:01.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.138+0000 7f6ab10d2780 1 < suggested update operation key=PUXLW9NBBQJX tag=RLQV91DE347S type=del size=337379 2024-09-19T13:43:01.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.140+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~0OVQ5DPR7A15.0 size=168849 2024-09-19T13:43:01.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.140+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=0OVQ5DPR7A15 tag=2TTEVBMOK8VE type=write size=1217425 2024-09-19T13:43:01.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.141+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~47RMADF8SHCO.0 size=280680 2024-09-19T13:43:01.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.142+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=47RMADF8SHCO tag=79XGD2ZJ26DH type=write size=1329256 2024-09-19T13:43:01.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.144+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=JDU8QJB4203D type=del size=3513185 2024-09-19T13:43:01.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.146+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=XXGGGT1RDIGG type=del size=1085345 2024-09-19T13:43:01.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.147+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=5VVE7F2M8LHS type=del size=1665024 2024-09-19T13:43:01.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.148+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=LS6MUYP6QXXN type=del 2024-09-19T13:43:01.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.149+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=2B02VMXFPXXT type=del size=3083278 2024-09-19T13:43:01.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.150+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~EDIM17XIZLZI.0 size=1048576 2024-09-19T13:43:01.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.151+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~EDIM17XIZLZI.1 size=225795 2024-09-19T13:43:01.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.153+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=EDIM17XIZLZI tag=ANBHXNS808FS type=write size=2322947 2024-09-19T13:43:01.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.154+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=GD1P0THNGMAQ type=write size=43115 2024-09-19T13:43:01.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.155+0000 7f6ab10d2780 -1 < failed to complete operation key=UPMXNNYUUJR7 tag=23VD9D1RZ2BD type=del size=3690847: (22) Invalid argument 2024-09-19T13:43:01.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.156+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=4A54HFN92457 type=del size=2142400 2024-09-19T13:43:01.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.157+0000 7f6ab10d2780 1 < canceled operation key=RXXCDV0LTCKS tag=PWQURJVS6XH6 type=del size=2431789 2024-09-19T13:43:01.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.159+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~1RXMFPB2LPN4.0 size=668042 2024-09-19T13:43:01.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.159+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=1RXMFPB2LPN4 tag=B1VW1XOQUQUR type=write size=1716618 2024-09-19T13:43:01.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.161+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=1WPZO6FQB00Y type=write 2024-09-19T13:43:01.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.163+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~CRYL4DZA62YN.0 size=1048576 2024-09-19T13:43:01.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.164+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~CRYL4DZA62YN.1 size=249279 2024-09-19T13:43:01.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.164+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=CRYL4DZA62YN tag=K55M1Z7V9C19 type=write size=2346431 2024-09-19T13:43:01.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.164+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~P5Q9JQI23TCI.0 size=1048576 2024-09-19T13:43:01.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.165+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~P5Q9JQI23TCI.1 size=1048576 2024-09-19T13:43:01.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.166+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~P5Q9JQI23TCI.2 size=439997 2024-09-19T13:43:01.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.168+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=P5Q9JQI23TCI tag=DB7PQZYF2DAY type=write size=3585725 2024-09-19T13:43:01.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.169+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=613M3IIVWQL3 type=del size=2868859 2024-09-19T13:43:01.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.170+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~B1DYRTLM2KAZ.0 size=995256 2024-09-19T13:43:01.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.172+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=B1DYRTLM2KAZ tag=EDK8H0B9NEXH type=write size=2043832 2024-09-19T13:43:01.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.173+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=VULOT0DLRCF1 type=del size=2244543 2024-09-19T13:43:01.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.174+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=IQXB8M30FV67 type=del 2024-09-19T13:43:01.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.175+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=ZV5V1UGPUJPW type=write size=787031 2024-09-19T13:43:01.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.176+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=6A4EEA5D2KUI type=del 2024-09-19T13:43:01.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.177+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=VV6LE5ITB95S type=del size=632776 2024-09-19T13:43:01.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.178+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~L0IVUA74TB51.0 size=1048576 2024-09-19T13:43:01.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.179+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~L0IVUA74TB51.1 size=922116 2024-09-19T13:43:01.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.181+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=L0IVUA74TB51 tag=7BOCEDNQNBVL type=write size=3019268 2024-09-19T13:43:01.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.183+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~93EUCIMGN42S.0 size=1048576 2024-09-19T13:43:01.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.183+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~93EUCIMGN42S.1 size=272519 2024-09-19T13:43:01.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.183+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=93EUCIMGN42S tag=AASDFADUDICB type=write size=2369671 2024-09-19T13:43:01.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.185+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=F0G54QC8DDBE type=del 2024-09-19T13:43:01.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.186+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~FWRVL7UEHGVR.0 size=1048576 2024-09-19T13:43:01.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.187+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~FWRVL7UEHGVR.1 size=1048576 2024-09-19T13:43:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.188+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~FWRVL7UEHGVR.2 size=580649 2024-09-19T13:43:01.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.188+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=FWRVL7UEHGVR tag=1AG4Z69QZ1M5 type=write size=3726377 2024-09-19T13:43:01.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.189+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~5W5PGVG62EGI.0 size=901742 2024-09-19T13:43:01.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.191+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=5W5PGVG62EGI tag=JT5D6FWX4067 type=write size=1950318 2024-09-19T13:43:01.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.192+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=Z0M8KW77OD15 type=write size=997945 2024-09-19T13:43:01.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.193+0000 7f6ab10d2780 1 < canceled operation key=EE8F84K0ZAGJ tag=W3PYV7OH4T9U type=del size=2935579 2024-09-19T13:43:01.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.195+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~SWZJDZ8ECIYR.0 size=1048576 2024-09-19T13:43:01.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.196+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~SWZJDZ8ECIYR.1 size=1048576 2024-09-19T13:43:01.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.197+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~SWZJDZ8ECIYR.2 size=989455 2024-09-19T13:43:01.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.197+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=SWZJDZ8ECIYR tag=P4IFTHZU894I type=write size=4135183 2024-09-19T13:43:01.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.198+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~0OVQ5DPR7A15.0 size=168849 2024-09-19T13:43:01.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.200+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=0OVQ5DPR7A15 tag=2TTEVBMOK8VE type=write size=1217425 2024-09-19T13:43:01.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.201+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=MILTGA7ZOSLI type=del size=2273717 2024-09-19T13:43:01.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.203+0000 7f6ab10d2780 1 < suggested remove operation key=WDRUV5ERI000 tag=JDU8QJB4203D type=del 2024-09-19T13:43:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.205+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~COCH4FCRWFCL.0 size=662742 2024-09-19T13:43:01.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.205+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=COCH4FCRWFCL tag=V1Q6SN1Q2W3L type=write size=1711318 2024-09-19T13:43:01.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.206+0000 7f6ab10d2780 1 < canceled operation key=9Q9DGUSDSE49 tag=5VVE7F2M8LHS type=del size=1665024 2024-09-19T13:43:01.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.207+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=LVW0O78FJCH6 type=del size=1676450 2024-09-19T13:43:01.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.208+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=2B02VMXFPXXT type=del 2024-09-19T13:43:01.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.210+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=WR181YSO4I6D type=del size=2985678 2024-09-19T13:43:01.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.212+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=GD1P0THNGMAQ type=write size=43115 2024-09-19T13:43:01.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.214+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~F94TBMV28ASA.0 size=1048576 2024-09-19T13:43:01.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.214+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~F94TBMV28ASA.1 size=18397 2024-09-19T13:43:01.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.214+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=F94TBMV28ASA tag=C3NDKOX5GOWU type=write size=2115549 2024-09-19T13:43:01.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.216+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=4A54HFN92457 type=del 2024-09-19T13:43:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.218+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~ELVNQIJ5JQU7.0 size=881595 2024-09-19T13:43:01.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.218+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=ELVNQIJ5JQU7 tag=MGKKDMF9FS1G type=write size=1930171 2024-09-19T13:43:01.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.219+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~1RXMFPB2LPN4.0 size=668042 2024-09-19T13:43:01.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.221+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=1RXMFPB2LPN4 tag=B1VW1XOQUQUR type=write size=1716618 2024-09-19T13:43:01.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.222+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=J1Z2BUTD1SXH type=del size=3901244 2024-09-19T13:43:01.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.224+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~CRYL4DZA62YN.0 size=1048576 2024-09-19T13:43:01.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.225+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~CRYL4DZA62YN.1 size=249279 2024-09-19T13:43:01.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.227+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=CRYL4DZA62YN tag=K55M1Z7V9C19 type=write size=2346431 2024-09-19T13:43:01.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.228+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=XN4PJ2526S5G type=del size=3533741 2024-09-19T13:43:01.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.229+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=613M3IIVWQL3 type=del 2024-09-19T13:43:01.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.230+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=VCA18X52S8OD type=del size=3063050 2024-09-19T13:43:01.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.232+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=VULOT0DLRCF1 type=del 2024-09-19T13:43:01.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.233+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=CLK3KK1ULGEF type=del size=1900641 2024-09-19T13:43:01.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.235+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=ZV5V1UGPUJPW type=write size=787031 2024-09-19T13:43:01.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.237+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~05XTR0U7EVQK.0 size=1048576 2024-09-19T13:43:01.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.238+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~05XTR0U7EVQK.1 size=1048576 2024-09-19T13:43:01.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.239+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~05XTR0U7EVQK.2 size=718544 2024-09-19T13:43:01.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.239+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=05XTR0U7EVQK tag=EBB6I3W1PU7D type=write size=3864272 2024-09-19T13:43:01.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.241+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=VV6LE5ITB95S type=del 2024-09-19T13:43:01.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.242+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=RD1A3YKMS226 type=del size=3660167 2024-09-19T13:43:01.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.242+0000 7f6ab10d2780 1 < canceled part key=_multipart_QTGKMAOX2A6U.2~93EUCIMGN42S.0 size=1048576 2024-09-19T13:43:01.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.243+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~93EUCIMGN42S.1 size=272519 2024-09-19T13:43:01.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.245+0000 7f6ab10d2780 1 < canceled multipart upload key=QTGKMAOX2A6U upload=93EUCIMGN42S tag=AASDFADUDICB type=write size=2369671 2024-09-19T13:43:01.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.247+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~E4LQGA0MP3HV.0 size=1048576 2024-09-19T13:43:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.248+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~E4LQGA0MP3HV.1 size=1048576 2024-09-19T13:43:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.249+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~E4LQGA0MP3HV.2 size=362896 2024-09-19T13:43:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.249+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=E4LQGA0MP3HV tag=XG90DYYLIAIG type=write size=3508624 2024-09-19T13:43:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.250+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~FWRVL7UEHGVR.0 size=1048576 2024-09-19T13:43:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.251+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~FWRVL7UEHGVR.1 size=1048576 2024-09-19T13:43:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.252+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~FWRVL7UEHGVR.2 size=580649 2024-09-19T13:43:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.254+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=FWRVL7UEHGVR tag=1AG4Z69QZ1M5 type=write size=3726377 2024-09-19T13:43:01.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.256+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~4E9A53F0YJU0.0 size=1048576 2024-09-19T13:43:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.257+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~4E9A53F0YJU0.1 size=912265 2024-09-19T13:43:01.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.257+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=4E9A53F0YJU0 tag=3NCGVGOI7JVN type=write size=3009417 2024-09-19T13:43:01.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.258+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=Z0M8KW77OD15 type=write size=997945 2024-09-19T13:43:01.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.260+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=KLLXAW3D28R7 type=del size=1026636 2024-09-19T13:43:01.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.261+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~SWZJDZ8ECIYR.0 size=1048576 2024-09-19T13:43:01.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.262+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~SWZJDZ8ECIYR.1 size=1048576 2024-09-19T13:43:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.263+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~SWZJDZ8ECIYR.2 size=989455 2024-09-19T13:43:01.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.265+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=SWZJDZ8ECIYR tag=P4IFTHZU894I type=write size=4135183 2024-09-19T13:43:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.267+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~C8EO8CH0T4WM.0 size=1048576 2024-09-19T13:43:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.268+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~C8EO8CH0T4WM.1 size=1048576 2024-09-19T13:43:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.269+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~C8EO8CH0T4WM.2 size=468730 2024-09-19T13:43:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.269+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=C8EO8CH0T4WM tag=BLH0XOSW1C8D type=write size=3614458 2024-09-19T13:43:01.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.271+0000 7f6ab10d2780 1 < suggested remove operation key=X8CWBFNCJG6M tag=MILTGA7ZOSLI type=del 2024-09-19T13:43:01.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.272+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=7GDU2DR1JL83 type=del size=2196341 2024-09-19T13:43:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.273+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~COCH4FCRWFCL.0 size=662742 2024-09-19T13:43:01.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.275+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=COCH4FCRWFCL tag=V1Q6SN1Q2W3L type=write size=1711318 2024-09-19T13:43:01.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.276+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=ME529FTROKPA type=del size=3434912 2024-09-19T13:43:01.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.278+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=LVW0O78FJCH6 type=del size=1676450 2024-09-19T13:43:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.279+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=L5VOWI46M263 type=del size=3792286 2024-09-19T13:43:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.280+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=WR181YSO4I6D type=del 2024-09-19T13:43:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.281+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=W2X72QCOIIP0 type=del size=893127 2024-09-19T13:43:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.282+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~F94TBMV28ASA.0 size=1048576 2024-09-19T13:43:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.283+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~F94TBMV28ASA.1 size=18397 2024-09-19T13:43:01.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.285+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=F94TBMV28ASA tag=C3NDKOX5GOWU type=write size=2115549 2024-09-19T13:43:01.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.286+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=SONMU26Y761Z type=del size=1311606 2024-09-19T13:43:01.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.287+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~ELVNQIJ5JQU7.0 size=881595 2024-09-19T13:43:01.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.289+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=ELVNQIJ5JQU7 tag=MGKKDMF9FS1G type=write size=1930171 2024-09-19T13:43:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.290+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=SB36RX8YG245 type=del size=958081 2024-09-19T13:43:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.291+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=J1Z2BUTD1SXH type=del 2024-09-19T13:43:01.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.292+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=W78EM9LZJ504 type=del size=1914206 2024-09-19T13:43:01.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.293+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=XN4PJ2526S5G type=del 2024-09-19T13:43:01.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.294+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=DVR86A77C3VV type=del size=2784376 2024-09-19T13:43:01.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.295+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=VCA18X52S8OD type=del 2024-09-19T13:43:01.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.296+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=IQ58XFKMR9M9 type=del size=433960 2024-09-19T13:43:01.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.298+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=CLK3KK1ULGEF type=del 2024-09-19T13:43:01.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.299+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=X3N97FDGSBD0 type=del size=1196546 2024-09-19T13:43:01.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.300+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~05XTR0U7EVQK.0 size=1048576 2024-09-19T13:43:01.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.301+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~05XTR0U7EVQK.1 size=1048576 2024-09-19T13:43:01.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.302+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~05XTR0U7EVQK.2 size=718544 2024-09-19T13:43:01.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.304+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=05XTR0U7EVQK tag=EBB6I3W1PU7D type=write size=3864272 2024-09-19T13:43:01.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.306+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~3HW3BADKM0CM.0 size=1048576 2024-09-19T13:43:01.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.306+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~3HW3BADKM0CM.1 size=467773 2024-09-19T13:43:01.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.306+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=3HW3BADKM0CM tag=S0H0J27LQPX2 type=write size=2564925 2024-09-19T13:43:01.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.308+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=RD1A3YKMS226 type=del 2024-09-19T13:43:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.310+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~QKQT1Y3GVJ2M.0 size=1048576 2024-09-19T13:43:01.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.311+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~QKQT1Y3GVJ2M.1 size=155642 2024-09-19T13:43:01.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.311+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=QKQT1Y3GVJ2M tag=D090AINWF57M type=write size=2252794 2024-09-19T13:43:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.312+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~E4LQGA0MP3HV.0 size=1048576 2024-09-19T13:43:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.313+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~E4LQGA0MP3HV.1 size=1048576 2024-09-19T13:43:01.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.314+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~E4LQGA0MP3HV.2 size=362896 2024-09-19T13:43:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.317+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=E4LQGA0MP3HV tag=XG90DYYLIAIG type=write size=3508624 2024-09-19T13:43:01.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.319+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~WML5KUF4G0K2.0 size=761509 2024-09-19T13:43:01.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.319+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=WML5KUF4G0K2 tag=1YYTBWV579YS type=write size=1810085 2024-09-19T13:43:01.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.319+0000 7f6ab10d2780 1 < canceled part key=_multipart_4OSJA1879NQO.2~4E9A53F0YJU0.0 size=1048576 2024-09-19T13:43:01.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.320+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~4E9A53F0YJU0.1 size=912265 2024-09-19T13:43:01.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.322+0000 7f6ab10d2780 1 < canceled multipart upload key=4OSJA1879NQO upload=4E9A53F0YJU0 tag=3NCGVGOI7JVN type=write size=3009417 2024-09-19T13:43:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.323+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=FJFW9ALA7T3L type=write size=1030458 2024-09-19T13:43:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.324+0000 7f6ab10d2780 1 < canceled operation key=DF003ORZ1HOM tag=KLLXAW3D28R7 type=del size=1026636 2024-09-19T13:43:01.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.326+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~BHP65NMRY66P.0 size=1048576 2024-09-19T13:43:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.327+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~BHP65NMRY66P.1 size=170222 2024-09-19T13:43:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.327+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=BHP65NMRY66P tag=T9FO2M2UXG3G type=write size=2267374 2024-09-19T13:43:01.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.328+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~C8EO8CH0T4WM.0 size=1048576 2024-09-19T13:43:01.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.329+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~C8EO8CH0T4WM.1 size=1048576 2024-09-19T13:43:01.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.330+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~C8EO8CH0T4WM.2 size=468730 2024-09-19T13:43:01.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.332+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=C8EO8CH0T4WM tag=BLH0XOSW1C8D type=write size=3614458 2024-09-19T13:43:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.333+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=DA9AIBO9653Q type=del size=2286094 2024-09-19T13:43:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.334+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=7GDU2DR1JL83 type=del 2024-09-19T13:43:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.335+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=5YP0F0CVJHN0 type=del size=3797915 2024-09-19T13:43:01.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.336+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=ME529FTROKPA type=del 2024-09-19T13:43:01.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.338+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=YKL98KJM4HXJ type=del size=325439 2024-09-19T13:43:01.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.339+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=L5VOWI46M263 type=del 2024-09-19T13:43:01.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.340+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=JOEPHEMMXE6P type=del size=3456501 2024-09-19T13:43:01.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.341+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=W2X72QCOIIP0 type=del 2024-09-19T13:43:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.343+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~G8QO4H1YJHK8.0 size=1048576 2024-09-19T13:43:01.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.344+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~G8QO4H1YJHK8.1 size=335543 2024-09-19T13:43:01.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.344+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=G8QO4H1YJHK8 tag=0D7FV0CRC7YT type=write size=2432695 2024-09-19T13:43:01.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.345+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=SONMU26Y761Z type=del size=1311606 2024-09-19T13:43:01.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.347+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~D5ABPWEM5KF9.0 size=99212 2024-09-19T13:43:01.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.347+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=D5ABPWEM5KF9 tag=Y972KQAGAN2Y type=write size=1147788 2024-09-19T13:43:01.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.348+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=SB36RX8YG245 type=del 2024-09-19T13:43:01.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.349+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=GTLQ84HR1UAO type=write size=878071 2024-09-19T13:43:01.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.351+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=W78EM9LZJ504 type=del 2024-09-19T13:43:01.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.352+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=45ZSV95RFNQY type=del size=2462854 2024-09-19T13:43:01.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.353+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=DVR86A77C3VV type=del 2024-09-19T13:43:01.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.356+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~2XR7CKDFJUG1.0 size=530854 2024-09-19T13:43:01.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.356+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=2XR7CKDFJUG1 tag=D7WR2IFGYTI3 type=write size=1579430 2024-09-19T13:43:01.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.357+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=IQ58XFKMR9M9 type=del 2024-09-19T13:43:01.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.358+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=83K0RPNJFBD9 type=write size=686536 2024-09-19T13:43:01.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.359+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=X3N97FDGSBD0 type=del 2024-09-19T13:43:01.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.361+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~YY2VF3E0GTEO.0 size=1048576 2024-09-19T13:43:01.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.362+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~YY2VF3E0GTEO.1 size=1040876 2024-09-19T13:43:01.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.362+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=YY2VF3E0GTEO tag=SC1GDDXE2FXJ type=write size=3138028 2024-09-19T13:43:01.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.363+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~3HW3BADKM0CM.0 size=1048576 2024-09-19T13:43:01.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.364+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~3HW3BADKM0CM.1 size=467773 2024-09-19T13:43:01.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.366+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=3HW3BADKM0CM tag=S0H0J27LQPX2 type=write size=2564925 2024-09-19T13:43:01.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.368+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~UAVZO6EMZ0FH.0 size=570091 2024-09-19T13:43:01.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.368+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=UAVZO6EMZ0FH tag=V2B2TV1VVKFC type=write size=1618667 2024-09-19T13:43:01.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.369+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~QKQT1Y3GVJ2M.0 size=1048576 2024-09-19T13:43:01.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.370+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~QKQT1Y3GVJ2M.1 size=155642 2024-09-19T13:43:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.372+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=QKQT1Y3GVJ2M tag=D090AINWF57M type=write size=2252794 2024-09-19T13:43:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.374+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~MHSATMT0EIPG.0 size=982773 2024-09-19T13:43:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.374+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=MHSATMT0EIPG tag=98MQKB021YLC type=write size=2031349 2024-09-19T13:43:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.375+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~WML5KUF4G0K2.0 size=761509 2024-09-19T13:43:01.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.377+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=WML5KUF4G0K2 tag=1YYTBWV579YS type=write size=1810085 2024-09-19T13:43:01.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.379+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~YZK5QEEMG93D.0 size=1048576 2024-09-19T13:43:01.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.380+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~YZK5QEEMG93D.1 size=1048576 2024-09-19T13:43:01.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.381+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~YZK5QEEMG93D.2 size=347955 2024-09-19T13:43:01.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.381+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=YZK5QEEMG93D tag=5GESDHDTIMST type=write size=3493683 2024-09-19T13:43:01.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.383+0000 7f6ab10d2780 1 < suggested update operation key=9IN6E0JQFNAU tag=FJFW9ALA7T3L type=write size=1030458 2024-09-19T13:43:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.384+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=DUSI9GXSV1XT type=del size=1841060 2024-09-19T13:43:01.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.385+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~BHP65NMRY66P.0 size=1048576 2024-09-19T13:43:01.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.386+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~BHP65NMRY66P.1 size=170222 2024-09-19T13:43:01.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.388+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=BHP65NMRY66P tag=T9FO2M2UXG3G type=write size=2267374 2024-09-19T13:43:01.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.389+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=2HHPVJRW0Z5M type=del size=3412559 2024-09-19T13:43:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.390+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=DA9AIBO9653Q type=del 2024-09-19T13:43:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.392+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~9EF6UMFCWRSX.0 size=485601 2024-09-19T13:43:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.392+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=9EF6UMFCWRSX tag=4BF1L4OIT41F type=write size=1534177 2024-09-19T13:43:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.393+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=5YP0F0CVJHN0 type=del 2024-09-19T13:43:01.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.395+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~9J5YYQTFGS2S.0 size=441221 2024-09-19T13:43:01.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.395+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=9J5YYQTFGS2S tag=39BXQBQ0DN5H type=write size=1489797 2024-09-19T13:43:01.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.397+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=YKL98KJM4HXJ type=del size=325439 2024-09-19T13:43:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.399+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~A9R90J505XED.0 size=1048576 2024-09-19T13:43:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.400+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~A9R90J505XED.1 size=1048576 2024-09-19T13:43:01.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.401+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~A9R90J505XED.2 size=18951 2024-09-19T13:43:01.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.401+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=A9R90J505XED tag=ITOG6EO91H2U type=write size=3164679 2024-09-19T13:43:01.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.402+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=JOEPHEMMXE6P type=del 2024-09-19T13:43:01.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.403+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=PZEA8I8E6E3Z type=del size=2685105 2024-09-19T13:43:01.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.404+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~G8QO4H1YJHK8.0 size=1048576 2024-09-19T13:43:01.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.405+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~G8QO4H1YJHK8.1 size=335543 2024-09-19T13:43:01.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.407+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=G8QO4H1YJHK8 tag=0D7FV0CRC7YT type=write size=2432695 2024-09-19T13:43:01.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.408+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=3UWKHMXIQ8GP type=del size=2657687 2024-09-19T13:43:01.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.409+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~D5ABPWEM5KF9.0 size=99212 2024-09-19T13:43:01.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.411+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=D5ABPWEM5KF9 tag=Y972KQAGAN2Y type=write size=1147788 2024-09-19T13:43:01.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.413+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~WGVEP6PDKYDF.0 size=1048576 2024-09-19T13:43:01.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.414+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~WGVEP6PDKYDF.1 size=699986 2024-09-19T13:43:01.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.414+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=WGVEP6PDKYDF tag=M1IFYB6IGHVV type=write size=2797138 2024-09-19T13:43:01.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.415+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=GTLQ84HR1UAO type=write size=878071 2024-09-19T13:43:01.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.417+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~0Q062C51HNUH.0 size=1048576 2024-09-19T13:43:01.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.418+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~0Q062C51HNUH.1 size=1048576 2024-09-19T13:43:01.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.419+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~0Q062C51HNUH.2 size=726989 2024-09-19T13:43:01.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.419+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=0Q062C51HNUH tag=FH6P802CSXXF type=write size=3872717 2024-09-19T13:43:01.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.421+0000 7f6ab10d2780 1 < canceled operation key=CD4XXORKVS6J tag=45ZSV95RFNQY type=del size=2462854 2024-09-19T13:43:01.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.423+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~CRBCVRVJDFLX.0 size=1048576 2024-09-19T13:43:01.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.424+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~CRBCVRVJDFLX.1 size=1048576 2024-09-19T13:43:01.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.425+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~CRBCVRVJDFLX.2 size=192086 2024-09-19T13:43:01.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.425+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=CRBCVRVJDFLX tag=32AQ0MKFSZ9W type=write size=3337814 2024-09-19T13:43:01.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.426+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~2XR7CKDFJUG1.0 size=530854 2024-09-19T13:43:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.428+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=2XR7CKDFJUG1 tag=D7WR2IFGYTI3 type=write size=1579430 2024-09-19T13:43:01.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.430+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~IP6QF0I80FUJ.0 size=1048576 2024-09-19T13:43:01.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.431+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~IP6QF0I80FUJ.1 size=136743 2024-09-19T13:43:01.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.431+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=IP6QF0I80FUJ tag=QVY7UDL8DAZC type=write size=2233895 2024-09-19T13:43:01.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.432+0000 7f6ab10d2780 1 < completed write operation key=V8P17ZSOQUSM tag=83K0RPNJFBD9 type=write size=686536 2024-09-19T13:43:01.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.433+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=R6OF9QO0N9NJ type=del size=1324681 2024-09-19T13:43:01.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.434+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~YY2VF3E0GTEO.0 size=1048576 2024-09-19T13:43:01.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.435+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~YY2VF3E0GTEO.1 size=1040876 2024-09-19T13:43:01.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.437+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=YY2VF3E0GTEO tag=SC1GDDXE2FXJ type=write size=3138028 2024-09-19T13:43:01.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.438+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=HKLFUSCRJL6Q type=del size=1682497 2024-09-19T13:43:01.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.439+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~UAVZO6EMZ0FH.0 size=570091 2024-09-19T13:43:01.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.441+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=UAVZO6EMZ0FH tag=V2B2TV1VVKFC type=write size=1618667 2024-09-19T13:43:01.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.443+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~2SYM8UFNV0TC.0 size=1048576 2024-09-19T13:43:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.444+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~2SYM8UFNV0TC.1 size=532349 2024-09-19T13:43:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.444+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=2SYM8UFNV0TC tag=WX9ABJQZ427B type=write size=2629501 2024-09-19T13:43:01.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.444+0000 7f6ab10d2780 1 < canceled part key=_multipart_CD4XXORKVS6J.2~MHSATMT0EIPG.0 size=982773 2024-09-19T13:43:01.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.446+0000 7f6ab10d2780 1 < canceled multipart upload key=CD4XXORKVS6J upload=MHSATMT0EIPG tag=98MQKB021YLC type=write size=2031349 2024-09-19T13:43:01.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.448+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~VTQ0DDDLPDFW.0 size=1048576 2024-09-19T13:43:01.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.449+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~VTQ0DDDLPDFW.1 size=1048576 2024-09-19T13:43:01.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.450+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~VTQ0DDDLPDFW.2 size=95574 2024-09-19T13:43:01.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.450+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=VTQ0DDDLPDFW tag=VFFHWLV6DPPD type=write size=3241302 2024-09-19T13:43:01.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.452+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~YZK5QEEMG93D.0 size=1048576 2024-09-19T13:43:01.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.453+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~YZK5QEEMG93D.1 size=1048576 2024-09-19T13:43:01.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.454+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~YZK5QEEMG93D.2 size=347955 2024-09-19T13:43:01.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.456+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=YZK5QEEMG93D tag=5GESDHDTIMST type=write size=3493683 2024-09-19T13:43:01.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.458+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~KO03I3DP1HL2.0 size=1048576 2024-09-19T13:43:01.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.459+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~KO03I3DP1HL2.1 size=760234 2024-09-19T13:43:01.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.459+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=KO03I3DP1HL2 tag=SKNGMSYFS3SY type=write size=2857386 2024-09-19T13:43:01.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.460+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=DUSI9GXSV1XT type=del 2024-09-19T13:43:01.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.461+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=K4SKGTCLDSZN type=del size=218781 2024-09-19T13:43:01.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.462+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=2HHPVJRW0Z5M type=del 2024-09-19T13:43:01.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.463+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=09H691NLWO3C type=del size=2371690 2024-09-19T13:43:01.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.463+0000 7f6ab10d2780 1 < canceled part key=_multipart_WDRUV5ERI000.2~9EF6UMFCWRSX.0 size=485601 2024-09-19T13:43:01.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.465+0000 7f6ab10d2780 1 < canceled multipart upload key=WDRUV5ERI000 upload=9EF6UMFCWRSX tag=4BF1L4OIT41F type=write size=1534177 2024-09-19T13:43:01.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.466+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=GPXM4BULKSAD type=del size=2283646 2024-09-19T13:43:01.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.467+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~9J5YYQTFGS2S.0 size=441221 2024-09-19T13:43:01.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.469+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=9J5YYQTFGS2S tag=39BXQBQ0DN5H type=write size=1489797 2024-09-19T13:43:01.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.471+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~K13L9A9OW715.0 size=1048576 2024-09-19T13:43:01.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.472+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~K13L9A9OW715.1 size=1048576 2024-09-19T13:43:01.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.472+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~K13L9A9OW715.2 size=844275 2024-09-19T13:43:01.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.472+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=K13L9A9OW715 tag=47LJHUBG5XJ3 type=write size=3990003 2024-09-19T13:43:01.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.473+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~A9R90J505XED.0 size=1048576 2024-09-19T13:43:01.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.474+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~A9R90J505XED.1 size=1048576 2024-09-19T13:43:01.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.475+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~A9R90J505XED.2 size=18951 2024-09-19T13:43:01.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.477+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=A9R90J505XED tag=ITOG6EO91H2U type=write size=3164679 2024-09-19T13:43:01.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.479+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~4RQBHR2YHGKY.0 size=918088 2024-09-19T13:43:01.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.479+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=4RQBHR2YHGKY tag=PGF14ENU2WSD type=write size=1966664 2024-09-19T13:43:01.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.481+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=PZEA8I8E6E3Z type=del 2024-09-19T13:43:01.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.483+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~XM9O6Y35CHTP.0 size=1048576 2024-09-19T13:43:01.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.484+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~XM9O6Y35CHTP.1 size=1048576 2024-09-19T13:43:01.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.485+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~XM9O6Y35CHTP.2 size=1002911 2024-09-19T13:43:01.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.485+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=XM9O6Y35CHTP tag=YNBA6WBBQ9WF type=write size=4148639 2024-09-19T13:43:01.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.486+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=3UWKHMXIQ8GP type=del 2024-09-19T13:43:01.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.487+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=6SK3DEID3L14 type=del size=3182869 2024-09-19T13:43:01.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.489+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~WGVEP6PDKYDF.0 size=1048576 2024-09-19T13:43:01.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.490+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~WGVEP6PDKYDF.1 size=699986 2024-09-19T13:43:01.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.492+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=WGVEP6PDKYDF tag=M1IFYB6IGHVV type=write size=2797138 2024-09-19T13:43:01.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.493+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=EZH9AMTZUNDQ type=del size=3469451 2024-09-19T13:43:01.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.494+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~0Q062C51HNUH.0 size=1048576 2024-09-19T13:43:01.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.495+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~0Q062C51HNUH.1 size=1048576 2024-09-19T13:43:01.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.496+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~0Q062C51HNUH.2 size=726989 2024-09-19T13:43:01.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.497+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=0Q062C51HNUH tag=FH6P802CSXXF type=write size=3872717 2024-09-19T13:43:01.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.499+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=CT8983PVF817 type=del size=2999829 2024-09-19T13:43:01.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.500+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~CRBCVRVJDFLX.0 size=1048576 2024-09-19T13:43:01.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.501+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~CRBCVRVJDFLX.1 size=1048576 2024-09-19T13:43:01.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.501+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~CRBCVRVJDFLX.2 size=192086 2024-09-19T13:43:01.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.503+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=CRBCVRVJDFLX tag=32AQ0MKFSZ9W type=write size=3337814 2024-09-19T13:43:01.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.505+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~0KIGTA3BTLJG.0 size=1048576 2024-09-19T13:43:01.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.506+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~0KIGTA3BTLJG.1 size=36329 2024-09-19T13:43:01.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.506+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=0KIGTA3BTLJG tag=8N1HI948O7M8 type=write size=2133481 2024-09-19T13:43:01.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.507+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~IP6QF0I80FUJ.0 size=1048576 2024-09-19T13:43:01.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.508+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~IP6QF0I80FUJ.1 size=136743 2024-09-19T13:43:01.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.510+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=IP6QF0I80FUJ tag=QVY7UDL8DAZC type=write size=2233895 2024-09-19T13:43:01.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.511+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=WVB2EAHITRBB type=del size=2644997 2024-09-19T13:43:01.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.512+0000 7f6ab10d2780 1 < canceled operation key=DF003ORZ1HOM tag=R6OF9QO0N9NJ type=del size=1324681 2024-09-19T13:43:01.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.514+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~0AXI4S6YC9DF.0 size=274247 2024-09-19T13:43:01.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.514+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=0AXI4S6YC9DF tag=IEOQYAPYQO1K type=write size=1322823 2024-09-19T13:43:01.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.515+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=HKLFUSCRJL6Q type=del 2024-09-19T13:43:01.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.516+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=1G050VMFTVOW type=del size=167536 2024-09-19T13:43:01.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.517+0000 7f6ab10d2780 1 < canceled part key=_multipart_SRABG45EPVN2.2~2SYM8UFNV0TC.0 size=1048576 2024-09-19T13:43:01.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.517+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~2SYM8UFNV0TC.1 size=532349 2024-09-19T13:43:01.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.519+0000 7f6ab10d2780 1 < canceled multipart upload key=SRABG45EPVN2 upload=2SYM8UFNV0TC tag=WX9ABJQZ427B type=write size=2629501 2024-09-19T13:43:01.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.522+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~QWRA8O1AOWS3.0 size=1048576 2024-09-19T13:43:01.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.523+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~QWRA8O1AOWS3.1 size=670601 2024-09-19T13:43:01.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.523+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=QWRA8O1AOWS3 tag=OK3JG1V339XI type=write size=2767753 2024-09-19T13:43:01.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.523+0000 7f6ab10d2780 1 < canceled part key=_multipart_B0J7E7A0NP4J.2~VTQ0DDDLPDFW.0 size=1048576 2024-09-19T13:43:01.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.524+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~VTQ0DDDLPDFW.1 size=1048576 2024-09-19T13:43:01.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.525+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~VTQ0DDDLPDFW.2 size=95574 2024-09-19T13:43:01.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.527+0000 7f6ab10d2780 1 < canceled multipart upload key=B0J7E7A0NP4J upload=VTQ0DDDLPDFW tag=VFFHWLV6DPPD type=write size=3241302 2024-09-19T13:43:01.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.529+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~TAYWIZAF9AGM.0 size=1048576 2024-09-19T13:43:01.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.530+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~TAYWIZAF9AGM.1 size=651883 2024-09-19T13:43:01.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.530+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=TAYWIZAF9AGM tag=0N17SDTOKC92 type=write size=2749035 2024-09-19T13:43:01.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.531+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~KO03I3DP1HL2.0 size=1048576 2024-09-19T13:43:01.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.532+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~KO03I3DP1HL2.1 size=760234 2024-09-19T13:43:01.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.533+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=KO03I3DP1HL2 tag=SKNGMSYFS3SY type=write size=2857386 2024-09-19T13:43:01.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.535+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=6ETCDUZNUAV8 type=write size=812506 2024-09-19T13:43:01.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.536+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=K4SKGTCLDSZN type=del 2024-09-19T13:43:01.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.537+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=U2I2VWSAT3QQ type=del size=2766317 2024-09-19T13:43:01.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.539+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=09H691NLWO3C type=del 2024-09-19T13:43:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.541+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~FNNMP9MBGUEH.0 size=1048576 2024-09-19T13:43:01.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.542+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~FNNMP9MBGUEH.1 size=1048576 2024-09-19T13:43:01.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.543+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~FNNMP9MBGUEH.2 size=1027059 2024-09-19T13:43:01.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.543+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=FNNMP9MBGUEH tag=K3YQK6WZHU5K type=write size=4172787 2024-09-19T13:43:01.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.545+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=GPXM4BULKSAD type=del size=2283646 2024-09-19T13:43:01.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.546+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=OZMIQQDJSRM3 type=del size=3321114 2024-09-19T13:43:01.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.546+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~K13L9A9OW715.0 size=1048576 2024-09-19T13:43:01.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.547+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~K13L9A9OW715.1 size=1048576 2024-09-19T13:43:01.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.547+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~K13L9A9OW715.2 size=844275 2024-09-19T13:43:01.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.549+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=K13L9A9OW715 tag=47LJHUBG5XJ3 type=write size=3990003 2024-09-19T13:43:01.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.550+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=3LIYZQ9IP44W type=del size=892755 2024-09-19T13:43:01.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.551+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~4RQBHR2YHGKY.0 size=918088 2024-09-19T13:43:01.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.553+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=4RQBHR2YHGKY tag=PGF14ENU2WSD type=write size=1966664 2024-09-19T13:43:01.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.554+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=41UB6LLH918J type=del size=42571 2024-09-19T13:43:01.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.555+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~XM9O6Y35CHTP.0 size=1048576 2024-09-19T13:43:01.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.556+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~XM9O6Y35CHTP.1 size=1048576 2024-09-19T13:43:01.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.557+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~XM9O6Y35CHTP.2 size=1002911 2024-09-19T13:43:01.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.559+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=XM9O6Y35CHTP tag=YNBA6WBBQ9WF type=write size=4148639 2024-09-19T13:43:01.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.561+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~T5ID63EBFHIK.0 size=1048576 2024-09-19T13:43:01.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.562+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~T5ID63EBFHIK.1 size=114796 2024-09-19T13:43:01.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.562+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=T5ID63EBFHIK tag=9LVYJVMRULVW type=write size=2211948 2024-09-19T13:43:01.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.564+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=6SK3DEID3L14 type=del size=3182869 2024-09-19T13:43:01.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.566+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~R82RJ7GFFPZS.0 size=1048576 2024-09-19T13:43:01.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.567+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~R82RJ7GFFPZS.1 size=1048576 2024-09-19T13:43:01.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.568+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~R82RJ7GFFPZS.2 size=188438 2024-09-19T13:43:01.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.568+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=R82RJ7GFFPZS tag=MRR8YHQDVGWF type=write size=3334166 2024-09-19T13:43:01.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.570+0000 7f6ab10d2780 1 < suggested remove operation key=DF003ORZ1HOM tag=EZH9AMTZUNDQ type=del 2024-09-19T13:43:01.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.571+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=SBX5G4IHLEGY type=write size=734260 2024-09-19T13:43:01.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.572+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=CT8983PVF817 type=del 2024-09-19T13:43:01.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.574+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~ALXI3SS3UETC.0 size=350216 2024-09-19T13:43:01.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.574+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=ALXI3SS3UETC tag=48OA83EJ87ZO type=write size=1398792 2024-09-19T13:43:01.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.575+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~0KIGTA3BTLJG.0 size=1048576 2024-09-19T13:43:01.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.576+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~0KIGTA3BTLJG.1 size=36329 2024-09-19T13:43:01.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.578+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=0KIGTA3BTLJG tag=8N1HI948O7M8 type=write size=2133481 2024-09-19T13:43:01.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.580+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~UVW80G0PXHN1.0 size=1048576 2024-09-19T13:43:01.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.581+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~UVW80G0PXHN1.1 size=419481 2024-09-19T13:43:01.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.581+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=UVW80G0PXHN1 tag=KPSDP7KXL1L4 type=write size=2516633 2024-09-19T13:43:01.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.582+0000 7f6ab10d2780 -1 < failed to complete operation key=DF003ORZ1HOM tag=WVB2EAHITRBB type=del size=2644997: (22) Invalid argument 2024-09-19T13:43:01.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.583+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=OEBOBAR18ZXA type=del size=1156816 2024-09-19T13:43:01.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.584+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~0AXI4S6YC9DF.0 size=274247 2024-09-19T13:43:01.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.586+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=0AXI4S6YC9DF tag=IEOQYAPYQO1K type=write size=1322823 2024-09-19T13:43:01.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.588+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~2OPA1R277VRT.0 size=678772 2024-09-19T13:43:01.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.588+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=2OPA1R277VRT tag=FBHYN059VDI1 type=write size=1727348 2024-09-19T13:43:01.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.590+0000 7f6ab10d2780 1 < suggested update operation key=P2U09V0G7UUU tag=1G050VMFTVOW type=del size=167536 2024-09-19T13:43:01.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.592+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~C4CMGXYXNMTQ.0 size=1048576 2024-09-19T13:43:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.593+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~C4CMGXYXNMTQ.1 size=42990 2024-09-19T13:43:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.593+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=C4CMGXYXNMTQ tag=AUXXTBRGT5NW type=write size=2140142 2024-09-19T13:43:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.594+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~QWRA8O1AOWS3.0 size=1048576 2024-09-19T13:43:01.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.594+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~QWRA8O1AOWS3.1 size=670601 2024-09-19T13:43:01.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.595+0000 7f6ab10d2780 1 < canceled multipart upload key=9MCE8PXHBGNF upload=QWRA8O1AOWS3 tag=OK3JG1V339XI type=write size=2767753 2024-09-19T13:43:01.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.597+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=SZ3EZC49EERH type=del size=2502786 2024-09-19T13:43:01.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.598+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~TAYWIZAF9AGM.0 size=1048576 2024-09-19T13:43:01.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.599+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~TAYWIZAF9AGM.1 size=651883 2024-09-19T13:43:01.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.600+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=TAYWIZAF9AGM tag=0N17SDTOKC92 type=write size=2749035 2024-09-19T13:43:01.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.602+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~SH1O6CUFPA2U.0 size=344246 2024-09-19T13:43:01.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.602+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=SH1O6CUFPA2U tag=LO175CX5Z9E7 type=write size=1392822 2024-09-19T13:43:01.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.604+0000 7f6ab10d2780 1 < suggested remove operation key=B0J7E7A0NP4J tag=6ETCDUZNUAV8 type=write 2024-09-19T13:43:01.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.606+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=NCXBRI378V3E type=del size=4149523 2024-09-19T13:43:01.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.607+0000 7f6ab10d2780 1 < canceled operation key=7LHSAN5BBQRW tag=U2I2VWSAT3QQ type=del size=2766317 2024-09-19T13:43:01.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.608+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=W3P61AVZKZUJ type=write size=254025 2024-09-19T13:43:01.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.609+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~FNNMP9MBGUEH.0 size=1048576 2024-09-19T13:43:01.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.610+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~FNNMP9MBGUEH.1 size=1048576 2024-09-19T13:43:01.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.611+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~FNNMP9MBGUEH.2 size=1027059 2024-09-19T13:43:01.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.613+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=FNNMP9MBGUEH tag=K3YQK6WZHU5K type=write size=4172787 2024-09-19T13:43:01.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.614+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=B15LZESKP7RI type=del size=2281089 2024-09-19T13:43:01.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.615+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=OZMIQQDJSRM3 type=del 2024-09-19T13:43:01.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.616+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=SRP77T711FH3 type=del size=2130352 2024-09-19T13:43:01.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.617+0000 7f6ab10d2780 -1 < failed to complete operation key=B0J7E7A0NP4J tag=3LIYZQ9IP44W type=del size=892755: (22) Invalid argument 2024-09-19T13:43:01.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.618+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=Q2E14UPJGJEQ type=del size=2301397 2024-09-19T13:43:01.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.620+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=41UB6LLH918J type=del 2024-09-19T13:43:01.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.621+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=RLQNF1P0EQLL type=del size=1528050 2024-09-19T13:43:01.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.621+0000 7f6ab10d2780 1 < canceled part key=_multipart_DTSRVH526PE7.2~T5ID63EBFHIK.0 size=1048576 2024-09-19T13:43:01.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.623+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~T5ID63EBFHIK.1 size=114796 2024-09-19T13:43:01.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.626+0000 7f6ab10d2780 1 < canceled multipart upload key=DTSRVH526PE7 upload=T5ID63EBFHIK tag=9LVYJVMRULVW type=write size=2211948 2024-09-19T13:43:01.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.627+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=5S8LOBCVM8AF type=del size=3688417 2024-09-19T13:43:01.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.628+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~R82RJ7GFFPZS.0 size=1048576 2024-09-19T13:43:01.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.629+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~R82RJ7GFFPZS.1 size=1048576 2024-09-19T13:43:01.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.630+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~R82RJ7GFFPZS.2 size=188438 2024-09-19T13:43:01.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.632+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=R82RJ7GFFPZS tag=MRR8YHQDVGWF type=write size=3334166 2024-09-19T13:43:01.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.633+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=A432JL4E0USQ type=del size=1525219 2024-09-19T13:43:01.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.634+0000 7f6ab10d2780 1 < completed write operation key=X1JYDG1ASYAR tag=SBX5G4IHLEGY type=write size=734260 2024-09-19T13:43:01.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.635+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=SCBG3N6BEUO9 type=del size=1518581 2024-09-19T13:43:01.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.636+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~ALXI3SS3UETC.0 size=350216 2024-09-19T13:43:01.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.638+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=ALXI3SS3UETC tag=48OA83EJ87ZO type=write size=1398792 2024-09-19T13:43:01.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.639+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=ZCI23EBIJRYM type=del size=2118436 2024-09-19T13:43:01.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.641+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~UVW80G0PXHN1.0 size=1048576 2024-09-19T13:43:01.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.641+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~UVW80G0PXHN1.1 size=419481 2024-09-19T13:43:01.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.643+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=UVW80G0PXHN1 tag=KPSDP7KXL1L4 type=write size=2516633 2024-09-19T13:43:01.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.645+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~CUYYL17UP321.0 size=1048576 2024-09-19T13:43:01.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.646+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~CUYYL17UP321.1 size=1048576 2024-09-19T13:43:01.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.647+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~CUYYL17UP321.2 size=1613 2024-09-19T13:43:01.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.647+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=CUYYL17UP321 tag=GXNI3YYKR05T type=write size=3147341 2024-09-19T13:43:01.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.648+0000 7f6ab10d2780 1 < canceled operation key=X1JYDG1ASYAR tag=OEBOBAR18ZXA type=del size=1156816 2024-09-19T13:43:01.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.650+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~GCH7VU0QZEEO.0 size=1048576 2024-09-19T13:43:01.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.651+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~GCH7VU0QZEEO.1 size=581346 2024-09-19T13:43:01.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.651+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=GCH7VU0QZEEO tag=YSZU09HRETOT type=write size=2678498 2024-09-19T13:43:01.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.651+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~2OPA1R277VRT.0 size=678772 2024-09-19T13:43:01.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.652+0000 7f6ab10d2780 1 < canceled multipart upload key=X8CWBFNCJG6M upload=2OPA1R277VRT tag=FBHYN059VDI1 type=write size=1727348 2024-09-19T13:43:01.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.654+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~6JIU02XH99HD.0 size=1048576 2024-09-19T13:43:01.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.655+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~6JIU02XH99HD.1 size=548114 2024-09-19T13:43:01.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.655+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=6JIU02XH99HD tag=EDAG2SGH16AJ type=write size=2645266 2024-09-19T13:43:01.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.656+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~C4CMGXYXNMTQ.0 size=1048576 2024-09-19T13:43:01.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.657+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~C4CMGXYXNMTQ.1 size=42990 2024-09-19T13:43:01.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.659+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=C4CMGXYXNMTQ tag=AUXXTBRGT5NW type=write size=2140142 2024-09-19T13:43:01.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.661+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~U5TO5O2XTRUY.0 size=837235 2024-09-19T13:43:01.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.661+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=U5TO5O2XTRUY tag=HN29J4V1J61F type=write size=1885811 2024-09-19T13:43:01.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.662+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=SZ3EZC49EERH type=del 2024-09-19T13:43:01.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.664+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~E7DU66C64S6G.0 size=1048576 2024-09-19T13:43:01.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.665+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~E7DU66C64S6G.1 size=1035715 2024-09-19T13:43:01.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.665+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=E7DU66C64S6G tag=FQWR4H9P0IJO type=write size=3132867 2024-09-19T13:43:01.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.666+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~SH1O6CUFPA2U.0 size=344246 2024-09-19T13:43:01.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.668+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=SH1O6CUFPA2U tag=LO175CX5Z9E7 type=write size=1392822 2024-09-19T13:43:01.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.670+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~V1E14LWWS92Z.0 size=1023854 2024-09-19T13:43:01.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.670+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=V1E14LWWS92Z tag=ALJTWQ2MTL4Y type=write size=2072430 2024-09-19T13:43:01.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.672+0000 7f6ab10d2780 1 < suggested remove operation key=9WTLWBONAOET tag=NCXBRI378V3E type=del 2024-09-19T13:43:01.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.674+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~XZMD9T0JFXRQ.0 size=1048576 2024-09-19T13:43:01.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.675+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~XZMD9T0JFXRQ.1 size=667151 2024-09-19T13:43:01.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.675+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=XZMD9T0JFXRQ tag=X3LEJLJSNVWM type=write size=2764303 2024-09-19T13:43:01.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.675+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=9WTLWBONAOET tag=W3P61AVZKZUJ type=write size=254025: (2) No such file or directory 2024-09-19T13:43:01.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.677+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~8LWO8LKLJM4B.0 size=1048576 2024-09-19T13:43:01.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.678+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~8LWO8LKLJM4B.1 size=681433 2024-09-19T13:43:01.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.678+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=8LWO8LKLJM4B tag=GB0SM995Q4C7 type=write size=2778585 2024-09-19T13:43:01.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.679+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=B15LZESKP7RI type=del 2024-09-19T13:43:01.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.681+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~E0EAIM64EW3N.0 size=1048576 2024-09-19T13:43:01.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.682+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~E0EAIM64EW3N.1 size=1048576 2024-09-19T13:43:01.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.683+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~E0EAIM64EW3N.2 size=392882 2024-09-19T13:43:01.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.683+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=E0EAIM64EW3N tag=5FZ0S7XNO3QM type=write size=3538610 2024-09-19T13:43:01.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.684+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=SRP77T711FH3 type=del 2024-09-19T13:43:01.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.686+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~B4ZLN7INJQDE.0 size=1048576 2024-09-19T13:43:01.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.687+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~B4ZLN7INJQDE.1 size=842908 2024-09-19T13:43:01.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.687+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=B4ZLN7INJQDE tag=RADY3UPG4WK3 type=write size=2940060 2024-09-19T13:43:01.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.689+0000 7f6ab10d2780 1 < suggested update operation key=2KX2NSY41STV tag=Q2E14UPJGJEQ type=del size=2301397 2024-09-19T13:43:01.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.691+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~3NLF2DELHL2O.0 size=561722 2024-09-19T13:43:01.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.691+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=3NLF2DELHL2O tag=MXF8DP76Q1A5 type=write size=1610298 2024-09-19T13:43:01.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.692+0000 7f6ab10d2780 1 < canceled operation key=B0J7E7A0NP4J tag=RLQNF1P0EQLL type=del size=1528050 2024-09-19T13:43:01.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.694+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~IX3ZYIQ667Z8.0 size=110877 2024-09-19T13:43:01.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.694+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=IX3ZYIQ667Z8 tag=IX8UIL531TSU type=write size=1159453 2024-09-19T13:43:01.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.695+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=5S8LOBCVM8AF type=del 2024-09-19T13:43:01.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.696+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=1D9PCZ3O2JMC type=del size=654772 2024-09-19T13:43:01.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.697+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=A432JL4E0USQ type=del 2024-09-19T13:43:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.698+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=ZYUJQU7QVN0G type=del size=102586 2024-09-19T13:43:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.700+0000 7f6ab10d2780 1 < suggested remove operation key=RU6OR8SM72GU tag=SCBG3N6BEUO9 type=del 2024-09-19T13:43:01.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.702+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=56E9ICHXRHYD type=del size=3798909 2024-09-19T13:43:01.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.703+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=ZCI23EBIJRYM type=del 2024-09-19T13:43:01.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.704+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=SZ4H0D6OHXZG type=del size=776581 2024-09-19T13:43:01.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.705+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~CUYYL17UP321.0 size=1048576 2024-09-19T13:43:01.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.706+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~CUYYL17UP321.1 size=1048576 2024-09-19T13:43:01.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.707+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~CUYYL17UP321.2 size=1613 2024-09-19T13:43:01.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.708+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=CUYYL17UP321 tag=GXNI3YYKR05T type=write size=3147341 2024-09-19T13:43:01.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.710+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=UK9IRZH8VTC2 type=del size=668678 2024-09-19T13:43:01.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.711+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~GCH7VU0QZEEO.0 size=1048576 2024-09-19T13:43:01.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.711+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~GCH7VU0QZEEO.1 size=581346 2024-09-19T13:43:01.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.713+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=GCH7VU0QZEEO tag=YSZU09HRETOT type=write size=2678498 2024-09-19T13:43:01.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.714+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=ZGPNXD7YB6V4 type=del size=4046485 2024-09-19T13:43:01.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.715+0000 7f6ab10d2780 1 < canceled part key=_multipart_V8P17ZSOQUSM.2~6JIU02XH99HD.0 size=1048576 2024-09-19T13:43:01.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.716+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~6JIU02XH99HD.1 size=548114 2024-09-19T13:43:01.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.718+0000 7f6ab10d2780 1 < canceled multipart upload key=V8P17ZSOQUSM upload=6JIU02XH99HD tag=EDAG2SGH16AJ type=write size=2645266 2024-09-19T13:43:01.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.720+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~PSQIXFKW6Q29.0 size=536238 2024-09-19T13:43:01.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.720+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=PSQIXFKW6Q29 tag=6TJR19YC5K0I type=write size=1584814 2024-09-19T13:43:01.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.721+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~U5TO5O2XTRUY.0 size=837235 2024-09-19T13:43:01.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.722+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=U5TO5O2XTRUY tag=HN29J4V1J61F type=write size=1885811 2024-09-19T13:43:01.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.724+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~C9AIUT5NUJSI.0 size=570954 2024-09-19T13:43:01.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.724+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=C9AIUT5NUJSI tag=5LSO5N7YKLF4 type=write size=1619530 2024-09-19T13:43:01.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.727+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~E7DU66C64S6G.0 size=1048576 2024-09-19T13:43:01.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.728+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~E7DU66C64S6G.1 size=1035715 2024-09-19T13:43:01.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.730+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=E7DU66C64S6G tag=FQWR4H9P0IJO type=write size=3132867 2024-09-19T13:43:01.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.731+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=LWODJ6T9E78Q type=del size=2437951 2024-09-19T13:43:01.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.731+0000 7f6ab10d2780 1 < canceled part key=_multipart_9Q9DGUSDSE49.2~V1E14LWWS92Z.0 size=1023854 2024-09-19T13:43:01.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.733+0000 7f6ab10d2780 1 < canceled multipart upload key=9Q9DGUSDSE49 upload=V1E14LWWS92Z tag=ALJTWQ2MTL4Y type=write size=2072430 2024-09-19T13:43:01.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.734+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=CY0F6FU6KU16 type=del size=2056920 2024-09-19T13:43:01.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.735+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~XZMD9T0JFXRQ.0 size=1048576 2024-09-19T13:43:01.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.736+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~XZMD9T0JFXRQ.1 size=667151 2024-09-19T13:43:01.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.738+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=XZMD9T0JFXRQ tag=X3LEJLJSNVWM type=write size=2764303 2024-09-19T13:43:01.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.739+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~VQGBW80C4O3V.0 size=104742 2024-09-19T13:43:01.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.739+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=VQGBW80C4O3V tag=MI4J1FEGIANN type=write size=1153318 2024-09-19T13:43:01.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.741+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~8LWO8LKLJM4B.0 size=1048576 2024-09-19T13:43:01.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.741+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~8LWO8LKLJM4B.1 size=681433 2024-09-19T13:43:01.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.743+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=8LWO8LKLJM4B tag=GB0SM995Q4C7 type=write size=2778585 2024-09-19T13:43:01.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.744+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=WGGEEIVLCYGZ type=del size=2789392 2024-09-19T13:43:01.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.745+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~E0EAIM64EW3N.0 size=1048576 2024-09-19T13:43:01.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.746+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~E0EAIM64EW3N.1 size=1048576 2024-09-19T13:43:01.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.747+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~E0EAIM64EW3N.2 size=392882 2024-09-19T13:43:01.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.749+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=E0EAIM64EW3N tag=5FZ0S7XNO3QM type=write size=3538610 2024-09-19T13:43:01.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.751+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~3AZ62KJF1S19.0 size=599942 2024-09-19T13:43:01.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.751+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=3AZ62KJF1S19 tag=PDSHCQCOW0GU type=write size=1648518 2024-09-19T13:43:01.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.752+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~B4ZLN7INJQDE.0 size=1048576 2024-09-19T13:43:01.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.753+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~B4ZLN7INJQDE.1 size=842908 2024-09-19T13:43:01.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.755+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=B4ZLN7INJQDE tag=RADY3UPG4WK3 type=write size=2940060 2024-09-19T13:43:01.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.756+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=DM0TQ8GT8UWD type=del size=2353038 2024-09-19T13:43:01.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.757+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~3NLF2DELHL2O.0 size=561722 2024-09-19T13:43:01.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.759+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=3NLF2DELHL2O tag=MXF8DP76Q1A5 type=write size=1610298 2024-09-19T13:43:01.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.761+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~PJF1T1F9VZT1.0 size=1048576 2024-09-19T13:43:01.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.762+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~PJF1T1F9VZT1.1 size=1003232 2024-09-19T13:43:01.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.762+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=PJF1T1F9VZT1 tag=IQNKRRMXSLO3 type=write size=3100384 2024-09-19T13:43:01.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.763+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~IX3ZYIQ667Z8.0 size=110877 2024-09-19T13:43:01.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.764+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=IX3ZYIQ667Z8 tag=IX8UIL531TSU type=write size=1159453 2024-09-19T13:43:01.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.766+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=C24S5X1EUTP3 type=del size=2971657 2024-09-19T13:43:01.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.767+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=1D9PCZ3O2JMC type=del 2024-09-19T13:43:01.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.768+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=DZBSDMAF6MEX type=del size=1898252 2024-09-19T13:43:01.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.769+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=ZYUJQU7QVN0G type=del 2024-09-19T13:43:01.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.771+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~Y0TLT4NLTW5X.0 size=1048576 2024-09-19T13:43:01.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.772+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~Y0TLT4NLTW5X.1 size=1043068 2024-09-19T13:43:01.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.772+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=Y0TLT4NLTW5X tag=FCZ6UVFIGBPB type=write size=3140220 2024-09-19T13:43:01.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.773+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=56E9ICHXRHYD type=del 2024-09-19T13:43:01.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.775+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~GM61LUOL8B2J.0 size=260742 2024-09-19T13:43:01.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.775+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=GM61LUOL8B2J tag=HJ5B2MNIVPG3 type=write size=1309318 2024-09-19T13:43:01.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.776+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=SZ4H0D6OHXZG type=del 2024-09-19T13:43:01.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.777+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=5MY3GSG7WWCG type=del size=1513531 2024-09-19T13:43:01.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.778+0000 7f6ab10d2780 1 < canceled operation key=EE8F84K0ZAGJ tag=UK9IRZH8VTC2 type=del size=668678 2024-09-19T13:43:01.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.779+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=7FNDMSOB8YR1 type=del size=2445955 2024-09-19T13:43:01.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.781+0000 7f6ab10d2780 1 < canceled operation key=V8P17ZSOQUSM tag=ZGPNXD7YB6V4 type=del size=4046485 2024-09-19T13:43:01.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.782+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=7CCJYNQEV0FP type=write size=962788 2024-09-19T13:43:01.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.783+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~PSQIXFKW6Q29.0 size=536238 2024-09-19T13:43:01.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.785+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=PSQIXFKW6Q29 tag=6TJR19YC5K0I type=write size=1584814 2024-09-19T13:43:01.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.786+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=7HEQM4MGJGAC type=del size=4024372 2024-09-19T13:43:01.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.787+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~C9AIUT5NUJSI.0 size=570954 2024-09-19T13:43:01.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.789+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=C9AIUT5NUJSI tag=5LSO5N7YKLF4 type=write size=1619530 2024-09-19T13:43:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.790+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=0AATFQABW7YH type=del size=2920289 2024-09-19T13:43:01.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.791+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=LWODJ6T9E78Q type=del size=2437951 2024-09-19T13:43:01.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.794+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~12UQWPP4W75X.0 size=1048576 2024-09-19T13:43:01.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.795+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~12UQWPP4W75X.1 size=1048576 2024-09-19T13:43:01.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.796+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~12UQWPP4W75X.2 size=471759 2024-09-19T13:43:01.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.796+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=12UQWPP4W75X tag=KEA9VQH32UF3 type=write size=3617487 2024-09-19T13:43:01.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.797+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=CY0F6FU6KU16 type=del 2024-09-19T13:43:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.799+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~JMX55FRJSBLR.0 size=1048576 2024-09-19T13:43:01.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.799+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~JMX55FRJSBLR.1 size=1048576 2024-09-19T13:43:01.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.800+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~JMX55FRJSBLR.2 size=995137 2024-09-19T13:43:01.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.800+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=JMX55FRJSBLR tag=ZXYNC297O9M1 type=write size=4140865 2024-09-19T13:43:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.802+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~VQGBW80C4O3V.0 size=104742 2024-09-19T13:43:01.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.803+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=VQGBW80C4O3V tag=MI4J1FEGIANN type=write size=1153318 2024-09-19T13:43:01.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.804+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=TE3RV5NAY0X1 type=del size=1244147 2024-09-19T13:43:01.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.806+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=WGGEEIVLCYGZ type=del 2024-09-19T13:43:01.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.807+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=HHR8G5GVRA1E type=del size=3204006 2024-09-19T13:43:01.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.808+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~3AZ62KJF1S19.0 size=599942 2024-09-19T13:43:01.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.810+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=3AZ62KJF1S19 tag=PDSHCQCOW0GU type=write size=1648518 2024-09-19T13:43:01.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.811+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=ISC89T38R5VQ type=del size=2368593 2024-09-19T13:43:01.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.812+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=DM0TQ8GT8UWD type=del 2024-09-19T13:43:01.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.813+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=O5ZDNNPFQUX5 type=del size=2890307 2024-09-19T13:43:01.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.815+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~PJF1T1F9VZT1.0 size=1048576 2024-09-19T13:43:01.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.815+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~PJF1T1F9VZT1.1 size=1003232 2024-09-19T13:43:01.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.817+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=PJF1T1F9VZT1 tag=IQNKRRMXSLO3 type=write size=3100384 2024-09-19T13:43:01.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.819+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~3ZDA1N31VW2X.0 size=369966 2024-09-19T13:43:01.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.819+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=3ZDA1N31VW2X tag=O37XG7HIJUCA type=write size=1418542 2024-09-19T13:43:01.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.821+0000 7f6ab10d2780 1 < suggested update operation key=B0J7E7A0NP4J tag=C24S5X1EUTP3 type=del size=2971657 2024-09-19T13:43:01.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.823+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~X2RS6SLCQBGB.0 size=1048576 2024-09-19T13:43:01.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.824+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~X2RS6SLCQBGB.1 size=811828 2024-09-19T13:43:01.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.824+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=X2RS6SLCQBGB tag=2KTGS52365QM type=write size=2908980 2024-09-19T13:43:01.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.825+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=DZBSDMAF6MEX type=del 2024-09-19T13:43:01.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.827+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=ZPCGRIVIV603 type=del size=3179102 2024-09-19T13:43:01.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.828+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~Y0TLT4NLTW5X.0 size=1048576 2024-09-19T13:43:01.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.830+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~Y0TLT4NLTW5X.1 size=1043068 2024-09-19T13:43:01.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.832+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=Y0TLT4NLTW5X tag=FCZ6UVFIGBPB type=write size=3140220 2024-09-19T13:43:01.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.833+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=W9Z3NP3DDNN1 type=write size=731105 2024-09-19T13:43:01.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.835+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~GM61LUOL8B2J.0 size=260742 2024-09-19T13:43:01.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.837+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=GM61LUOL8B2J tag=HJ5B2MNIVPG3 type=write size=1309318 2024-09-19T13:43:01.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.838+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=RQTMZYNGII8B type=del size=1723120 2024-09-19T13:43:01.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.840+0000 7f6ab10d2780 1 < suggested remove operation key=SDQ64HOD22EM tag=5MY3GSG7WWCG type=del 2024-09-19T13:43:01.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.841+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=Q1HL33TR9C1P type=del size=3273692 2024-09-19T13:43:01.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.842+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=7FNDMSOB8YR1 type=del 2024-09-19T13:43:01.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.844+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=S78V87PTI6BD type=del size=3158048 2024-09-19T13:43:01.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.845+0000 7f6ab10d2780 1 < completed write operation key=SRABG45EPVN2 tag=7CCJYNQEV0FP type=write size=962788 2024-09-19T13:43:01.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.847+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~DIA2LWT55WHZ.0 size=1048576 2024-09-19T13:43:01.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.848+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~DIA2LWT55WHZ.1 size=78270 2024-09-19T13:43:01.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.848+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=DIA2LWT55WHZ tag=9LO13T5ZH3M8 type=write size=2175422 2024-09-19T13:43:01.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.850+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=7HEQM4MGJGAC type=del size=4024372 2024-09-19T13:43:01.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.852+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~AJQ5TEHPVA3B.0 size=490398 2024-09-19T13:43:01.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.852+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=AJQ5TEHPVA3B tag=YL2DRSN2YTEL type=write size=1538974 2024-09-19T13:43:01.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.853+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=0AATFQABW7YH type=del 2024-09-19T13:43:01.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.854+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=QFM5FD01270M type=write size=197246 2024-09-19T13:43:01.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.855+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~12UQWPP4W75X.0 size=1048576 2024-09-19T13:43:01.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.856+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~12UQWPP4W75X.1 size=1048576 2024-09-19T13:43:01.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.857+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~12UQWPP4W75X.2 size=471759 2024-09-19T13:43:01.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.859+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=12UQWPP4W75X tag=KEA9VQH32UF3 type=write size=3617487 2024-09-19T13:43:01.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.860+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=QFZRQPGW5KUS type=del size=847681 2024-09-19T13:43:01.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.861+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~JMX55FRJSBLR.0 size=1048576 2024-09-19T13:43:01.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.862+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~JMX55FRJSBLR.1 size=1048576 2024-09-19T13:43:01.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.863+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~JMX55FRJSBLR.2 size=995137 2024-09-19T13:43:01.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.865+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=JMX55FRJSBLR tag=ZXYNC297O9M1 type=write size=4140865 2024-09-19T13:43:01.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.866+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=GGDWDNYCPZ3L type=write size=315834 2024-09-19T13:43:01.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.868+0000 7f6ab10d2780 1 < suggested update operation key=QTGKMAOX2A6U tag=TE3RV5NAY0X1 type=del size=1244147 2024-09-19T13:43:01.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.869+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=DO9OLRGEDG0N type=del size=1788520 2024-09-19T13:43:01.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.870+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=HHR8G5GVRA1E type=del 2024-09-19T13:43:01.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.872+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~LGIN4G2PIAK2.0 size=1048576 2024-09-19T13:43:01.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.873+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~LGIN4G2PIAK2.1 size=615911 2024-09-19T13:43:01.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.873+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=LGIN4G2PIAK2 tag=O4GRXMBY2A0I type=write size=2713063 2024-09-19T13:43:01.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.875+0000 7f6ab10d2780 1 < suggested remove operation key=TCXAYADSCTZI tag=ISC89T38R5VQ type=del 2024-09-19T13:43:01.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.877+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~I39PGNKASGHR.0 size=1048576 2024-09-19T13:43:01.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.878+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~I39PGNKASGHR.1 size=802817 2024-09-19T13:43:01.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.878+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=I39PGNKASGHR tag=GN1YKLLMEL9S type=write size=2899969 2024-09-19T13:43:01.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.879+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=O5ZDNNPFQUX5 type=del 2024-09-19T13:43:01.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.881+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=TQNB8UYGRHXA type=write size=112713 2024-09-19T13:43:01.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.882+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~3ZDA1N31VW2X.0 size=369966 2024-09-19T13:43:01.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.884+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=3ZDA1N31VW2X tag=O37XG7HIJUCA type=write size=1418542 2024-09-19T13:43:01.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.885+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=NKR21RB0CLMZ type=del size=1920183 2024-09-19T13:43:01.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.886+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~X2RS6SLCQBGB.0 size=1048576 2024-09-19T13:43:01.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.887+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~X2RS6SLCQBGB.1 size=811828 2024-09-19T13:43:01.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.889+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=X2RS6SLCQBGB tag=2KTGS52365QM type=write size=2908980 2024-09-19T13:43:01.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.890+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=7J65UG3SLQVX type=del size=1974601 2024-09-19T13:43:01.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.892+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=ZPCGRIVIV603 type=del 2024-09-19T13:43:01.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.893+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=VSYFHHDGFR0N type=del size=3806019 2024-09-19T13:43:01.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.894+0000 7f6ab10d2780 1 < completed write operation key=B0J7E7A0NP4J tag=W9Z3NP3DDNN1 type=write size=731105 2024-09-19T13:43:01.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.895+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=48WPHRXGRRY3 type=del size=2506640 2024-09-19T13:43:01.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.896+0000 7f6ab10d2780 -1 < failed to complete operation key=QTGKMAOX2A6U tag=RQTMZYNGII8B type=del size=1723120: (22) Invalid argument 2024-09-19T13:43:01.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.897+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=ZJ8LEBFHXZ13 type=del size=2531416 2024-09-19T13:43:01.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.898+0000 7f6ab10d2780 -1 < failed to complete operation key=QTGKMAOX2A6U tag=Q1HL33TR9C1P type=del size=3273692: (22) Invalid argument 2024-09-19T13:43:01.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.900+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=RDNG0WSPQZZZ type=write size=302155 2024-09-19T13:43:01.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.901+0000 7f6ab10d2780 -1 < failed to complete operation key=TCXAYADSCTZI tag=S78V87PTI6BD type=del size=3158048: (22) Invalid argument 2024-09-19T13:43:01.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.903+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~MAED9VX744NK.0 size=519754 2024-09-19T13:43:01.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.903+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=MAED9VX744NK tag=3TCDYOLGF3L4 type=write size=1568330 2024-09-19T13:43:01.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.904+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~DIA2LWT55WHZ.0 size=1048576 2024-09-19T13:43:01.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.905+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~DIA2LWT55WHZ.1 size=78270 2024-09-19T13:43:01.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.907+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=DIA2LWT55WHZ tag=9LO13T5ZH3M8 type=write size=2175422 2024-09-19T13:43:01.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.908+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=WNM5W6QRC0KF type=del size=752127 2024-09-19T13:43:01.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.909+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~AJQ5TEHPVA3B.0 size=490398 2024-09-19T13:43:01.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.911+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=AJQ5TEHPVA3B tag=YL2DRSN2YTEL type=write size=1538974 2024-09-19T13:43:01.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.912+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=TFF3VRZD4PTP type=del size=442393 2024-09-19T13:43:01.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.915+0000 7f6ab10d2780 1 < suggested remove operation key=P2U09V0G7UUU tag=QFM5FD01270M type=write 2024-09-19T13:43:01.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.916+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=YVUDEED9ONAT type=del size=1123496 2024-09-19T13:43:01.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.918+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=QFZRQPGW5KUS type=del size=847681 2024-09-19T13:43:01.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.919+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=7E619XHEDUU1 type=write size=785857 2024-09-19T13:43:01.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.920+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=GGDWDNYCPZ3L type=write size=315834 2024-09-19T13:43:01.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.921+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=SVQN2LXQGBV5 type=del size=3178325 2024-09-19T13:43:01.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.923+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=DO9OLRGEDG0N type=del 2024-09-19T13:43:01.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.924+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=5WJ3T1YEAO2M type=del size=2727522 2024-09-19T13:43:01.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.925+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~LGIN4G2PIAK2.0 size=1048576 2024-09-19T13:43:01.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.926+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~LGIN4G2PIAK2.1 size=615911 2024-09-19T13:43:01.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.927+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=LGIN4G2PIAK2 tag=O4GRXMBY2A0I type=write size=2713063 2024-09-19T13:43:01.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.930+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~VTN9623IAQCW.0 size=1048576 2024-09-19T13:43:01.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.931+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~VTN9623IAQCW.1 size=976923 2024-09-19T13:43:01.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.931+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=VTN9623IAQCW tag=JOTXECEC5OKB type=write size=3074075 2024-09-19T13:43:01.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.931+0000 7f6ab10d2780 1 < canceled part key=_multipart_SRABG45EPVN2.2~I39PGNKASGHR.0 size=1048576 2024-09-19T13:43:01.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.932+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~I39PGNKASGHR.1 size=802817 2024-09-19T13:43:01.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.934+0000 7f6ab10d2780 1 < canceled multipart upload key=SRABG45EPVN2 upload=I39PGNKASGHR tag=GN1YKLLMEL9S type=write size=2899969 2024-09-19T13:43:01.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.936+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~E7G8T2P9HN74.0 size=1048576 2024-09-19T13:43:01.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.938+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~E7G8T2P9HN74.1 size=416822 2024-09-19T13:43:01.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.938+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=E7G8T2P9HN74 tag=GNUG0SJKRHRT type=write size=2513974 2024-09-19T13:43:01.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.939+0000 7f6ab10d2780 1 < canceled operation key=9IN6E0JQFNAU tag=TQNB8UYGRHXA type=write size=112713 2024-09-19T13:43:01.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.941+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~GQTRFX2EMTJ3.0 size=1048576 2024-09-19T13:43:01.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.942+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~GQTRFX2EMTJ3.1 size=1048576 2024-09-19T13:43:01.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.943+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~GQTRFX2EMTJ3.2 size=654384 2024-09-19T13:43:01.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.943+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=GQTRFX2EMTJ3 tag=U9B3FI04726X type=write size=3800112 2024-09-19T13:43:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.944+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=NKR21RB0CLMZ type=del 2024-09-19T13:43:01.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.946+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~A2D7ZABNGQ6I.0 size=1048576 2024-09-19T13:43:01.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.947+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~A2D7ZABNGQ6I.1 size=178923 2024-09-19T13:43:01.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.947+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=A2D7ZABNGQ6I tag=CYM6AUFSRGVG type=write size=2276075 2024-09-19T13:43:01.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.948+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=7J65UG3SLQVX type=del 2024-09-19T13:43:01.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.950+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=R3W0VQZBHXOD type=write size=833492 2024-09-19T13:43:01.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.951+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=VSYFHHDGFR0N type=del 2024-09-19T13:43:01.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.953+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~3RVND5W45XE3.0 size=1048576 2024-09-19T13:43:01.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.954+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~3RVND5W45XE3.1 size=1048576 2024-09-19T13:43:01.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.955+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~3RVND5W45XE3.2 size=405680 2024-09-19T13:43:01.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.955+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=3RVND5W45XE3 tag=TMBGKS3T5L1W type=write size=3551408 2024-09-19T13:43:01.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.956+0000 7f6ab10d2780 1 < canceled operation key=QTGKMAOX2A6U tag=48WPHRXGRRY3 type=del size=2506640 2024-09-19T13:43:01.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.957+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=6C7G691123KM type=write size=907332 2024-09-19T13:43:01.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.958+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=ZJ8LEBFHXZ13 type=del 2024-09-19T13:43:01.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.960+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=TK4WLUPBTU9D type=del size=789643 2024-09-19T13:43:01.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.961+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=RDNG0WSPQZZZ type=write size=302155 2024-09-19T13:43:01.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.963+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~W6PL7FW2OMK8.0 size=1011442 2024-09-19T13:43:01.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.963+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=W6PL7FW2OMK8 tag=FJ7BLFI8B1X7 type=write size=2060018 2024-09-19T13:43:01.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.964+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~MAED9VX744NK.0 size=519754 2024-09-19T13:43:01.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.966+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=MAED9VX744NK tag=3TCDYOLGF3L4 type=write size=1568330 2024-09-19T13:43:01.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.968+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~JA36YSXRVBEM.0 size=1048576 2024-09-19T13:43:01.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.969+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~JA36YSXRVBEM.1 size=1048576 2024-09-19T13:43:01.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.970+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~JA36YSXRVBEM.2 size=140987 2024-09-19T13:43:01.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.970+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=JA36YSXRVBEM tag=8U8GC2LOIHV6 type=write size=3286715 2024-09-19T13:43:01.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.971+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=WNM5W6QRC0KF type=del 2024-09-19T13:43:01.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.972+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=0A4WI449YBR0 type=del size=2916858 2024-09-19T13:43:01.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.973+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=TFF3VRZD4PTP type=del 2024-09-19T13:43:01.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.975+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~K11YH5WBF369.0 size=1048576 2024-09-19T13:43:01.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.976+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~K11YH5WBF369.1 size=483055 2024-09-19T13:43:01.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.976+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=K11YH5WBF369 tag=TFY2PT7BVIC0 type=write size=2580207 2024-09-19T13:43:01.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.977+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=YVUDEED9ONAT type=del 2024-09-19T13:43:01.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.978+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=O6W88W6DX2EV type=write size=295200 2024-09-19T13:43:01.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.979+0000 7f6ab10d2780 1 < completed write operation key=RU6OR8SM72GU tag=7E619XHEDUU1 type=write size=785857 2024-09-19T13:43:01.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.981+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~LKG3Y31416R7.0 size=86600 2024-09-19T13:43:01.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.981+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=LKG3Y31416R7 tag=TBRQPNCHP234 type=write size=1135176 2024-09-19T13:43:01.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.982+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=SVQN2LXQGBV5 type=del 2024-09-19T13:43:01.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.984+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~60VGM8R1Q0S7.0 size=482799 2024-09-19T13:43:01.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.984+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=60VGM8R1Q0S7 tag=9ITRJ65HE31T type=write size=1531375 2024-09-19T13:43:01.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.985+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=5WJ3T1YEAO2M type=del 2024-09-19T13:43:01.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.987+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~AH7Q1L66P05R.0 size=1048576 2024-09-19T13:43:01.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.988+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~AH7Q1L66P05R.1 size=867266 2024-09-19T13:43:01.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.988+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=AH7Q1L66P05R tag=N981ROUSFCM7 type=write size=2964418 2024-09-19T13:43:01.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.989+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~VTN9623IAQCW.0 size=1048576 2024-09-19T13:43:01.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.990+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~VTN9623IAQCW.1 size=976923 2024-09-19T13:43:01.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.992+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=VTN9623IAQCW tag=JOTXECEC5OKB type=write size=3074075 2024-09-19T13:43:01.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.994+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~N7MIK3CJ18IG.0 size=1048576 2024-09-19T13:43:01.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.995+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~N7MIK3CJ18IG.1 size=1048576 2024-09-19T13:43:01.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.996+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~N7MIK3CJ18IG.2 size=519682 2024-09-19T13:43:01.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.996+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=N7MIK3CJ18IG tag=ZX5WIZAOGZDR type=write size=3665410 2024-09-19T13:43:01.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.997+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~E7G8T2P9HN74.0 size=1048576 2024-09-19T13:43:02.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:01.998+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~E7G8T2P9HN74.1 size=416822 2024-09-19T13:43:02.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.000+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=E7G8T2P9HN74 tag=GNUG0SJKRHRT type=write size=2513974 2024-09-19T13:43:02.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.001+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=1SCFVOEN4NE8 type=del size=1950870 2024-09-19T13:43:02.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.001+0000 7f6ab10d2780 1 < canceled part key=_multipart_DTSRVH526PE7.2~GQTRFX2EMTJ3.0 size=1048576 2024-09-19T13:43:02.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.002+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~GQTRFX2EMTJ3.1 size=1048576 2024-09-19T13:43:02.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.003+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~GQTRFX2EMTJ3.2 size=654384 2024-09-19T13:43:02.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.005+0000 7f6ab10d2780 1 < canceled multipart upload key=DTSRVH526PE7 upload=GQTRFX2EMTJ3 tag=U9B3FI04726X type=write size=3800112 2024-09-19T13:43:02.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.007+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~V9DMVHCEODEU.0 size=1048576 2024-09-19T13:43:02.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.008+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~V9DMVHCEODEU.1 size=1048576 2024-09-19T13:43:02.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.009+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~V9DMVHCEODEU.2 size=656214 2024-09-19T13:43:02.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.009+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=V9DMVHCEODEU tag=Q959WW7EDFL2 type=write size=3801942 2024-09-19T13:43:02.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.009+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~A2D7ZABNGQ6I.0 size=1048576 2024-09-19T13:43:02.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.009+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~A2D7ZABNGQ6I.1 size=178923 2024-09-19T13:43:02.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.011+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=A2D7ZABNGQ6I tag=CYM6AUFSRGVG type=write size=2276075 2024-09-19T13:43:02.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.012+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=ICS1JDYZNZKS type=del size=393253 2024-09-19T13:43:02.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.013+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=R3W0VQZBHXOD type=write size=833492 2024-09-19T13:43:02.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.014+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=QQQVMQ1LVPY6 type=del size=1491745 2024-09-19T13:43:02.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.015+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~3RVND5W45XE3.0 size=1048576 2024-09-19T13:43:02.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.016+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~3RVND5W45XE3.1 size=1048576 2024-09-19T13:43:02.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.017+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~3RVND5W45XE3.2 size=405680 2024-09-19T13:43:02.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.019+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=3RVND5W45XE3 tag=TMBGKS3T5L1W type=write size=3551408 2024-09-19T13:43:02.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.021+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~14R6TO7CMKB4.0 size=1048576 2024-09-19T13:43:02.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.022+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~14R6TO7CMKB4.1 size=1048576 2024-09-19T13:43:02.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.023+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~14R6TO7CMKB4.2 size=185049 2024-09-19T13:43:02.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.023+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=14R6TO7CMKB4 tag=U0V21EJKZHLT type=write size=3330777 2024-09-19T13:43:02.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.024+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=6C7G691123KM type=write size=907332 2024-09-19T13:43:02.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.025+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=H39IOU7ROD3R type=del size=2256400 2024-09-19T13:43:02.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.026+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=TK4WLUPBTU9D type=del 2024-09-19T13:43:02.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.028+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~5RFCO2WIMGZN.0 size=1048576 2024-09-19T13:43:02.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.029+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~5RFCO2WIMGZN.1 size=1048576 2024-09-19T13:43:02.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.030+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~5RFCO2WIMGZN.2 size=957285 2024-09-19T13:43:02.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.030+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=5RFCO2WIMGZN tag=NS8QDZ4XMZ5S type=write size=4103013 2024-09-19T13:43:02.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.030+0000 7f6ab10d2780 1 < canceled part key=_multipart_WDRUV5ERI000.2~W6PL7FW2OMK8.0 size=1011442 2024-09-19T13:43:02.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.032+0000 7f6ab10d2780 1 < canceled multipart upload key=WDRUV5ERI000 upload=W6PL7FW2OMK8 tag=FJ7BLFI8B1X7 type=write size=2060018 2024-09-19T13:43:02.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.033+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=VP62UQNN3JFA type=del size=1294355 2024-09-19T13:43:02.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.034+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~JA36YSXRVBEM.0 size=1048576 2024-09-19T13:43:02.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.035+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~JA36YSXRVBEM.1 size=1048576 2024-09-19T13:43:02.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.036+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~JA36YSXRVBEM.2 size=140987 2024-09-19T13:43:02.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.038+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=JA36YSXRVBEM tag=8U8GC2LOIHV6 type=write size=3286715 2024-09-19T13:43:02.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.039+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=ZQLD0B1WG7LT type=del size=2243159 2024-09-19T13:43:02.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.041+0000 7f6ab10d2780 1 < canceled operation key=DTSRVH526PE7 tag=0A4WI449YBR0 type=del size=2916858 2024-09-19T13:43:02.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.043+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~3CAJZ24IRIHD.0 size=980033 2024-09-19T13:43:02.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.043+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=3CAJZ24IRIHD tag=RGIDV0NFN24V type=write size=2028609 2024-09-19T13:43:02.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.044+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~K11YH5WBF369.0 size=1048576 2024-09-19T13:43:02.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.045+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~K11YH5WBF369.1 size=483055 2024-09-19T13:43:02.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.047+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=K11YH5WBF369 tag=TFY2PT7BVIC0 type=write size=2580207 2024-09-19T13:43:02.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.049+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~8BMTS76X88AF.0 size=263585 2024-09-19T13:43:02.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.049+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=8BMTS76X88AF tag=8UJITXVRHGCD type=write size=1312161 2024-09-19T13:43:02.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.050+0000 7f6ab10d2780 1 < completed write operation key=A14YTABJ1Z3Z tag=O6W88W6DX2EV type=write size=295200 2024-09-19T13:43:02.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.051+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=AKDFXLYB58P8 type=del size=1812 2024-09-19T13:43:02.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.053+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~LKG3Y31416R7.0 size=86600 2024-09-19T13:43:02.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.054+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=LKG3Y31416R7 tag=TBRQPNCHP234 type=write size=1135176 2024-09-19T13:43:02.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.056+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=220UTOO3JJVT type=del size=624534 2024-09-19T13:43:02.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.057+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~60VGM8R1Q0S7.0 size=482799 2024-09-19T13:43:02.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.058+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=60VGM8R1Q0S7 tag=9ITRJ65HE31T type=write size=1531375 2024-09-19T13:43:02.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.060+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=9XKSYS5KN6NM type=del size=4078877 2024-09-19T13:43:02.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.061+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~AH7Q1L66P05R.0 size=1048576 2024-09-19T13:43:02.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.061+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~AH7Q1L66P05R.1 size=867266 2024-09-19T13:43:02.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.062+0000 7f6ab10d2780 1 < canceled multipart upload key=9MCE8PXHBGNF upload=AH7Q1L66P05R tag=N981ROUSFCM7 type=write size=2964418 2024-09-19T13:43:02.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.063+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=VNWQKVWPAB2E type=del size=3504959 2024-09-19T13:43:02.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.065+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~N7MIK3CJ18IG.0 size=1048576 2024-09-19T13:43:02.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.065+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~N7MIK3CJ18IG.1 size=1048576 2024-09-19T13:43:02.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.066+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~N7MIK3CJ18IG.2 size=519682 2024-09-19T13:43:02.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.068+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=N7MIK3CJ18IG tag=ZX5WIZAOGZDR type=write size=3665410 2024-09-19T13:43:02.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.069+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=NTNXDNDEZ78J type=del size=1514986 2024-09-19T13:43:02.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.070+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=1SCFVOEN4NE8 type=del 2024-09-19T13:43:02.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.071+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=VWOZ4FEKQDG2 type=del size=2817342 2024-09-19T13:43:02.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.073+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~V9DMVHCEODEU.0 size=1048576 2024-09-19T13:43:02.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.073+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~V9DMVHCEODEU.1 size=1048576 2024-09-19T13:43:02.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.074+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~V9DMVHCEODEU.2 size=656214 2024-09-19T13:43:02.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.076+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=V9DMVHCEODEU tag=Q959WW7EDFL2 type=write size=3801942 2024-09-19T13:43:02.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.077+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=1LH1T3RB6AW8 type=del size=692133 2024-09-19T13:43:02.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.079+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=ICS1JDYZNZKS type=del size=393253 2024-09-19T13:43:02.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.080+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=MA24LQRWO8ET type=write size=485246 2024-09-19T13:43:02.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.081+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=QQQVMQ1LVPY6 type=del 2024-09-19T13:43:02.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.082+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=69D9O43DNX1X type=del size=2457724 2024-09-19T13:43:02.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.083+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~14R6TO7CMKB4.0 size=1048576 2024-09-19T13:43:02.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.084+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~14R6TO7CMKB4.1 size=1048576 2024-09-19T13:43:02.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.085+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~14R6TO7CMKB4.2 size=185049 2024-09-19T13:43:02.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.087+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=14R6TO7CMKB4 tag=U0V21EJKZHLT type=write size=3330777 2024-09-19T13:43:02.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.089+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~0ZZ8KF8IRKP9.0 size=1048576 2024-09-19T13:43:02.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.090+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~0ZZ8KF8IRKP9.1 size=817551 2024-09-19T13:43:02.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.090+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=0ZZ8KF8IRKP9 tag=M7JO5VIBNBDG type=write size=2914703 2024-09-19T13:43:02.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.091+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=H39IOU7ROD3R type=del 2024-09-19T13:43:02.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.093+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=TEYLBU02TS71 type=del size=1729005 2024-09-19T13:43:02.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.094+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~5RFCO2WIMGZN.0 size=1048576 2024-09-19T13:43:02.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.094+0000 7f6ab10d2780 1 < canceled part key=_multipart_DTSRVH526PE7.2~5RFCO2WIMGZN.1 size=1048576 2024-09-19T13:43:02.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.095+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~5RFCO2WIMGZN.2 size=957285 2024-09-19T13:43:02.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.097+0000 7f6ab10d2780 1 < canceled multipart upload key=DTSRVH526PE7 upload=5RFCO2WIMGZN tag=NS8QDZ4XMZ5S type=write size=4103013 2024-09-19T13:43:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.099+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~J5OSV7XYWLN9.0 size=605355 2024-09-19T13:43:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.099+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=J5OSV7XYWLN9 tag=0OE9YW54S603 type=write size=1653931 2024-09-19T13:43:02.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.100+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=VP62UQNN3JFA type=del 2024-09-19T13:43:02.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.101+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=EYQP238C9D1I type=del size=1491430 2024-09-19T13:43:02.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.103+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=ZQLD0B1WG7LT type=del 2024-09-19T13:43:02.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.104+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=PJWD0Z22OIAT type=del size=3987333 2024-09-19T13:43:02.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.105+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~3CAJZ24IRIHD.0 size=980033 2024-09-19T13:43:02.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.107+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=3CAJZ24IRIHD tag=RGIDV0NFN24V type=write size=2028609 2024-09-19T13:43:02.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.109+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~WBJ3Q8QJBN1S.0 size=1048576 2024-09-19T13:43:02.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.110+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~WBJ3Q8QJBN1S.1 size=1048576 2024-09-19T13:43:02.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.111+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~WBJ3Q8QJBN1S.2 size=238576 2024-09-19T13:43:02.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.111+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=WBJ3Q8QJBN1S tag=H4HGA1UYGHFO type=write size=3384304 2024-09-19T13:43:02.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.112+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~8BMTS76X88AF.0 size=263585 2024-09-19T13:43:02.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.114+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=8BMTS76X88AF tag=8UJITXVRHGCD type=write size=1312161 2024-09-19T13:43:02.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.115+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=7ZH5BJ921N2T type=write size=283272 2024-09-19T13:43:02.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.116+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=AKDFXLYB58P8 type=del 2024-09-19T13:43:02.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.117+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=KKUE2V88TLSX type=del size=2879413 2024-09-19T13:43:02.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.119+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=220UTOO3JJVT type=del 2024-09-19T13:43:02.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.120+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=L91LVACFAL44 type=del size=1912406 2024-09-19T13:43:02.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.122+0000 7f6ab10d2780 1 < suggested remove operation key=VFJIKOLYI0HN tag=9XKSYS5KN6NM type=del 2024-09-19T13:43:02.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.124+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~VQUID9UXL0FO.0 size=1048576 2024-09-19T13:43:02.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.125+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~VQUID9UXL0FO.1 size=1048576 2024-09-19T13:43:02.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.126+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~VQUID9UXL0FO.2 size=936124 2024-09-19T13:43:02.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.126+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=VQUID9UXL0FO tag=0321H5GHB63W type=write size=4081852 2024-09-19T13:43:02.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.127+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=VNWQKVWPAB2E type=del 2024-09-19T13:43:02.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.128+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=LKBPJ7FCO63S type=write size=956595 2024-09-19T13:43:02.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.129+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=NTNXDNDEZ78J type=del 2024-09-19T13:43:02.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.131+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=3F8S5A3BY9AE type=del size=871490 2024-09-19T13:43:02.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.132+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=VWOZ4FEKQDG2 type=del 2024-09-19T13:43:02.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.133+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=2GQESERX2IXL type=del size=940239 2024-09-19T13:43:02.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.135+0000 7f6ab10d2780 1 < suggested remove operation key=V8P17ZSOQUSM tag=1LH1T3RB6AW8 type=del 2024-09-19T13:43:02.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.136+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=XVEW2CVN2KDC type=del size=344729 2024-09-19T13:43:02.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.137+0000 7f6ab10d2780 1 < completed write operation key=UPMXNNYUUJR7 tag=MA24LQRWO8ET type=write size=485246 2024-09-19T13:43:02.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.140+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~GR3LDXJJKXRL.0 size=1048576 2024-09-19T13:43:02.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.140+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~GR3LDXJJKXRL.1 size=1048576 2024-09-19T13:43:02.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.141+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~GR3LDXJJKXRL.2 size=774482 2024-09-19T13:43:02.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.141+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=GR3LDXJJKXRL tag=QB8LMITSQ45C type=write size=3920210 2024-09-19T13:43:02.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.143+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=69D9O43DNX1X type=del 2024-09-19T13:43:02.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.144+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=KSDVZDCAOCTV type=del size=3143423 2024-09-19T13:43:02.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.145+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~0ZZ8KF8IRKP9.0 size=1048576 2024-09-19T13:43:02.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.146+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~0ZZ8KF8IRKP9.1 size=817551 2024-09-19T13:43:02.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.149+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=0ZZ8KF8IRKP9 tag=M7JO5VIBNBDG type=write size=2914703 2024-09-19T13:43:02.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.150+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=0UUP5KSRI4W0 type=write size=769008 2024-09-19T13:43:02.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.151+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=TEYLBU02TS71 type=del 2024-09-19T13:43:02.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.153+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~2BXWKNFMLHWZ.0 size=1048576 2024-09-19T13:43:02.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.154+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~2BXWKNFMLHWZ.1 size=88683 2024-09-19T13:43:02.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.154+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=2BXWKNFMLHWZ tag=HV01N9LL8JQG type=write size=2185835 2024-09-19T13:43:02.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.155+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~J5OSV7XYWLN9.0 size=605355 2024-09-19T13:43:02.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.157+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=J5OSV7XYWLN9 tag=0OE9YW54S603 type=write size=1653931 2024-09-19T13:43:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.159+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~6JKD3LOT4398.0 size=1048576 2024-09-19T13:43:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.160+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~6JKD3LOT4398.1 size=1048576 2024-09-19T13:43:02.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.160+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~6JKD3LOT4398.2 size=761154 2024-09-19T13:43:02.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.160+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=6JKD3LOT4398 tag=ECN02DUN5X5X type=write size=3906882 2024-09-19T13:43:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.162+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=EYQP238C9D1I type=del 2024-09-19T13:43:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.163+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=GNKFKTTMUY1L type=del size=2250274 2024-09-19T13:43:02.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.164+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=PJWD0Z22OIAT type=del 2024-09-19T13:43:02.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.165+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=332S7BW3DZWQ type=del size=476367 2024-09-19T13:43:02.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.166+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~WBJ3Q8QJBN1S.0 size=1048576 2024-09-19T13:43:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.167+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~WBJ3Q8QJBN1S.1 size=1048576 2024-09-19T13:43:02.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.167+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~WBJ3Q8QJBN1S.2 size=238576 2024-09-19T13:43:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.169+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=WBJ3Q8QJBN1S tag=H4HGA1UYGHFO type=write size=3384304 2024-09-19T13:43:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.170+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=CQGQMUVFSWWF type=write size=169440 2024-09-19T13:43:02.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.171+0000 7f6ab10d2780 1 < completed write operation key=TCXAYADSCTZI tag=7ZH5BJ921N2T type=write size=283272 2024-09-19T13:43:02.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.172+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=1Z0HF1UJQTJR type=del size=1888167 2024-09-19T13:43:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.174+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=KKUE2V88TLSX type=del 2024-09-19T13:43:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.175+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=5M3JID675ERG type=del size=1202576 2024-09-19T13:43:02.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.176+0000 7f6ab10d2780 -1 < failed to complete operation key=CD4XXORKVS6J tag=L91LVACFAL44 type=del size=1912406: (22) Invalid argument 2024-09-19T13:43:02.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.179+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~Z2Q1WMK31PH2.0 size=1048576 2024-09-19T13:43:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.179+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~Z2Q1WMK31PH2.1 size=287539 2024-09-19T13:43:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.179+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=Z2Q1WMK31PH2 tag=32EMLAUGJ5LW type=write size=2384691 2024-09-19T13:43:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.180+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~VQUID9UXL0FO.0 size=1048576 2024-09-19T13:43:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.181+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~VQUID9UXL0FO.1 size=1048576 2024-09-19T13:43:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.182+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~VQUID9UXL0FO.2 size=936124 2024-09-19T13:43:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.183+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=VQUID9UXL0FO tag=0321H5GHB63W type=write size=4081852 2024-09-19T13:43:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.185+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=1Q0CE0BGXPAX type=del size=4000800 2024-09-19T13:43:02.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.187+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=LKBPJ7FCO63S type=write 2024-09-19T13:43:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.189+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~GQBV5GX398WP.0 size=49546 2024-09-19T13:43:02.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.189+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=GQBV5GX398WP tag=EHLCYTEXJYJJ type=write size=1098122 2024-09-19T13:43:02.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.190+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=3F8S5A3BY9AE type=del 2024-09-19T13:43:02.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.192+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~T3E5UZE2VXJ2.0 size=1048576 2024-09-19T13:43:02.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.193+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~T3E5UZE2VXJ2.1 size=1048576 2024-09-19T13:43:02.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.194+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~T3E5UZE2VXJ2.2 size=954684 2024-09-19T13:43:02.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.194+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=T3E5UZE2VXJ2 tag=8N41WDBWMCCB type=write size=4100412 2024-09-19T13:43:02.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.195+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=2GQESERX2IXL type=del 2024-09-19T13:43:02.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.196+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=2RJIVF8EJVZU type=del size=173304 2024-09-19T13:43:02.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.198+0000 7f6ab10d2780 1 < canceled operation key=DTSRVH526PE7 tag=XVEW2CVN2KDC type=del size=344729 2024-09-19T13:43:02.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.199+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=ABESVIXA7ZVF type=write size=31074 2024-09-19T13:43:02.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.200+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~GR3LDXJJKXRL.0 size=1048576 2024-09-19T13:43:02.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.200+0000 7f6ab10d2780 1 < canceled part key=_multipart_535R757HSXMB.2~GR3LDXJJKXRL.1 size=1048576 2024-09-19T13:43:02.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.201+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~GR3LDXJJKXRL.2 size=774482 2024-09-19T13:43:02.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.203+0000 7f6ab10d2780 1 < canceled multipart upload key=535R757HSXMB upload=GR3LDXJJKXRL tag=QB8LMITSQ45C type=write size=3920210 2024-09-19T13:43:02.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.205+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~R61LE2D6WSJG.0 size=1048576 2024-09-19T13:43:02.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.205+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~R61LE2D6WSJG.1 size=1048576 2024-09-19T13:43:02.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.206+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~R61LE2D6WSJG.2 size=1009734 2024-09-19T13:43:02.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.206+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=R61LE2D6WSJG tag=UIJ3H5WG5VKD type=write size=4155462 2024-09-19T13:43:02.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.208+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=KSDVZDCAOCTV type=del 2024-09-19T13:43:02.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.210+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~Z8S0RK253VAA.0 size=878130 2024-09-19T13:43:02.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.210+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=Z8S0RK253VAA tag=1P2H2HYZP0QU type=write size=1926706 2024-09-19T13:43:02.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.211+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=0UUP5KSRI4W0 type=write size=769008 2024-09-19T13:43:02.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.213+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~7KVDN7NGK9YZ.0 size=1048576 2024-09-19T13:43:02.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.214+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~7KVDN7NGK9YZ.1 size=1048576 2024-09-19T13:43:02.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.215+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~7KVDN7NGK9YZ.2 size=952777 2024-09-19T13:43:02.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.215+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=7KVDN7NGK9YZ tag=9U8Q5P36KNM5 type=write size=4098505 2024-09-19T13:43:02.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.215+0000 7f6ab10d2780 1 < canceled part key=_multipart_P2U09V0G7UUU.2~2BXWKNFMLHWZ.0 size=1048576 2024-09-19T13:43:02.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.216+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~2BXWKNFMLHWZ.1 size=88683 2024-09-19T13:43:02.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.218+0000 7f6ab10d2780 1 < canceled multipart upload key=P2U09V0G7UUU upload=2BXWKNFMLHWZ tag=HV01N9LL8JQG type=write size=2185835 2024-09-19T13:43:02.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.219+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=PQR1BS4R3CC4 type=write size=441595 2024-09-19T13:43:02.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.220+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~6JKD3LOT4398.0 size=1048576 2024-09-19T13:43:02.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.220+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~6JKD3LOT4398.1 size=1048576 2024-09-19T13:43:02.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.221+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~6JKD3LOT4398.2 size=761154 2024-09-19T13:43:02.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.223+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=6JKD3LOT4398 tag=ECN02DUN5X5X type=write size=3906882 2024-09-19T13:43:02.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.224+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=0LBFGYM1RJ1E type=write size=520799 2024-09-19T13:43:02.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.225+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=GNKFKTTMUY1L type=del 2024-09-19T13:43:02.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.227+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~XAQFU8G2GUMC.0 size=345821 2024-09-19T13:43:02.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.227+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=XAQFU8G2GUMC tag=T09C71ICAEKQ type=write size=1394397 2024-09-19T13:43:02.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.229+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=332S7BW3DZWQ type=del 2024-09-19T13:43:02.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.231+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~VF0HKEWD195J.0 size=1048576 2024-09-19T13:43:02.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.232+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~VF0HKEWD195J.1 size=163796 2024-09-19T13:43:02.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.232+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=VF0HKEWD195J tag=XJRPUHHUL2GQ type=write size=2260948 2024-09-19T13:43:02.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.234+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=CQGQMUVFSWWF type=write size=169440 2024-09-19T13:43:02.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.236+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~948ST2IK7R7A.0 size=1048576 2024-09-19T13:43:02.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.237+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~948ST2IK7R7A.1 size=1038162 2024-09-19T13:43:02.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.237+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=948ST2IK7R7A tag=EQBJ94C1YAZF type=write size=3135314 2024-09-19T13:43:02.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.238+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=1Z0HF1UJQTJR type=del 2024-09-19T13:43:02.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.239+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=SLEWKN46T0UZ type=del size=2691456 2024-09-19T13:43:02.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.240+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=5M3JID675ERG type=del 2024-09-19T13:43:02.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.241+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=RQ3QNGY97G24 type=del size=2895524 2024-09-19T13:43:02.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.242+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~Z2Q1WMK31PH2.0 size=1048576 2024-09-19T13:43:02.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.243+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~Z2Q1WMK31PH2.1 size=287539 2024-09-19T13:43:02.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.245+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=Z2Q1WMK31PH2 tag=32EMLAUGJ5LW type=write size=2384691 2024-09-19T13:43:02.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.247+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~W7XUQJ1N2KEW.0 size=1048576 2024-09-19T13:43:02.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.248+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~W7XUQJ1N2KEW.1 size=850819 2024-09-19T13:43:02.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.248+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=W7XUQJ1N2KEW tag=2VBGGJ5D6CZQ type=write size=2947971 2024-09-19T13:43:02.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.249+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=1Q0CE0BGXPAX type=del 2024-09-19T13:43:02.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.250+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=XER8EXLFXT2X type=del size=503907 2024-09-19T13:43:02.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.253+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~GQBV5GX398WP.0 size=49546 2024-09-19T13:43:02.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.254+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=GQBV5GX398WP tag=EHLCYTEXJYJJ type=write size=1098122 2024-09-19T13:43:02.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.256+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=BA95UNP5I4V8 type=write size=423286 2024-09-19T13:43:02.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.257+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~T3E5UZE2VXJ2.0 size=1048576 2024-09-19T13:43:02.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.258+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~T3E5UZE2VXJ2.1 size=1048576 2024-09-19T13:43:02.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.259+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~T3E5UZE2VXJ2.2 size=954684 2024-09-19T13:43:02.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.260+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=T3E5UZE2VXJ2 tag=8N41WDBWMCCB type=write size=4100412 2024-09-19T13:43:02.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.262+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=ZKI7EZ01V28B type=del size=2101546 2024-09-19T13:43:02.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.263+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=2RJIVF8EJVZU type=del 2024-09-19T13:43:02.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.264+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=V5U43XIWYNEF type=del size=1189239 2024-09-19T13:43:02.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.265+0000 7f6ab10d2780 1 < canceled operation key=RXXCDV0LTCKS tag=ABESVIXA7ZVF type=write size=31074 2024-09-19T13:43:02.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.266+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=DV0NEL5AKWEV type=del size=3126587 2024-09-19T13:43:02.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.266+0000 7f6ab10d2780 1 < canceled part key=_multipart_SDQ64HOD22EM.2~R61LE2D6WSJG.0 size=1048576 2024-09-19T13:43:02.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.267+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~R61LE2D6WSJG.1 size=1048576 2024-09-19T13:43:02.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.267+0000 7f6ab10d2780 1 < canceled part key=_multipart_SDQ64HOD22EM.2~R61LE2D6WSJG.2 size=1009734 2024-09-19T13:43:02.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.269+0000 7f6ab10d2780 1 < canceled multipart upload key=SDQ64HOD22EM upload=R61LE2D6WSJG tag=UIJ3H5WG5VKD type=write size=4155462 2024-09-19T13:43:02.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.271+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=OQOFIQ27B1A5 type=write size=965914 2024-09-19T13:43:02.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.272+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~Z8S0RK253VAA.0 size=878130 2024-09-19T13:43:02.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.274+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=Z8S0RK253VAA tag=1P2H2HYZP0QU type=write size=1926706 2024-09-19T13:43:02.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.276+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~F85BCQE2LOSY.0 size=1048576 2024-09-19T13:43:02.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.277+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~F85BCQE2LOSY.1 size=1048576 2024-09-19T13:43:02.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.278+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~F85BCQE2LOSY.2 size=394226 2024-09-19T13:43:02.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.278+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=F85BCQE2LOSY tag=VQX87EPNS29T type=write size=3539954 2024-09-19T13:43:02.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.279+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~7KVDN7NGK9YZ.0 size=1048576 2024-09-19T13:43:02.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.279+0000 7f6ab10d2780 1 < canceled part key=_multipart_DF003ORZ1HOM.2~7KVDN7NGK9YZ.1 size=1048576 2024-09-19T13:43:02.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.280+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~7KVDN7NGK9YZ.2 size=952777 2024-09-19T13:43:02.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.282+0000 7f6ab10d2780 1 < canceled multipart upload key=DF003ORZ1HOM upload=7KVDN7NGK9YZ tag=9U8Q5P36KNM5 type=write size=4098505 2024-09-19T13:43:02.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.284+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~MVFRTHZY2RIU.0 size=1048576 2024-09-19T13:43:02.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.285+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~MVFRTHZY2RIU.1 size=172752 2024-09-19T13:43:02.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.285+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=MVFRTHZY2RIU tag=GUAOFIEO4INK type=write size=2269904 2024-09-19T13:43:02.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.286+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=PQR1BS4R3CC4 type=write size=441595 2024-09-19T13:43:02.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.288+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~HS32I54ANPO7.0 size=1048576 2024-09-19T13:43:02.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.289+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~HS32I54ANPO7.1 size=1048576 2024-09-19T13:43:02.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.290+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~HS32I54ANPO7.2 size=963630 2024-09-19T13:43:02.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.290+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=HS32I54ANPO7 tag=TUDGG7UOESP8 type=write size=4109358 2024-09-19T13:43:02.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.291+0000 7f6ab10d2780 -1 < failed to complete operation key=535R757HSXMB tag=0LBFGYM1RJ1E type=write size=520799: (22) Invalid argument 2024-09-19T13:43:02.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.293+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~1HL1DDPXX1I4.0 size=495534 2024-09-19T13:43:02.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.293+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=1HL1DDPXX1I4 tag=GCNLTLR06MZ5 type=write size=1544110 2024-09-19T13:43:02.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.294+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~XAQFU8G2GUMC.0 size=345821 2024-09-19T13:43:02.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.296+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=XAQFU8G2GUMC tag=T09C71ICAEKQ type=write size=1394397 2024-09-19T13:43:02.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.297+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=RO6V0KO30RUW type=del size=4149431 2024-09-19T13:43:02.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.299+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~VF0HKEWD195J.0 size=1048576 2024-09-19T13:43:02.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.299+0000 7f6ab10d2780 1 < canceled part key=_multipart_9IN6E0JQFNAU.2~VF0HKEWD195J.1 size=163796 2024-09-19T13:43:02.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.300+0000 7f6ab10d2780 1 < canceled multipart upload key=9IN6E0JQFNAU upload=VF0HKEWD195J tag=XJRPUHHUL2GQ type=write size=2260948 2024-09-19T13:43:02.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.302+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=8981D9WN3XD3 type=del size=2145686 2024-09-19T13:43:02.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.303+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~948ST2IK7R7A.0 size=1048576 2024-09-19T13:43:02.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.304+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~948ST2IK7R7A.1 size=1038162 2024-09-19T13:43:02.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.306+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=948ST2IK7R7A tag=EQBJ94C1YAZF type=write size=3135314 2024-09-19T13:43:02.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.307+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=I5YIF7S23CT6 type=del size=2817955 2024-09-19T13:43:02.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.308+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=SLEWKN46T0UZ type=del 2024-09-19T13:43:02.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.310+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~TF54BKC827M7.0 size=250718 2024-09-19T13:43:02.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.310+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=TF54BKC827M7 tag=NTGY0K7NWWE8 type=write size=1299294 2024-09-19T13:43:02.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.313+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=RQ3QNGY97G24 type=del 2024-09-19T13:43:02.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.315+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~H7ASOKKZMDA1.0 size=1048576 2024-09-19T13:43:02.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.316+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~H7ASOKKZMDA1.1 size=1048576 2024-09-19T13:43:02.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.317+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~H7ASOKKZMDA1.2 size=581211 2024-09-19T13:43:02.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.317+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=H7ASOKKZMDA1 tag=MPUV0QPS5VQJ type=write size=3726939 2024-09-19T13:43:02.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.317+0000 7f6ab10d2780 1 < canceled part key=_multipart_535R757HSXMB.2~W7XUQJ1N2KEW.0 size=1048576 2024-09-19T13:43:02.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.318+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~W7XUQJ1N2KEW.1 size=850819 2024-09-19T13:43:02.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.320+0000 7f6ab10d2780 1 < canceled multipart upload key=535R757HSXMB upload=W7XUQJ1N2KEW tag=2VBGGJ5D6CZQ type=write size=2947971 2024-09-19T13:43:02.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.321+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=XM7ROQ85NW9W type=del size=4058796 2024-09-19T13:43:02.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.324+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=XER8EXLFXT2X type=del 2024-09-19T13:43:02.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.325+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=I3PF3IE7C4NU type=del size=1542750 2024-09-19T13:43:02.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.326+0000 7f6ab10d2780 1 < completed write operation key=DF003ORZ1HOM tag=BA95UNP5I4V8 type=write size=423286 2024-09-19T13:43:02.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.327+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=RXPE1OKO841T type=del size=2889227 2024-09-19T13:43:02.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.328+0000 7f6ab10d2780 -1 < failed to complete operation key=CD4XXORKVS6J tag=ZKI7EZ01V28B type=del size=2101546: (22) Invalid argument 2024-09-19T13:43:02.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.329+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=3ETAZWUC5AIW type=del size=1299280 2024-09-19T13:43:02.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.331+0000 7f6ab10d2780 1 < suggested update operation key=SERUGCO68R9W tag=V5U43XIWYNEF type=del size=1189239 2024-09-19T13:43:02.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.332+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=TMJJ0F2WJ2B2 type=write size=175357 2024-09-19T13:43:02.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.334+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=DV0NEL5AKWEV type=del 2024-09-19T13:43:02.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.335+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=CQ2L9KFPUIJX type=del size=3178027 2024-09-19T13:43:02.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.336+0000 7f6ab10d2780 1 < completed write operation key=QTGKMAOX2A6U tag=OQOFIQ27B1A5 type=write size=965914 2024-09-19T13:43:02.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.337+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=BJM6POEOTDXG type=del size=3701526 2024-09-19T13:43:02.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.338+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~F85BCQE2LOSY.0 size=1048576 2024-09-19T13:43:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.339+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~F85BCQE2LOSY.1 size=1048576 2024-09-19T13:43:02.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.339+0000 7f6ab10d2780 1 < canceled part key=_multipart_A14YTABJ1Z3Z.2~F85BCQE2LOSY.2 size=394226 2024-09-19T13:43:02.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.341+0000 7f6ab10d2780 1 < canceled multipart upload key=A14YTABJ1Z3Z upload=F85BCQE2LOSY tag=VQX87EPNS29T type=write size=3539954 2024-09-19T13:43:02.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.342+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=5YC071QHGSJK type=del size=3512264 2024-09-19T13:43:02.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.343+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~MVFRTHZY2RIU.0 size=1048576 2024-09-19T13:43:02.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.344+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~MVFRTHZY2RIU.1 size=172752 2024-09-19T13:43:02.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.346+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=MVFRTHZY2RIU tag=GUAOFIEO4INK type=write size=2269904 2024-09-19T13:43:02.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.347+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=AKDG1JGWNKBB type=del size=2320884 2024-09-19T13:43:02.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.348+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~HS32I54ANPO7.0 size=1048576 2024-09-19T13:43:02.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.349+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~HS32I54ANPO7.1 size=1048576 2024-09-19T13:43:02.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.349+0000 7f6ab10d2780 1 < canceled part key=_multipart_9IN6E0JQFNAU.2~HS32I54ANPO7.2 size=963630 2024-09-19T13:43:02.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.351+0000 7f6ab10d2780 1 < canceled multipart upload key=9IN6E0JQFNAU upload=HS32I54ANPO7 tag=TUDGG7UOESP8 type=write size=4109358 2024-09-19T13:43:02.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.352+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=GXNC8EQJXZCJ type=write size=104631 2024-09-19T13:43:02.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.354+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~1HL1DDPXX1I4.0 size=495534 2024-09-19T13:43:02.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.355+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=1HL1DDPXX1I4 tag=GCNLTLR06MZ5 type=write size=1544110 2024-09-19T13:43:02.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.357+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1J8AR4E0SNRO.0 size=1048576 2024-09-19T13:43:02.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.359+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1J8AR4E0SNRO.1 size=361620 2024-09-19T13:43:02.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.359+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=1J8AR4E0SNRO tag=7CIOMN916SPQ type=write size=2458772 2024-09-19T13:43:02.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.360+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=RO6V0KO30RUW type=del 2024-09-19T13:43:02.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.361+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=LGXHY7011FAQ type=write size=875134 2024-09-19T13:43:02.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.362+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=8981D9WN3XD3 type=del 2024-09-19T13:43:02.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.364+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~ZKXJMQNBN14J.0 size=1048576 2024-09-19T13:43:02.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.365+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~ZKXJMQNBN14J.1 size=662760 2024-09-19T13:43:02.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.365+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=ZKXJMQNBN14J tag=LZ5C3D2I28UG type=write size=2759912 2024-09-19T13:43:02.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.366+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=I5YIF7S23CT6 type=del 2024-09-19T13:43:02.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.367+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=MXVQJYHFURGR type=del size=2776020 2024-09-19T13:43:02.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.368+0000 7f6ab10d2780 1 < canceled part key=_multipart_CD4XXORKVS6J.2~TF54BKC827M7.0 size=250718 2024-09-19T13:43:02.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.369+0000 7f6ab10d2780 1 < canceled multipart upload key=CD4XXORKVS6J upload=TF54BKC827M7 tag=NTGY0K7NWWE8 type=write size=1299294 2024-09-19T13:43:02.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.371+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~7Q2YJ52UK9N0.0 size=947006 2024-09-19T13:43:02.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.371+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=7Q2YJ52UK9N0 tag=QAAOS1M0L2V8 type=write size=1995582 2024-09-19T13:43:02.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.372+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~H7ASOKKZMDA1.0 size=1048576 2024-09-19T13:43:02.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.373+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~H7ASOKKZMDA1.1 size=1048576 2024-09-19T13:43:02.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.374+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~H7ASOKKZMDA1.2 size=581211 2024-09-19T13:43:02.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.376+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=H7ASOKKZMDA1 tag=MPUV0QPS5VQJ type=write size=3726939 2024-09-19T13:43:02.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.377+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=W1HI02RABVXH type=del size=369513 2024-09-19T13:43:02.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.379+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=XM7ROQ85NW9W type=del 2024-09-19T13:43:02.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.380+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=J7WRKQYJJYUA type=write size=199947 2024-09-19T13:43:02.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.381+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=I3PF3IE7C4NU type=del 2024-09-19T13:43:02.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.383+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~GELID1Q3SY1O.0 size=1048576 2024-09-19T13:43:02.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.384+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~GELID1Q3SY1O.1 size=788496 2024-09-19T13:43:02.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.384+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=GELID1Q3SY1O tag=WUSRNC5TGTYL type=write size=2885648 2024-09-19T13:43:02.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.385+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=RXPE1OKO841T type=del 2024-09-19T13:43:02.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.387+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=Y1I5ZJF71M05 type=del size=3893623 2024-09-19T13:43:02.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.388+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=3ETAZWUC5AIW type=del 2024-09-19T13:43:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.389+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=HYHPEQ5H1T18 type=write size=992971 2024-09-19T13:43:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.391+0000 7f6ab10d2780 1 < suggested update operation key=TCXAYADSCTZI tag=TMJJ0F2WJ2B2 type=write size=175357 2024-09-19T13:43:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.393+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=FSKR2ZKERDVC type=del size=3967746 2024-09-19T13:43:02.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.395+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=CQ2L9KFPUIJX type=del size=3178027 2024-09-19T13:43:02.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.396+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=YMNDYGJR7ODN type=del size=1593512 2024-09-19T13:43:02.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.397+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=BJM6POEOTDXG type=del 2024-09-19T13:43:02.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.398+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=RPML719CDOEC type=del size=3768416 2024-09-19T13:43:02.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.399+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=5YC071QHGSJK type=del 2024-09-19T13:43:02.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.400+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=KSUEUY8F2V44 type=del size=3646276 2024-09-19T13:43:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.401+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=AKDG1JGWNKBB type=del 2024-09-19T13:43:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.404+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~M2UFEEHOMJO1.0 size=1048576 2024-09-19T13:43:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.404+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~M2UFEEHOMJO1.1 size=783113 2024-09-19T13:43:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.404+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=M2UFEEHOMJO1 tag=6H9KKSALT148 type=write size=2880265 2024-09-19T13:43:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.406+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=GXNC8EQJXZCJ type=write size=104631 2024-09-19T13:43:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.407+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=SELG42M2GJHG type=del size=3415823 2024-09-19T13:43:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.408+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~1J8AR4E0SNRO.0 size=1048576 2024-09-19T13:43:02.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.409+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~1J8AR4E0SNRO.1 size=361620 2024-09-19T13:43:02.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.411+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=1J8AR4E0SNRO tag=7CIOMN916SPQ type=write size=2458772 2024-09-19T13:43:02.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.413+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=3EIYXNX2NFYM type=del size=188823 2024-09-19T13:43:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.415+0000 7f6ab10d2780 1 < suggested update operation key=9MCE8PXHBGNF tag=LGXHY7011FAQ type=write size=875134 2024-09-19T13:43:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.416+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=CLF4Q49AZ568 type=del size=1159768 2024-09-19T13:43:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.417+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~ZKXJMQNBN14J.0 size=1048576 2024-09-19T13:43:02.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.418+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~ZKXJMQNBN14J.1 size=662760 2024-09-19T13:43:02.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.420+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=ZKXJMQNBN14J tag=LZ5C3D2I28UG type=write size=2759912 2024-09-19T13:43:02.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.421+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=B39W13PU900P type=del size=1979649 2024-09-19T13:43:02.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.423+0000 7f6ab10d2780 1 < suggested update operation key=P2U09V0G7UUU tag=MXVQJYHFURGR type=del size=2776020 2024-09-19T13:43:02.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.425+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=AQVCFJ5HBWVC type=del size=2484046 2024-09-19T13:43:02.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.426+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~7Q2YJ52UK9N0.0 size=947006 2024-09-19T13:43:02.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.428+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=7Q2YJ52UK9N0 tag=QAAOS1M0L2V8 type=write size=1995582 2024-09-19T13:43:02.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.429+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=FDL4N3RY5CQY type=write size=599096 2024-09-19T13:43:02.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.430+0000 7f6ab10d2780 -1 < failed to complete operation key=P2U09V0G7UUU tag=W1HI02RABVXH type=del size=369513: (22) Invalid argument 2024-09-19T13:43:02.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.432+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~4GLSEQSKL4UG.0 size=860176 2024-09-19T13:43:02.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.432+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=4GLSEQSKL4UG tag=11TE3ORMQT8H type=write size=1908752 2024-09-19T13:43:02.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.433+0000 7f6ab10d2780 1 < completed write operation key=SRABG45EPVN2 tag=J7WRKQYJJYUA type=write size=199947 2024-09-19T13:43:02.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.435+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~26APNH1R1MZC.0 size=1048576 2024-09-19T13:43:02.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.436+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~26APNH1R1MZC.1 size=1048576 2024-09-19T13:43:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.437+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~26APNH1R1MZC.2 size=461960 2024-09-19T13:43:02.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.437+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=26APNH1R1MZC tag=JG15TILJXORM type=write size=3607688 2024-09-19T13:43:02.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.438+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~GELID1Q3SY1O.0 size=1048576 2024-09-19T13:43:02.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.439+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~GELID1Q3SY1O.1 size=788496 2024-09-19T13:43:02.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.440+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=GELID1Q3SY1O tag=WUSRNC5TGTYL type=write size=2885648 2024-09-19T13:43:02.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.442+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~FWMQ1ZL46N9B.0 size=1048576 2024-09-19T13:43:02.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.443+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~FWMQ1ZL46N9B.1 size=597050 2024-09-19T13:43:02.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.443+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=FWMQ1ZL46N9B tag=R285Y6Y0T1SY type=write size=2694202 2024-09-19T13:43:02.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.444+0000 7f6ab10d2780 -1 < failed to complete operation key=TCXAYADSCTZI tag=Y1I5ZJF71M05 type=del size=3893623: (22) Invalid argument 2024-09-19T13:43:02.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.445+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=HTLW1IBMJPWW type=del size=2196929 2024-09-19T13:43:02.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.448+0000 7f6ab10d2780 1 < suggested update operation key=A14YTABJ1Z3Z tag=HYHPEQ5H1T18 type=write size=992971 2024-09-19T13:43:02.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.449+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=UT22KO3Q7NY5 type=del size=1807456 2024-09-19T13:43:02.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.450+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=FSKR2ZKERDVC type=del 2024-09-19T13:43:02.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.451+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=XENS0XL5OMYM type=del size=2843487 2024-09-19T13:43:02.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.452+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=YMNDYGJR7ODN type=del 2024-09-19T13:43:02.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.453+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=YZCU4RWZKO9L type=del size=3008286 2024-09-19T13:43:02.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.454+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=RPML719CDOEC type=del 2024-09-19T13:43:02.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.455+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=KGQ298HE4RF0 type=del size=1052110 2024-09-19T13:43:02.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.456+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=KSUEUY8F2V44 type=del 2024-09-19T13:43:02.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.458+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~X0P8JBGAS8Q0.0 size=332740 2024-09-19T13:43:02.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.458+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=X0P8JBGAS8Q0 tag=N0LSIPHD92NJ type=write size=1381316 2024-09-19T13:43:02.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.459+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~M2UFEEHOMJO1.0 size=1048576 2024-09-19T13:43:02.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.460+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~M2UFEEHOMJO1.1 size=783113 2024-09-19T13:43:02.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.462+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=M2UFEEHOMJO1 tag=6H9KKSALT148 type=write size=2880265 2024-09-19T13:43:02.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.464+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~N4E7IUUI1P79.0 size=1048576 2024-09-19T13:43:02.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.466+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~N4E7IUUI1P79.1 size=126344 2024-09-19T13:43:02.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.466+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=N4E7IUUI1P79 tag=MLERO1OALA2F type=write size=2223496 2024-09-19T13:43:02.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.467+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=SELG42M2GJHG type=del 2024-09-19T13:43:02.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.469+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~S38UX9R7JIR2.0 size=1048576 2024-09-19T13:43:02.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.470+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~S38UX9R7JIR2.1 size=1048576 2024-09-19T13:43:02.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.471+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~S38UX9R7JIR2.2 size=944527 2024-09-19T13:43:02.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.471+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=S38UX9R7JIR2 tag=A9D4IEVFTCFR type=write size=4090255 2024-09-19T13:43:02.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.472+0000 7f6ab10d2780 1 < canceled operation key=7LHSAN5BBQRW tag=3EIYXNX2NFYM type=del size=188823 2024-09-19T13:43:02.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.474+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=O46AN0GXXIAK type=del size=2744830 2024-09-19T13:43:02.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.475+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=CLF4Q49AZ568 type=del 2024-09-19T13:43:02.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.477+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~9Y1EUFAD1LZK.0 size=542244 2024-09-19T13:43:02.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.477+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=9Y1EUFAD1LZK tag=46YI4TUHMJUR type=write size=1590820 2024-09-19T13:43:02.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.479+0000 7f6ab10d2780 1 < suggested update operation key=13GXIDWI4J9F tag=B39W13PU900P type=del size=1979649 2024-09-19T13:43:02.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.480+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=UV1Z818GI7WE type=del size=2628697 2024-09-19T13:43:02.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.481+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=AQVCFJ5HBWVC type=del 2024-09-19T13:43:02.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.482+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=FPBBYLSH5NPZ type=del size=643365 2024-09-19T13:43:02.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.483+0000 7f6ab10d2780 1 < completed write operation key=V8P17ZSOQUSM tag=FDL4N3RY5CQY type=write size=599096 2024-09-19T13:43:02.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.484+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=OUB3MWUVWNEH type=del size=2588662 2024-09-19T13:43:02.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.485+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~4GLSEQSKL4UG.0 size=860176 2024-09-19T13:43:02.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.487+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=4GLSEQSKL4UG tag=11TE3ORMQT8H type=write size=1908752 2024-09-19T13:43:02.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.488+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=2BKR9900QMWJ type=del size=930390 2024-09-19T13:43:02.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.489+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~26APNH1R1MZC.0 size=1048576 2024-09-19T13:43:02.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.491+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~26APNH1R1MZC.1 size=1048576 2024-09-19T13:43:02.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.491+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~26APNH1R1MZC.2 size=461960 2024-09-19T13:43:02.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.493+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=26APNH1R1MZC tag=JG15TILJXORM type=write size=3607688 2024-09-19T13:43:02.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.494+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=RIS67NLE2VNG type=del size=2786017 2024-09-19T13:43:02.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.495+0000 7f6ab10d2780 1 < canceled part key=_multipart_B0J7E7A0NP4J.2~FWMQ1ZL46N9B.0 size=1048576 2024-09-19T13:43:02.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.496+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~FWMQ1ZL46N9B.1 size=597050 2024-09-19T13:43:02.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.497+0000 7f6ab10d2780 1 < canceled multipart upload key=B0J7E7A0NP4J upload=FWMQ1ZL46N9B tag=R285Y6Y0T1SY type=write size=2694202 2024-09-19T13:43:02.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.499+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=X8YDF4IBXMRE type=write size=343407 2024-09-19T13:43:02.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.500+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=HTLW1IBMJPWW type=del 2024-09-19T13:43:02.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.501+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=P9SIJ716EWJF type=write size=985476 2024-09-19T13:43:02.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.503+0000 7f6ab10d2780 1 < suggested update operation key=9MCE8PXHBGNF tag=UT22KO3Q7NY5 type=del size=1807456 2024-09-19T13:43:02.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.505+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~BIJX8TDEIKLA.0 size=272495 2024-09-19T13:43:02.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.505+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=BIJX8TDEIKLA tag=X2QODZXISEKI type=write size=1321071 2024-09-19T13:43:02.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.506+0000 7f6ab10d2780 -1 < failed to complete operation key=9MCE8PXHBGNF tag=XENS0XL5OMYM type=del size=2843487: (22) Invalid argument 2024-09-19T13:43:02.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.507+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=S0BDAZNX3IUZ type=del size=1097536 2024-09-19T13:43:02.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.508+0000 7f6ab10d2780 -1 < failed to complete operation key=13GXIDWI4J9F tag=YZCU4RWZKO9L type=del size=3008286: (22) Invalid argument 2024-09-19T13:43:02.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.510+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~IZYYXO9KER4X.0 size=1048576 2024-09-19T13:43:02.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.511+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~IZYYXO9KER4X.1 size=708264 2024-09-19T13:43:02.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.511+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=IZYYXO9KER4X tag=GHURJUSYR0OX type=write size=2805416 2024-09-19T13:43:02.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.512+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=KGQ298HE4RF0 type=del 2024-09-19T13:43:02.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.514+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=F2YREOIIHF13 type=del size=1118470 2024-09-19T13:43:02.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.514+0000 7f6ab10d2780 1 < canceled part key=_multipart_2KX2NSY41STV.2~X0P8JBGAS8Q0.0 size=332740 2024-09-19T13:43:02.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.516+0000 7f6ab10d2780 1 < canceled multipart upload key=2KX2NSY41STV upload=X0P8JBGAS8Q0 tag=N0LSIPHD92NJ type=write size=1381316 2024-09-19T13:43:02.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.517+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=UVUTLEV3FRSA type=write size=950527 2024-09-19T13:43:02.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.518+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~N4E7IUUI1P79.0 size=1048576 2024-09-19T13:43:02.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.519+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~N4E7IUUI1P79.1 size=126344 2024-09-19T13:43:02.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.521+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=N4E7IUUI1P79 tag=MLERO1OALA2F type=write size=2223496 2024-09-19T13:43:02.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.523+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~SDRZV0FC28NH.0 size=1048576 2024-09-19T13:43:02.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.523+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~SDRZV0FC28NH.1 size=507857 2024-09-19T13:43:02.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.523+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=SDRZV0FC28NH tag=TUF8WEWOKE03 type=write size=2605009 2024-09-19T13:43:02.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.525+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~S38UX9R7JIR2.0 size=1048576 2024-09-19T13:43:02.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.526+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~S38UX9R7JIR2.1 size=1048576 2024-09-19T13:43:02.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.526+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~S38UX9R7JIR2.2 size=944527 2024-09-19T13:43:02.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.528+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=S38UX9R7JIR2 tag=A9D4IEVFTCFR type=write size=4090255 2024-09-19T13:43:02.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.529+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=J27E0X61WRM9 type=write size=968417 2024-09-19T13:43:02.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.531+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=O46AN0GXXIAK type=del 2024-09-19T13:43:02.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.532+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=KAEGP1KXWSBC type=del size=2787648 2024-09-19T13:43:02.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.533+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~9Y1EUFAD1LZK.0 size=542244 2024-09-19T13:43:02.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.535+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=9Y1EUFAD1LZK tag=46YI4TUHMJUR type=write size=1590820 2024-09-19T13:43:02.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.536+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=BR6UN2NL52FI type=del size=580406 2024-09-19T13:43:02.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.538+0000 7f6ab10d2780 1 < suggested remove operation key=RXXCDV0LTCKS tag=UV1Z818GI7WE type=del 2024-09-19T13:43:02.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.539+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=XR51MDEY3ZCI type=write size=415280 2024-09-19T13:43:02.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.540+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=FPBBYLSH5NPZ type=del 2024-09-19T13:43:02.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.541+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=X9DGB9MRAAUX type=del size=3630739 2024-09-19T13:43:02.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.543+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=OUB3MWUVWNEH type=del 2024-09-19T13:43:02.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.545+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~K2QAG1FLZDPJ.0 size=1048576 2024-09-19T13:43:02.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.545+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~K2QAG1FLZDPJ.1 size=1048576 2024-09-19T13:43:02.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.546+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~K2QAG1FLZDPJ.2 size=968963 2024-09-19T13:43:02.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.546+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=K2QAG1FLZDPJ tag=1OGSN42GDOQ8 type=write size=4114691 2024-09-19T13:43:02.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.548+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=2BKR9900QMWJ type=del 2024-09-19T13:43:02.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.549+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=TNNPBHXFHQ0J type=del size=2339749 2024-09-19T13:43:02.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.551+0000 7f6ab10d2780 1 < suggested remove operation key=VFJIKOLYI0HN tag=RIS67NLE2VNG type=del 2024-09-19T13:43:02.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.552+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=2XX3C1MX1ZM4 type=del size=1742967 2024-09-19T13:43:02.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.553+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=X8YDF4IBXMRE type=write size=343407 2024-09-19T13:43:02.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.554+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=I3MWYJSLCJJW type=write size=773511 2024-09-19T13:43:02.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.555+0000 7f6ab10d2780 1 < completed write operation key=535R757HSXMB tag=P9SIJ716EWJF type=write size=985476 2024-09-19T13:43:02.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.556+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=30YH5EKNGULX type=del size=1549214 2024-09-19T13:43:02.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.558+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~BIJX8TDEIKLA.0 size=272495 2024-09-19T13:43:02.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.560+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=BIJX8TDEIKLA tag=X2QODZXISEKI type=write size=1321071 2024-09-19T13:43:02.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.562+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~LN4ET6OSWQS1.0 size=681368 2024-09-19T13:43:02.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.562+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=LN4ET6OSWQS1 tag=GVC62T62E33L type=write size=1729944 2024-09-19T13:43:02.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.563+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=S0BDAZNX3IUZ type=del 2024-09-19T13:43:02.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.565+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~L6AX5MID525U.0 size=341695 2024-09-19T13:43:02.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.565+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=L6AX5MID525U tag=QBB8D3XS0COR type=write size=1390271 2024-09-19T13:43:02.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.565+0000 7f6ab10d2780 1 < canceled part key=_multipart_UX2ICIT36Q3R.2~IZYYXO9KER4X.0 size=1048576 2024-09-19T13:43:02.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.566+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~IZYYXO9KER4X.1 size=708264 2024-09-19T13:43:02.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.568+0000 7f6ab10d2780 1 < canceled multipart upload key=UX2ICIT36Q3R upload=IZYYXO9KER4X tag=GHURJUSYR0OX type=write size=2805416 2024-09-19T13:43:02.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.569+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=421VX72YM1ZY type=del size=565066 2024-09-19T13:43:02.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.571+0000 7f6ab10d2780 -1 < failed to complete operation key=VFJIKOLYI0HN tag=F2YREOIIHF13 type=del size=1118470: (22) Invalid argument 2024-09-19T13:43:02.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.573+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=36708E58CJ9W type=del size=4016058 2024-09-19T13:43:02.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.574+0000 7f6ab10d2780 -1 < failed to complete operation key=RXXCDV0LTCKS tag=UVUTLEV3FRSA type=write size=950527: (22) Invalid argument 2024-09-19T13:43:02.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.575+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=8E3X2AUVDHO0 type=del size=1140898 2024-09-19T13:43:02.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.577+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~SDRZV0FC28NH.0 size=1048576 2024-09-19T13:43:02.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.578+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~SDRZV0FC28NH.1 size=507857 2024-09-19T13:43:02.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.580+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=SDRZV0FC28NH tag=TUF8WEWOKE03 type=write size=2605009 2024-09-19T13:43:02.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.581+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=YV2GZCYZZNO0 type=del size=79768 2024-09-19T13:43:02.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.582+0000 7f6ab10d2780 1 < canceled operation key=RU6OR8SM72GU tag=J27E0X61WRM9 type=write size=968417 2024-09-19T13:43:02.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.584+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~Z6P8LNXP3SX0.0 size=648187 2024-09-19T13:43:02.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.584+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=Z6P8LNXP3SX0 tag=6IM7FC4Q4IS5 type=write size=1696763 2024-09-19T13:43:02.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.585+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=KAEGP1KXWSBC type=del 2024-09-19T13:43:02.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.586+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=CVHYNB901PTI type=del size=209584 2024-09-19T13:43:02.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.589+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=BR6UN2NL52FI type=del size=580406 2024-09-19T13:43:02.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.591+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~3TL1RSA8QUHG.0 size=558837 2024-09-19T13:43:02.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.591+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=3TL1RSA8QUHG tag=IU7DS6J25R2L type=write size=1607413 2024-09-19T13:43:02.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.592+0000 7f6ab10d2780 -1 < failed to complete operation key=VFJIKOLYI0HN tag=XR51MDEY3ZCI type=write size=415280: (22) Invalid argument 2024-09-19T13:43:02.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.593+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=E1JV9M7GB1RC type=del size=2604553 2024-09-19T13:43:02.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.595+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=X9DGB9MRAAUX type=del 2024-09-19T13:43:02.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.597+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~D4YOYJS6OMCF.0 size=1048576 2024-09-19T13:43:02.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.598+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~D4YOYJS6OMCF.1 size=147151 2024-09-19T13:43:02.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.598+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=D4YOYJS6OMCF tag=NGHL7U0FH470 type=write size=2244303 2024-09-19T13:43:02.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.599+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~K2QAG1FLZDPJ.0 size=1048576 2024-09-19T13:43:02.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.600+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~K2QAG1FLZDPJ.1 size=1048576 2024-09-19T13:43:02.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.600+0000 7f6ab10d2780 1 < canceled part key=_multipart_DTSRVH526PE7.2~K2QAG1FLZDPJ.2 size=968963 2024-09-19T13:43:02.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.601+0000 7f6ab10d2780 1 < canceled multipart upload key=DTSRVH526PE7 upload=K2QAG1FLZDPJ tag=1OGSN42GDOQ8 type=write size=4114691 2024-09-19T13:43:02.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.603+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=1GZJUBUPLXV6 type=del size=2376536 2024-09-19T13:43:02.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.604+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=TNNPBHXFHQ0J type=del 2024-09-19T13:43:02.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.605+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=6OA2DCP112GU type=write size=765183 2024-09-19T13:43:02.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.607+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=2XX3C1MX1ZM4 type=del size=1742967 2024-09-19T13:43:02.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.609+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~C36HM3NCZYWN.0 size=1046005 2024-09-19T13:43:02.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.609+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=C36HM3NCZYWN tag=SXK1A70J775E type=write size=2094581 2024-09-19T13:43:02.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.610+0000 7f6ab10d2780 1 < completed write operation key=2KX2NSY41STV tag=I3MWYJSLCJJW type=write size=773511 2024-09-19T13:43:02.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.611+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=43BEI53U0FX4 type=del size=2898439 2024-09-19T13:43:02.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.612+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=30YH5EKNGULX type=del 2024-09-19T13:43:02.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.613+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=OP4IWJWNIR9B type=del size=3543613 2024-09-19T13:43:02.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.614+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~LN4ET6OSWQS1.0 size=681368 2024-09-19T13:43:02.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.616+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=LN4ET6OSWQS1 tag=GVC62T62E33L type=write size=1729944 2024-09-19T13:43:02.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.617+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=GR0EBNQ95QAR type=write size=673034 2024-09-19T13:43:02.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.618+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~L6AX5MID525U.0 size=341695 2024-09-19T13:43:02.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.620+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=L6AX5MID525U tag=QBB8D3XS0COR type=write size=1390271 2024-09-19T13:43:02.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.622+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~A021LEHG4GFP.0 size=1048576 2024-09-19T13:43:02.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.623+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~A021LEHG4GFP.1 size=666821 2024-09-19T13:43:02.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.623+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=A021LEHG4GFP tag=UWX6459CRK2E type=write size=2763973 2024-09-19T13:43:02.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.625+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=421VX72YM1ZY type=del 2024-09-19T13:43:02.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.626+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=KRH2VYTIFAXS type=write size=441001 2024-09-19T13:43:02.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.627+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=36708E58CJ9W type=del 2024-09-19T13:43:02.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.629+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~55CW29EZPCR7.0 size=1048576 2024-09-19T13:43:02.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.630+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~55CW29EZPCR7.1 size=1048576 2024-09-19T13:43:02.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.631+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~55CW29EZPCR7.2 size=962038 2024-09-19T13:43:02.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.631+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=55CW29EZPCR7 tag=N2X6GBDNW2GN type=write size=4107766 2024-09-19T13:43:02.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.632+0000 7f6ab10d2780 1 < canceled operation key=SRABG45EPVN2 tag=8E3X2AUVDHO0 type=del size=1140898 2024-09-19T13:43:02.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.633+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=3A1T7FXHK6L4 type=del size=1377487 2024-09-19T13:43:02.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.634+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=YV2GZCYZZNO0 type=del 2024-09-19T13:43:02.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.636+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~W3FD7TW3YSZF.0 size=1048576 2024-09-19T13:43:02.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.637+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~W3FD7TW3YSZF.1 size=1048576 2024-09-19T13:43:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.638+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~W3FD7TW3YSZF.2 size=373524 2024-09-19T13:43:02.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.638+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=W3FD7TW3YSZF tag=7FO3LPK3WSB1 type=write size=3519252 2024-09-19T13:43:02.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.639+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~Z6P8LNXP3SX0.0 size=648187 2024-09-19T13:43:02.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.642+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=Z6P8LNXP3SX0 tag=6IM7FC4Q4IS5 type=write size=1696763 2024-09-19T13:43:02.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.643+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=2C9R4FH4O9XC type=write size=355562 2024-09-19T13:43:02.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.644+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=CVHYNB901PTI type=del 2024-09-19T13:43:02.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.645+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=MRZP0VC1VNB8 type=del size=133665 2024-09-19T13:43:02.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.646+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~3TL1RSA8QUHG.0 size=558837 2024-09-19T13:43:02.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.648+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=3TL1RSA8QUHG tag=IU7DS6J25R2L type=write size=1607413 2024-09-19T13:43:02.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.649+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=DSQIS86S1D22 type=del size=300657 2024-09-19T13:43:02.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.650+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=E1JV9M7GB1RC type=del 2024-09-19T13:43:02.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.651+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=JMZXOW1P0H0S type=del size=523228 2024-09-19T13:43:02.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.652+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~D4YOYJS6OMCF.0 size=1048576 2024-09-19T13:43:02.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.653+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~D4YOYJS6OMCF.1 size=147151 2024-09-19T13:43:02.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.655+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=D4YOYJS6OMCF tag=NGHL7U0FH470 type=write size=2244303 2024-09-19T13:43:02.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.656+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=3HSQG4CJD4ZF type=del size=2329454 2024-09-19T13:43:02.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.658+0000 7f6ab10d2780 1 < suggested update operation key=4OSJA1879NQO tag=1GZJUBUPLXV6 type=del size=2376536 2024-09-19T13:43:02.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.660+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=XS824BBERMWN type=del size=648572 2024-09-19T13:43:02.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.661+0000 7f6ab10d2780 1 < completed write operation key=535R757HSXMB tag=6OA2DCP112GU type=write size=765183 2024-09-19T13:43:02.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.662+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=NNVJ7U1UU6N3 type=write size=541705 2024-09-19T13:43:02.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.663+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~C36HM3NCZYWN.0 size=1046005 2024-09-19T13:43:02.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.665+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=C36HM3NCZYWN tag=SXK1A70J775E type=write size=2094581 2024-09-19T13:43:02.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.666+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=I37A3Z00UMQG type=del size=4039088 2024-09-19T13:43:02.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.667+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=43BEI53U0FX4 type=del 2024-09-19T13:43:02.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.669+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~WUGG0OET3CC5.0 size=1048576 2024-09-19T13:43:02.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.670+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~WUGG0OET3CC5.1 size=152705 2024-09-19T13:43:02.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.670+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=WUGG0OET3CC5 tag=YEHFSCDS75HP type=write size=2249857 2024-09-19T13:43:02.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.671+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=OP4IWJWNIR9B type=del 2024-09-19T13:43:02.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.673+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~KVXFOCU07QCP.0 size=1048576 2024-09-19T13:43:02.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.674+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~KVXFOCU07QCP.1 size=1048576 2024-09-19T13:43:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.675+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~KVXFOCU07QCP.2 size=912153 2024-09-19T13:43:02.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.675+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=KVXFOCU07QCP tag=BGYYNU1F3YX4 type=write size=4057881 2024-09-19T13:43:02.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.676+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=GR0EBNQ95QAR type=write size=673034 2024-09-19T13:43:02.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.677+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=K1FF6P59TXXS type=del size=3638538 2024-09-19T13:43:02.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.678+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~A021LEHG4GFP.0 size=1048576 2024-09-19T13:43:02.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.680+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~A021LEHG4GFP.1 size=666821 2024-09-19T13:43:02.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.682+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=A021LEHG4GFP tag=UWX6459CRK2E type=write size=2763973 2024-09-19T13:43:02.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.683+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=7RHWJU6MGCTH type=del size=685304 2024-09-19T13:43:02.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.685+0000 7f6ab10d2780 1 < completed write operation key=9MCE8PXHBGNF tag=KRH2VYTIFAXS type=write size=441001 2024-09-19T13:43:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.686+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~TLB6OWJOSU2I.0 size=461820 2024-09-19T13:43:02.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.687+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=TLB6OWJOSU2I tag=FTM3Q30JPC0S type=write size=1510396 2024-09-19T13:43:02.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.688+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~55CW29EZPCR7.0 size=1048576 2024-09-19T13:43:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.689+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~55CW29EZPCR7.1 size=1048576 2024-09-19T13:43:02.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.690+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~55CW29EZPCR7.2 size=962038 2024-09-19T13:43:02.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.691+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=55CW29EZPCR7 tag=N2X6GBDNW2GN type=write size=4107766 2024-09-19T13:43:02.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.693+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~IGJXJKWS8O46.0 size=1048576 2024-09-19T13:43:02.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.694+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~IGJXJKWS8O46.1 size=1048576 2024-09-19T13:43:02.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.695+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~IGJXJKWS8O46.2 size=889848 2024-09-19T13:43:02.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.695+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=IGJXJKWS8O46 tag=LCM79UEH0CF0 type=write size=4035576 2024-09-19T13:43:02.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.696+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=3A1T7FXHK6L4 type=del 2024-09-19T13:43:02.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.697+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=X6G56LRHTCNX type=del size=984932 2024-09-19T13:43:02.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.698+0000 7f6ab10d2780 1 < canceled part key=_multipart_WDRUV5ERI000.2~W3FD7TW3YSZF.0 size=1048576 2024-09-19T13:43:02.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.698+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~W3FD7TW3YSZF.1 size=1048576 2024-09-19T13:43:02.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.699+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~W3FD7TW3YSZF.2 size=373524 2024-09-19T13:43:02.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.701+0000 7f6ab10d2780 1 < canceled multipart upload key=WDRUV5ERI000 upload=W3FD7TW3YSZF tag=7FO3LPK3WSB1 type=write size=3519252 2024-09-19T13:43:02.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.702+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=WS29NURKNF07 type=del size=828448 2024-09-19T13:43:02.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.705+0000 7f6ab10d2780 1 < suggested update operation key=SDQ64HOD22EM tag=2C9R4FH4O9XC type=write size=355562 2024-09-19T13:43:02.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.706+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=VWI7UA717JWU type=del size=1906673 2024-09-19T13:43:02.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.707+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=MRZP0VC1VNB8 type=del 2024-09-19T13:43:02.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.709+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~TD1Y715UROE8.0 size=1048576 2024-09-19T13:43:02.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.710+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~TD1Y715UROE8.1 size=1048576 2024-09-19T13:43:02.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.711+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~TD1Y715UROE8.2 size=945462 2024-09-19T13:43:02.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.711+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=TD1Y715UROE8 tag=2YI8T7ZL85QY type=write size=4091190 2024-09-19T13:43:02.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.712+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=DSQIS86S1D22 type=del 2024-09-19T13:43:02.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.713+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=Z7YUK6APAH7I type=del size=3992161 2024-09-19T13:43:02.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.714+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=JMZXOW1P0H0S type=del 2024-09-19T13:43:02.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.717+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~ZXW3C5VGUFZX.0 size=1048576 2024-09-19T13:43:02.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.717+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~ZXW3C5VGUFZX.1 size=1019370 2024-09-19T13:43:02.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.717+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=ZXW3C5VGUFZX tag=DJMGA6A667VU type=write size=3116522 2024-09-19T13:43:02.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.719+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=3HSQG4CJD4ZF type=del 2024-09-19T13:43:02.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.721+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~8VEKLLN2J1HE.0 size=1048576 2024-09-19T13:43:02.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.721+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~8VEKLLN2J1HE.1 size=701491 2024-09-19T13:43:02.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.721+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=8VEKLLN2J1HE tag=4WDU2UOL3M3O type=write size=2798643 2024-09-19T13:43:02.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.723+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=XS824BBERMWN type=del 2024-09-19T13:43:02.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.725+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~V6PMC6II6FS3.0 size=1048576 2024-09-19T13:43:02.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.726+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~V6PMC6II6FS3.1 size=436962 2024-09-19T13:43:02.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.726+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=V6PMC6II6FS3 tag=Z6JFMOQZMFK4 type=write size=2534114 2024-09-19T13:43:02.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.727+0000 7f6ab10d2780 1 < completed write operation key=UX2ICIT36Q3R tag=NNVJ7U1UU6N3 type=write size=541705 2024-09-19T13:43:02.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.728+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=9JC37MFPS1FC type=del size=2246065 2024-09-19T13:43:02.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.729+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=I37A3Z00UMQG type=del 2024-09-19T13:43:02.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.731+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~4CSIL14IUG40.0 size=1048576 2024-09-19T13:43:02.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.732+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~4CSIL14IUG40.1 size=445185 2024-09-19T13:43:02.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.732+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=4CSIL14IUG40 tag=ONDWT4SGUTGW type=write size=2542337 2024-09-19T13:43:02.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.733+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~WUGG0OET3CC5.0 size=1048576 2024-09-19T13:43:02.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.734+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~WUGG0OET3CC5.1 size=152705 2024-09-19T13:43:02.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.736+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=WUGG0OET3CC5 tag=YEHFSCDS75HP type=write size=2249857 2024-09-19T13:43:02.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.737+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=79DJR779ZFU8 type=del size=3639220 2024-09-19T13:43:02.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.738+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~KVXFOCU07QCP.0 size=1048576 2024-09-19T13:43:02.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.739+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~KVXFOCU07QCP.1 size=1048576 2024-09-19T13:43:02.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.740+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~KVXFOCU07QCP.2 size=912153 2024-09-19T13:43:02.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.742+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=KVXFOCU07QCP tag=BGYYNU1F3YX4 type=write size=4057881 2024-09-19T13:43:02.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.744+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~UTDGKK6KS3IF.0 size=1048576 2024-09-19T13:43:02.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.745+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~UTDGKK6KS3IF.1 size=1048576 2024-09-19T13:43:02.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.746+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~UTDGKK6KS3IF.2 size=302430 2024-09-19T13:43:02.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.746+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=UTDGKK6KS3IF tag=XZFWMHETYX60 type=write size=3448158 2024-09-19T13:43:02.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.749+0000 7f6ab10d2780 1 < suggested update operation key=X1JYDG1ASYAR tag=K1FF6P59TXXS type=del size=3638538 2024-09-19T13:43:02.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.750+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=6B4CU1Y5JJXX type=del size=1381986 2024-09-19T13:43:02.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.751+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=7RHWJU6MGCTH type=del 2024-09-19T13:43:02.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.752+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=80IR11123RY9 type=del size=3863846 2024-09-19T13:43:02.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.753+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~TLB6OWJOSU2I.0 size=461820 2024-09-19T13:43:02.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.755+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=TLB6OWJOSU2I tag=FTM3Q30JPC0S type=write size=1510396 2024-09-19T13:43:02.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.756+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=B0W2AABNN73D type=del size=3637469 2024-09-19T13:43:02.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.758+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~IGJXJKWS8O46.0 size=1048576 2024-09-19T13:43:02.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.759+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~IGJXJKWS8O46.1 size=1048576 2024-09-19T13:43:02.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.760+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~IGJXJKWS8O46.2 size=889848 2024-09-19T13:43:02.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.761+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=IGJXJKWS8O46 tag=LCM79UEH0CF0 type=write size=4035576 2024-09-19T13:43:02.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.763+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=MUYY7HMGGMV0 type=write size=131575 2024-09-19T13:43:02.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.765+0000 7f6ab10d2780 1 < suggested remove operation key=EE8F84K0ZAGJ tag=X6G56LRHTCNX type=del 2024-09-19T13:43:02.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.767+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~X98DIM5128C6.0 size=1048576 2024-09-19T13:43:02.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.768+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~X98DIM5128C6.1 size=847560 2024-09-19T13:43:02.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.768+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=X98DIM5128C6 tag=U0WFJNZBJWKS type=write size=2944712 2024-09-19T13:43:02.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.769+0000 7f6ab10d2780 -1 < failed to complete operation key=X1JYDG1ASYAR tag=WS29NURKNF07 type=del size=828448: (22) Invalid argument 2024-09-19T13:43:02.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.770+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=00K1YN4PIMW7 type=del size=3046328 2024-09-19T13:43:02.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.773+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=VWI7UA717JWU type=del size=1906673 2024-09-19T13:43:02.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.775+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~SZH62E4JA0WP.0 size=664563 2024-09-19T13:43:02.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.775+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=SZH62E4JA0WP tag=VPLEIY5HJRN1 type=write size=1713139 2024-09-19T13:43:02.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.776+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~TD1Y715UROE8.0 size=1048576 2024-09-19T13:43:02.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.777+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~TD1Y715UROE8.1 size=1048576 2024-09-19T13:43:02.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.778+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~TD1Y715UROE8.2 size=945462 2024-09-19T13:43:02.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.780+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=TD1Y715UROE8 tag=2YI8T7ZL85QY type=write size=4091190 2024-09-19T13:43:02.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.782+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~H7L3VX0X8OWA.0 size=796643 2024-09-19T13:43:02.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.782+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=H7L3VX0X8OWA tag=YL63R2VCZAAX type=write size=1845219 2024-09-19T13:43:02.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.783+0000 7f6ab10d2780 -1 < failed to complete operation key=VFJIKOLYI0HN tag=Z7YUK6APAH7I type=del size=3992161: (22) Invalid argument 2024-09-19T13:43:02.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.784+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=BTD21LZBWZW2 type=del size=2432959 2024-09-19T13:43:02.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.785+0000 7f6ab10d2780 1 < canceled part key=_multipart_SRABG45EPVN2.2~ZXW3C5VGUFZX.0 size=1048576 2024-09-19T13:43:02.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.787+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~ZXW3C5VGUFZX.1 size=1019370 2024-09-19T13:43:02.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.789+0000 7f6ab10d2780 1 < canceled multipart upload key=SRABG45EPVN2 upload=ZXW3C5VGUFZX tag=DJMGA6A667VU type=write size=3116522 2024-09-19T13:43:02.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.790+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=Y1RRZUONTY3R type=del size=1348304 2024-09-19T13:43:02.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.791+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~8VEKLLN2J1HE.0 size=1048576 2024-09-19T13:43:02.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.792+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~8VEKLLN2J1HE.1 size=701491 2024-09-19T13:43:02.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.794+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=8VEKLLN2J1HE tag=4WDU2UOL3M3O type=write size=2798643 2024-09-19T13:43:02.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.795+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=FI0CQ3D5XJ89 type=del size=775361 2024-09-19T13:43:02.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.796+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~V6PMC6II6FS3.0 size=1048576 2024-09-19T13:43:02.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.797+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~V6PMC6II6FS3.1 size=436962 2024-09-19T13:43:02.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.799+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=V6PMC6II6FS3 tag=Z6JFMOQZMFK4 type=write size=2534114 2024-09-19T13:43:02.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.800+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=X75M110S71NS type=del size=1188991 2024-09-19T13:43:02.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.801+0000 7f6ab10d2780 1 < canceled operation key=4OSJA1879NQO tag=9JC37MFPS1FC type=del size=2246065 2024-09-19T13:43:02.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.803+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~TR812EU4GB41.0 size=1048576 2024-09-19T13:43:02.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.804+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~TR812EU4GB41.1 size=233474 2024-09-19T13:43:02.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.804+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=TR812EU4GB41 tag=7QKPVKJO3EW1 type=write size=2330626 2024-09-19T13:43:02.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.805+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~4CSIL14IUG40.0 size=1048576 2024-09-19T13:43:02.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.806+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~4CSIL14IUG40.1 size=445185 2024-09-19T13:43:02.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.808+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=4CSIL14IUG40 tag=ONDWT4SGUTGW type=write size=2542337 2024-09-19T13:43:02.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.810+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~2260SKBTNWM7.0 size=1048576 2024-09-19T13:43:02.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.811+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~2260SKBTNWM7.1 size=112494 2024-09-19T13:43:02.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.811+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=2260SKBTNWM7 tag=8RT0TWSEXL2L type=write size=2209646 2024-09-19T13:43:02.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.812+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=79DJR779ZFU8 type=del 2024-09-19T13:43:02.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.813+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=E81C8YKDZW3T type=del size=3426142 2024-09-19T13:43:02.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.813+0000 7f6ab10d2780 1 < canceled part key=_multipart_V8P17ZSOQUSM.2~UTDGKK6KS3IF.0 size=1048576 2024-09-19T13:43:02.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.814+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~UTDGKK6KS3IF.1 size=1048576 2024-09-19T13:43:02.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.814+0000 7f6ab10d2780 1 < canceled part key=_multipart_V8P17ZSOQUSM.2~UTDGKK6KS3IF.2 size=302430 2024-09-19T13:43:02.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.816+0000 7f6ab10d2780 1 < canceled multipart upload key=V8P17ZSOQUSM upload=UTDGKK6KS3IF tag=XZFWMHETYX60 type=write size=3448158 2024-09-19T13:43:02.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.818+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~SX084W1N7117.0 size=1048576 2024-09-19T13:43:02.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.819+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~SX084W1N7117.1 size=865997 2024-09-19T13:43:02.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.819+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=SX084W1N7117 tag=7KFITX4LF0FL type=write size=2963149 2024-09-19T13:43:02.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.820+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=6B4CU1Y5JJXX type=del 2024-09-19T13:43:02.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.821+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=TWO5AKCE4K2O type=write size=930064 2024-09-19T13:43:02.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.823+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=80IR11123RY9 type=del 2024-09-19T13:43:02.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.825+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~SD3J9K1Z5YB5.0 size=781390 2024-09-19T13:43:02.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.825+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=SD3J9K1Z5YB5 tag=GVOU29I0UFPI type=write size=1829966 2024-09-19T13:43:02.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.826+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=B0W2AABNN73D type=del 2024-09-19T13:43:02.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.827+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=WNKBOIEA10JP type=del size=3092621 2024-09-19T13:43:02.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.829+0000 7f6ab10d2780 1 < suggested remove operation key=TCXAYADSCTZI tag=MUYY7HMGGMV0 type=write 2024-09-19T13:43:02.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.830+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=A270WV5GVNTT type=write size=799866 2024-09-19T13:43:02.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.832+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~X98DIM5128C6.0 size=1048576 2024-09-19T13:43:02.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.832+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~X98DIM5128C6.1 size=847560 2024-09-19T13:43:02.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.834+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=X98DIM5128C6 tag=U0WFJNZBJWKS type=write size=2944712 2024-09-19T13:43:02.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.836+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~FZ5AWJEF60QB.0 size=1048576 2024-09-19T13:43:02.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~FZ5AWJEF60QB.1 size=896366 2024-09-19T13:43:02.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.837+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=FZ5AWJEF60QB tag=FAR3361VT62T type=write size=2993518 2024-09-19T13:43:02.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.839+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=00K1YN4PIMW7 type=del 2024-09-19T13:43:02.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.840+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=5XV0H5FVKXH8 type=write size=538619 2024-09-19T13:43:02.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.840+0000 7f6ab10d2780 1 < canceled part key=_multipart_2KX2NSY41STV.2~SZH62E4JA0WP.0 size=664563 2024-09-19T13:43:02.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.842+0000 7f6ab10d2780 1 < canceled multipart upload key=2KX2NSY41STV upload=SZH62E4JA0WP tag=VPLEIY5HJRN1 type=write size=1713139 2024-09-19T13:43:02.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.843+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=M3GXKMCGTGWO type=del size=1091080 2024-09-19T13:43:02.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.844+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~H7L3VX0X8OWA.0 size=796643 2024-09-19T13:43:02.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.846+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=H7L3VX0X8OWA tag=YL63R2VCZAAX type=write size=1845219 2024-09-19T13:43:02.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.849+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~40SVAB1PHVUB.0 size=1048576 2024-09-19T13:43:02.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.850+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~40SVAB1PHVUB.1 size=1048576 2024-09-19T13:43:02.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.851+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~40SVAB1PHVUB.2 size=146941 2024-09-19T13:43:02.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.851+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=40SVAB1PHVUB tag=76Z3H0GIGCD0 type=write size=3292669 2024-09-19T13:43:02.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.853+0000 7f6ab10d2780 1 < suggested remove operation key=XQLWZA2X91GF tag=BTD21LZBWZW2 type=del 2024-09-19T13:43:02.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.854+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=G5IHJ0ZHBGIT type=del size=3191400 2024-09-19T13:43:02.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.854+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=TCXAYADSCTZI tag=Y1RRZUONTY3R type=del size=1348304: (2) No such file or directory 2024-09-19T13:43:02.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.857+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~AIN7UXSXT1K0.0 size=1048576 2024-09-19T13:43:02.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.857+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~AIN7UXSXT1K0.1 size=242892 2024-09-19T13:43:02.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.857+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=AIN7UXSXT1K0 tag=U65WKP0N703D type=write size=2340044 2024-09-19T13:43:02.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.859+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=FI0CQ3D5XJ89 type=del 2024-09-19T13:43:02.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.861+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~HZOO0V91KY66.0 size=1048576 2024-09-19T13:43:02.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.861+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~HZOO0V91KY66.1 size=1048576 2024-09-19T13:43:02.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.862+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~HZOO0V91KY66.2 size=539792 2024-09-19T13:43:02.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.862+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=HZOO0V91KY66 tag=H26YC3S83QOY type=write size=3685520 2024-09-19T13:43:02.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.863+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=X75M110S71NS type=del 2024-09-19T13:43:02.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.865+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=C3F06SIV5T7M type=del size=2406423 2024-09-19T13:43:02.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.866+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~TR812EU4GB41.0 size=1048576 2024-09-19T13:43:02.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.867+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~TR812EU4GB41.1 size=233474 2024-09-19T13:43:02.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.869+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=TR812EU4GB41 tag=7QKPVKJO3EW1 type=write size=2330626 2024-09-19T13:43:02.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.870+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=CAQ52BL8D8A9 type=del size=2586603 2024-09-19T13:43:02.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.871+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~2260SKBTNWM7.0 size=1048576 2024-09-19T13:43:02.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.872+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~2260SKBTNWM7.1 size=112494 2024-09-19T13:43:02.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.874+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=2260SKBTNWM7 tag=8RT0TWSEXL2L type=write size=2209646 2024-09-19T13:43:02.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.875+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=4FTD1TJI7GTP type=del size=1823756 2024-09-19T13:43:02.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.876+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=E81C8YKDZW3T type=del 2024-09-19T13:43:02.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.878+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=6KE5QF2CDFBE type=write size=99595 2024-09-19T13:43:02.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.879+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~SX084W1N7117.0 size=1048576 2024-09-19T13:43:02.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.880+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~SX084W1N7117.1 size=865997 2024-09-19T13:43:02.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.882+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=SX084W1N7117 tag=7KFITX4LF0FL type=write size=2963149 2024-09-19T13:43:02.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.883+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=M7WP6FWYD6E8 type=del size=1367514 2024-09-19T13:43:02.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.884+0000 7f6ab10d2780 1 < canceled operation key=UPMXNNYUUJR7 tag=TWO5AKCE4K2O type=write size=930064 2024-09-19T13:43:02.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.886+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~EX6706XEAXDI.0 size=1048576 2024-09-19T13:43:02.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.887+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~EX6706XEAXDI.1 size=1048576 2024-09-19T13:43:02.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.888+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~EX6706XEAXDI.2 size=413376 2024-09-19T13:43:02.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.888+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=EX6706XEAXDI tag=NDDXGTZYADY9 type=write size=3559104 2024-09-19T13:43:02.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.889+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~SD3J9K1Z5YB5.0 size=781390 2024-09-19T13:43:02.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.891+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=SD3J9K1Z5YB5 tag=GVOU29I0UFPI type=write size=1829966 2024-09-19T13:43:02.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.893+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=GEVDSL9AMX1I type=del size=2318534 2024-09-19T13:43:02.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.894+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=WNKBOIEA10JP type=del 2024-09-19T13:43:02.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.895+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=G6G8XJKAJ7SQ type=del size=4186374 2024-09-19T13:43:02.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.896+0000 7f6ab10d2780 1 < completed write operation key=9WTLWBONAOET tag=A270WV5GVNTT type=write size=799866 2024-09-19T13:43:02.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.899+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~VHS6C6NZV24P.0 size=1048576 2024-09-19T13:43:02.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.899+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~VHS6C6NZV24P.1 size=1048576 2024-09-19T13:43:02.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.900+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~VHS6C6NZV24P.2 size=748548 2024-09-19T13:43:02.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.900+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=VHS6C6NZV24P tag=RZ1GBE1VUE24 type=write size=3894276 2024-09-19T13:43:02.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.901+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~FZ5AWJEF60QB.0 size=1048576 2024-09-19T13:43:02.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.902+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~FZ5AWJEF60QB.1 size=896366 2024-09-19T13:43:02.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.904+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=FZ5AWJEF60QB tag=FAR3361VT62T type=write size=2993518 2024-09-19T13:43:02.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.905+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=T4GB0OA81A58 type=write size=493931 2024-09-19T13:43:02.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.906+0000 7f6ab10d2780 1 < completed write operation key=535R757HSXMB tag=5XV0H5FVKXH8 type=write size=538619 2024-09-19T13:43:02.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.908+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~POPJ57HGI3QT.0 size=243873 2024-09-19T13:43:02.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.908+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=POPJ57HGI3QT tag=GNY8U6FS01AK type=write size=1292449 2024-09-19T13:43:02.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.909+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=M3GXKMCGTGWO type=del 2024-09-19T13:43:02.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.911+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=4ZYLBUI3L2HW type=del size=3967127 2024-09-19T13:43:02.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.912+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~40SVAB1PHVUB.0 size=1048576 2024-09-19T13:43:02.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.913+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~40SVAB1PHVUB.1 size=1048576 2024-09-19T13:43:02.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.913+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~40SVAB1PHVUB.2 size=146941 2024-09-19T13:43:02.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.915+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=40SVAB1PHVUB tag=76Z3H0GIGCD0 type=write size=3292669 2024-09-19T13:43:02.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.916+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=3E3LM7897X5W type=del size=3267852 2024-09-19T13:43:02.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.918+0000 7f6ab10d2780 1 < canceled operation key=XQLWZA2X91GF tag=G5IHJ0ZHBGIT type=del size=3191400 2024-09-19T13:43:02.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.919+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=DR8RD3D9H3PT type=del size=1289164 2024-09-19T13:43:02.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.921+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~AIN7UXSXT1K0.0 size=1048576 2024-09-19T13:43:02.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.922+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~AIN7UXSXT1K0.1 size=242892 2024-09-19T13:43:02.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.923+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=AIN7UXSXT1K0 tag=U65WKP0N703D type=write size=2340044 2024-09-19T13:43:02.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.924+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=WISTXPGADHZX type=del size=1072120 2024-09-19T13:43:02.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.926+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~HZOO0V91KY66.0 size=1048576 2024-09-19T13:43:02.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.927+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~HZOO0V91KY66.1 size=1048576 2024-09-19T13:43:02.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.927+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~HZOO0V91KY66.2 size=539792 2024-09-19T13:43:02.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.929+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=HZOO0V91KY66 tag=H26YC3S83QOY type=write size=3685520 2024-09-19T13:43:02.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.930+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=1JVR6BFPNZ82 type=del size=126487 2024-09-19T13:43:02.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.932+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=C3F06SIV5T7M type=del 2024-09-19T13:43:02.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.933+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=MLUQU020Z3RO type=del size=965950 2024-09-19T13:43:02.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.934+0000 7f6ab10d2780 1 < canceled operation key=4OSJA1879NQO tag=CAQ52BL8D8A9 type=del size=2586603 2024-09-19T13:43:02.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.936+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~FYFDOZWKTU8H.0 size=427525 2024-09-19T13:43:02.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.936+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=FYFDOZWKTU8H tag=ZI8FHDAAUYOM type=write size=1476101 2024-09-19T13:43:02.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.937+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=4FTD1TJI7GTP type=del 2024-09-19T13:43:02.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.938+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=FCGH0Y2QE8OJ type=del size=695610 2024-09-19T13:43:02.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.939+0000 7f6ab10d2780 1 < completed write operation key=UPMXNNYUUJR7 tag=6KE5QF2CDFBE type=write size=99595 2024-09-19T13:43:02.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.940+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=R9P2CKDPIYDV type=del size=1550783 2024-09-19T13:43:02.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.941+0000 7f6ab10d2780 1 < canceled operation key=CD4XXORKVS6J tag=M7WP6FWYD6E8 type=del size=1367514 2024-09-19T13:43:02.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.944+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~9TJ2E38GTY63.0 size=1048576 2024-09-19T13:43:02.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.944+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~9TJ2E38GTY63.1 size=956718 2024-09-19T13:43:02.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.944+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=9TJ2E38GTY63 tag=3C56BSYBPIZG type=write size=3053870 2024-09-19T13:43:02.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.945+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~EX6706XEAXDI.0 size=1048576 2024-09-19T13:43:02.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.946+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~EX6706XEAXDI.1 size=1048576 2024-09-19T13:43:02.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.947+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~EX6706XEAXDI.2 size=413376 2024-09-19T13:43:02.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.949+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=EX6706XEAXDI tag=NDDXGTZYADY9 type=write size=3559104 2024-09-19T13:43:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.951+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~6OEX9F0NYOSC.0 size=703687 2024-09-19T13:43:02.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.951+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=6OEX9F0NYOSC tag=PN7BWZ73X49P type=write size=1752263 2024-09-19T13:43:02.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.952+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=GEVDSL9AMX1I type=del 2024-09-19T13:43:02.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.953+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=MAZZV1JQX2IN type=del size=1367642 2024-09-19T13:43:02.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.955+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=G6G8XJKAJ7SQ type=del 2024-09-19T13:43:02.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.956+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=ECP8VI97MH6C type=del size=295283 2024-09-19T13:43:02.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.957+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~VHS6C6NZV24P.0 size=1048576 2024-09-19T13:43:02.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.958+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~VHS6C6NZV24P.1 size=1048576 2024-09-19T13:43:02.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.959+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~VHS6C6NZV24P.2 size=748548 2024-09-19T13:43:02.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.961+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=VHS6C6NZV24P tag=RZ1GBE1VUE24 type=write size=3894276 2024-09-19T13:43:02.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.963+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~4BBSK6DW2O6N.0 size=1048576 2024-09-19T13:43:02.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.964+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~4BBSK6DW2O6N.1 size=438866 2024-09-19T13:43:02.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.964+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=4BBSK6DW2O6N tag=W386SY3M4FA8 type=write size=2536018 2024-09-19T13:43:02.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.966+0000 7f6ab10d2780 1 < suggested remove operation key=DTSRVH526PE7 tag=T4GB0OA81A58 type=write 2024-09-19T13:43:02.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.967+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=789DTQ14VCDY type=del size=1353072 2024-09-19T13:43:02.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.968+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~POPJ57HGI3QT.0 size=243873 2024-09-19T13:43:02.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.970+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=POPJ57HGI3QT tag=GNY8U6FS01AK type=write size=1292449 2024-09-19T13:43:02.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.972+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~POL7S43472SW.0 size=1048576 2024-09-19T13:43:02.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.973+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~POL7S43472SW.1 size=1048576 2024-09-19T13:43:02.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.974+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~POL7S43472SW.2 size=466333 2024-09-19T13:43:02.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.974+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=POL7S43472SW tag=DH54NVK0NHCC type=write size=3612061 2024-09-19T13:43:02.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.975+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=4ZYLBUI3L2HW type=del 2024-09-19T13:43:02.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.976+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=Q4IIYQ00UKPI type=del size=936023 2024-09-19T13:43:02.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.977+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=3E3LM7897X5W type=del 2024-09-19T13:43:02.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.978+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=WA03WK8OCJYZ type=del size=2040088 2024-09-19T13:43:02.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.980+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=DR8RD3D9H3PT type=del 2024-09-19T13:43:02.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.981+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=IQ47GDRQ6WW5 type=del size=1784423 2024-09-19T13:43:02.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.982+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=WISTXPGADHZX type=del 2024-09-19T13:43:02.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.983+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=GMIDOA4VLGBP type=del size=3854240 2024-09-19T13:43:02.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.985+0000 7f6ab10d2780 1 < suggested update operation key=7LHSAN5BBQRW tag=1JVR6BFPNZ82 type=del size=126487 2024-09-19T13:43:02.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.986+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=U85VIJIZ6MF8 type=del size=1649965 2024-09-19T13:43:02.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.987+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=MLUQU020Z3RO type=del 2024-09-19T13:43:02.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.988+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=FBYSG8N2JYA1 type=write size=622790 2024-09-19T13:43:02.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.990+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~FYFDOZWKTU8H.0 size=427525 2024-09-19T13:43:02.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.992+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=FYFDOZWKTU8H tag=ZI8FHDAAUYOM type=write size=1476101 2024-09-19T13:43:02.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.994+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~R5XBE8OWFM2W.0 size=1048576 2024-09-19T13:43:02.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.995+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~R5XBE8OWFM2W.1 size=851474 2024-09-19T13:43:02.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.995+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=R5XBE8OWFM2W tag=G184098J9QFI type=write size=2948626 2024-09-19T13:43:02.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.996+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=FCGH0Y2QE8OJ type=del 2024-09-19T13:43:02.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.997+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=3DUXKHSW1AUM type=del size=2766927 2024-09-19T13:43:03.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:02.999+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=R9P2CKDPIYDV type=del 2024-09-19T13:43:03.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.001+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~0C2903WTXHRT.0 size=1048576 2024-09-19T13:43:03.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.002+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~0C2903WTXHRT.1 size=261752 2024-09-19T13:43:03.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.002+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=0C2903WTXHRT tag=28XKUAYRRRXV type=write size=2358904 2024-09-19T13:43:03.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.003+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~9TJ2E38GTY63.0 size=1048576 2024-09-19T13:43:03.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.004+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~9TJ2E38GTY63.1 size=956718 2024-09-19T13:43:03.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.006+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=9TJ2E38GTY63 tag=3C56BSYBPIZG type=write size=3053870 2024-09-19T13:43:03.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.007+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=JLMCB2LT33JG type=del size=1273365 2024-09-19T13:43:03.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.008+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~6OEX9F0NYOSC.0 size=703687 2024-09-19T13:43:03.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.010+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=6OEX9F0NYOSC tag=PN7BWZ73X49P type=write size=1752263 2024-09-19T13:43:03.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.012+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~8TOY0FSVV5OG.0 size=1048576 2024-09-19T13:43:03.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.013+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~8TOY0FSVV5OG.1 size=1048576 2024-09-19T13:43:03.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.014+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~8TOY0FSVV5OG.2 size=869260 2024-09-19T13:43:03.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.014+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=8TOY0FSVV5OG tag=0303OA7QSSG0 type=write size=4014988 2024-09-19T13:43:03.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.015+0000 7f6ab10d2780 1 < canceled operation key=A14YTABJ1Z3Z tag=MAZZV1JQX2IN type=del size=1367642 2024-09-19T13:43:03.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.016+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=ESMZYZNP1NDD type=del size=3549704 2024-09-19T13:43:03.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.018+0000 7f6ab10d2780 1 < suggested remove operation key=RU6OR8SM72GU tag=ECP8VI97MH6C type=del 2024-09-19T13:43:03.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.020+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~ZN351T5MV49R.0 size=1048576 2024-09-19T13:43:03.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.021+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~ZN351T5MV49R.1 size=864644 2024-09-19T13:43:03.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.021+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=ZN351T5MV49R tag=ZKZU4AWJHL1B type=write size=2961796 2024-09-19T13:43:03.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.021+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~4BBSK6DW2O6N.0 size=1048576 2024-09-19T13:43:03.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.022+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~4BBSK6DW2O6N.1 size=438866 2024-09-19T13:43:03.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.024+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=4BBSK6DW2O6N tag=W386SY3M4FA8 type=write size=2536018 2024-09-19T13:43:03.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.026+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~3XEKHZMKQYBQ.0 size=169510 2024-09-19T13:43:03.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.026+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=3XEKHZMKQYBQ tag=I5BRUZUCKVUQ type=write size=1218086 2024-09-19T13:43:03.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.027+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=789DTQ14VCDY type=del 2024-09-19T13:43:03.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.029+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~SCDGXDL6KIBO.0 size=1048576 2024-09-19T13:43:03.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.030+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~SCDGXDL6KIBO.1 size=1048576 2024-09-19T13:43:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.031+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~SCDGXDL6KIBO.2 size=298887 2024-09-19T13:43:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.031+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=SCDGXDL6KIBO tag=MOT6PPU3N21Q type=write size=3444615 2024-09-19T13:43:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.032+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~POL7S43472SW.0 size=1048576 2024-09-19T13:43:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.033+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~POL7S43472SW.1 size=1048576 2024-09-19T13:43:03.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.034+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~POL7S43472SW.2 size=466333 2024-09-19T13:43:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.036+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=POL7S43472SW tag=DH54NVK0NHCC type=write size=3612061 2024-09-19T13:43:03.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.037+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=0RGC3SSEQGFR type=del size=535114 2024-09-19T13:43:03.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.038+0000 7f6ab10d2780 1 < canceled operation key=9IN6E0JQFNAU tag=Q4IIYQ00UKPI type=del size=936023 2024-09-19T13:43:03.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.039+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=PJSG9EE8WQ8F type=del size=1047691 2024-09-19T13:43:03.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.041+0000 7f6ab10d2780 1 < canceled operation key=X8CWBFNCJG6M tag=WA03WK8OCJYZ type=del size=2040088 2024-09-19T13:43:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.042+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=LT3O7AMVZNH6 type=del size=471452 2024-09-19T13:43:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.043+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=IQ47GDRQ6WW5 type=del 2024-09-19T13:43:03.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.044+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=R14TMRZS34RO type=del size=2501664 2024-09-19T13:43:03.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.045+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=GMIDOA4VLGBP type=del 2024-09-19T13:43:03.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.046+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=0EXYEWR7P760 type=del size=418812 2024-09-19T13:43:03.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.047+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=U85VIJIZ6MF8 type=del 2024-09-19T13:43:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.049+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=1ZZU801U9KDO type=del size=2648050 2024-09-19T13:43:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.049+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=RU6OR8SM72GU tag=FBYSG8N2JYA1 type=write size=622790: (2) No such file or directory 2024-09-19T13:43:03.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.050+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=6ZZ8JQAIC09Y type=del size=2529354 2024-09-19T13:43:03.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.051+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~R5XBE8OWFM2W.0 size=1048576 2024-09-19T13:43:03.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.052+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~R5XBE8OWFM2W.1 size=851474 2024-09-19T13:43:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.054+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=R5XBE8OWFM2W tag=G184098J9QFI type=write size=2948626 2024-09-19T13:43:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.055+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=BD6F84DLKJ47 type=del size=64583 2024-09-19T13:43:03.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.057+0000 7f6ab10d2780 1 < suggested remove operation key=UPMXNNYUUJR7 tag=3DUXKHSW1AUM type=del 2024-09-19T13:43:03.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.059+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~YXIYIJCJNPQP.0 size=554373 2024-09-19T13:43:03.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.059+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=YXIYIJCJNPQP tag=3452ZLVJ3LLS type=write size=1602949 2024-09-19T13:43:03.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.061+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~0C2903WTXHRT.0 size=1048576 2024-09-19T13:43:03.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.061+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~0C2903WTXHRT.1 size=261752 2024-09-19T13:43:03.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.063+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=0C2903WTXHRT tag=28XKUAYRRRXV type=write size=2358904 2024-09-19T13:43:03.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.064+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=GLK0TJYCMI4O type=del size=473166 2024-09-19T13:43:03.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.065+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=JLMCB2LT33JG type=del 2024-09-19T13:43:03.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.067+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=Z4K45HW7EJIJ type=del size=4007156 2024-09-19T13:43:03.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.068+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~8TOY0FSVV5OG.0 size=1048576 2024-09-19T13:43:03.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.068+0000 7f6ab10d2780 1 < canceled part key=_multipart_13GXIDWI4J9F.2~8TOY0FSVV5OG.1 size=1048576 2024-09-19T13:43:03.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.069+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~8TOY0FSVV5OG.2 size=869260 2024-09-19T13:43:03.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.070+0000 7f6ab10d2780 1 < canceled multipart upload key=13GXIDWI4J9F upload=8TOY0FSVV5OG tag=0303OA7QSSG0 type=write size=4014988 2024-09-19T13:43:03.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.071+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=E1L83PXT11XA type=del size=75374 2024-09-19T13:43:03.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.072+0000 7f6ab10d2780 -1 < failed to complete operation key=RU6OR8SM72GU tag=ESMZYZNP1NDD type=del size=3549704: (22) Invalid argument 2024-09-19T13:43:03.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.074+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=XWDIMW3YMRYP type=del size=1233111 2024-09-19T13:43:03.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.075+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~ZN351T5MV49R.0 size=1048576 2024-09-19T13:43:03.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.076+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~ZN351T5MV49R.1 size=864644 2024-09-19T13:43:03.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.077+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=ZN351T5MV49R tag=ZKZU4AWJHL1B type=write size=2961796 2024-09-19T13:43:03.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.079+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=MG94EH4WLKV1 type=del size=2191482 2024-09-19T13:43:03.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.080+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~3XEKHZMKQYBQ.0 size=169510 2024-09-19T13:43:03.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.081+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=3XEKHZMKQYBQ tag=I5BRUZUCKVUQ type=write size=1218086 2024-09-19T13:43:03.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.083+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=IHFCD5W9B0TI type=del size=1191881 2024-09-19T13:43:03.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.084+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~SCDGXDL6KIBO.0 size=1048576 2024-09-19T13:43:03.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.085+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~SCDGXDL6KIBO.1 size=1048576 2024-09-19T13:43:03.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.085+0000 7f6ab10d2780 1 < canceled part key=_multipart_9MCE8PXHBGNF.2~SCDGXDL6KIBO.2 size=298887 2024-09-19T13:43:03.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.087+0000 7f6ab10d2780 1 < canceled multipart upload key=9MCE8PXHBGNF upload=SCDGXDL6KIBO tag=MOT6PPU3N21Q type=write size=3444615 2024-09-19T13:43:03.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.088+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=KFZV1K580YI1 type=del size=531588 2024-09-19T13:43:03.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.089+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=0RGC3SSEQGFR type=del 2024-09-19T13:43:03.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.091+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ZZ31M8V13YV2.0 size=1048576 2024-09-19T13:43:03.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.092+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ZZ31M8V13YV2.1 size=675479 2024-09-19T13:43:03.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.092+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=ZZ31M8V13YV2 tag=H71QCRXG4HWX type=write size=2772631 2024-09-19T13:43:03.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.093+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=PJSG9EE8WQ8F type=del 2024-09-19T13:43:03.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.095+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~AA4GIA05LDYY.0 size=1048576 2024-09-19T13:43:03.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.096+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~AA4GIA05LDYY.1 size=887204 2024-09-19T13:43:03.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.096+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=AA4GIA05LDYY tag=CVRG2J84IYK1 type=write size=2984356 2024-09-19T13:43:03.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.098+0000 7f6ab10d2780 1 < suggested remove operation key=PUXLW9NBBQJX tag=LT3O7AMVZNH6 type=del 2024-09-19T13:43:03.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.099+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=E144NCPV0LWO type=del size=1168272 2024-09-19T13:43:03.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.101+0000 7f6ab10d2780 1 < suggested remove operation key=EE8F84K0ZAGJ tag=R14TMRZS34RO type=del 2024-09-19T13:43:03.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.105+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~DJ1PGABW6ERK.0 size=1048576 2024-09-19T13:43:03.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.105+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~DJ1PGABW6ERK.1 size=895088 2024-09-19T13:43:03.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.105+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=DJ1PGABW6ERK tag=LGAV3BAN3WE7 type=write size=2992240 2024-09-19T13:43:03.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.107+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=0EXYEWR7P760 type=del 2024-09-19T13:43:03.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.109+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~YYZIRTPANJVN.0 size=458695 2024-09-19T13:43:03.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.109+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=YYZIRTPANJVN tag=WAXKRDZF5UGB type=write size=1507271 2024-09-19T13:43:03.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.110+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=1ZZU801U9KDO type=del 2024-09-19T13:43:03.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.111+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=MIYWURLWMVT3 type=del size=4073066 2024-09-19T13:43:03.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.112+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=6ZZ8JQAIC09Y type=del 2024-09-19T13:43:03.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.114+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~4QP8GW313MCZ.0 size=1048576 2024-09-19T13:43:03.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.115+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~4QP8GW313MCZ.1 size=1048576 2024-09-19T13:43:03.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.116+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~4QP8GW313MCZ.2 size=462744 2024-09-19T13:43:03.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.116+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=4QP8GW313MCZ tag=IBQNXKUMPIIH type=write size=3608472 2024-09-19T13:43:03.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.118+0000 7f6ab10d2780 1 < suggested remove operation key=X1JYDG1ASYAR tag=BD6F84DLKJ47 type=del 2024-09-19T13:43:03.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.120+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~FD612IV3SG96.0 size=1048576 2024-09-19T13:43:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.121+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~FD612IV3SG96.1 size=789300 2024-09-19T13:43:03.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.121+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=FD612IV3SG96 tag=ABOW2YN9KXE1 type=write size=2886452 2024-09-19T13:43:03.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.122+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~YXIYIJCJNPQP.0 size=554373 2024-09-19T13:43:03.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.124+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=YXIYIJCJNPQP tag=3452ZLVJ3LLS type=write size=1602949 2024-09-19T13:43:03.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.125+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=7LEZAT1YK2WY type=del size=1240514 2024-09-19T13:43:03.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.128+0000 7f6ab10d2780 1 < suggested update operation key=RXXCDV0LTCKS tag=GLK0TJYCMI4O type=del size=473166 2024-09-19T13:43:03.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.129+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=NJ2EYBZCD6VL type=del size=1434905 2024-09-19T13:43:03.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.130+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=Z4K45HW7EJIJ type=del 2024-09-19T13:43:03.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.131+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=BP728FIXLQBT type=del size=3490758 2024-09-19T13:43:03.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.132+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=E1L83PXT11XA type=del 2024-09-19T13:43:03.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.133+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=STYN2A9H82F1 type=write size=586626 2024-09-19T13:43:03.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.135+0000 7f6ab10d2780 1 < canceled operation key=SRABG45EPVN2 tag=XWDIMW3YMRYP type=del size=1233111 2024-09-19T13:43:03.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.136+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=IYUP8F2Y9WIY type=write size=37493 2024-09-19T13:43:03.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.137+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=MG94EH4WLKV1 type=del 2024-09-19T13:43:03.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.138+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=HSGN95Z5QUDG type=del size=206434 2024-09-19T13:43:03.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.139+0000 7f6ab10d2780 -1 < failed to complete operation key=EE8F84K0ZAGJ tag=IHFCD5W9B0TI type=del size=1191881: (22) Invalid argument 2024-09-19T13:43:03.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.140+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=TP97KN4C8ZE1 type=del size=3449222 2024-09-19T13:43:03.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.141+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=KFZV1K580YI1 type=del 2024-09-19T13:43:03.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.142+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=FA6JQ1RH49O9 type=del size=1738348 2024-09-19T13:43:03.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.144+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~ZZ31M8V13YV2.0 size=1048576 2024-09-19T13:43:03.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.145+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~ZZ31M8V13YV2.1 size=675479 2024-09-19T13:43:03.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.146+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=ZZ31M8V13YV2 tag=H71QCRXG4HWX type=write size=2772631 2024-09-19T13:43:03.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.148+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~OSBNFZV9AT7T.0 size=1048576 2024-09-19T13:43:03.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.149+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~OSBNFZV9AT7T.1 size=777028 2024-09-19T13:43:03.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.149+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=OSBNFZV9AT7T tag=0B1560TWKAAE type=write size=2874180 2024-09-19T13:43:03.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.150+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~AA4GIA05LDYY.0 size=1048576 2024-09-19T13:43:03.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.151+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~AA4GIA05LDYY.1 size=887204 2024-09-19T13:43:03.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.153+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=AA4GIA05LDYY tag=CVRG2J84IYK1 type=write size=2984356 2024-09-19T13:43:03.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.154+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=Y7ZT1MQ63GB7 type=del size=459153 2024-09-19T13:43:03.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.156+0000 7f6ab10d2780 1 < suggested remove operation key=UX2ICIT36Q3R tag=E144NCPV0LWO type=del 2024-09-19T13:43:03.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.157+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=EKQY1T2YNMDY type=del size=3125689 2024-09-19T13:43:03.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.159+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~DJ1PGABW6ERK.0 size=1048576 2024-09-19T13:43:03.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.159+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~DJ1PGABW6ERK.1 size=895088 2024-09-19T13:43:03.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.161+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=DJ1PGABW6ERK tag=LGAV3BAN3WE7 type=write size=2992240 2024-09-19T13:43:03.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.162+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=IJOSORK40C4X type=del size=3276937 2024-09-19T13:43:03.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.163+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~YYZIRTPANJVN.0 size=458695 2024-09-19T13:43:03.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.165+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=YYZIRTPANJVN tag=WAXKRDZF5UGB type=write size=1507271 2024-09-19T13:43:03.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.166+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=76WCL6HH2YP3 type=del size=3579434 2024-09-19T13:43:03.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.169+0000 7f6ab10d2780 1 < suggested update operation key=535R757HSXMB tag=MIYWURLWMVT3 type=del size=4073066 2024-09-19T13:43:03.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.170+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=K7EX3U34SL42 type=del size=2800040 2024-09-19T13:43:03.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.171+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~4QP8GW313MCZ.0 size=1048576 2024-09-19T13:43:03.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.172+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~4QP8GW313MCZ.1 size=1048576 2024-09-19T13:43:03.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.173+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~4QP8GW313MCZ.2 size=462744 2024-09-19T13:43:03.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.174+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=4QP8GW313MCZ tag=IBQNXKUMPIIH type=write size=3608472 2024-09-19T13:43:03.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.176+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=TXRGUAKEYQAB type=del size=1883413 2024-09-19T13:43:03.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.177+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~FD612IV3SG96.0 size=1048576 2024-09-19T13:43:03.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.178+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~FD612IV3SG96.1 size=789300 2024-09-19T13:43:03.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.179+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=FD612IV3SG96 tag=ABOW2YN9KXE1 type=write size=2886452 2024-09-19T13:43:03.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.180+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=128B8BS1D1ZT type=del size=3029787 2024-09-19T13:43:03.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.182+0000 7f6ab10d2780 -1 < failed to complete operation key=RXXCDV0LTCKS tag=7LEZAT1YK2WY type=del size=1240514: (22) Invalid argument 2024-09-19T13:43:03.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.184+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~GJIIOYH40BZW.0 size=1048576 2024-09-19T13:43:03.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.184+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~GJIIOYH40BZW.1 size=1048576 2024-09-19T13:43:03.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.185+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~GJIIOYH40BZW.2 size=904151 2024-09-19T13:43:03.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.185+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=GJIIOYH40BZW tag=UCO9I52EVO7B type=write size=4049879 2024-09-19T13:43:03.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.187+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=NJ2EYBZCD6VL type=del 2024-09-19T13:43:03.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.189+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~ODK7637NY63Y.0 size=1048576 2024-09-19T13:43:03.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.190+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~ODK7637NY63Y.1 size=350150 2024-09-19T13:43:03.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.190+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=ODK7637NY63Y tag=DB69VT3E1QWI type=write size=2447302 2024-09-19T13:43:03.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.191+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=BP728FIXLQBT type=del 2024-09-19T13:43:03.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.192+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=BLN7K03W4BPA type=del size=3892471 2024-09-19T13:43:03.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.193+0000 7f6ab10d2780 1 < canceled operation key=9WTLWBONAOET tag=STYN2A9H82F1 type=write size=586626 2024-09-19T13:43:03.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.194+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=GN01FTSKNL78 type=write size=380006 2024-09-19T13:43:03.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.195+0000 7f6ab10d2780 1 < completed write operation key=9MCE8PXHBGNF tag=IYUP8F2Y9WIY type=write size=37493 2024-09-19T13:43:03.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.198+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~S52LFCBBBS6T.0 size=1048576 2024-09-19T13:43:03.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.198+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~S52LFCBBBS6T.1 size=344907 2024-09-19T13:43:03.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.199+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=S52LFCBBBS6T tag=EOV8I3EBXJE8 type=write size=2442059 2024-09-19T13:43:03.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.200+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=HSGN95Z5QUDG type=del 2024-09-19T13:43:03.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.201+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=JEKABNHZAUY4 type=write size=143412 2024-09-19T13:43:03.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.203+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=TP97KN4C8ZE1 type=del 2024-09-19T13:43:03.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.204+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=6GD3FRF3CVE5 type=write size=261082 2024-09-19T13:43:03.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.206+0000 7f6ab10d2780 1 < suggested update operation key=EE8F84K0ZAGJ tag=FA6JQ1RH49O9 type=del size=1738348 2024-09-19T13:43:03.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.207+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=E3GOBA0YVP6P type=del size=3015866 2024-09-19T13:43:03.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.208+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~OSBNFZV9AT7T.0 size=1048576 2024-09-19T13:43:03.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.210+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~OSBNFZV9AT7T.1 size=777028 2024-09-19T13:43:03.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.212+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=OSBNFZV9AT7T tag=0B1560TWKAAE type=write size=2874180 2024-09-19T13:43:03.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.213+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=2D5QCIUNJKVO type=del size=1851473 2024-09-19T13:43:03.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.214+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=Y7ZT1MQ63GB7 type=del 2024-09-19T13:43:03.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.217+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~YNON64MQC9TQ.0 size=191366 2024-09-19T13:43:03.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.217+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=YNON64MQC9TQ tag=LCQ0MXG4RGO9 type=write size=1239942 2024-09-19T13:43:03.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.218+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=EKQY1T2YNMDY type=del 2024-09-19T13:43:03.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.219+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=0IO6XLGI877R type=write size=401844 2024-09-19T13:43:03.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.220+0000 7f6ab10d2780 1 < canceled operation key=TCXAYADSCTZI tag=IJOSORK40C4X type=del size=3276937 2024-09-19T13:43:03.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.222+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~O0ESXFCGBNRB.0 size=1048576 2024-09-19T13:43:03.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.223+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~O0ESXFCGBNRB.1 size=204517 2024-09-19T13:43:03.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.223+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=O0ESXFCGBNRB tag=SA48M13MF1X6 type=write size=2301669 2024-09-19T13:43:03.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.224+0000 7f6ab10d2780 1 < canceled operation key=RU6OR8SM72GU tag=76WCL6HH2YP3 type=del size=3579434 2024-09-19T13:43:03.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.225+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=YXA3XBYJNNRO type=del size=4084715 2024-09-19T13:43:03.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.226+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=K7EX3U34SL42 type=del 2024-09-19T13:43:03.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.227+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=XT33HGTBGJ2N type=del size=890500 2024-09-19T13:43:03.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.229+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=TXRGUAKEYQAB type=del 2024-09-19T13:43:03.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.230+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=7N83W9SCZ2L4 type=del size=3018872 2024-09-19T13:43:03.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.232+0000 7f6ab10d2780 1 < suggested remove operation key=DF003ORZ1HOM tag=128B8BS1D1ZT type=del 2024-09-19T13:43:03.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.233+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=EB0YJ6W1LHSC type=del size=3172777 2024-09-19T13:43:03.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.234+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~GJIIOYH40BZW.0 size=1048576 2024-09-19T13:43:03.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.235+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~GJIIOYH40BZW.1 size=1048576 2024-09-19T13:43:03.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.236+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~GJIIOYH40BZW.2 size=904151 2024-09-19T13:43:03.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.238+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=GJIIOYH40BZW tag=UCO9I52EVO7B type=write size=4049879 2024-09-19T13:43:03.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.240+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~8V2073Q4BLQC.0 size=525774 2024-09-19T13:43:03.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.240+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=8V2073Q4BLQC tag=08WOMEEGCZS0 type=write size=1574350 2024-09-19T13:43:03.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.241+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~ODK7637NY63Y.0 size=1048576 2024-09-19T13:43:03.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.242+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~ODK7637NY63Y.1 size=350150 2024-09-19T13:43:03.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.244+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=ODK7637NY63Y tag=DB69VT3E1QWI type=write size=2447302 2024-09-19T13:43:03.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.245+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=FAD0ITD38I53 type=del size=2345400 2024-09-19T13:43:03.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.246+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=BLN7K03W4BPA type=del 2024-09-19T13:43:03.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.248+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~3YC2WOW4PEJZ.0 size=1048576 2024-09-19T13:43:03.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.249+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~3YC2WOW4PEJZ.1 size=563563 2024-09-19T13:43:03.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.249+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=3YC2WOW4PEJZ tag=G5NCWRHYVAAA type=write size=2660715 2024-09-19T13:43:03.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.250+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=GN01FTSKNL78 type=write size=380006 2024-09-19T13:43:03.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.252+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~W78FM0EUUA7O.0 size=1048576 2024-09-19T13:43:03.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.253+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~W78FM0EUUA7O.1 size=1048576 2024-09-19T13:43:03.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.254+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~W78FM0EUUA7O.2 size=549364 2024-09-19T13:43:03.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.254+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=W78FM0EUUA7O tag=VKV6RKCJ5POQ type=write size=3695092 2024-09-19T13:43:03.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.255+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~S52LFCBBBS6T.0 size=1048576 2024-09-19T13:43:03.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.256+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~S52LFCBBBS6T.1 size=344907 2024-09-19T13:43:03.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.258+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=S52LFCBBBS6T tag=EOV8I3EBXJE8 type=write size=2442059 2024-09-19T13:43:03.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.259+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=0693026LY3W4 type=del size=4074886 2024-09-19T13:43:03.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.260+0000 7f6ab10d2780 1 < completed write operation key=PUXLW9NBBQJX tag=JEKABNHZAUY4 type=write size=143412 2024-09-19T13:43:03.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.261+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=UK174OSIAXPY type=del size=378977 2024-09-19T13:43:03.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.262+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=6GD3FRF3CVE5 type=write size=261082 2024-09-19T13:43:03.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.264+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~NSHS8A62R2S5.0 size=8048 2024-09-19T13:43:03.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.264+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=NSHS8A62R2S5 tag=EQ7D9CA9DF62 type=write size=1056624 2024-09-19T13:43:03.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.265+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=E3GOBA0YVP6P type=del 2024-09-19T13:43:03.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.266+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=O01RCSTPQGRJ type=write size=130161 2024-09-19T13:43:03.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.267+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=2D5QCIUNJKVO type=del 2024-09-19T13:43:03.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.269+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~1YUDHU512K64.0 size=1048576 2024-09-19T13:43:03.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.270+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~1YUDHU512K64.1 size=31553 2024-09-19T13:43:03.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.270+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=1YUDHU512K64 tag=XGW7WUG1NXDL type=write size=2128705 2024-09-19T13:43:03.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.272+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~YNON64MQC9TQ.0 size=191366 2024-09-19T13:43:03.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.273+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=YNON64MQC9TQ tag=LCQ0MXG4RGO9 type=write size=1239942 2024-09-19T13:43:03.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.275+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=FO5JG3TKUVKH type=del size=2952577 2024-09-19T13:43:03.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.277+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=0IO6XLGI877R type=write size=401844 2024-09-19T13:43:03.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.279+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~KDHA6FGN7FKM.0 size=1048576 2024-09-19T13:43:03.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.280+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~KDHA6FGN7FKM.1 size=539609 2024-09-19T13:43:03.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.280+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=KDHA6FGN7FKM tag=COTL30A01XQ7 type=write size=2636761 2024-09-19T13:43:03.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.281+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~O0ESXFCGBNRB.0 size=1048576 2024-09-19T13:43:03.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.282+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~O0ESXFCGBNRB.1 size=204517 2024-09-19T13:43:03.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.283+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=O0ESXFCGBNRB tag=SA48M13MF1X6 type=write size=2301669 2024-09-19T13:43:03.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.285+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=227QZUT512I2 type=write size=539379 2024-09-19T13:43:03.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.287+0000 7f6ab10d2780 1 < suggested update operation key=9IN6E0JQFNAU tag=YXA3XBYJNNRO type=del size=4084715 2024-09-19T13:43:03.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.289+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~5QK8TYCY9MLX.0 size=976202 2024-09-19T13:43:03.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.289+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=5QK8TYCY9MLX tag=MP7L6OM0VFRH type=write size=2024778 2024-09-19T13:43:03.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.290+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=XT33HGTBGJ2N type=del 2024-09-19T13:43:03.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.291+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=ONGY1NJF25UB type=del size=4159035 2024-09-19T13:43:03.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.294+0000 7f6ab10d2780 1 < suggested update operation key=EE8F84K0ZAGJ tag=7N83W9SCZ2L4 type=del size=3018872 2024-09-19T13:43:03.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.295+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=YYJXAJBQOHOH type=del size=2920435 2024-09-19T13:43:03.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.296+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=EB0YJ6W1LHSC type=del 2024-09-19T13:43:03.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.297+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=E2BT8L255TXA type=del size=3072007 2024-09-19T13:43:03.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.299+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~8V2073Q4BLQC.0 size=525774 2024-09-19T13:43:03.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.300+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=8V2073Q4BLQC tag=08WOMEEGCZS0 type=write size=1574350 2024-09-19T13:43:03.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.302+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=5HOXLJMRP391 type=del size=3859315 2024-09-19T13:43:03.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.303+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=FAD0ITD38I53 type=del 2024-09-19T13:43:03.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.305+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~ICIUOA9JCGYE.0 size=1048576 2024-09-19T13:43:03.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.306+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~ICIUOA9JCGYE.1 size=1048576 2024-09-19T13:43:03.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.307+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~ICIUOA9JCGYE.2 size=446695 2024-09-19T13:43:03.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.307+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=ICIUOA9JCGYE tag=7VUKQEYEVCH3 type=write size=3592423 2024-09-19T13:43:03.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.307+0000 7f6ab10d2780 1 < canceled part key=_multipart_P2U09V0G7UUU.2~3YC2WOW4PEJZ.0 size=1048576 2024-09-19T13:43:03.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.308+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~3YC2WOW4PEJZ.1 size=563563 2024-09-19T13:43:03.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.310+0000 7f6ab10d2780 1 < canceled multipart upload key=P2U09V0G7UUU upload=3YC2WOW4PEJZ tag=G5NCWRHYVAAA type=write size=2660715 2024-09-19T13:43:03.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.313+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~8M3K0VG1XS3H.0 size=690226 2024-09-19T13:43:03.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.313+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=8M3K0VG1XS3H tag=JHFKQXLA8AFN type=write size=1738802 2024-09-19T13:43:03.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.314+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~W78FM0EUUA7O.0 size=1048576 2024-09-19T13:43:03.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.315+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~W78FM0EUUA7O.1 size=1048576 2024-09-19T13:43:03.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.317+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~W78FM0EUUA7O.2 size=549364 2024-09-19T13:43:03.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.319+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=W78FM0EUUA7O tag=VKV6RKCJ5POQ type=write size=3695092 2024-09-19T13:43:03.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.321+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~H62F922YEAA9.0 size=1048576 2024-09-19T13:43:03.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.321+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~H62F922YEAA9.1 size=13581 2024-09-19T13:43:03.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.321+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=H62F922YEAA9 tag=NND28GLZ0Y54 type=write size=2110733 2024-09-19T13:43:03.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.323+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=0693026LY3W4 type=del 2024-09-19T13:43:03.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.324+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=QMKRCDWAV3YM type=write size=394772 2024-09-19T13:43:03.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.325+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=UK174OSIAXPY type=del 2024-09-19T13:43:03.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.326+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=E347AN1MFACV type=del size=2214750 2024-09-19T13:43:03.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.327+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~NSHS8A62R2S5.0 size=8048 2024-09-19T13:43:03.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.328+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=NSHS8A62R2S5 tag=EQ7D9CA9DF62 type=write size=1056624 2024-09-19T13:43:03.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.330+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~GENB4N145ZON.0 size=1048576 2024-09-19T13:43:03.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.331+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~GENB4N145ZON.1 size=16047 2024-09-19T13:43:03.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.331+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=GENB4N145ZON tag=Z8VLX1OX4PHY type=write size=2113199 2024-09-19T13:43:03.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.334+0000 7f6ab10d2780 1 < suggested remove operation key=UX2ICIT36Q3R tag=O01RCSTPQGRJ type=write 2024-09-19T13:43:03.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.336+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~05EGWZ4V4YQG.0 size=1048576 2024-09-19T13:43:03.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.337+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~05EGWZ4V4YQG.1 size=1048576 2024-09-19T13:43:03.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.337+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~05EGWZ4V4YQG.2 size=104644 2024-09-19T13:43:03.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.337+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=05EGWZ4V4YQG tag=ZAU14YZXRK4C type=write size=3250372 2024-09-19T13:43:03.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.339+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~1YUDHU512K64.0 size=1048576 2024-09-19T13:43:03.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.340+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~1YUDHU512K64.1 size=31553 2024-09-19T13:43:03.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.342+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=1YUDHU512K64 tag=XGW7WUG1NXDL type=write size=2128705 2024-09-19T13:43:03.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.343+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=BGDGIEBR4JMS type=del size=2954250 2024-09-19T13:43:03.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.344+0000 7f6ab10d2780 -1 < failed to complete operation key=9IN6E0JQFNAU tag=FO5JG3TKUVKH type=del size=2952577: (22) Invalid argument 2024-09-19T13:43:03.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.346+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~89749ECJMFWV.0 size=1048576 2024-09-19T13:43:03.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.347+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~89749ECJMFWV.1 size=372488 2024-09-19T13:43:03.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.347+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=89749ECJMFWV tag=IV7BXOKGUHH0 type=write size=2469640 2024-09-19T13:43:03.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.348+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~KDHA6FGN7FKM.0 size=1048576 2024-09-19T13:43:03.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.349+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~KDHA6FGN7FKM.1 size=539609 2024-09-19T13:43:03.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.351+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=KDHA6FGN7FKM tag=COTL30A01XQ7 type=write size=2636761 2024-09-19T13:43:03.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.352+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=DJN00THUCMZ3 type=del size=1918656 2024-09-19T13:43:03.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.354+0000 7f6ab10d2780 1 < suggested remove operation key=PUXLW9NBBQJX tag=227QZUT512I2 type=write 2024-09-19T13:43:03.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.356+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~22Y1B1RT9RDG.0 size=1048576 2024-09-19T13:43:03.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.357+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~22Y1B1RT9RDG.1 size=250972 2024-09-19T13:43:03.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.357+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=22Y1B1RT9RDG tag=KBQW2LUVZ2FJ type=write size=2348124 2024-09-19T13:43:03.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.359+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~5QK8TYCY9MLX.0 size=976202 2024-09-19T13:43:03.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.361+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=5QK8TYCY9MLX tag=MP7L6OM0VFRH type=write size=2024778 2024-09-19T13:43:03.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.363+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~1LGRX64CY094.0 size=309020 2024-09-19T13:43:03.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.363+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=1LGRX64CY094 tag=8Q83K50L3FRB type=write size=1357596 2024-09-19T13:43:03.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.364+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=ONGY1NJF25UB type=del 2024-09-19T13:43:03.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.366+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~JMEDFRLTHFCY.0 size=1048576 2024-09-19T13:43:03.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.367+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~JMEDFRLTHFCY.1 size=1048576 2024-09-19T13:43:03.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.368+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~JMEDFRLTHFCY.2 size=560079 2024-09-19T13:43:03.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.368+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=JMEDFRLTHFCY tag=9Z2A1M9K6DB3 type=write size=3705807 2024-09-19T13:43:03.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.369+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=YYJXAJBQOHOH type=del 2024-09-19T13:43:03.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.371+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~6YCOPH9MU26C.0 size=1048576 2024-09-19T13:43:03.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.372+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~6YCOPH9MU26C.1 size=1048576 2024-09-19T13:43:03.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.373+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~6YCOPH9MU26C.2 size=240901 2024-09-19T13:43:03.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.373+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=6YCOPH9MU26C tag=TIUR9QKZ2VR5 type=write size=3386629 2024-09-19T13:43:03.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.374+0000 7f6ab10d2780 1 < canceled operation key=4OSJA1879NQO tag=E2BT8L255TXA type=del size=3072007 2024-09-19T13:43:03.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.375+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=TPRA6R776CHF type=write size=741739 2024-09-19T13:43:03.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.376+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=5HOXLJMRP391 type=del 2024-09-19T13:43:03.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.379+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~0MY4JN2AHVRI.0 size=342455 2024-09-19T13:43:03.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.379+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=0MY4JN2AHVRI tag=Q5ICJQ07Y1G4 type=write size=1391031 2024-09-19T13:43:03.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.380+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~ICIUOA9JCGYE.0 size=1048576 2024-09-19T13:43:03.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.381+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~ICIUOA9JCGYE.1 size=1048576 2024-09-19T13:43:03.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.382+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~ICIUOA9JCGYE.2 size=446695 2024-09-19T13:43:03.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.383+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=ICIUOA9JCGYE tag=7VUKQEYEVCH3 type=write size=3592423 2024-09-19T13:43:03.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.385+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=ES3FPOCEKJ13 type=del size=2895747 2024-09-19T13:43:03.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.386+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~8M3K0VG1XS3H.0 size=690226 2024-09-19T13:43:03.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.388+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=8M3K0VG1XS3H tag=JHFKQXLA8AFN type=write size=1738802 2024-09-19T13:43:03.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.390+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~C0MWXL9JI0NM.0 size=1048576 2024-09-19T13:43:03.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.391+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~C0MWXL9JI0NM.1 size=1048576 2024-09-19T13:43:03.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.392+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~C0MWXL9JI0NM.2 size=292946 2024-09-19T13:43:03.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.392+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=C0MWXL9JI0NM tag=21WU96U8SENS type=write size=3438674 2024-09-19T13:43:03.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.393+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~H62F922YEAA9.0 size=1048576 2024-09-19T13:43:03.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.393+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~H62F922YEAA9.1 size=13581 2024-09-19T13:43:03.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.395+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=H62F922YEAA9 tag=NND28GLZ0Y54 type=write size=2110733 2024-09-19T13:43:03.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.397+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VTDTP7CJ1M3Z.0 size=1048576 2024-09-19T13:43:03.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.398+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VTDTP7CJ1M3Z.1 size=925920 2024-09-19T13:43:03.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.398+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=VTDTP7CJ1M3Z tag=2GEVY336C9LP type=write size=3023072 2024-09-19T13:43:03.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.400+0000 7f6ab10d2780 1 < canceled operation key=EE8F84K0ZAGJ tag=QMKRCDWAV3YM type=write size=394772 2024-09-19T13:43:03.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.402+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~G5GECSBSH9JW.0 size=1048576 2024-09-19T13:43:03.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.403+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~G5GECSBSH9JW.1 size=522785 2024-09-19T13:43:03.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.403+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=G5GECSBSH9JW tag=FFVHDJEPXP4W type=write size=2619937 2024-09-19T13:43:03.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.404+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=E347AN1MFACV type=del 2024-09-19T13:43:03.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.405+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=XNIT9V265R0W type=del size=2828588 2024-09-19T13:43:03.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.406+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~GENB4N145ZON.0 size=1048576 2024-09-19T13:43:03.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.407+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~GENB4N145ZON.1 size=16047 2024-09-19T13:43:03.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.409+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=GENB4N145ZON tag=Z8VLX1OX4PHY type=write size=2113199 2024-09-19T13:43:03.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.411+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FEUQBFEEZ5LQ.0 size=1048576 2024-09-19T13:43:03.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.412+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FEUQBFEEZ5LQ.1 size=1048576 2024-09-19T13:43:03.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.413+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FEUQBFEEZ5LQ.2 size=292034 2024-09-19T13:43:03.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.413+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=FEUQBFEEZ5LQ tag=Z72B9QCPWLTZ type=write size=3437762 2024-09-19T13:43:03.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.414+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~05EGWZ4V4YQG.0 size=1048576 2024-09-19T13:43:03.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.415+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~05EGWZ4V4YQG.1 size=1048576 2024-09-19T13:43:03.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.415+0000 7f6ab10d2780 1 < canceled part key=_multipart_UX2ICIT36Q3R.2~05EGWZ4V4YQG.2 size=104644 2024-09-19T13:43:03.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.417+0000 7f6ab10d2780 1 < canceled multipart upload key=UX2ICIT36Q3R upload=05EGWZ4V4YQG tag=ZAU14YZXRK4C type=write size=3250372 2024-09-19T13:43:03.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.418+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=UZ98AMHYYTRR type=del size=334034 2024-09-19T13:43:03.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.419+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=BGDGIEBR4JMS type=del 2024-09-19T13:43:03.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.422+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=NF5KNDRORAA3 type=del size=1703310 2024-09-19T13:43:03.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.422+0000 7f6ab10d2780 1 < canceled part key=_multipart_X1JYDG1ASYAR.2~89749ECJMFWV.0 size=1048576 2024-09-19T13:43:03.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.423+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~89749ECJMFWV.1 size=372488 2024-09-19T13:43:03.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.425+0000 7f6ab10d2780 1 < canceled multipart upload key=X1JYDG1ASYAR upload=89749ECJMFWV tag=IV7BXOKGUHH0 type=write size=2469640 2024-09-19T13:43:03.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.427+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~RDU2UWJXD84Q.0 size=1048576 2024-09-19T13:43:03.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.428+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~RDU2UWJXD84Q.1 size=527864 2024-09-19T13:43:03.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.428+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=RDU2UWJXD84Q tag=6OF377RUQ1AZ type=write size=2625016 2024-09-19T13:43:03.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.430+0000 7f6ab10d2780 1 < suggested update operation key=9Q9DGUSDSE49 tag=DJN00THUCMZ3 type=del size=1918656 2024-09-19T13:43:03.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.432+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~P4IPY1NW5U8S.0 size=1048576 2024-09-19T13:43:03.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.433+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~P4IPY1NW5U8S.1 size=50804 2024-09-19T13:43:03.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.433+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=P4IPY1NW5U8S tag=15SRQV6C89WX type=write size=2147956 2024-09-19T13:43:03.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.434+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~22Y1B1RT9RDG.0 size=1048576 2024-09-19T13:43:03.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.435+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~22Y1B1RT9RDG.1 size=250972 2024-09-19T13:43:03.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.436+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=22Y1B1RT9RDG tag=KBQW2LUVZ2FJ type=write size=2348124 2024-09-19T13:43:03.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.437+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=OKMXZQ05T8MC type=del size=3375046 2024-09-19T13:43:03.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.439+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~1LGRX64CY094.0 size=309020 2024-09-19T13:43:03.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.440+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=1LGRX64CY094 tag=8Q83K50L3FRB type=write size=1357596 2024-09-19T13:43:03.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.442+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~08FFJP1VDABT.0 size=1048576 2024-09-19T13:43:03.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.443+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~08FFJP1VDABT.1 size=179947 2024-09-19T13:43:03.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.443+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=08FFJP1VDABT tag=6F9YJPVMN33B type=write size=2277099 2024-09-19T13:43:03.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.444+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~JMEDFRLTHFCY.0 size=1048576 2024-09-19T13:43:03.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.445+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~JMEDFRLTHFCY.1 size=1048576 2024-09-19T13:43:03.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.446+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~JMEDFRLTHFCY.2 size=560079 2024-09-19T13:43:03.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.448+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=JMEDFRLTHFCY tag=9Z2A1M9K6DB3 type=write size=3705807 2024-09-19T13:43:03.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.449+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=6B05T1KOW48T type=del size=421846 2024-09-19T13:43:03.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.449+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~6YCOPH9MU26C.0 size=1048576 2024-09-19T13:43:03.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.450+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~6YCOPH9MU26C.1 size=1048576 2024-09-19T13:43:03.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.451+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~6YCOPH9MU26C.2 size=240901 2024-09-19T13:43:03.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.453+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=6YCOPH9MU26C tag=TIUR9QKZ2VR5 type=write size=3386629 2024-09-19T13:43:03.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.454+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=B1G1FH0YOXRB type=del size=2641466 2024-09-19T13:43:03.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.455+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=TPRA6R776CHF type=write size=741739 2024-09-19T13:43:03.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.456+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=LAX16JUUT5KS type=write size=381959 2024-09-19T13:43:03.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.457+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~0MY4JN2AHVRI.0 size=342455 2024-09-19T13:43:03.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.459+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=0MY4JN2AHVRI tag=Q5ICJQ07Y1G4 type=write size=1391031 2024-09-19T13:43:03.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.460+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=I7USHFRI9A6J type=del size=1329049 2024-09-19T13:43:03.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.462+0000 7f6ab10d2780 1 < suggested remove operation key=7LHSAN5BBQRW tag=ES3FPOCEKJ13 type=del 2024-09-19T13:43:03.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.464+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~3D3J9XY417EK.0 size=1048576 2024-09-19T13:43:03.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.465+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~3D3J9XY417EK.1 size=679889 2024-09-19T13:43:03.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.465+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=3D3J9XY417EK tag=RF4NQH38XQ1V type=write size=2777041 2024-09-19T13:43:03.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.466+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~C0MWXL9JI0NM.0 size=1048576 2024-09-19T13:43:03.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.467+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~C0MWXL9JI0NM.1 size=1048576 2024-09-19T13:43:03.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.468+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~C0MWXL9JI0NM.2 size=292946 2024-09-19T13:43:03.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.470+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=C0MWXL9JI0NM tag=21WU96U8SENS type=write size=3438674 2024-09-19T13:43:03.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.471+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=NR56XLB2ATEJ type=del size=731257 2024-09-19T13:43:03.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.472+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VTDTP7CJ1M3Z.0 size=1048576 2024-09-19T13:43:03.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.473+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VTDTP7CJ1M3Z.1 size=925920 2024-09-19T13:43:03.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.474+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=VTDTP7CJ1M3Z tag=2GEVY336C9LP type=write size=3023072 2024-09-19T13:43:03.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.476+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=18G3G30FF4FN type=del size=3768908 2024-09-19T13:43:03.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.477+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~G5GECSBSH9JW.0 size=1048576 2024-09-19T13:43:03.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.478+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~G5GECSBSH9JW.1 size=522785 2024-09-19T13:43:03.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.480+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=G5GECSBSH9JW tag=FFVHDJEPXP4W type=write size=2619937 2024-09-19T13:43:03.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.482+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~I6DB6V0D7UM1.0 size=373319 2024-09-19T13:43:03.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.482+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=I6DB6V0D7UM1 tag=JMV0F86LS2QD type=write size=1421895 2024-09-19T13:43:03.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.483+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=XNIT9V265R0W type=del 2024-09-19T13:43:03.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.484+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=W7CNUX7W4YXB type=del size=1211546 2024-09-19T13:43:03.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.485+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~FEUQBFEEZ5LQ.0 size=1048576 2024-09-19T13:43:03.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.486+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~FEUQBFEEZ5LQ.1 size=1048576 2024-09-19T13:43:03.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.487+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~FEUQBFEEZ5LQ.2 size=292034 2024-09-19T13:43:03.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.489+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=FEUQBFEEZ5LQ tag=Z72B9QCPWLTZ type=write size=3437762 2024-09-19T13:43:03.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.490+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~LB9UH3K73880.0 size=400884 2024-09-19T13:43:03.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.490+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=LB9UH3K73880 tag=JQI2S5ZJXUIJ type=write size=1449460 2024-09-19T13:43:03.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.492+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=UZ98AMHYYTRR type=del 2024-09-19T13:43:03.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.493+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=8VIVA38GJJ6J type=del size=2400918 2024-09-19T13:43:03.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.494+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=NF5KNDRORAA3 type=del 2024-09-19T13:43:03.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.496+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~OYTNC6MIL4FG.0 size=542745 2024-09-19T13:43:03.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.496+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=OYTNC6MIL4FG tag=RZPL01OOJKPY type=write size=1591321 2024-09-19T13:43:03.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.497+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~RDU2UWJXD84Q.0 size=1048576 2024-09-19T13:43:03.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.498+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~RDU2UWJXD84Q.1 size=527864 2024-09-19T13:43:03.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.500+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=RDU2UWJXD84Q tag=6OF377RUQ1AZ type=write size=2625016 2024-09-19T13:43:03.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.501+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=DE6N719IVRDS type=write size=743843 2024-09-19T13:43:03.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.502+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~P4IPY1NW5U8S.0 size=1048576 2024-09-19T13:43:03.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.503+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~P4IPY1NW5U8S.1 size=50804 2024-09-19T13:43:03.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.504+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=P4IPY1NW5U8S tag=15SRQV6C89WX type=write size=2147956 2024-09-19T13:43:03.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.506+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=W06EV4R4AB6L type=del size=2440997 2024-09-19T13:43:03.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.508+0000 7f6ab10d2780 1 < suggested remove operation key=9Q9DGUSDSE49 tag=OKMXZQ05T8MC type=del 2024-09-19T13:43:03.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.509+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=NJHF5YNFQFFL type=del size=913243 2024-09-19T13:43:03.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.510+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~08FFJP1VDABT.0 size=1048576 2024-09-19T13:43:03.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.511+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~08FFJP1VDABT.1 size=179947 2024-09-19T13:43:03.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.513+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=08FFJP1VDABT tag=6F9YJPVMN33B type=write size=2277099 2024-09-19T13:43:03.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.514+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=PYSN2SD9M0LH type=write size=103301 2024-09-19T13:43:03.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.517+0000 7f6ab10d2780 1 < suggested update operation key=B0J7E7A0NP4J tag=6B05T1KOW48T type=del size=421846 2024-09-19T13:43:03.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.518+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=Q1CSC95HGGGC type=write size=164115 2024-09-19T13:43:03.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.519+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=B1G1FH0YOXRB type=del 2024-09-19T13:43:03.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.521+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~E3HLQP583NUI.0 size=1048576 2024-09-19T13:43:03.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.523+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~E3HLQP583NUI.1 size=1048576 2024-09-19T13:43:03.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.524+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~E3HLQP583NUI.2 size=917858 2024-09-19T13:43:03.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.524+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=E3HLQP583NUI tag=I76HOSXP4LZT type=write size=4063586 2024-09-19T13:43:03.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.525+0000 7f6ab10d2780 1 < completed write operation key=P2U09V0G7UUU tag=LAX16JUUT5KS type=write size=381959 2024-09-19T13:43:03.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.527+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~3Q7ATKLKAX7L.0 size=700484 2024-09-19T13:43:03.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.527+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=3Q7ATKLKAX7L tag=N2SAEVDMO9VD type=write size=1749060 2024-09-19T13:43:03.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.528+0000 7f6ab10d2780 -1 < failed to complete operation key=7LHSAN5BBQRW tag=I7USHFRI9A6J type=del size=1329049: (22) Invalid argument 2024-09-19T13:43:03.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.530+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~QATOHDJ5FJGB.0 size=2146 2024-09-19T13:43:03.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.530+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=QATOHDJ5FJGB tag=SFLNHDX4CPLC type=write size=1050722 2024-09-19T13:43:03.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.531+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~3D3J9XY417EK.0 size=1048576 2024-09-19T13:43:03.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.532+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~3D3J9XY417EK.1 size=679889 2024-09-19T13:43:03.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.534+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=3D3J9XY417EK tag=RF4NQH38XQ1V type=write size=2777041 2024-09-19T13:43:03.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.536+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~1ZICC04Y1BYK.0 size=1048576 2024-09-19T13:43:03.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.537+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~1ZICC04Y1BYK.1 size=532034 2024-09-19T13:43:03.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.537+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=1ZICC04Y1BYK tag=LWP5HOU5PFHX type=write size=2629186 2024-09-19T13:43:03.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.538+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=NR56XLB2ATEJ type=del 2024-09-19T13:43:03.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.539+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=ZHJO42CE182T type=write size=448432 2024-09-19T13:43:03.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.540+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=18G3G30FF4FN type=del 2024-09-19T13:43:03.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.541+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=WD31DD0QFM19 type=write size=43267 2024-09-19T13:43:03.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.542+0000 7f6ab10d2780 1 < canceled part key=_multipart_XQLWZA2X91GF.2~I6DB6V0D7UM1.0 size=373319 2024-09-19T13:43:03.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.544+0000 7f6ab10d2780 1 < canceled multipart upload key=XQLWZA2X91GF upload=I6DB6V0D7UM1 tag=JMV0F86LS2QD type=write size=1421895 2024-09-19T13:43:03.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.545+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=L54954UYYML2 type=del size=2117468 2024-09-19T13:43:03.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.546+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=W7CNUX7W4YXB type=del 2024-09-19T13:43:03.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.547+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=0LR3GHWD1KDR type=del size=3370125 2024-09-19T13:43:03.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.547+0000 7f6ab10d2780 1 < canceled part key=_multipart_WDRUV5ERI000.2~LB9UH3K73880.0 size=400884 2024-09-19T13:43:03.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.549+0000 7f6ab10d2780 1 < canceled multipart upload key=WDRUV5ERI000 upload=LB9UH3K73880 tag=JQI2S5ZJXUIJ type=write size=1449460 2024-09-19T13:43:03.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.551+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~52TAKTK62742.0 size=1048576 2024-09-19T13:43:03.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.552+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~52TAKTK62742.1 size=1048576 2024-09-19T13:43:03.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.553+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~52TAKTK62742.2 size=371524 2024-09-19T13:43:03.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.553+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=52TAKTK62742 tag=124TY84I3YS4 type=write size=3517252 2024-09-19T13:43:03.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.554+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=8VIVA38GJJ6J type=del 2024-09-19T13:43:03.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.556+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~XO22M1POAZ4O.0 size=1048576 2024-09-19T13:43:03.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.557+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~XO22M1POAZ4O.1 size=1048576 2024-09-19T13:43:03.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.558+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~XO22M1POAZ4O.2 size=120317 2024-09-19T13:43:03.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.558+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=XO22M1POAZ4O tag=AQZ073G6RU45 type=write size=3266045 2024-09-19T13:43:03.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.559+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~OYTNC6MIL4FG.0 size=542745 2024-09-19T13:43:03.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.560+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=OYTNC6MIL4FG tag=RZPL01OOJKPY type=write size=1591321 2024-09-19T13:43:03.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.561+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=F1OT8ECKZY7J type=del size=470436 2024-09-19T13:43:03.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.563+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=DE6N719IVRDS type=write size=743843 2024-09-19T13:43:03.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.564+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=CEYXYWD7V713 type=write size=553297 2024-09-19T13:43:03.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.565+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=W06EV4R4AB6L type=del 2024-09-19T13:43:03.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.567+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~20WJ36GBZBVA.0 size=1048576 2024-09-19T13:43:03.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.568+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~20WJ36GBZBVA.1 size=1048576 2024-09-19T13:43:03.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.569+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~20WJ36GBZBVA.2 size=401575 2024-09-19T13:43:03.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.569+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=20WJ36GBZBVA tag=5QRXNT4J6TH4 type=write size=3547303 2024-09-19T13:43:03.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.570+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=NJHF5YNFQFFL type=del 2024-09-19T13:43:03.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.572+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~CLJQLUZE0RKI.0 size=1048576 2024-09-19T13:43:03.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.572+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~CLJQLUZE0RKI.1 size=1048576 2024-09-19T13:43:03.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.573+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~CLJQLUZE0RKI.2 size=297927 2024-09-19T13:43:03.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.573+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=CLJQLUZE0RKI tag=10KQPB39GC8C type=write size=3443655 2024-09-19T13:43:03.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.576+0000 7f6ab10d2780 1 < suggested update operation key=7LHSAN5BBQRW tag=PYSN2SD9M0LH type=write size=103301 2024-09-19T13:43:03.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.578+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~X1N5PSG8DR7F.0 size=526627 2024-09-19T13:43:03.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.578+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=X1N5PSG8DR7F tag=O6OJRGI1H2OC type=write size=1575203 2024-09-19T13:43:03.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.579+0000 7f6ab10d2780 1 < completed write operation key=VFJIKOLYI0HN tag=Q1CSC95HGGGC type=write size=164115 2024-09-19T13:43:03.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.580+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=EW03CBIY7VDU type=del size=3853250 2024-09-19T13:43:03.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.581+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~E3HLQP583NUI.0 size=1048576 2024-09-19T13:43:03.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.582+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~E3HLQP583NUI.1 size=1048576 2024-09-19T13:43:03.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.583+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~E3HLQP583NUI.2 size=917858 2024-09-19T13:43:03.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.585+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=E3HLQP583NUI tag=I76HOSXP4LZT type=write size=4063586 2024-09-19T13:43:03.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.587+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~TR9JE5D2EJ6H.0 size=1048576 2024-09-19T13:43:03.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.588+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~TR9JE5D2EJ6H.1 size=1048576 2024-09-19T13:43:03.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.589+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~TR9JE5D2EJ6H.2 size=218498 2024-09-19T13:43:03.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.589+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=TR9JE5D2EJ6H tag=3T0LHUC5MA89 type=write size=3364226 2024-09-19T13:43:03.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.590+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~3Q7ATKLKAX7L.0 size=700484 2024-09-19T13:43:03.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.592+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=3Q7ATKLKAX7L tag=N2SAEVDMO9VD type=write size=1749060 2024-09-19T13:43:03.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.594+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~TEOBF2X74KDB.0 size=972740 2024-09-19T13:43:03.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.594+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=TEOBF2X74KDB tag=LHNJE7JO8L9O type=write size=2021316 2024-09-19T13:43:03.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.595+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~QATOHDJ5FJGB.0 size=2146 2024-09-19T13:43:03.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.597+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=QATOHDJ5FJGB tag=SFLNHDX4CPLC type=write size=1050722 2024-09-19T13:43:03.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.598+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=G2MITKXO8FBT type=del size=1465796 2024-09-19T13:43:03.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.600+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~1ZICC04Y1BYK.0 size=1048576 2024-09-19T13:43:03.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.601+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~1ZICC04Y1BYK.1 size=532034 2024-09-19T13:43:03.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.603+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=1ZICC04Y1BYK tag=LWP5HOU5PFHX type=write size=2629186 2024-09-19T13:43:03.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.604+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=J54RBQU7DSZQ type=del size=2761809 2024-09-19T13:43:03.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.606+0000 7f6ab10d2780 1 < suggested remove operation key=4OSJA1879NQO tag=ZHJO42CE182T type=write 2024-09-19T13:43:03.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.607+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=CH4BEKMMZ9F0 type=del size=28338 2024-09-19T13:43:03.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.608+0000 7f6ab10d2780 1 < completed write operation key=2KX2NSY41STV tag=WD31DD0QFM19 type=write size=43267 2024-09-19T13:43:03.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.609+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=XMC7V64D4RE5 type=write size=543556 2024-09-19T13:43:03.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.610+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=L54954UYYML2 type=del 2024-09-19T13:43:03.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.612+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~82G7JQ1F1XS1.0 size=1048576 2024-09-19T13:43:03.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.613+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~82G7JQ1F1XS1.1 size=941576 2024-09-19T13:43:03.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.613+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=82G7JQ1F1XS1 tag=1GB8V2Z6F8MM type=write size=3038728 2024-09-19T13:43:03.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.614+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=0LR3GHWD1KDR type=del 2024-09-19T13:43:03.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.615+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=2FFSBMIH0FPZ type=del size=1404507 2024-09-19T13:43:03.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.615+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~52TAKTK62742.0 size=1048576 2024-09-19T13:43:03.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.616+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~52TAKTK62742.1 size=1048576 2024-09-19T13:43:03.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.617+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~52TAKTK62742.2 size=371524 2024-09-19T13:43:03.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.619+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=52TAKTK62742 tag=124TY84I3YS4 type=write size=3517252 2024-09-19T13:43:03.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.620+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=9DK0111XI3AZ type=write size=95392 2024-09-19T13:43:03.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.621+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~XO22M1POAZ4O.0 size=1048576 2024-09-19T13:43:03.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.622+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~XO22M1POAZ4O.1 size=1048576 2024-09-19T13:43:03.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.623+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~XO22M1POAZ4O.2 size=120317 2024-09-19T13:43:03.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.627+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=XO22M1POAZ4O tag=AQZ073G6RU45 type=write size=3266045 2024-09-19T13:43:03.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.628+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=0MC45F56L0AV type=del size=3291819 2024-09-19T13:43:03.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.629+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=F1OT8ECKZY7J type=del 2024-09-19T13:43:03.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.630+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=D6GISIS6RIQE type=del size=3311661 2024-09-19T13:43:03.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.632+0000 7f6ab10d2780 1 < suggested remove operation key=QTGKMAOX2A6U tag=CEYXYWD7V713 type=write 2024-09-19T13:43:03.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.633+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=CGXG9W2QXOYU type=del size=4149827 2024-09-19T13:43:03.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.634+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~20WJ36GBZBVA.0 size=1048576 2024-09-19T13:43:03.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.635+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~20WJ36GBZBVA.1 size=1048576 2024-09-19T13:43:03.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.636+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~20WJ36GBZBVA.2 size=401575 2024-09-19T13:43:03.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.638+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=20WJ36GBZBVA tag=5QRXNT4J6TH4 type=write size=3547303 2024-09-19T13:43:03.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.640+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~1Q76DLL1M6XK.0 size=1012718 2024-09-19T13:43:03.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.640+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=1Q76DLL1M6XK tag=RWO1U8PB5LAL type=write size=2061294 2024-09-19T13:43:03.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.641+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~CLJQLUZE0RKI.0 size=1048576 2024-09-19T13:43:03.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.642+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~CLJQLUZE0RKI.1 size=1048576 2024-09-19T13:43:03.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.643+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~CLJQLUZE0RKI.2 size=297927 2024-09-19T13:43:03.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.645+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=CLJQLUZE0RKI tag=10KQPB39GC8C type=write size=3443655 2024-09-19T13:43:03.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.646+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=OOBK4NOG162M type=write size=997047 2024-09-19T13:43:03.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.647+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~X1N5PSG8DR7F.0 size=526627 2024-09-19T13:43:03.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.649+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=X1N5PSG8DR7F tag=O6OJRGI1H2OC type=write size=1575203 2024-09-19T13:43:03.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.650+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~DSXZBEF043DY.0 size=1048576 2024-09-19T13:43:03.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.651+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~DSXZBEF043DY.1 size=1048576 2024-09-19T13:43:03.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.652+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~DSXZBEF043DY.2 size=971848 2024-09-19T13:43:03.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.652+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=DSXZBEF043DY tag=T5Q2K5L3NT8H type=write size=4117576 2024-09-19T13:43:03.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.653+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=EW03CBIY7VDU type=del 2024-09-19T13:43:03.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.655+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~DWOLB1T6DLEE.0 size=1048576 2024-09-19T13:43:03.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.656+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~DWOLB1T6DLEE.1 size=1048576 2024-09-19T13:43:03.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.657+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~DWOLB1T6DLEE.2 size=399520 2024-09-19T13:43:03.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.657+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=DWOLB1T6DLEE tag=MJZAI3JXKORO type=write size=3545248 2024-09-19T13:43:03.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.658+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~TR9JE5D2EJ6H.0 size=1048576 2024-09-19T13:43:03.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.659+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~TR9JE5D2EJ6H.1 size=1048576 2024-09-19T13:43:03.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.660+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~TR9JE5D2EJ6H.2 size=218498 2024-09-19T13:43:03.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.662+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=TR9JE5D2EJ6H tag=3T0LHUC5MA89 type=write size=3364226 2024-09-19T13:43:03.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.664+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~3SKL3LPHA616.0 size=1048576 2024-09-19T13:43:03.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.665+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~3SKL3LPHA616.1 size=563918 2024-09-19T13:43:03.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.665+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=3SKL3LPHA616 tag=UW5GS7RSB39A type=write size=2661070 2024-09-19T13:43:03.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.666+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~TEOBF2X74KDB.0 size=972740 2024-09-19T13:43:03.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.668+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=TEOBF2X74KDB tag=LHNJE7JO8L9O type=write size=2021316 2024-09-19T13:43:03.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.670+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~AKRF4HQAYW1P.0 size=460941 2024-09-19T13:43:03.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.670+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=AKRF4HQAYW1P tag=0DWM3NHB57UV type=write size=1509517 2024-09-19T13:43:03.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.671+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=G2MITKXO8FBT type=del 2024-09-19T13:43:03.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.672+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=MIMEJ2PV2XSV type=del size=460711 2024-09-19T13:43:03.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.674+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=J54RBQU7DSZQ type=del 2024-09-19T13:43:03.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.675+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=PU6TCT8FP2DD type=del size=2154002 2024-09-19T13:43:03.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.676+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=CH4BEKMMZ9F0 type=del 2024-09-19T13:43:03.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.677+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=JVIEF9A93REN type=del size=4049884 2024-09-19T13:43:03.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.678+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=XMC7V64D4RE5 type=write size=543556 2024-09-19T13:43:03.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.680+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~GLRNX2RMSUCG.0 size=1048576 2024-09-19T13:43:03.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.681+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~GLRNX2RMSUCG.1 size=1048576 2024-09-19T13:43:03.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.682+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~GLRNX2RMSUCG.2 size=884925 2024-09-19T13:43:03.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.682+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=GLRNX2RMSUCG tag=9894MN454DLI type=write size=4030653 2024-09-19T13:43:03.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.683+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~82G7JQ1F1XS1.0 size=1048576 2024-09-19T13:43:03.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.684+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~82G7JQ1F1XS1.1 size=941576 2024-09-19T13:43:03.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.686+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=82G7JQ1F1XS1 tag=1GB8V2Z6F8MM type=write size=3038728 2024-09-19T13:43:03.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.688+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=1465JR14EZH1 type=del size=114079 2024-09-19T13:43:03.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.690+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=2FFSBMIH0FPZ type=del 2024-09-19T13:43:03.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.691+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=2HSXXJFAQCY5 type=del size=2630274 2024-09-19T13:43:03.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.693+0000 7f6ab10d2780 1 < suggested update operation key=WDRUV5ERI000 tag=9DK0111XI3AZ type=write size=95392 2024-09-19T13:43:03.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.694+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=BCE3VAG5Q09T type=del size=414349 2024-09-19T13:43:03.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.696+0000 7f6ab10d2780 1 < canceled operation key=SDQ64HOD22EM tag=0MC45F56L0AV type=del size=3291819 2024-09-19T13:43:03.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.697+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=ENSCQXLZFRKA type=del size=990742 2024-09-19T13:43:03.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.699+0000 7f6ab10d2780 1 < suggested remove operation key=SERUGCO68R9W tag=D6GISIS6RIQE type=del 2024-09-19T13:43:03.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.700+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=Y7RZT56H2F7U type=del size=375420 2024-09-19T13:43:03.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.701+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=CGXG9W2QXOYU type=del 2024-09-19T13:43:03.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.704+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~B9BI9X6H50XS.0 size=806040 2024-09-19T13:43:03.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.704+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=B9BI9X6H50XS tag=GWARV553OIL7 type=write size=1854616 2024-09-19T13:43:03.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.705+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~1Q76DLL1M6XK.0 size=1012718 2024-09-19T13:43:03.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.707+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=1Q76DLL1M6XK tag=RWO1U8PB5LAL type=write size=2061294 2024-09-19T13:43:03.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.708+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=TV5QITPI3YCR type=write size=1014980 2024-09-19T13:43:03.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.710+0000 7f6ab10d2780 1 < suggested update operation key=EE8F84K0ZAGJ tag=OOBK4NOG162M type=write size=997047 2024-09-19T13:43:03.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.712+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~0HQLY70F0EUG.0 size=1048576 2024-09-19T13:43:03.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.713+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~0HQLY70F0EUG.1 size=198972 2024-09-19T13:43:03.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.713+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=0HQLY70F0EUG tag=IM0MJF7EW2FL type=write size=2296124 2024-09-19T13:43:03.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.714+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~DSXZBEF043DY.0 size=1048576 2024-09-19T13:43:03.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.715+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~DSXZBEF043DY.1 size=1048576 2024-09-19T13:43:03.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.716+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~DSXZBEF043DY.2 size=971848 2024-09-19T13:43:03.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.717+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=DSXZBEF043DY tag=T5Q2K5L3NT8H type=write size=4117576 2024-09-19T13:43:03.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.719+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=FF8WIK3TZHGI type=del size=745916 2024-09-19T13:43:03.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.720+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~DWOLB1T6DLEE.0 size=1048576 2024-09-19T13:43:03.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.721+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~DWOLB1T6DLEE.1 size=1048576 2024-09-19T13:43:03.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.722+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~DWOLB1T6DLEE.2 size=399520 2024-09-19T13:43:03.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.724+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=DWOLB1T6DLEE tag=MJZAI3JXKORO type=write size=3545248 2024-09-19T13:43:03.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.725+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=48IXJYZ8BN5E type=del size=473711 2024-09-19T13:43:03.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.726+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~3SKL3LPHA616.0 size=1048576 2024-09-19T13:43:03.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.727+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~3SKL3LPHA616.1 size=563918 2024-09-19T13:43:03.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.729+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=3SKL3LPHA616 tag=UW5GS7RSB39A type=write size=2661070 2024-09-19T13:43:03.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.732+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~CXVY5VYACB82.0 size=1048576 2024-09-19T13:43:03.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.733+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~CXVY5VYACB82.1 size=872758 2024-09-19T13:43:03.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.733+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=CXVY5VYACB82 tag=WT2Y80ER0AMH type=write size=2969910 2024-09-19T13:43:03.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.734+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~AKRF4HQAYW1P.0 size=460941 2024-09-19T13:43:03.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.736+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=AKRF4HQAYW1P tag=0DWM3NHB57UV type=write size=1509517 2024-09-19T13:43:03.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.738+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~IWCRWT07X5ZR.0 size=776333 2024-09-19T13:43:03.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.738+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=IWCRWT07X5ZR tag=5JM8LKK21KX7 type=write size=1824909 2024-09-19T13:43:03.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.739+0000 7f6ab10d2780 -1 < failed to complete operation key=2KX2NSY41STV tag=MIMEJ2PV2XSV type=del size=460711: (22) Invalid argument 2024-09-19T13:43:03.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.740+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=EMV5OPIDKM8S type=write size=151171 2024-09-19T13:43:03.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.742+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=PU6TCT8FP2DD type=del 2024-09-19T13:43:03.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.743+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=QWF79VYN02HH type=del size=2878756 2024-09-19T13:43:03.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.744+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=JVIEF9A93REN type=del 2024-09-19T13:43:03.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.746+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~8LRYA2I25ZET.0 size=1048576 2024-09-19T13:43:03.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.747+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~8LRYA2I25ZET.1 size=512534 2024-09-19T13:43:03.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.747+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=8LRYA2I25ZET tag=5EGBVN0BU5N4 type=write size=2609686 2024-09-19T13:43:03.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.748+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~GLRNX2RMSUCG.0 size=1048576 2024-09-19T13:43:03.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.749+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~GLRNX2RMSUCG.1 size=1048576 2024-09-19T13:43:03.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.750+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~GLRNX2RMSUCG.2 size=884925 2024-09-19T13:43:03.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.752+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=GLRNX2RMSUCG tag=9894MN454DLI type=write size=4030653 2024-09-19T13:43:03.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.754+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~Q87IWONN175B.0 size=1048576 2024-09-19T13:43:03.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.755+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~Q87IWONN175B.1 size=1048576 2024-09-19T13:43:03.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.756+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~Q87IWONN175B.2 size=61072 2024-09-19T13:43:03.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.756+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=Q87IWONN175B tag=W3N1JS88RMBU type=write size=3206800 2024-09-19T13:43:03.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.757+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=1465JR14EZH1 type=del 2024-09-19T13:43:03.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.758+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=H4A2LHA59N1L type=del size=2414962 2024-09-19T13:43:03.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.760+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=2HSXXJFAQCY5 type=del size=2630274 2024-09-19T13:43:03.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.761+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=JP0WME79G9MV type=del size=2520788 2024-09-19T13:43:03.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.762+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=BCE3VAG5Q09T type=del 2024-09-19T13:43:03.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.764+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=PDRSFV2MHHNO type=write size=36458 2024-09-19T13:43:03.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.765+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=ENSCQXLZFRKA type=del 2024-09-19T13:43:03.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.766+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=XTWFLGTWUOF8 type=write size=261851 2024-09-19T13:43:03.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.769+0000 7f6ab10d2780 1 < suggested remove operation key=EE8F84K0ZAGJ tag=Y7RZT56H2F7U type=del 2024-09-19T13:43:03.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.770+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=9FZMEK6GU7NF type=del size=2596196 2024-09-19T13:43:03.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.771+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~B9BI9X6H50XS.0 size=806040 2024-09-19T13:43:03.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.773+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=B9BI9X6H50XS tag=GWARV553OIL7 type=write size=1854616 2024-09-19T13:43:03.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.775+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=DV4M0571TCEC type=del size=865790 2024-09-19T13:43:03.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.776+0000 7f6ab10d2780 1 < completed write operation key=B0J7E7A0NP4J tag=TV5QITPI3YCR type=write size=1014980 2024-09-19T13:43:03.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.777+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=VVG8I5CZIC3V type=del size=3280465 2024-09-19T13:43:03.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.778+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~0HQLY70F0EUG.0 size=1048576 2024-09-19T13:43:03.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.779+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~0HQLY70F0EUG.1 size=198972 2024-09-19T13:43:03.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.781+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=0HQLY70F0EUG tag=IM0MJF7EW2FL type=write size=2296124 2024-09-19T13:43:03.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.783+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=RKATUIGI0DAS type=del size=3685175 2024-09-19T13:43:03.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.784+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=FF8WIK3TZHGI type=del size=745916 2024-09-19T13:43:03.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.785+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=XOEYTVIN9T2G type=del size=1350958 2024-09-19T13:43:03.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.786+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=48IXJYZ8BN5E type=del 2024-09-19T13:43:03.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.789+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~DFL54YBYRBXW.0 size=978127 2024-09-19T13:43:03.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.789+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=DFL54YBYRBXW tag=U1KEH1YZ7WRQ type=write size=2026703 2024-09-19T13:43:03.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.790+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~CXVY5VYACB82.0 size=1048576 2024-09-19T13:43:03.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.791+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~CXVY5VYACB82.1 size=872758 2024-09-19T13:43:03.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.793+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=CXVY5VYACB82 tag=WT2Y80ER0AMH type=write size=2969910 2024-09-19T13:43:03.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.794+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=853RHN7PQ7JR type=del size=2468258 2024-09-19T13:43:03.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.795+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~IWCRWT07X5ZR.0 size=776333 2024-09-19T13:43:03.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.797+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=IWCRWT07X5ZR tag=5JM8LKK21KX7 type=write size=1824909 2024-09-19T13:43:03.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.798+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=0VWBTQOGOMTC type=del size=406887 2024-09-19T13:43:03.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.801+0000 7f6ab10d2780 1 < suggested remove operation key=RXXCDV0LTCKS tag=EMV5OPIDKM8S type=write 2024-09-19T13:43:03.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.803+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~13GK6JRRF7LL.0 size=11773 2024-09-19T13:43:03.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.803+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=13GK6JRRF7LL tag=CJFF2A27POHV type=write size=1060349 2024-09-19T13:43:03.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.804+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=QWF79VYN02HH type=del 2024-09-19T13:43:03.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.806+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~ZEQ8KWZ84ZOJ.0 size=1048576 2024-09-19T13:43:03.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.807+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~ZEQ8KWZ84ZOJ.1 size=1048576 2024-09-19T13:43:03.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.808+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~ZEQ8KWZ84ZOJ.2 size=18346 2024-09-19T13:43:03.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.808+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=ZEQ8KWZ84ZOJ tag=I0IAEDNU5TLY type=write size=3164074 2024-09-19T13:43:03.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.809+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~8LRYA2I25ZET.0 size=1048576 2024-09-19T13:43:03.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.810+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~8LRYA2I25ZET.1 size=512534 2024-09-19T13:43:03.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.812+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=8LRYA2I25ZET tag=5EGBVN0BU5N4 type=write size=2609686 2024-09-19T13:43:03.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.813+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=671MT401HTYK type=del size=2012402 2024-09-19T13:43:03.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.815+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~Q87IWONN175B.0 size=1048576 2024-09-19T13:43:03.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.815+0000 7f6ab10d2780 1 < canceled part key=_multipart_X1JYDG1ASYAR.2~Q87IWONN175B.1 size=1048576 2024-09-19T13:43:03.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.816+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~Q87IWONN175B.2 size=61072 2024-09-19T13:43:03.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.818+0000 7f6ab10d2780 1 < canceled multipart upload key=X1JYDG1ASYAR upload=Q87IWONN175B tag=W3N1JS88RMBU type=write size=3206800 2024-09-19T13:43:03.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.819+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=HE0V4Z6VHR61 type=del size=2051292 2024-09-19T13:43:03.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.820+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=H4A2LHA59N1L type=del 2024-09-19T13:43:03.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.822+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=IU8T1PCMU4IH type=del size=3354519 2024-09-19T13:43:03.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.823+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=JP0WME79G9MV type=del 2024-09-19T13:43:03.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.824+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=OFYFJGSUBKCH type=write size=693582 2024-09-19T13:43:03.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.825+0000 7f6ab10d2780 1 < completed write operation key=CD4XXORKVS6J tag=PDRSFV2MHHNO type=write size=36458 2024-09-19T13:43:03.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.826+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=IHS6WOY8XKAK type=write size=903368 2024-09-19T13:43:03.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.827+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=XTWFLGTWUOF8 type=write size=261851 2024-09-19T13:43:03.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.829+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=UH9YD2VZ5CXQ type=del size=2653191 2024-09-19T13:43:03.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.830+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=9FZMEK6GU7NF type=del 2024-09-19T13:43:03.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.831+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=6VVY5Q3RL91L type=del size=452783 2024-09-19T13:43:03.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.832+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=DV4M0571TCEC type=del 2024-09-19T13:43:03.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.833+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=TWYMXNWWOB08 type=del size=216634 2024-09-19T13:43:03.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.834+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=VVG8I5CZIC3V type=del 2024-09-19T13:43:03.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.836+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~UGVNOZIHN1F1.0 size=1048576 2024-09-19T13:43:03.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~UGVNOZIHN1F1.1 size=1048576 2024-09-19T13:43:03.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.838+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~UGVNOZIHN1F1.2 size=586821 2024-09-19T13:43:03.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.838+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=UGVNOZIHN1F1 tag=W6VPVN39D2GU type=write size=3732549 2024-09-19T13:43:03.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.839+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=RKATUIGI0DAS type=del 2024-09-19T13:43:03.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.841+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~F1J6LKYIHT4F.0 size=598268 2024-09-19T13:43:03.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.841+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=F1J6LKYIHT4F tag=1KS1DBSNN3NV type=write size=1646844 2024-09-19T13:43:03.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.844+0000 7f6ab10d2780 1 < suggested update operation key=RU6OR8SM72GU tag=XOEYTVIN9T2G type=del size=1350958 2024-09-19T13:43:03.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.845+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=18ARHLVB8WD2 type=del size=1142575 2024-09-19T13:43:03.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.846+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~DFL54YBYRBXW.0 size=978127 2024-09-19T13:43:03.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.848+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=DFL54YBYRBXW tag=U1KEH1YZ7WRQ type=write size=2026703 2024-09-19T13:43:03.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.849+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=OXJ3UY85TT84 type=del size=4150072 2024-09-19T13:43:03.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.851+0000 7f6ab10d2780 1 < suggested remove operation key=UPMXNNYUUJR7 tag=853RHN7PQ7JR type=del 2024-09-19T13:43:03.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.853+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~1OOLAKNJZOUG.0 size=1048576 2024-09-19T13:43:03.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.854+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~1OOLAKNJZOUG.1 size=1048576 2024-09-19T13:43:03.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.855+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~1OOLAKNJZOUG.2 size=19812 2024-09-19T13:43:03.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.855+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=1OOLAKNJZOUG tag=YN0PADNY0JJ3 type=write size=3165540 2024-09-19T13:43:03.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.856+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=0VWBTQOGOMTC type=del 2024-09-19T13:43:03.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.857+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=NANB5F9MNF61 type=write size=184554 2024-09-19T13:43:03.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.857+0000 7f6ab10d2780 1 < canceled part key=_multipart_PUXLW9NBBQJX.2~13GK6JRRF7LL.0 size=11773 2024-09-19T13:43:03.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.859+0000 7f6ab10d2780 1 < canceled multipart upload key=PUXLW9NBBQJX upload=13GK6JRRF7LL tag=CJFF2A27POHV type=write size=1060349 2024-09-19T13:43:03.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.860+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=5M8UMKRZNDPV type=del size=3313080 2024-09-19T13:43:03.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.861+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~ZEQ8KWZ84ZOJ.0 size=1048576 2024-09-19T13:43:03.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.862+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~ZEQ8KWZ84ZOJ.1 size=1048576 2024-09-19T13:43:03.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.863+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~ZEQ8KWZ84ZOJ.2 size=18346 2024-09-19T13:43:03.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.865+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=ZEQ8KWZ84ZOJ tag=I0IAEDNU5TLY type=write size=3164074 2024-09-19T13:43:03.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.866+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=1TZ30VX9J1OW type=del size=3476616 2024-09-19T13:43:03.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.867+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=671MT401HTYK type=del 2024-09-19T13:43:03.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.869+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~LZI691D0SJ7I.0 size=1048576 2024-09-19T13:43:03.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.870+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~LZI691D0SJ7I.1 size=488399 2024-09-19T13:43:03.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.870+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=LZI691D0SJ7I tag=IODBNK0V6R61 type=write size=2585551 2024-09-19T13:43:03.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.871+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=HE0V4Z6VHR61 type=del 2024-09-19T13:43:03.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.873+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1Y1AXPWVNFH3.0 size=1048576 2024-09-19T13:43:03.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.874+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1Y1AXPWVNFH3.1 size=1048576 2024-09-19T13:43:03.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.874+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~1Y1AXPWVNFH3.2 size=963841 2024-09-19T13:43:03.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.874+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=1Y1AXPWVNFH3 tag=Y6VCN638MBRZ type=write size=4109569 2024-09-19T13:43:03.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.877+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=IU8T1PCMU4IH type=del 2024-09-19T13:43:03.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.878+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=KFOSSN7PGIL0 type=del size=3612973 2024-09-19T13:43:03.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.878+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=UPMXNNYUUJR7 tag=OFYFJGSUBKCH type=write size=693582: (2) No such file or directory 2024-09-19T13:43:03.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.879+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=BYB9Z6G2XPY5 type=write size=780021 2024-09-19T13:43:03.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.880+0000 7f6ab10d2780 1 < completed write operation key=TCXAYADSCTZI tag=IHS6WOY8XKAK type=write size=903368 2024-09-19T13:43:03.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.882+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~2IW7S8I7C1F7.0 size=256420 2024-09-19T13:43:03.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.882+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=2IW7S8I7C1F7 tag=LYTJGH6T324T type=write size=1304996 2024-09-19T13:43:03.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.883+0000 7f6ab10d2780 1 < canceled operation key=A14YTABJ1Z3Z tag=UH9YD2VZ5CXQ type=del size=2653191 2024-09-19T13:43:03.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.884+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=RQ3ESEJNHEAD type=del size=2946486 2024-09-19T13:43:03.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.886+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=6VVY5Q3RL91L type=del 2024-09-19T13:43:03.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.888+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~92LN9PT8FCZN.0 size=1048576 2024-09-19T13:43:03.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.889+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~92LN9PT8FCZN.1 size=246165 2024-09-19T13:43:03.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.889+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=92LN9PT8FCZN tag=78N0DK5RE7O5 type=write size=2343317 2024-09-19T13:43:03.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.890+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=TWYMXNWWOB08 type=del 2024-09-19T13:43:03.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.892+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~88DRFW5FN1G9.0 size=1048576 2024-09-19T13:43:03.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.892+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~88DRFW5FN1G9.1 size=194689 2024-09-19T13:43:03.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.892+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=88DRFW5FN1G9 tag=G4O2K6Y8URKT type=write size=2291841 2024-09-19T13:43:03.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.894+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~UGVNOZIHN1F1.0 size=1048576 2024-09-19T13:43:03.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.894+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~UGVNOZIHN1F1.1 size=1048576 2024-09-19T13:43:03.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.895+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~UGVNOZIHN1F1.2 size=586821 2024-09-19T13:43:03.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.897+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=UGVNOZIHN1F1 tag=W6VPVN39D2GU type=write size=3732549 2024-09-19T13:43:03.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.898+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=KVUAZF636ZGG type=write size=901782 2024-09-19T13:43:03.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.899+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~F1J6LKYIHT4F.0 size=598268 2024-09-19T13:43:03.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.901+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=F1J6LKYIHT4F tag=1KS1DBSNN3NV type=write size=1646844 2024-09-19T13:43:03.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.903+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~JFO8DDFBRYH7.0 size=1048576 2024-09-19T13:43:03.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.904+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~JFO8DDFBRYH7.1 size=776259 2024-09-19T13:43:03.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.904+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=JFO8DDFBRYH7 tag=FS03BQL4TX2I type=write size=2873411 2024-09-19T13:43:03.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.905+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=18ARHLVB8WD2 type=del 2024-09-19T13:43:03.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.906+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=5KD7T36L3SQB type=del size=1597818 2024-09-19T13:43:03.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.908+0000 7f6ab10d2780 1 < suggested update operation key=P2U09V0G7UUU tag=OXJ3UY85TT84 type=del size=4150072 2024-09-19T13:43:03.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.910+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=4I3RUIGE0OI0 type=del size=284192 2024-09-19T13:43:03.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.911+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~1OOLAKNJZOUG.0 size=1048576 2024-09-19T13:43:03.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.912+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~1OOLAKNJZOUG.1 size=1048576 2024-09-19T13:43:03.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.913+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~1OOLAKNJZOUG.2 size=19812 2024-09-19T13:43:03.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.914+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=1OOLAKNJZOUG tag=YN0PADNY0JJ3 type=write size=3165540 2024-09-19T13:43:03.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.916+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~JEO6DIIN0QLE.0 size=1048576 2024-09-19T13:43:03.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.917+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~JEO6DIIN0QLE.1 size=543219 2024-09-19T13:43:03.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.917+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=JEO6DIIN0QLE tag=N0CL5S3N01PL type=write size=2640371 2024-09-19T13:43:03.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.919+0000 7f6ab10d2780 -1 < failed to complete operation key=P2U09V0G7UUU tag=NANB5F9MNF61 type=write size=184554: (22) Invalid argument 2024-09-19T13:43:03.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.921+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~3BZL687RSG2G.0 size=169270 2024-09-19T13:43:03.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.921+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=3BZL687RSG2G tag=OUVO89YPYZ9F type=write size=1217846 2024-09-19T13:43:03.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.922+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=5M8UMKRZNDPV type=del 2024-09-19T13:43:03.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.923+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=B1NMMF6115VS type=write size=150894 2024-09-19T13:43:03.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.924+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=1TZ30VX9J1OW type=del 2024-09-19T13:43:03.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.925+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=38BYQ1L21MRP type=del size=434697 2024-09-19T13:43:03.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.926+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~LZI691D0SJ7I.0 size=1048576 2024-09-19T13:43:03.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.927+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~LZI691D0SJ7I.1 size=488399 2024-09-19T13:43:03.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.929+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=LZI691D0SJ7I tag=IODBNK0V6R61 type=write size=2585551 2024-09-19T13:43:03.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.930+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=LDPZ1XC1AZ8M type=del size=2411136 2024-09-19T13:43:03.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.931+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~1Y1AXPWVNFH3.0 size=1048576 2024-09-19T13:43:03.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.931+0000 7f6ab10d2780 1 < canceled part key=_multipart_XQLWZA2X91GF.2~1Y1AXPWVNFH3.1 size=1048576 2024-09-19T13:43:03.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.932+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~1Y1AXPWVNFH3.2 size=963841 2024-09-19T13:43:03.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.934+0000 7f6ab10d2780 1 < canceled multipart upload key=XQLWZA2X91GF upload=1Y1AXPWVNFH3 tag=Y6VCN638MBRZ type=write size=4109569 2024-09-19T13:43:03.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.935+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=X713SJJPUQI3 type=del size=776856 2024-09-19T13:43:03.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.936+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=KFOSSN7PGIL0 type=del 2024-09-19T13:43:03.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.938+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~LPPDJCRU70W7.0 size=1048576 2024-09-19T13:43:03.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.939+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~LPPDJCRU70W7.1 size=1048576 2024-09-19T13:43:03.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.939+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~LPPDJCRU70W7.2 size=903698 2024-09-19T13:43:03.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.939+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=LPPDJCRU70W7 tag=MORGPSZ393QR type=write size=4049426 2024-09-19T13:43:03.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.941+0000 7f6ab10d2780 1 < completed write operation key=13GXIDWI4J9F tag=BYB9Z6G2XPY5 type=write size=780021 2024-09-19T13:43:03.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.942+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=REJ0R84OJUTG type=write size=981974 2024-09-19T13:43:03.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.943+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~2IW7S8I7C1F7.0 size=256420 2024-09-19T13:43:03.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.946+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=2IW7S8I7C1F7 tag=LYTJGH6T324T type=write size=1304996 2024-09-19T13:43:03.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.947+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=A2LBAKFGIRLS type=write size=664177 2024-09-19T13:43:03.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.949+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=RQ3ESEJNHEAD type=del 2024-09-19T13:43:03.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.950+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=7VW0NO66G6HQ type=del size=2067116 2024-09-19T13:43:03.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.951+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~92LN9PT8FCZN.0 size=1048576 2024-09-19T13:43:03.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.952+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~92LN9PT8FCZN.1 size=246165 2024-09-19T13:43:03.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.953+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=92LN9PT8FCZN tag=78N0DK5RE7O5 type=write size=2343317 2024-09-19T13:43:03.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.954+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=NC9XDS9XLYFV type=write size=255404 2024-09-19T13:43:03.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.956+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~88DRFW5FN1G9.0 size=1048576 2024-09-19T13:43:03.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.956+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~88DRFW5FN1G9.1 size=194689 2024-09-19T13:43:03.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.958+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=88DRFW5FN1G9 tag=G4O2K6Y8URKT type=write size=2291841 2024-09-19T13:43:03.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.959+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=PJ2TO5BWO3SX type=del size=3114828 2024-09-19T13:43:03.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.960+0000 7f6ab10d2780 1 < canceled operation key=VFJIKOLYI0HN tag=KVUAZF636ZGG type=write size=901782 2024-09-19T13:43:03.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.961+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=YVS24YRQDME1 type=del size=313808 2024-09-19T13:43:03.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.962+0000 7f6ab10d2780 1 < canceled part key=_multipart_SDQ64HOD22EM.2~JFO8DDFBRYH7.0 size=1048576 2024-09-19T13:43:03.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.963+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~JFO8DDFBRYH7.1 size=776259 2024-09-19T13:43:03.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.964+0000 7f6ab10d2780 1 < canceled multipart upload key=SDQ64HOD22EM upload=JFO8DDFBRYH7 tag=FS03BQL4TX2I type=write size=2873411 2024-09-19T13:43:03.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.966+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~ZLKIIGQP6VJ2.0 size=1048576 2024-09-19T13:43:03.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.967+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~ZLKIIGQP6VJ2.1 size=1048576 2024-09-19T13:43:03.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.968+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~ZLKIIGQP6VJ2.2 size=321605 2024-09-19T13:43:03.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.968+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=ZLKIIGQP6VJ2 tag=GVF27P5EP26S type=write size=3467333 2024-09-19T13:43:03.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.969+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=5KD7T36L3SQB type=del 2024-09-19T13:43:03.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.970+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=Z1FHI9ZPQC2S type=del size=1448650 2024-09-19T13:43:03.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.971+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=4I3RUIGE0OI0 type=del 2024-09-19T13:43:03.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.973+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~77U76WQNRTGL.0 size=1048576 2024-09-19T13:43:03.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.974+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~77U76WQNRTGL.1 size=351047 2024-09-19T13:43:03.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.974+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=77U76WQNRTGL tag=EFMF1S4FUBMD type=write size=2448199 2024-09-19T13:43:03.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.974+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~JEO6DIIN0QLE.0 size=1048576 2024-09-19T13:43:03.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.975+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~JEO6DIIN0QLE.1 size=543219 2024-09-19T13:43:03.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.977+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=JEO6DIIN0QLE tag=N0CL5S3N01PL type=write size=2640371 2024-09-19T13:43:03.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.978+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=CEQT41Y32SNS type=del size=194649 2024-09-19T13:43:03.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.979+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~3BZL687RSG2G.0 size=169270 2024-09-19T13:43:03.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.980+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=3BZL687RSG2G tag=OUVO89YPYZ9F type=write size=1217846 2024-09-19T13:43:03.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.982+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~PKWSGEYYMUZI.0 size=1048576 2024-09-19T13:43:03.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.983+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~PKWSGEYYMUZI.1 size=921255 2024-09-19T13:43:03.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.983+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=PKWSGEYYMUZI tag=6R8U9TIADZEE type=write size=3018407 2024-09-19T13:43:03.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.984+0000 7f6ab10d2780 1 < completed write operation key=UPMXNNYUUJR7 tag=B1NMMF6115VS type=write size=150894 2024-09-19T13:43:03.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.985+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=0BBU1FDF4MUM type=del size=2130268 2024-09-19T13:43:03.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.987+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=38BYQ1L21MRP type=del 2024-09-19T13:43:03.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.989+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~ZEZ9C2EHBTUJ.0 size=240635 2024-09-19T13:43:03.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.989+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=ZEZ9C2EHBTUJ tag=S71ADW73X958 type=write size=1289211 2024-09-19T13:43:03.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.990+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=LDPZ1XC1AZ8M type=del 2024-09-19T13:43:03.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.991+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=PXE6JDG2BPQ2 type=del size=1547430 2024-09-19T13:43:03.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.993+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=X713SJJPUQI3 type=del 2024-09-19T13:43:03.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.995+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~11AA8NVLGF3A.0 size=1048576 2024-09-19T13:43:03.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.996+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~11AA8NVLGF3A.1 size=922315 2024-09-19T13:43:03.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.996+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=11AA8NVLGF3A tag=047087GD128P type=write size=3019467 2024-09-19T13:43:03.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.997+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~LPPDJCRU70W7.0 size=1048576 2024-09-19T13:43:04.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.998+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~LPPDJCRU70W7.1 size=1048576 2024-09-19T13:43:04.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:03.999+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~LPPDJCRU70W7.2 size=903698 2024-09-19T13:43:04.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.000+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=LPPDJCRU70W7 tag=MORGPSZ393QR type=write size=4049426 2024-09-19T13:43:04.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.002+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=L44UEP7RSD95 type=write size=89459 2024-09-19T13:43:04.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.003+0000 7f6ab10d2780 1 < completed write operation key=X1JYDG1ASYAR tag=REJ0R84OJUTG type=write size=981974 2024-09-19T13:43:04.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.004+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=WBYN4OCXZKW0 type=del size=3288069 2024-09-19T13:43:04.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.005+0000 7f6ab10d2780 1 < completed write operation key=DF003ORZ1HOM tag=A2LBAKFGIRLS type=write size=664177 2024-09-19T13:43:04.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.006+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=ZCJYR9I5FFWD type=write size=282800 2024-09-19T13:43:04.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.007+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=7VW0NO66G6HQ type=del 2024-09-19T13:43:04.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.009+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=G3CBZU6VQS11 type=del size=3547644 2024-09-19T13:43:04.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.010+0000 7f6ab10d2780 1 < canceled operation key=SRABG45EPVN2 tag=NC9XDS9XLYFV type=write size=255404 2024-09-19T13:43:04.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.011+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=L4NY93JDOWPV type=write size=838348 2024-09-19T13:43:04.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.012+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=PJ2TO5BWO3SX type=del 2024-09-19T13:43:04.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.013+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=RMILENLHNTOA type=del size=3875330 2024-09-19T13:43:04.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.015+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=YVS24YRQDME1 type=del 2024-09-19T13:43:04.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.017+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~001I24U6T00D.0 size=1048576 2024-09-19T13:43:04.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.018+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~001I24U6T00D.1 size=1048576 2024-09-19T13:43:04.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.018+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~001I24U6T00D.2 size=898177 2024-09-19T13:43:04.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.018+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=001I24U6T00D tag=UCOPPX2HDEM8 type=write size=4043905 2024-09-19T13:43:04.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.020+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~ZLKIIGQP6VJ2.0 size=1048576 2024-09-19T13:43:04.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.021+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~ZLKIIGQP6VJ2.1 size=1048576 2024-09-19T13:43:04.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.022+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~ZLKIIGQP6VJ2.2 size=321605 2024-09-19T13:43:04.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.024+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=ZLKIIGQP6VJ2 tag=GVF27P5EP26S type=write size=3467333 2024-09-19T13:43:04.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.026+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~FXLZ1KFPJR2N.0 size=1031969 2024-09-19T13:43:04.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.026+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=FXLZ1KFPJR2N tag=TEU09Z6EDATQ type=write size=2080545 2024-09-19T13:43:04.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.027+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=Z1FHI9ZPQC2S type=del 2024-09-19T13:43:04.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.029+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~G8GII303N1N9.0 size=284250 2024-09-19T13:43:04.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.029+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=G8GII303N1N9 tag=1YEUF68L34W5 type=write size=1332826 2024-09-19T13:43:04.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.030+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~77U76WQNRTGL.0 size=1048576 2024-09-19T13:43:04.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.030+0000 7f6ab10d2780 1 < canceled part key=_multipart_CD4XXORKVS6J.2~77U76WQNRTGL.1 size=351047 2024-09-19T13:43:04.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.032+0000 7f6ab10d2780 1 < canceled multipart upload key=CD4XXORKVS6J upload=77U76WQNRTGL tag=EFMF1S4FUBMD type=write size=2448199 2024-09-19T13:43:04.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.033+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=TYWT730P00IM type=del size=1516883 2024-09-19T13:43:04.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.034+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=CEQT41Y32SNS type=del 2024-09-19T13:43:04.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.035+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=P6GJCHJLONDF type=write size=359197 2024-09-19T13:43:04.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.036+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~PKWSGEYYMUZI.0 size=1048576 2024-09-19T13:43:04.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.037+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~PKWSGEYYMUZI.1 size=921255 2024-09-19T13:43:04.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.039+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=PKWSGEYYMUZI tag=6R8U9TIADZEE type=write size=3018407 2024-09-19T13:43:04.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.042+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~D108H40DAWUT.0 size=1048576 2024-09-19T13:43:04.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.042+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~D108H40DAWUT.1 size=1048576 2024-09-19T13:43:04.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.043+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~D108H40DAWUT.2 size=876792 2024-09-19T13:43:04.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.043+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=D108H40DAWUT tag=NT2IJJVGL2LF type=write size=4022520 2024-09-19T13:43:04.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.046+0000 7f6ab10d2780 1 < suggested update operation key=X8CWBFNCJG6M tag=0BBU1FDF4MUM type=del size=2130268 2024-09-19T13:43:04.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.047+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=DIW3N2QNV6ON type=del size=439288 2024-09-19T13:43:04.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.049+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~ZEZ9C2EHBTUJ.0 size=240635 2024-09-19T13:43:04.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.051+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=ZEZ9C2EHBTUJ tag=S71ADW73X958 type=write size=1289211 2024-09-19T13:43:04.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.052+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=VPPL47ORYZCM type=del size=3245252 2024-09-19T13:43:04.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.053+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=PXE6JDG2BPQ2 type=del 2024-09-19T13:43:04.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.055+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~MK5000QVCTUP.0 size=1048576 2024-09-19T13:43:04.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.056+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~MK5000QVCTUP.1 size=1048576 2024-09-19T13:43:04.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.057+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~MK5000QVCTUP.2 size=937684 2024-09-19T13:43:04.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.057+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=MK5000QVCTUP tag=UXS07CQ3ZW1A type=write size=4083412 2024-09-19T13:43:04.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.059+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~11AA8NVLGF3A.0 size=1048576 2024-09-19T13:43:04.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.060+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~11AA8NVLGF3A.1 size=922315 2024-09-19T13:43:04.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.062+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=11AA8NVLGF3A tag=047087GD128P type=write size=3019467 2024-09-19T13:43:04.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.063+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=FQJGF6YK74EF type=del size=3891937 2024-09-19T13:43:04.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.064+0000 7f6ab10d2780 1 < completed write operation key=B0J7E7A0NP4J tag=L44UEP7RSD95 type=write size=89459 2024-09-19T13:43:04.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.065+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=01QE8RZH9AHD type=del size=3147129 2024-09-19T13:43:04.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.067+0000 7f6ab10d2780 1 < suggested remove operation key=9WTLWBONAOET tag=WBYN4OCXZKW0 type=del 2024-09-19T13:43:04.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.068+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=FW6K5T3YV347 type=write size=318134 2024-09-19T13:43:04.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.069+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=ZCJYR9I5FFWD type=write size=282800 2024-09-19T13:43:04.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.070+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=9KLPTQUMV1Y0 type=write size=917897 2024-09-19T13:43:04.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.072+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=G3CBZU6VQS11 type=del 2024-09-19T13:43:04.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.073+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=46H4KWKOKOI1 type=del size=1902195 2024-09-19T13:43:04.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.074+0000 7f6ab10d2780 1 < completed write operation key=UPMXNNYUUJR7 tag=L4NY93JDOWPV type=write size=838348 2024-09-19T13:43:04.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.076+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~IMDAVV1HTQ8Q.0 size=72872 2024-09-19T13:43:04.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.076+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=IMDAVV1HTQ8Q tag=ZQZXQ5RS4H0C type=write size=1121448 2024-09-19T13:43:04.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.077+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=RMILENLHNTOA type=del 2024-09-19T13:43:04.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.078+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=Z1JC92670S20 type=del size=3624341 2024-09-19T13:43:04.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.079+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~001I24U6T00D.0 size=1048576 2024-09-19T13:43:04.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.080+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~001I24U6T00D.1 size=1048576 2024-09-19T13:43:04.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.081+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~001I24U6T00D.2 size=898177 2024-09-19T13:43:04.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.082+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=001I24U6T00D tag=UCOPPX2HDEM8 type=write size=4043905 2024-09-19T13:43:04.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.084+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~JQID89E5TOQ1.0 size=1048576 2024-09-19T13:43:04.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.085+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~JQID89E5TOQ1.1 size=326193 2024-09-19T13:43:04.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.085+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=JQID89E5TOQ1 tag=Q9SGFGLOSM6H type=write size=2423345 2024-09-19T13:43:04.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.086+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~FXLZ1KFPJR2N.0 size=1031969 2024-09-19T13:43:04.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.088+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=FXLZ1KFPJR2N tag=TEU09Z6EDATQ type=write size=2080545 2024-09-19T13:43:04.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.090+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~NBTS14H6VGEJ.0 size=1048576 2024-09-19T13:43:04.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.091+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~NBTS14H6VGEJ.1 size=1048576 2024-09-19T13:43:04.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.092+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~NBTS14H6VGEJ.2 size=698370 2024-09-19T13:43:04.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.092+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=NBTS14H6VGEJ tag=H9TD9RV8OT3I type=write size=3844098 2024-09-19T13:43:04.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.093+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~G8GII303N1N9.0 size=284250 2024-09-19T13:43:04.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.095+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=G8GII303N1N9 tag=1YEUF68L34W5 type=write size=1332826 2024-09-19T13:43:04.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.096+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=WS94ECFN59RP type=del size=3638394 2024-09-19T13:43:04.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.097+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=TYWT730P00IM type=del 2024-09-19T13:43:04.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.099+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~JL0HMTP0L60Y.0 size=1048576 2024-09-19T13:43:04.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.100+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~JL0HMTP0L60Y.1 size=879144 2024-09-19T13:43:04.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.100+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=JL0HMTP0L60Y tag=LK92QQGOEQRN type=write size=2976296 2024-09-19T13:43:04.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.101+0000 7f6ab10d2780 1 < canceled operation key=9MCE8PXHBGNF tag=P6GJCHJLONDF type=write size=359197 2024-09-19T13:43:04.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.103+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=TAOAJKEMR4JT type=del size=1056866 2024-09-19T13:43:04.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.104+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~D108H40DAWUT.0 size=1048576 2024-09-19T13:43:04.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.104+0000 7f6ab10d2780 1 < canceled part key=_multipart_SERUGCO68R9W.2~D108H40DAWUT.1 size=1048576 2024-09-19T13:43:04.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.105+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~D108H40DAWUT.2 size=876792 2024-09-19T13:43:04.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.107+0000 7f6ab10d2780 1 < canceled multipart upload key=SERUGCO68R9W upload=D108H40DAWUT tag=NT2IJJVGL2LF type=write size=4022520 2024-09-19T13:43:04.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.109+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~SDVBCQHL4J4N.0 size=1048576 2024-09-19T13:43:04.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.110+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~SDVBCQHL4J4N.1 size=1048576 2024-09-19T13:43:04.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.110+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~SDVBCQHL4J4N.2 size=593640 2024-09-19T13:43:04.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.110+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=SDVBCQHL4J4N tag=5JQ30N80N5TK type=write size=3739368 2024-09-19T13:43:04.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.112+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=DIW3N2QNV6ON type=del 2024-09-19T13:43:04.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.113+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=DV3JSJ0S3TNE type=del size=427079 2024-09-19T13:43:04.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.114+0000 7f6ab10d2780 1 < canceled operation key=CD4XXORKVS6J tag=VPPL47ORYZCM type=del size=3245252 2024-09-19T13:43:04.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.116+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~8JV8N1BYA3AR.0 size=1048576 2024-09-19T13:43:04.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.117+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~8JV8N1BYA3AR.1 size=1048576 2024-09-19T13:43:04.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.118+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~8JV8N1BYA3AR.2 size=259001 2024-09-19T13:43:04.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.118+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=8JV8N1BYA3AR tag=4IIEJTWALVJ6 type=write size=3404729 2024-09-19T13:43:04.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.119+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~MK5000QVCTUP.0 size=1048576 2024-09-19T13:43:04.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.120+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~MK5000QVCTUP.1 size=1048576 2024-09-19T13:43:04.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.121+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~MK5000QVCTUP.2 size=937684 2024-09-19T13:43:04.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.123+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=MK5000QVCTUP tag=UXS07CQ3ZW1A type=write size=4083412 2024-09-19T13:43:04.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.124+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=8DFYVK5ZSOMC type=del size=3365878 2024-09-19T13:43:04.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.125+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=FQJGF6YK74EF type=del size=3891937 2024-09-19T13:43:04.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.128+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~ENE0F55WT6ZY.0 size=490632 2024-09-19T13:43:04.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.128+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=ENE0F55WT6ZY tag=DSZA00SMC1X9 type=write size=1539208 2024-09-19T13:43:04.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.129+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=01QE8RZH9AHD type=del 2024-09-19T13:43:04.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.130+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=YKA7JR3Z1GQ4 type=del size=1366390 2024-09-19T13:43:04.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.131+0000 7f6ab10d2780 1 < completed write operation key=XQLWZA2X91GF tag=FW6K5T3YV347 type=write size=318134 2024-09-19T13:43:04.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.132+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=VQEKGU4KOCG3 type=del size=2089646 2024-09-19T13:43:04.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.134+0000 7f6ab10d2780 1 < canceled operation key=9Q9DGUSDSE49 tag=9KLPTQUMV1Y0 type=write size=917897 2024-09-19T13:43:04.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.135+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=0BJ32WT12V09 type=write size=205547 2024-09-19T13:43:04.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.136+0000 7f6ab10d2780 1 < canceled operation key=WDRUV5ERI000 tag=46H4KWKOKOI1 type=del size=1902195 2024-09-19T13:43:04.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.137+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=RN118P0FRKHL type=del size=1872263 2024-09-19T13:43:04.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.138+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~IMDAVV1HTQ8Q.0 size=72872 2024-09-19T13:43:04.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.140+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=IMDAVV1HTQ8Q tag=ZQZXQ5RS4H0C type=write size=1121448 2024-09-19T13:43:04.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.141+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=443R22CD1ZSO type=del size=2191293 2024-09-19T13:43:04.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.143+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=Z1JC92670S20 type=del 2024-09-19T13:43:04.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.145+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~SHJOSSHWCFM8.0 size=1048576 2024-09-19T13:43:04.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.146+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~SHJOSSHWCFM8.1 size=454503 2024-09-19T13:43:04.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.146+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=SHJOSSHWCFM8 tag=CEQAHKAKKQ3E type=write size=2551655 2024-09-19T13:43:04.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.147+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~JQID89E5TOQ1.0 size=1048576 2024-09-19T13:43:04.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.148+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~JQID89E5TOQ1.1 size=326193 2024-09-19T13:43:04.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.150+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=JQID89E5TOQ1 tag=Q9SGFGLOSM6H type=write size=2423345 2024-09-19T13:43:04.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.152+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~09RUYTQF4H1J.0 size=1048576 2024-09-19T13:43:04.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.153+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~09RUYTQF4H1J.1 size=40495 2024-09-19T13:43:04.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.153+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=09RUYTQF4H1J tag=H6QZHQ7Q9RTS type=write size=2137647 2024-09-19T13:43:04.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.153+0000 7f6ab10d2780 1 < canceled part key=_multipart_PUXLW9NBBQJX.2~NBTS14H6VGEJ.0 size=1048576 2024-09-19T13:43:04.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.155+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~NBTS14H6VGEJ.1 size=1048576 2024-09-19T13:43:04.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.155+0000 7f6ab10d2780 1 < canceled part key=_multipart_PUXLW9NBBQJX.2~NBTS14H6VGEJ.2 size=698370 2024-09-19T13:43:04.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.156+0000 7f6ab10d2780 1 < canceled multipart upload key=PUXLW9NBBQJX upload=NBTS14H6VGEJ tag=H9TD9RV8OT3I type=write size=3844098 2024-09-19T13:43:04.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.158+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=KG442ZIDU3VH type=del size=3515648 2024-09-19T13:43:04.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.159+0000 7f6ab10d2780 1 < canceled operation key=XQLWZA2X91GF tag=WS94ECFN59RP type=del size=3638394 2024-09-19T13:43:04.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.161+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~A8M21LHB91EZ.0 size=29049 2024-09-19T13:43:04.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.161+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=A8M21LHB91EZ tag=667G09RAYJDI type=write size=1077625 2024-09-19T13:43:04.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.162+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~JL0HMTP0L60Y.0 size=1048576 2024-09-19T13:43:04.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.163+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~JL0HMTP0L60Y.1 size=879144 2024-09-19T13:43:04.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.164+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=JL0HMTP0L60Y tag=LK92QQGOEQRN type=write size=2976296 2024-09-19T13:43:04.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.166+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~IVF928EEJ55D.0 size=1048576 2024-09-19T13:43:04.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.167+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~IVF928EEJ55D.1 size=1048576 2024-09-19T13:43:04.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.168+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~IVF928EEJ55D.2 size=357206 2024-09-19T13:43:04.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.168+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=IVF928EEJ55D tag=5VCB1Q5BEJ5Z type=write size=3502934 2024-09-19T13:43:04.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.170+0000 7f6ab10d2780 1 < suggested update operation key=UX2ICIT36Q3R tag=TAOAJKEMR4JT type=del size=1056866 2024-09-19T13:43:04.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.172+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~BONV8FQ4GSC5.0 size=1048576 2024-09-19T13:43:04.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.173+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~BONV8FQ4GSC5.1 size=197691 2024-09-19T13:43:04.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.173+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=BONV8FQ4GSC5 tag=HAFVID7VZKBX type=write size=2294843 2024-09-19T13:43:04.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.174+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~SDVBCQHL4J4N.0 size=1048576 2024-09-19T13:43:04.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.175+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~SDVBCQHL4J4N.1 size=1048576 2024-09-19T13:43:04.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.176+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~SDVBCQHL4J4N.2 size=593640 2024-09-19T13:43:04.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.178+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=SDVBCQHL4J4N tag=5JQ30N80N5TK type=write size=3739368 2024-09-19T13:43:04.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.179+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=VKC923KHPXW6 type=write size=292462 2024-09-19T13:43:04.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.180+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=DV3JSJ0S3TNE type=del 2024-09-19T13:43:04.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.181+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=Y1PI0OKEU0FB type=write size=336874 2024-09-19T13:43:04.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.182+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~8JV8N1BYA3AR.0 size=1048576 2024-09-19T13:43:04.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.183+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~8JV8N1BYA3AR.1 size=1048576 2024-09-19T13:43:04.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.184+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~8JV8N1BYA3AR.2 size=259001 2024-09-19T13:43:04.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.186+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=8JV8N1BYA3AR tag=4IIEJTWALVJ6 type=write size=3404729 2024-09-19T13:43:04.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.187+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=2XBBX9IYRE48 type=del size=2292399 2024-09-19T13:43:04.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.188+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=8DFYVK5ZSOMC type=del 2024-09-19T13:43:04.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.189+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=XHE1AA7KPJ27 type=del size=1847585 2024-09-19T13:43:04.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.190+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~ENE0F55WT6ZY.0 size=490632 2024-09-19T13:43:04.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.192+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=ENE0F55WT6ZY tag=DSZA00SMC1X9 type=write size=1539208 2024-09-19T13:43:04.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.193+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=HOZQQ0G7ZJ59 type=del size=1909510 2024-09-19T13:43:04.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.194+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=YKA7JR3Z1GQ4 type=del 2024-09-19T13:43:04.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.196+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~28KC6N0V7XFP.0 size=1048576 2024-09-19T13:43:04.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.197+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~28KC6N0V7XFP.1 size=1048576 2024-09-19T13:43:04.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.198+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~28KC6N0V7XFP.2 size=587024 2024-09-19T13:43:04.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.198+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=28KC6N0V7XFP tag=ZTWJG240ZWRS type=write size=3732752 2024-09-19T13:43:04.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.200+0000 7f6ab10d2780 1 < suggested remove operation key=SRABG45EPVN2 tag=VQEKGU4KOCG3 type=del 2024-09-19T13:43:04.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.201+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=WWTB8LJ0X4D6 type=del size=2865811 2024-09-19T13:43:04.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.202+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=SRABG45EPVN2 tag=0BJ32WT12V09 type=write size=205547: (2) No such file or directory 2024-09-19T13:43:04.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.203+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=VJYF8BSVHX8R type=del size=2677408 2024-09-19T13:43:04.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.204+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=RN118P0FRKHL type=del 2024-09-19T13:43:04.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.206+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~R9ZMMC9OY2L5.0 size=1048576 2024-09-19T13:43:04.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.207+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~R9ZMMC9OY2L5.1 size=1048576 2024-09-19T13:43:04.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.208+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~R9ZMMC9OY2L5.2 size=338841 2024-09-19T13:43:04.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.208+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=R9ZMMC9OY2L5 tag=2MRSKMCUBKVL type=write size=3484569 2024-09-19T13:43:04.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.209+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=443R22CD1ZSO type=del 2024-09-19T13:43:04.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.210+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=VI3B68ZENUSN type=del size=309460 2024-09-19T13:43:04.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.211+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~SHJOSSHWCFM8.0 size=1048576 2024-09-19T13:43:04.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.211+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~SHJOSSHWCFM8.1 size=454503 2024-09-19T13:43:04.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.213+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=SHJOSSHWCFM8 tag=CEQAHKAKKQ3E type=write size=2551655 2024-09-19T13:43:04.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.214+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=8ZUAA7D5KMWE type=del size=1919704 2024-09-19T13:43:04.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.216+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~09RUYTQF4H1J.0 size=1048576 2024-09-19T13:43:04.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.216+0000 7f6ab10d2780 1 < canceled part key=_multipart_RXXCDV0LTCKS.2~09RUYTQF4H1J.1 size=40495 2024-09-19T13:43:04.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.217+0000 7f6ab10d2780 1 < canceled multipart upload key=RXXCDV0LTCKS upload=09RUYTQF4H1J tag=H6QZHQ7Q9RTS type=write size=2137647 2024-09-19T13:43:04.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.219+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=7Z68MRCIEP9E type=del size=337932 2024-09-19T13:43:04.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.220+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=KG442ZIDU3VH type=del 2024-09-19T13:43:04.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.221+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=R8L6XRTBBQD4 type=del size=3483223 2024-09-19T13:43:04.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.222+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~A8M21LHB91EZ.0 size=29049 2024-09-19T13:43:04.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.224+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=A8M21LHB91EZ tag=667G09RAYJDI type=write size=1077625 2024-09-19T13:43:04.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.225+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=LF7Z44YIH1S8 type=del size=549474 2024-09-19T13:43:04.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.226+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~IVF928EEJ55D.0 size=1048576 2024-09-19T13:43:04.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.227+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~IVF928EEJ55D.1 size=1048576 2024-09-19T13:43:04.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.228+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~IVF928EEJ55D.2 size=357206 2024-09-19T13:43:04.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.230+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=IVF928EEJ55D tag=5VCB1Q5BEJ5Z type=write size=3502934 2024-09-19T13:43:04.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.232+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~E4Z8UP9X7KL3.0 size=432939 2024-09-19T13:43:04.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.232+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=E4Z8UP9X7KL3 tag=QFDNPDYLG9BP type=write size=1481515 2024-09-19T13:43:04.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.233+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~BONV8FQ4GSC5.0 size=1048576 2024-09-19T13:43:04.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.234+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~BONV8FQ4GSC5.1 size=197691 2024-09-19T13:43:04.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.236+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=BONV8FQ4GSC5 tag=HAFVID7VZKBX type=write size=2294843 2024-09-19T13:43:04.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.238+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~5O3Q898UZACO.0 size=869566 2024-09-19T13:43:04.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.238+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=5O3Q898UZACO tag=N074E2OCGIOU type=write size=1918142 2024-09-19T13:43:04.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.240+0000 7f6ab10d2780 1 < suggested update operation key=QTGKMAOX2A6U tag=VKC923KHPXW6 type=write size=292462 2024-09-19T13:43:04.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.241+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=3RXNGZ2XYLDG type=del size=2989547 2024-09-19T13:43:04.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.242+0000 7f6ab10d2780 1 < canceled operation key=SDQ64HOD22EM tag=Y1PI0OKEU0FB type=write size=336874 2024-09-19T13:43:04.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.244+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~WB0VJV9QDIGQ.0 size=889088 2024-09-19T13:43:04.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.244+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=WB0VJV9QDIGQ tag=1P9GBNIH1A5H type=write size=1937664 2024-09-19T13:43:04.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.247+0000 7f6ab10d2780 1 < suggested remove operation key=B0J7E7A0NP4J tag=2XBBX9IYRE48 type=del 2024-09-19T13:43:04.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.248+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=AMDG3OQHVIOA type=del size=3556182 2024-09-19T13:43:04.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.250+0000 7f6ab10d2780 1 < suggested update operation key=2KX2NSY41STV tag=XHE1AA7KPJ27 type=del size=1847585 2024-09-19T13:43:04.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.251+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=TLLRKJOAOTR2 type=del size=3931956 2024-09-19T13:43:04.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.252+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=HOZQQ0G7ZJ59 type=del 2024-09-19T13:43:04.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.253+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=TV9U1DQSSD98 type=del size=1823452 2024-09-19T13:43:04.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.254+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~28KC6N0V7XFP.0 size=1048576 2024-09-19T13:43:04.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.255+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~28KC6N0V7XFP.1 size=1048576 2024-09-19T13:43:04.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.256+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~28KC6N0V7XFP.2 size=587024 2024-09-19T13:43:04.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.259+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=28KC6N0V7XFP tag=ZTWJG240ZWRS type=write size=3732752 2024-09-19T13:43:04.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.260+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=MW41SUD24FY8 type=write size=58928 2024-09-19T13:43:04.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.261+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=WWTB8LJ0X4D6 type=del 2024-09-19T13:43:04.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.262+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=91ZOHSUG7RP5 type=del size=3090520 2024-09-19T13:43:04.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.264+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=VJYF8BSVHX8R type=del 2024-09-19T13:43:04.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.266+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~R8E9O8SFPI77.0 size=920669 2024-09-19T13:43:04.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.266+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=R8E9O8SFPI77 tag=VGKIDY0Q2ZO2 type=write size=1969245 2024-09-19T13:43:04.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.267+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~R9ZMMC9OY2L5.0 size=1048576 2024-09-19T13:43:04.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.268+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~R9ZMMC9OY2L5.1 size=1048576 2024-09-19T13:43:04.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.268+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~R9ZMMC9OY2L5.2 size=338841 2024-09-19T13:43:04.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.270+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=R9ZMMC9OY2L5 tag=2MRSKMCUBKVL type=write size=3484569 2024-09-19T13:43:04.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.271+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=LII3LBD6DD4K type=del size=1847976 2024-09-19T13:43:04.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.272+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=VI3B68ZENUSN type=del 2024-09-19T13:43:04.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.274+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~QZBPUW62N7DJ.0 size=1048576 2024-09-19T13:43:04.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.276+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~QZBPUW62N7DJ.1 size=1048576 2024-09-19T13:43:04.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.276+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~QZBPUW62N7DJ.2 size=666477 2024-09-19T13:43:04.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.276+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=QZBPUW62N7DJ tag=GOPEDY356IBY type=write size=3812205 2024-09-19T13:43:04.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.278+0000 7f6ab10d2780 1 < canceled operation key=X1JYDG1ASYAR tag=8ZUAA7D5KMWE type=del size=1919704 2024-09-19T13:43:04.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.279+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=6BU42MSFOHX4 type=del size=770805 2024-09-19T13:43:04.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.280+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=7Z68MRCIEP9E type=del 2024-09-19T13:43:04.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.281+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=YS0J2BLM3BGB type=del size=1186270 2024-09-19T13:43:04.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.283+0000 7f6ab10d2780 1 < suggested remove operation key=B0J7E7A0NP4J tag=R8L6XRTBBQD4 type=del 2024-09-19T13:43:04.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.285+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~0BJX8EYAHE0E.0 size=1048576 2024-09-19T13:43:04.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.286+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~0BJX8EYAHE0E.1 size=229959 2024-09-19T13:43:04.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.286+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=0BJX8EYAHE0E tag=S0PJ0OCP5YSZ type=write size=2327111 2024-09-19T13:43:04.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.287+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=LF7Z44YIH1S8 type=del 2024-09-19T13:43:04.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.288+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=R23G5XWK9ZT7 type=del size=1540574 2024-09-19T13:43:04.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.289+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~E4Z8UP9X7KL3.0 size=432939 2024-09-19T13:43:04.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.291+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=E4Z8UP9X7KL3 tag=QFDNPDYLG9BP type=write size=1481515 2024-09-19T13:43:04.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.292+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=63GYRK1NH952 type=del size=4155865 2024-09-19T13:43:04.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.293+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~5O3Q898UZACO.0 size=869566 2024-09-19T13:43:04.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.295+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=5O3Q898UZACO tag=N074E2OCGIOU type=write size=1918142 2024-09-19T13:43:04.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.296+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=B12X5HOWDS3H type=del size=2819136 2024-09-19T13:43:04.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.298+0000 7f6ab10d2780 -1 < failed to complete operation key=2KX2NSY41STV tag=3RXNGZ2XYLDG type=del size=2989547: (22) Invalid argument 2024-09-19T13:43:04.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.300+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~IVWGKHW39IQE.0 size=1048576 2024-09-19T13:43:04.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.301+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~IVWGKHW39IQE.1 size=1048576 2024-09-19T13:43:04.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.302+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~IVWGKHW39IQE.2 size=718436 2024-09-19T13:43:04.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.302+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=IVWGKHW39IQE tag=0IG7VX4M96OK type=write size=3864164 2024-09-19T13:43:04.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.303+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~WB0VJV9QDIGQ.0 size=889088 2024-09-19T13:43:04.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.305+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=WB0VJV9QDIGQ tag=1P9GBNIH1A5H type=write size=1937664 2024-09-19T13:43:04.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.308+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~SBYHTG1CTBU2.0 size=1048576 2024-09-19T13:43:04.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.309+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~SBYHTG1CTBU2.1 size=1048576 2024-09-19T13:43:04.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.309+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~SBYHTG1CTBU2.2 size=901421 2024-09-19T13:43:04.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.309+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=SBYHTG1CTBU2 tag=ESQEF7VB332D type=write size=4047149 2024-09-19T13:43:04.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.311+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=AMDG3OQHVIOA type=del 2024-09-19T13:43:04.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.313+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~P18BAM63SACG.0 size=1048576 2024-09-19T13:43:04.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.314+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~P18BAM63SACG.1 size=1048576 2024-09-19T13:43:04.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.315+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~P18BAM63SACG.2 size=685345 2024-09-19T13:43:04.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.315+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=P18BAM63SACG tag=MN288KM37W1J type=write size=3831073 2024-09-19T13:43:04.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.316+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=TLLRKJOAOTR2 type=del 2024-09-19T13:43:04.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.317+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=D66YACMX3DEA type=write size=666147 2024-09-19T13:43:04.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.317+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=B0J7E7A0NP4J tag=TV9U1DQSSD98 type=del size=1823452: (2) No such file or directory 2024-09-19T13:43:04.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.319+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=9PMRN5W0QFHS type=del size=281048 2024-09-19T13:43:04.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.320+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=MW41SUD24FY8 type=write size=58928 2024-09-19T13:43:04.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.321+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=TAVNW5E24GJU type=write size=247110 2024-09-19T13:43:04.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.324+0000 7f6ab10d2780 1 < suggested remove operation key=UPMXNNYUUJR7 tag=91ZOHSUG7RP5 type=del 2024-09-19T13:43:04.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.326+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~Z3DZJQD2DUWQ.0 size=1048576 2024-09-19T13:43:04.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.327+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~Z3DZJQD2DUWQ.1 size=1048576 2024-09-19T13:43:04.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.328+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~Z3DZJQD2DUWQ.2 size=721259 2024-09-19T13:43:04.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.328+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=Z3DZJQD2DUWQ tag=JFJO2B5WDS0M type=write size=3866987 2024-09-19T13:43:04.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.329+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~R8E9O8SFPI77.0 size=920669 2024-09-19T13:43:04.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.331+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=R8E9O8SFPI77 tag=VGKIDY0Q2ZO2 type=write size=1969245 2024-09-19T13:43:04.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.332+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=Q7MC3QU1QL5V type=del size=967892 2024-09-19T13:43:04.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.333+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=LII3LBD6DD4K type=del 2024-09-19T13:43:04.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.334+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=X9Q57LT8FX4K type=del size=965837 2024-09-19T13:43:04.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.335+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~QZBPUW62N7DJ.0 size=1048576 2024-09-19T13:43:04.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.336+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~QZBPUW62N7DJ.1 size=1048576 2024-09-19T13:43:04.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.337+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~QZBPUW62N7DJ.2 size=666477 2024-09-19T13:43:04.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.339+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=QZBPUW62N7DJ tag=GOPEDY356IBY type=write size=3812205 2024-09-19T13:43:04.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.340+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=O0BFXLJIUP9H type=del size=2286014 2024-09-19T13:43:04.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.341+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=6BU42MSFOHX4 type=del 2024-09-19T13:43:04.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.342+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=O81YM03N4GDB type=write size=30899 2024-09-19T13:43:04.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.343+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=YS0J2BLM3BGB type=del 2024-09-19T13:43:04.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.345+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~1VNQLWKVPV10.0 size=1048576 2024-09-19T13:43:04.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.346+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~1VNQLWKVPV10.1 size=848732 2024-09-19T13:43:04.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.346+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=1VNQLWKVPV10 tag=WVZL5J5EM1TU type=write size=2945884 2024-09-19T13:43:04.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.347+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~0BJX8EYAHE0E.0 size=1048576 2024-09-19T13:43:04.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.348+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~0BJX8EYAHE0E.1 size=229959 2024-09-19T13:43:04.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.350+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=0BJX8EYAHE0E tag=S0PJ0OCP5YSZ type=write size=2327111 2024-09-19T13:43:04.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.352+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~6FTCORMYB3OR.0 size=323982 2024-09-19T13:43:04.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.352+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=6FTCORMYB3OR tag=D8LDDU02XXAD type=write size=1372558 2024-09-19T13:43:04.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.354+0000 7f6ab10d2780 1 < suggested remove operation key=DTSRVH526PE7 tag=R23G5XWK9ZT7 type=del 2024-09-19T13:43:04.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.356+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~2OV80HVGZMOE.0 size=1048576 2024-09-19T13:43:04.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.357+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~2OV80HVGZMOE.1 size=1048576 2024-09-19T13:43:04.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.358+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~2OV80HVGZMOE.2 size=42630 2024-09-19T13:43:04.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.358+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=2OV80HVGZMOE tag=FGR663TOR713 type=write size=3188358 2024-09-19T13:43:04.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.360+0000 7f6ab10d2780 1 < suggested update operation key=EE8F84K0ZAGJ tag=63GYRK1NH952 type=del size=4155865 2024-09-19T13:43:04.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.361+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=118TSK98RV3L type=del size=1651581 2024-09-19T13:43:04.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.365+0000 7f6ab10d2780 1 < suggested update operation key=QTGKMAOX2A6U tag=B12X5HOWDS3H type=del size=2819136 2024-09-19T13:43:04.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.367+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~4X0J7SZ6OGES.0 size=1048576 2024-09-19T13:43:04.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.367+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~4X0J7SZ6OGES.1 size=618622 2024-09-19T13:43:04.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.367+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=4X0J7SZ6OGES tag=AYEDSP43S0C0 type=write size=2715774 2024-09-19T13:43:04.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.369+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~IVWGKHW39IQE.0 size=1048576 2024-09-19T13:43:04.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.370+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~IVWGKHW39IQE.1 size=1048576 2024-09-19T13:43:04.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.371+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~IVWGKHW39IQE.2 size=718436 2024-09-19T13:43:04.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.373+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=IVWGKHW39IQE tag=0IG7VX4M96OK type=write size=3864164 2024-09-19T13:43:04.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.374+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=KA0ECB6M8VQT type=write size=373756 2024-09-19T13:43:04.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.376+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~SBYHTG1CTBU2.0 size=1048576 2024-09-19T13:43:04.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.377+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~SBYHTG1CTBU2.1 size=1048576 2024-09-19T13:43:04.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.378+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~SBYHTG1CTBU2.2 size=901421 2024-09-19T13:43:04.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.380+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=SBYHTG1CTBU2 tag=ESQEF7VB332D type=write size=4047149 2024-09-19T13:43:04.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.381+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=OQKS2XMD5XBT type=del size=1268829 2024-09-19T13:43:04.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.382+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~P18BAM63SACG.0 size=1048576 2024-09-19T13:43:04.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.383+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~P18BAM63SACG.1 size=1048576 2024-09-19T13:43:04.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.384+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~P18BAM63SACG.2 size=685345 2024-09-19T13:43:04.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.386+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=P18BAM63SACG tag=MN288KM37W1J type=write size=3831073 2024-09-19T13:43:04.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.388+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~9DWWSBYM4VC8.0 size=683534 2024-09-19T13:43:04.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.388+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=9DWWSBYM4VC8 tag=JBBLZO54HGAP type=write size=1732110 2024-09-19T13:43:04.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.390+0000 7f6ab10d2780 1 < suggested update operation key=XQLWZA2X91GF tag=D66YACMX3DEA type=write size=666147 2024-09-19T13:43:04.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.391+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=KIB96N3CAK68 type=del size=1341332 2024-09-19T13:43:04.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.392+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=9PMRN5W0QFHS type=del 2024-09-19T13:43:04.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.393+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=JXPJ1KE5QIAY type=del size=2888014 2024-09-19T13:43:04.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.395+0000 7f6ab10d2780 1 < completed write operation key=4OSJA1879NQO tag=TAVNW5E24GJU type=write size=247110 2024-09-19T13:43:04.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.397+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~1X0F9I9IXZGB.0 size=322351 2024-09-19T13:43:04.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.397+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=1X0F9I9IXZGB tag=XSXCRCS8LMER type=write size=1370927 2024-09-19T13:43:04.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.398+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~Z3DZJQD2DUWQ.0 size=1048576 2024-09-19T13:43:04.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.399+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~Z3DZJQD2DUWQ.1 size=1048576 2024-09-19T13:43:04.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.399+0000 7f6ab10d2780 1 < canceled part key=_multipart_P2U09V0G7UUU.2~Z3DZJQD2DUWQ.2 size=721259 2024-09-19T13:43:04.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.402+0000 7f6ab10d2780 1 < canceled multipart upload key=P2U09V0G7UUU upload=Z3DZJQD2DUWQ tag=JFJO2B5WDS0M type=write size=3866987 2024-09-19T13:43:04.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.404+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~7G943ISZ5JAP.0 size=1048576 2024-09-19T13:43:04.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.405+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~7G943ISZ5JAP.1 size=617430 2024-09-19T13:43:04.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.405+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=7G943ISZ5JAP tag=3L2S8PJNZP72 type=write size=2714582 2024-09-19T13:43:04.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.406+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=Q7MC3QU1QL5V type=del 2024-09-19T13:43:04.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.407+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=39FU3SGJSF3L type=del size=688733 2024-09-19T13:43:04.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.408+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=X9Q57LT8FX4K type=del 2024-09-19T13:43:04.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.410+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=8TFYNY0QM6T4 type=write size=135013 2024-09-19T13:43:04.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.411+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=O0BFXLJIUP9H type=del 2024-09-19T13:43:04.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.412+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=8PJS4HET0OI0 type=del size=114208 2024-09-19T13:43:04.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.413+0000 7f6ab10d2780 1 < completed write operation key=13GXIDWI4J9F tag=O81YM03N4GDB type=write size=30899 2024-09-19T13:43:04.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.414+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=U47NJIY4D3YJ type=write size=886414 2024-09-19T13:43:04.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.415+0000 7f6ab10d2780 1 < canceled part key=_multipart_9IN6E0JQFNAU.2~1VNQLWKVPV10.0 size=1048576 2024-09-19T13:43:04.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.415+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~1VNQLWKVPV10.1 size=848732 2024-09-19T13:43:04.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.417+0000 7f6ab10d2780 1 < canceled multipart upload key=9IN6E0JQFNAU upload=1VNQLWKVPV10 tag=WVZL5J5EM1TU type=write size=2945884 2024-09-19T13:43:04.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.419+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=SXUZK0SJPILK type=del size=192128 2024-09-19T13:43:04.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.420+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~6FTCORMYB3OR.0 size=323982 2024-09-19T13:43:04.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.422+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=6FTCORMYB3OR tag=D8LDDU02XXAD type=write size=1372558 2024-09-19T13:43:04.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.423+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=71MLYFTHDLTB type=write size=135578 2024-09-19T13:43:04.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.424+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~2OV80HVGZMOE.0 size=1048576 2024-09-19T13:43:04.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.424+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~2OV80HVGZMOE.1 size=1048576 2024-09-19T13:43:04.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.425+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~2OV80HVGZMOE.2 size=42630 2024-09-19T13:43:04.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.427+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=2OV80HVGZMOE tag=FGR663TOR713 type=write size=3188358 2024-09-19T13:43:04.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.428+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=MF3AUP5RTHAS type=write size=736704 2024-09-19T13:43:04.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.431+0000 7f6ab10d2780 1 < suggested remove operation key=SDQ64HOD22EM tag=118TSK98RV3L type=del 2024-09-19T13:43:04.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.432+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=WBT1Z3ER4SVD type=del size=1740585 2024-09-19T13:43:04.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.432+0000 7f6ab10d2780 1 < canceled part key=_multipart_QTGKMAOX2A6U.2~4X0J7SZ6OGES.0 size=1048576 2024-09-19T13:43:04.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.433+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~4X0J7SZ6OGES.1 size=618622 2024-09-19T13:43:04.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.435+0000 7f6ab10d2780 1 < canceled multipart upload key=QTGKMAOX2A6U upload=4X0J7SZ6OGES tag=AYEDSP43S0C0 type=write size=2715774 2024-09-19T13:43:04.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.436+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=V9NHQ32IOZ08 type=del size=639059 2024-09-19T13:43:04.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.437+0000 7f6ab10d2780 1 < completed write operation key=VFJIKOLYI0HN tag=KA0ECB6M8VQT type=write size=373756 2024-09-19T13:43:04.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.438+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=M3YNP3AKK8G5 type=del size=1712577 2024-09-19T13:43:04.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.439+0000 7f6ab10d2780 1 < canceled operation key=9Q9DGUSDSE49 tag=OQKS2XMD5XBT type=del size=1268829 2024-09-19T13:43:04.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.442+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VGE33XZEMZYQ.0 size=1048576 2024-09-19T13:43:04.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.442+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VGE33XZEMZYQ.1 size=1048576 2024-09-19T13:43:04.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.443+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VGE33XZEMZYQ.2 size=672399 2024-09-19T13:43:04.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.443+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=VGE33XZEMZYQ tag=QD1L5R1UIK69 type=write size=3818127 2024-09-19T13:43:04.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.445+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~9DWWSBYM4VC8.0 size=683534 2024-09-19T13:43:04.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.446+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=9DWWSBYM4VC8 tag=JBBLZO54HGAP type=write size=1732110 2024-09-19T13:43:04.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.448+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~PLNASC015YCG.0 size=1048576 2024-09-19T13:43:04.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.449+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~PLNASC015YCG.1 size=280558 2024-09-19T13:43:04.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.449+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=PLNASC015YCG tag=2KMJ5BR5G7OV type=write size=2377710 2024-09-19T13:43:04.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.451+0000 7f6ab10d2780 1 < suggested update operation key=TCXAYADSCTZI tag=KIB96N3CAK68 type=del size=1341332 2024-09-19T13:43:04.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.453+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~25OPIY8R6XMF.0 size=1048576 2024-09-19T13:43:04.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.454+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~25OPIY8R6XMF.1 size=1048576 2024-09-19T13:43:04.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.455+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~25OPIY8R6XMF.2 size=412950 2024-09-19T13:43:04.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.455+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=25OPIY8R6XMF tag=X4E650Y60U32 type=write size=3558678 2024-09-19T13:43:04.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.457+0000 7f6ab10d2780 1 < suggested update operation key=UX2ICIT36Q3R tag=JXPJ1KE5QIAY type=del size=2888014 2024-09-19T13:43:04.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.458+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=337MT6NQSRUF type=del size=2265848 2024-09-19T13:43:04.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.459+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~1X0F9I9IXZGB.0 size=322351 2024-09-19T13:43:04.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.461+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=1X0F9I9IXZGB tag=XSXCRCS8LMER type=write size=1370927 2024-09-19T13:43:04.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.462+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=11N2WRQ8DT92 type=del size=2279197 2024-09-19T13:43:04.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.463+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~7G943ISZ5JAP.0 size=1048576 2024-09-19T13:43:04.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.464+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~7G943ISZ5JAP.1 size=617430 2024-09-19T13:43:04.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.466+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=7G943ISZ5JAP tag=3L2S8PJNZP72 type=write size=2714582 2024-09-19T13:43:04.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.468+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~I40D9LLONRKB.0 size=1048576 2024-09-19T13:43:04.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.469+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~I40D9LLONRKB.1 size=819524 2024-09-19T13:43:04.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.469+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=I40D9LLONRKB tag=5L1GKMV3W9XM type=write size=2916676 2024-09-19T13:43:04.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.470+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=39FU3SGJSF3L type=del 2024-09-19T13:43:04.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.473+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~KLEKJBTRVLZF.0 size=443796 2024-09-19T13:43:04.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.473+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=KLEKJBTRVLZF tag=PV27BKOKUCM3 type=write size=1492372 2024-09-19T13:43:04.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.474+0000 7f6ab10d2780 -1 < failed to complete operation key=TCXAYADSCTZI tag=8TFYNY0QM6T4 type=write size=135013: (22) Invalid argument 2024-09-19T13:43:04.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.476+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~A2NBR04INHIA.0 size=631934 2024-09-19T13:43:04.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.476+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=A2NBR04INHIA tag=F3VZP2K4I8I3 type=write size=1680510 2024-09-19T13:43:04.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.477+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=8PJS4HET0OI0 type=del 2024-09-19T13:43:04.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.479+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~VIU73VR4LFII.0 size=1048576 2024-09-19T13:43:04.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.480+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~VIU73VR4LFII.1 size=1048576 2024-09-19T13:43:04.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.481+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~VIU73VR4LFII.2 size=215505 2024-09-19T13:43:04.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.481+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=VIU73VR4LFII tag=T6HHPUEUDV2J type=write size=3361233 2024-09-19T13:43:04.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.482+0000 7f6ab10d2780 1 < completed write operation key=RXXCDV0LTCKS tag=U47NJIY4D3YJ type=write size=886414 2024-09-19T13:43:04.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.483+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=BAWOY24A5HPJ type=del size=2906615 2024-09-19T13:43:04.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.484+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=SXUZK0SJPILK type=del 2024-09-19T13:43:04.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.485+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=EV71CULAZDVX type=del size=550539 2024-09-19T13:43:04.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.486+0000 7f6ab10d2780 1 < completed write operation key=A14YTABJ1Z3Z tag=71MLYFTHDLTB type=write size=135578 2024-09-19T13:43:04.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.487+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=Y67RUP45H100 type=del size=2286042 2024-09-19T13:43:04.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.489+0000 7f6ab10d2780 1 < completed write operation key=CD4XXORKVS6J tag=MF3AUP5RTHAS type=write size=736704 2024-09-19T13:43:04.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.490+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=R400R24QE604 type=del size=1441577 2024-09-19T13:43:04.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.492+0000 7f6ab10d2780 1 < suggested remove operation key=TCXAYADSCTZI tag=WBT1Z3ER4SVD type=del 2024-09-19T13:43:04.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.493+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=14Y37ZVHJAWE type=del size=3052443 2024-09-19T13:43:04.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.494+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=V9NHQ32IOZ08 type=del 2024-09-19T13:43:04.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.495+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=32ZZR8LRA309 type=del size=827152 2024-09-19T13:43:04.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.497+0000 7f6ab10d2780 1 < canceled operation key=DF003ORZ1HOM tag=M3YNP3AKK8G5 type=del size=1712577 2024-09-19T13:43:04.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.498+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=X7W4YXZE8JY3 type=del size=1727097 2024-09-19T13:43:04.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.499+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VGE33XZEMZYQ.0 size=1048576 2024-09-19T13:43:04.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.500+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VGE33XZEMZYQ.1 size=1048576 2024-09-19T13:43:04.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.501+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VGE33XZEMZYQ.2 size=672399 2024-09-19T13:43:04.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.503+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=VGE33XZEMZYQ tag=QD1L5R1UIK69 type=write size=3818127 2024-09-19T13:43:04.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.504+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=BVZ7Y1L91SPT type=del size=2266396 2024-09-19T13:43:04.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.505+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~PLNASC015YCG.0 size=1048576 2024-09-19T13:43:04.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.506+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~PLNASC015YCG.1 size=280558 2024-09-19T13:43:04.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.508+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=PLNASC015YCG tag=2KMJ5BR5G7OV type=write size=2377710 2024-09-19T13:43:04.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.509+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=2PUKUHCX534S type=del size=2906540 2024-09-19T13:43:04.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.509+0000 7f6ab10d2780 1 < canceled part key=_multipart_535R757HSXMB.2~25OPIY8R6XMF.0 size=1048576 2024-09-19T13:43:04.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.510+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~25OPIY8R6XMF.1 size=1048576 2024-09-19T13:43:04.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.511+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~25OPIY8R6XMF.2 size=412950 2024-09-19T13:43:04.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.513+0000 7f6ab10d2780 1 < canceled multipart upload key=535R757HSXMB upload=25OPIY8R6XMF tag=X4E650Y60U32 type=write size=3558678 2024-09-19T13:43:04.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.515+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~1H1MARV8MW4H.0 size=1048576 2024-09-19T13:43:04.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.516+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~1H1MARV8MW4H.1 size=1048576 2024-09-19T13:43:04.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.517+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~1H1MARV8MW4H.2 size=834305 2024-09-19T13:43:04.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.517+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=1H1MARV8MW4H tag=OTI2XFMT386D type=write size=3980033 2024-09-19T13:43:04.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.520+0000 7f6ab10d2780 1 < suggested remove operation key=RU6OR8SM72GU tag=337MT6NQSRUF type=del 2024-09-19T13:43:04.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.521+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=J5LQT78FGD9T type=del size=1518151 2024-09-19T13:43:04.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.522+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=11N2WRQ8DT92 type=del 2024-09-19T13:43:04.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.524+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~2M733LTVX5KG.0 size=1048576 2024-09-19T13:43:04.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.525+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~2M733LTVX5KG.1 size=883944 2024-09-19T13:43:04.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.525+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=2M733LTVX5KG tag=4XO6PVEJVFML type=write size=2981096 2024-09-19T13:43:04.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.526+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~I40D9LLONRKB.0 size=1048576 2024-09-19T13:43:04.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.527+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~I40D9LLONRKB.1 size=819524 2024-09-19T13:43:04.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.529+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=I40D9LLONRKB tag=5L1GKMV3W9XM type=write size=2916676 2024-09-19T13:43:04.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.531+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~5UT1S21I4RSA.0 size=1048576 2024-09-19T13:43:04.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.532+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~5UT1S21I4RSA.1 size=1048576 2024-09-19T13:43:04.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.533+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~5UT1S21I4RSA.2 size=623484 2024-09-19T13:43:04.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.533+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=5UT1S21I4RSA tag=5W9N5DCOIUMN type=write size=3769212 2024-09-19T13:43:04.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.534+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~KLEKJBTRVLZF.0 size=443796 2024-09-19T13:43:04.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.536+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=KLEKJBTRVLZF tag=PV27BKOKUCM3 type=write size=1492372 2024-09-19T13:43:04.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.538+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~6JEYY6T715PG.0 size=1048576 2024-09-19T13:43:04.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.539+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~6JEYY6T715PG.1 size=1048576 2024-09-19T13:43:04.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.540+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~6JEYY6T715PG.2 size=822520 2024-09-19T13:43:04.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.540+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=6JEYY6T715PG tag=HLJ4IUS06M16 type=write size=3968248 2024-09-19T13:43:04.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.541+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~A2NBR04INHIA.0 size=631934 2024-09-19T13:43:04.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.543+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=A2NBR04INHIA tag=F3VZP2K4I8I3 type=write size=1680510 2024-09-19T13:43:04.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.545+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~6UKJI7YCYO53.0 size=260462 2024-09-19T13:43:04.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.545+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=6UKJI7YCYO53 tag=FYJO834W5DDD type=write size=1309038 2024-09-19T13:43:04.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.546+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~VIU73VR4LFII.0 size=1048576 2024-09-19T13:43:04.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.548+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~VIU73VR4LFII.1 size=1048576 2024-09-19T13:43:04.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.548+0000 7f6ab10d2780 1 < canceled part key=_multipart_RU6OR8SM72GU.2~VIU73VR4LFII.2 size=215505 2024-09-19T13:43:04.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.549+0000 7f6ab10d2780 1 < canceled multipart upload key=RU6OR8SM72GU upload=VIU73VR4LFII tag=T6HHPUEUDV2J type=write size=3361233 2024-09-19T13:43:04.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.550+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=AYHJGX64XYGY type=write size=882054 2024-09-19T13:43:04.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.551+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=BAWOY24A5HPJ type=del 2024-09-19T13:43:04.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.554+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~4Z0O2MPQDPF6.0 size=1048576 2024-09-19T13:43:04.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.554+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~4Z0O2MPQDPF6.1 size=610920 2024-09-19T13:43:04.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.554+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=4Z0O2MPQDPF6 tag=UQ25BZPXOMW1 type=write size=2708072 2024-09-19T13:43:04.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.555+0000 7f6ab10d2780 -1 < failed to complete operation key=RU6OR8SM72GU tag=EV71CULAZDVX type=del size=550539: (22) Invalid argument 2024-09-19T13:43:04.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.558+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~3CDL6DLT5V84.0 size=1048576 2024-09-19T13:43:04.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.558+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~3CDL6DLT5V84.1 size=821292 2024-09-19T13:43:04.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.558+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=3CDL6DLT5V84 tag=4VHUL8Z0Y4BJ type=write size=2918444 2024-09-19T13:43:04.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.560+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=Y67RUP45H100 type=del 2024-09-19T13:43:04.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.561+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=ASLXM7X7A70K type=del size=588336 2024-09-19T13:43:04.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.562+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=R400R24QE604 type=del 2024-09-19T13:43:04.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.563+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=1ERIIKHCIME9 type=write size=19609 2024-09-19T13:43:04.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.564+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=14Y37ZVHJAWE type=del 2024-09-19T13:43:04.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.565+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=T172S1HLN5YN type=del size=3781572 2024-09-19T13:43:04.568 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.566+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=32ZZR8LRA309 type=del 2024-09-19T13:43:04.569 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.567+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=60ZXQYQBIOGL type=del size=1600737 2024-09-19T13:43:04.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.569+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=X7W4YXZE8JY3 type=del 2024-09-19T13:43:04.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.570+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~3PF7J953CRBY.0 size=1048576 2024-09-19T13:43:04.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.571+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~3PF7J953CRBY.1 size=472839 2024-09-19T13:43:04.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.571+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=3PF7J953CRBY tag=AE4BDDGI9E33 type=write size=2569991 2024-09-19T13:43:04.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.572+0000 7f6ab10d2780 1 < canceled operation key=PUXLW9NBBQJX tag=BVZ7Y1L91SPT type=del size=2266396 2024-09-19T13:43:04.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.574+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=L3YK0X375YM1 type=del size=2610451 2024-09-19T13:43:04.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.575+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=2PUKUHCX534S type=del 2024-09-19T13:43:04.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.578+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~ZQISDJNYOFSM.0 size=1048576 2024-09-19T13:43:04.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.579+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~ZQISDJNYOFSM.1 size=21375 2024-09-19T13:43:04.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.579+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=ZQISDJNYOFSM tag=W5ZLBNXUFR7E type=write size=2118527 2024-09-19T13:43:04.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.580+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~1H1MARV8MW4H.0 size=1048576 2024-09-19T13:43:04.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.581+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~1H1MARV8MW4H.1 size=1048576 2024-09-19T13:43:04.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.581+0000 7f6ab10d2780 1 < canceled part key=_multipart_DF003ORZ1HOM.2~1H1MARV8MW4H.2 size=834305 2024-09-19T13:43:04.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.583+0000 7f6ab10d2780 1 < canceled multipart upload key=DF003ORZ1HOM upload=1H1MARV8MW4H tag=OTI2XFMT386D type=write size=3980033 2024-09-19T13:43:04.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.585+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~RIWMPVR9Z650.0 size=1048576 2024-09-19T13:43:04.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.586+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~RIWMPVR9Z650.1 size=1048576 2024-09-19T13:43:04.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.587+0000 7f6ab10d2780 1 > prepared part key=_multipart_XQLWZA2X91GF.2~RIWMPVR9Z650.2 size=264005 2024-09-19T13:43:04.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.587+0000 7f6ab10d2780 1 > prepared multipart upload key=XQLWZA2X91GF upload=RIWMPVR9Z650 tag=C5X1N17DCUGX type=write size=3409733 2024-09-19T13:43:04.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.588+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=J5LQT78FGD9T type=del 2024-09-19T13:43:04.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.590+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~5D3ZCCNIFHY3.0 size=728955 2024-09-19T13:43:04.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.590+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=5D3ZCCNIFHY3 tag=OV0LMDJXNQPV type=write size=1777531 2024-09-19T13:43:04.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.591+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~2M733LTVX5KG.0 size=1048576 2024-09-19T13:43:04.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.592+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~2M733LTVX5KG.1 size=883944 2024-09-19T13:43:04.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.594+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=2M733LTVX5KG tag=4XO6PVEJVFML type=write size=2981096 2024-09-19T13:43:04.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.596+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~9ZQC34PY7BQU.0 size=550975 2024-09-19T13:43:04.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.596+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=9ZQC34PY7BQU tag=F0JN1AEPALFH type=write size=1599551 2024-09-19T13:43:04.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.596+0000 7f6ab10d2780 1 < canceled part key=_multipart_SDQ64HOD22EM.2~5UT1S21I4RSA.0 size=1048576 2024-09-19T13:43:04.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.597+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~5UT1S21I4RSA.1 size=1048576 2024-09-19T13:43:04.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.597+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~5UT1S21I4RSA.2 size=623484 2024-09-19T13:43:04.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.599+0000 7f6ab10d2780 1 < canceled multipart upload key=SDQ64HOD22EM upload=5UT1S21I4RSA tag=5W9N5DCOIUMN type=write size=3769212 2024-09-19T13:43:04.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.601+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~NC7GJJYBHR1L.0 size=896466 2024-09-19T13:43:04.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.601+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=NC7GJJYBHR1L tag=IT66FMJQAET3 type=write size=1945042 2024-09-19T13:43:04.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.602+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~6JEYY6T715PG.0 size=1048576 2024-09-19T13:43:04.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.603+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~6JEYY6T715PG.1 size=1048576 2024-09-19T13:43:04.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.604+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~6JEYY6T715PG.2 size=822520 2024-09-19T13:43:04.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.606+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=6JEYY6T715PG tag=HLJ4IUS06M16 type=write size=3968248 2024-09-19T13:43:04.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.607+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=D8K159WDM46H type=write size=74192 2024-09-19T13:43:04.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.608+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~6UKJI7YCYO53.0 size=260462 2024-09-19T13:43:04.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.610+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=6UKJI7YCYO53 tag=FYJO834W5DDD type=write size=1309038 2024-09-19T13:43:04.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.611+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=2RFUBQBNY6RR type=write size=234423 2024-09-19T13:43:04.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.612+0000 7f6ab10d2780 1 < completed write operation key=DF003ORZ1HOM tag=AYHJGX64XYGY type=write size=882054 2024-09-19T13:43:04.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.613+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=8PHROJT4CEBZ type=del size=2094762 2024-09-19T13:43:04.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.614+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~4Z0O2MPQDPF6.0 size=1048576 2024-09-19T13:43:04.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.615+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~4Z0O2MPQDPF6.1 size=610920 2024-09-19T13:43:04.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.617+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=4Z0O2MPQDPF6 tag=UQ25BZPXOMW1 type=write size=2708072 2024-09-19T13:43:04.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.618+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=6BA9XO9EC7HG type=del size=2538381 2024-09-19T13:43:04.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.619+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~3CDL6DLT5V84.0 size=1048576 2024-09-19T13:43:04.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.620+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~3CDL6DLT5V84.1 size=821292 2024-09-19T13:43:04.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.622+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=3CDL6DLT5V84 tag=4VHUL8Z0Y4BJ type=write size=2918444 2024-09-19T13:43:04.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.623+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=84ZSJAEDL4OV type=del size=2952803 2024-09-19T13:43:04.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.624+0000 7f6ab10d2780 1 < canceled operation key=UPMXNNYUUJR7 tag=ASLXM7X7A70K type=del size=588336 2024-09-19T13:43:04.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.627+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~4VZYNU0B083J.0 size=677008 2024-09-19T13:43:04.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.627+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=4VZYNU0B083J tag=URKAGTMEPN5X type=write size=1725584 2024-09-19T13:43:04.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.628+0000 7f6ab10d2780 1 < canceled operation key=B0J7E7A0NP4J tag=1ERIIKHCIME9 type=write size=19609 2024-09-19T13:43:04.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.629+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=GGIZ5PGQ8G4Z type=del size=235268 2024-09-19T13:43:04.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.630+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=T172S1HLN5YN type=del 2024-09-19T13:43:04.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.632+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~TRKFE9IDGEJ2.0 size=1048576 2024-09-19T13:43:04.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.633+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~TRKFE9IDGEJ2.1 size=688977 2024-09-19T13:43:04.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.633+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=TRKFE9IDGEJ2 tag=Q82EM7R1IJJN type=write size=2786129 2024-09-19T13:43:04.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.635+0000 7f6ab10d2780 1 < completed delete operation key=2KX2NSY41STV tag=60ZXQYQBIOGL type=del 2024-09-19T13:43:04.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.636+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=FTYO3A58ZC2L type=del size=2352167 2024-09-19T13:43:04.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.637+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~3PF7J953CRBY.0 size=1048576 2024-09-19T13:43:04.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.638+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~3PF7J953CRBY.1 size=472839 2024-09-19T13:43:04.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.640+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=3PF7J953CRBY tag=AE4BDDGI9E33 type=write size=2569991 2024-09-19T13:43:04.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.642+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~PUTDYD1XK17T.0 size=1048576 2024-09-19T13:43:04.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.643+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~PUTDYD1XK17T.1 size=1048576 2024-09-19T13:43:04.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.644+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~PUTDYD1XK17T.2 size=111736 2024-09-19T13:43:04.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.644+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=PUTDYD1XK17T tag=3E43JPCQF3B6 type=write size=3257464 2024-09-19T13:43:04.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.645+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=L3YK0X375YM1 type=del 2024-09-19T13:43:04.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.647+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~43BHWTW5PTA9.0 size=1048576 2024-09-19T13:43:04.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.648+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~43BHWTW5PTA9.1 size=1048576 2024-09-19T13:43:04.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.649+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~43BHWTW5PTA9.2 size=134714 2024-09-19T13:43:04.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.649+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=43BHWTW5PTA9 tag=RG3MGQM5MGF0 type=write size=3280442 2024-09-19T13:43:04.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.650+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~ZQISDJNYOFSM.0 size=1048576 2024-09-19T13:43:04.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.651+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~ZQISDJNYOFSM.1 size=21375 2024-09-19T13:43:04.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.653+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=ZQISDJNYOFSM tag=W5ZLBNXUFR7E type=write size=2118527 2024-09-19T13:43:04.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.654+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=ERY2JYE66HH2 type=del size=2459036 2024-09-19T13:43:04.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.655+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~RIWMPVR9Z650.0 size=1048576 2024-09-19T13:43:04.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.656+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~RIWMPVR9Z650.1 size=1048576 2024-09-19T13:43:04.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.657+0000 7f6ab10d2780 1 < completed part key=_multipart_XQLWZA2X91GF.2~RIWMPVR9Z650.2 size=264005 2024-09-19T13:43:04.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.659+0000 7f6ab10d2780 1 < completed multipart upload key=XQLWZA2X91GF upload=RIWMPVR9Z650 tag=C5X1N17DCUGX type=write size=3409733 2024-09-19T13:43:04.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.660+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=ONZYWS1EOVAA type=del size=1639302 2024-09-19T13:43:04.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.660+0000 7f6ab10d2780 1 < canceled part key=_multipart_9Q9DGUSDSE49.2~5D3ZCCNIFHY3.0 size=728955 2024-09-19T13:43:04.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.662+0000 7f6ab10d2780 1 < canceled multipart upload key=9Q9DGUSDSE49 upload=5D3ZCCNIFHY3 tag=OV0LMDJXNQPV type=write size=1777531 2024-09-19T13:43:04.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.663+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=FW31JWEKT3NJ type=del size=541134 2024-09-19T13:43:04.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.664+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~9ZQC34PY7BQU.0 size=550975 2024-09-19T13:43:04.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.666+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=9ZQC34PY7BQU tag=F0JN1AEPALFH type=write size=1599551 2024-09-19T13:43:04.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.668+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~QDI2ZQ3U1OA0.0 size=1048576 2024-09-19T13:43:04.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.669+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~QDI2ZQ3U1OA0.1 size=1048576 2024-09-19T13:43:04.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.669+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~QDI2ZQ3U1OA0.2 size=57908 2024-09-19T13:43:04.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.669+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=QDI2ZQ3U1OA0 tag=34USV1R0ZWJC type=write size=3203636 2024-09-19T13:43:04.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.671+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~NC7GJJYBHR1L.0 size=896466 2024-09-19T13:43:04.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.672+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=NC7GJJYBHR1L tag=IT66FMJQAET3 type=write size=1945042 2024-09-19T13:43:04.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.673+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=763C9I4W4ZD6 type=del size=3681207 2024-09-19T13:43:04.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.676+0000 7f6ab10d2780 1 < suggested update operation key=9WTLWBONAOET tag=D8K159WDM46H type=write size=74192 2024-09-19T13:43:04.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.677+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~0KEWJVG9284A.0 size=1048576 2024-09-19T13:43:04.681 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.679+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~0KEWJVG9284A.1 size=1048576 2024-09-19T13:43:04.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.680+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~0KEWJVG9284A.2 size=388815 2024-09-19T13:43:04.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.680+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=0KEWJVG9284A tag=UQUQMURLKBTW type=write size=3534543 2024-09-19T13:43:04.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.681+0000 7f6ab10d2780 1 < completed write operation key=4OSJA1879NQO tag=2RFUBQBNY6RR type=write size=234423 2024-09-19T13:43:04.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.682+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=KDF0R37T4TH2 type=del size=2924870 2024-09-19T13:43:04.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.683+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=8PHROJT4CEBZ type=del 2024-09-19T13:43:04.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.685+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~HQWYUKCIRPQB.0 size=1048576 2024-09-19T13:43:04.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.686+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~HQWYUKCIRPQB.1 size=1048576 2024-09-19T13:43:04.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.687+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~HQWYUKCIRPQB.2 size=672358 2024-09-19T13:43:04.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.687+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=HQWYUKCIRPQB tag=YPRX34PLJ36Q type=write size=3818086 2024-09-19T13:43:04.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.688+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=6BA9XO9EC7HG type=del 2024-09-19T13:43:04.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.690+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~DSB51OJTENV1.0 size=445507 2024-09-19T13:43:04.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.690+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=DSB51OJTENV1 tag=PBFAHN2JH8MJ type=write size=1494083 2024-09-19T13:43:04.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.692+0000 7f6ab10d2780 1 < suggested remove operation key=B0J7E7A0NP4J tag=84ZSJAEDL4OV type=del 2024-09-19T13:43:04.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.694+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=173IBQWZ02ER type=write size=853476 2024-09-19T13:43:04.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.695+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~4VZYNU0B083J.0 size=677008 2024-09-19T13:43:04.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.697+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=4VZYNU0B083J tag=URKAGTMEPN5X type=write size=1725584 2024-09-19T13:43:04.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.698+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=WFXKUDAZJ41Z type=write size=916263 2024-09-19T13:43:04.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.699+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=GGIZ5PGQ8G4Z type=del 2024-09-19T13:43:04.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.700+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=MS5C1UNDBTQ3 type=write size=177014 2024-09-19T13:43:04.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.701+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~TRKFE9IDGEJ2.0 size=1048576 2024-09-19T13:43:04.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.702+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~TRKFE9IDGEJ2.1 size=688977 2024-09-19T13:43:04.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.704+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=TRKFE9IDGEJ2 tag=Q82EM7R1IJJN type=write size=2786129 2024-09-19T13:43:04.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.705+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=IP4RCV358LLL type=del size=3426972 2024-09-19T13:43:04.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.706+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=FTYO3A58ZC2L type=del 2024-09-19T13:43:04.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.708+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=W8INP657GGKC type=del size=743 2024-09-19T13:43:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.709+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~PUTDYD1XK17T.0 size=1048576 2024-09-19T13:43:04.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.710+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~PUTDYD1XK17T.1 size=1048576 2024-09-19T13:43:04.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.711+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~PUTDYD1XK17T.2 size=111736 2024-09-19T13:43:04.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.713+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=PUTDYD1XK17T tag=3E43JPCQF3B6 type=write size=3257464 2024-09-19T13:43:04.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.715+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FW5I113XO807.0 size=1048576 2024-09-19T13:43:04.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.716+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FW5I113XO807.1 size=1048576 2024-09-19T13:43:04.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.716+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~FW5I113XO807.2 size=14934 2024-09-19T13:43:04.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.716+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=FW5I113XO807 tag=IMU8YAN43YYI type=write size=3160662 2024-09-19T13:43:04.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.718+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~43BHWTW5PTA9.0 size=1048576 2024-09-19T13:43:04.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.719+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~43BHWTW5PTA9.1 size=1048576 2024-09-19T13:43:04.721 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.719+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~43BHWTW5PTA9.2 size=134714 2024-09-19T13:43:04.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.721+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=43BHWTW5PTA9 tag=RG3MGQM5MGF0 type=write size=3280442 2024-09-19T13:43:04.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.723+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~9Q4LPCK79NN4.0 size=68620 2024-09-19T13:43:04.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.723+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=9Q4LPCK79NN4 tag=TNPCRRK4W20J type=write size=1117196 2024-09-19T13:43:04.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.724+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=ERY2JYE66HH2 type=del 2024-09-19T13:43:04.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.726+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~PSJNMJ8DHI72.0 size=1048576 2024-09-19T13:43:04.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.727+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~PSJNMJ8DHI72.1 size=1048576 2024-09-19T13:43:04.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.728+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~PSJNMJ8DHI72.2 size=1019943 2024-09-19T13:43:04.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.728+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=PSJNMJ8DHI72 tag=83KZPI989LK9 type=write size=4165671 2024-09-19T13:43:04.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.729+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=ONZYWS1EOVAA type=del 2024-09-19T13:43:04.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.731+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~MWRJ0WIT8J2F.0 size=1048576 2024-09-19T13:43:04.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.732+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~MWRJ0WIT8J2F.1 size=964742 2024-09-19T13:43:04.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.732+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=MWRJ0WIT8J2F tag=Z0JE0AAKP0JW type=write size=3061894 2024-09-19T13:43:04.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.733+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=FW31JWEKT3NJ type=del 2024-09-19T13:43:04.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.735+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=H0M139VZG9R2 type=del size=317314 2024-09-19T13:43:04.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.735+0000 7f6ab10d2780 1 < canceled part key=_multipart_9WTLWBONAOET.2~QDI2ZQ3U1OA0.0 size=1048576 2024-09-19T13:43:04.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.736+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~QDI2ZQ3U1OA0.1 size=1048576 2024-09-19T13:43:04.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.737+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~QDI2ZQ3U1OA0.2 size=57908 2024-09-19T13:43:04.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.739+0000 7f6ab10d2780 1 < canceled multipart upload key=9WTLWBONAOET upload=QDI2ZQ3U1OA0 tag=34USV1R0ZWJC type=write size=3203636 2024-09-19T13:43:04.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.741+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~MTW9JXMGUBR2.0 size=1048576 2024-09-19T13:43:04.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.741+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~MTW9JXMGUBR2.1 size=7496 2024-09-19T13:43:04.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.741+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=MTW9JXMGUBR2 tag=0LL86RN15CNG type=write size=2104648 2024-09-19T13:43:04.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.743+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=763C9I4W4ZD6 type=del size=3681207 2024-09-19T13:43:04.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.745+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~T07JY1SZM7KA.0 size=1048576 2024-09-19T13:43:04.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.745+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~T07JY1SZM7KA.1 size=518076 2024-09-19T13:43:04.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.745+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=T07JY1SZM7KA tag=WD1D9EBZPMR9 type=write size=2615228 2024-09-19T13:43:04.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.746+0000 7f6ab10d2780 1 < canceled part key=_multipart_EE8F84K0ZAGJ.2~0KEWJVG9284A.0 size=1048576 2024-09-19T13:43:04.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.747+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~0KEWJVG9284A.1 size=1048576 2024-09-19T13:43:04.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.748+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~0KEWJVG9284A.2 size=388815 2024-09-19T13:43:04.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.750+0000 7f6ab10d2780 1 < canceled multipart upload key=EE8F84K0ZAGJ upload=0KEWJVG9284A tag=UQUQMURLKBTW type=write size=3534543 2024-09-19T13:43:04.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.752+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~CWSKEMMOOCT6.0 size=1048576 2024-09-19T13:43:04.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.753+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~CWSKEMMOOCT6.1 size=67886 2024-09-19T13:43:04.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.753+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=CWSKEMMOOCT6 tag=6KUW9EUUK0OZ type=write size=2165038 2024-09-19T13:43:04.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.754+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=KDF0R37T4TH2 type=del 2024-09-19T13:43:04.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.755+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=1D9JC3LU6Y1O type=write size=595497 2024-09-19T13:43:04.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.756+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~HQWYUKCIRPQB.0 size=1048576 2024-09-19T13:43:04.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.757+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~HQWYUKCIRPQB.1 size=1048576 2024-09-19T13:43:04.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.758+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~HQWYUKCIRPQB.2 size=672358 2024-09-19T13:43:04.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.760+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=HQWYUKCIRPQB tag=YPRX34PLJ36Q type=write size=3818086 2024-09-19T13:43:04.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.761+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=28CY51M89ID2 type=del size=3786646 2024-09-19T13:43:04.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.762+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~DSB51OJTENV1.0 size=445507 2024-09-19T13:43:04.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.764+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=DSB51OJTENV1 tag=PBFAHN2JH8MJ type=write size=1494083 2024-09-19T13:43:04.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.765+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=XK88I0AD22ZC type=del size=373499 2024-09-19T13:43:04.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.766+0000 7f6ab10d2780 1 < completed write operation key=UPMXNNYUUJR7 tag=173IBQWZ02ER type=write size=853476 2024-09-19T13:43:04.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.768+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~KSLNMGCA95E7.0 size=267162 2024-09-19T13:43:04.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.768+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=KSLNMGCA95E7 tag=5RQWRQ97E5YW type=write size=1315738 2024-09-19T13:43:04.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.769+0000 7f6ab10d2780 1 < completed write operation key=7LHSAN5BBQRW tag=WFXKUDAZJ41Z type=write size=916263 2024-09-19T13:43:04.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.771+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=2PA4YRKKYEC2 type=write size=275839 2024-09-19T13:43:04.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.773+0000 7f6ab10d2780 1 < suggested update operation key=RXXCDV0LTCKS tag=MS5C1UNDBTQ3 type=write size=177014 2024-09-19T13:43:04.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.775+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~AVOGIPMYWNY6.0 size=1048576 2024-09-19T13:43:04.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.776+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~AVOGIPMYWNY6.1 size=1048576 2024-09-19T13:43:04.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.777+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~AVOGIPMYWNY6.2 size=277012 2024-09-19T13:43:04.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.777+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=AVOGIPMYWNY6 tag=BH8ZQ1NSIV2Q type=write size=3422740 2024-09-19T13:43:04.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.778+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=IP4RCV358LLL type=del 2024-09-19T13:43:04.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.779+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=EDJ3COBBM43O type=del size=2271339 2024-09-19T13:43:04.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.781+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=W8INP657GGKC type=del 2024-09-19T13:43:04.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.784+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~KUNFRY8XP62H.0 size=432667 2024-09-19T13:43:04.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.784+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=KUNFRY8XP62H tag=OSPQ0NS8JBQ5 type=write size=1481243 2024-09-19T13:43:04.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.785+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~FW5I113XO807.0 size=1048576 2024-09-19T13:43:04.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.786+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~FW5I113XO807.1 size=1048576 2024-09-19T13:43:04.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.787+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~FW5I113XO807.2 size=14934 2024-09-19T13:43:04.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.789+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=FW5I113XO807 tag=IMU8YAN43YYI type=write size=3160662 2024-09-19T13:43:04.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.791+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=2BH7Z0LGUCAJ type=del size=4101718 2024-09-19T13:43:04.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.792+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~9Q4LPCK79NN4.0 size=68620 2024-09-19T13:43:04.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.793+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=9Q4LPCK79NN4 tag=TNPCRRK4W20J type=write size=1117196 2024-09-19T13:43:04.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.795+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=YB2CN72IAGX4 type=del size=3845001 2024-09-19T13:43:04.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.796+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~PSJNMJ8DHI72.0 size=1048576 2024-09-19T13:43:04.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.797+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~PSJNMJ8DHI72.1 size=1048576 2024-09-19T13:43:04.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.798+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~PSJNMJ8DHI72.2 size=1019943 2024-09-19T13:43:04.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.799+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=PSJNMJ8DHI72 tag=83KZPI989LK9 type=write size=4165671 2024-09-19T13:43:04.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.801+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~1OV0B6UVN338.0 size=1048576 2024-09-19T13:43:04.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.802+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~1OV0B6UVN338.1 size=679214 2024-09-19T13:43:04.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.802+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=1OV0B6UVN338 tag=OMZ4FQKY5TDD type=write size=2776366 2024-09-19T13:43:04.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.803+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~MWRJ0WIT8J2F.0 size=1048576 2024-09-19T13:43:04.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.803+0000 7f6ab10d2780 1 < canceled part key=_multipart_SRABG45EPVN2.2~MWRJ0WIT8J2F.1 size=964742 2024-09-19T13:43:04.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.805+0000 7f6ab10d2780 1 < canceled multipart upload key=SRABG45EPVN2 upload=MWRJ0WIT8J2F tag=Z0JE0AAKP0JW type=write size=3061894 2024-09-19T13:43:04.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.807+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~QH8F2Z9DID44.0 size=1048576 2024-09-19T13:43:04.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.808+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~QH8F2Z9DID44.1 size=86676 2024-09-19T13:43:04.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.808+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=QH8F2Z9DID44 tag=9NP1ADBXDUX9 type=write size=2183828 2024-09-19T13:43:04.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.809+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=H0M139VZG9R2 type=del 2024-09-19T13:43:04.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.810+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=7LBYDEJBDE2A type=del size=3893978 2024-09-19T13:43:04.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.811+0000 7f6ab10d2780 1 < canceled part key=_multipart_A14YTABJ1Z3Z.2~MTW9JXMGUBR2.0 size=1048576 2024-09-19T13:43:04.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.812+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~MTW9JXMGUBR2.1 size=7496 2024-09-19T13:43:04.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.814+0000 7f6ab10d2780 1 < canceled multipart upload key=A14YTABJ1Z3Z upload=MTW9JXMGUBR2 tag=0LL86RN15CNG type=write size=2104648 2024-09-19T13:43:04.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.815+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=PZEFEVN7GV83 type=del size=3977238 2024-09-19T13:43:04.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.815+0000 7f6ab10d2780 1 < canceled part key=_multipart_A14YTABJ1Z3Z.2~T07JY1SZM7KA.0 size=1048576 2024-09-19T13:43:04.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.816+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~T07JY1SZM7KA.1 size=518076 2024-09-19T13:43:04.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.818+0000 7f6ab10d2780 1 < canceled multipart upload key=A14YTABJ1Z3Z upload=T07JY1SZM7KA tag=WD1D9EBZPMR9 type=write size=2615228 2024-09-19T13:43:04.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.819+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=UKMG5P29DJ2R type=del size=2378181 2024-09-19T13:43:04.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.820+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~CWSKEMMOOCT6.0 size=1048576 2024-09-19T13:43:04.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.820+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~CWSKEMMOOCT6.1 size=67886 2024-09-19T13:43:04.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.822+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=CWSKEMMOOCT6 tag=6KUW9EUUK0OZ type=write size=2165038 2024-09-19T13:43:04.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.823+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=DTMYQ8P538F8 type=del size=4042161 2024-09-19T13:43:04.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.824+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=1D9JC3LU6Y1O type=write size=595497 2024-09-19T13:43:04.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.825+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=077I9FBRMEMI type=del size=583480 2024-09-19T13:43:04.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.826+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=28CY51M89ID2 type=del 2024-09-19T13:43:04.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.827+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=Y1R8IJ31CPIJ type=write size=868100 2024-09-19T13:43:04.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.828+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=XK88I0AD22ZC type=del 2024-09-19T13:43:04.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.830+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~P9NP1KO2MC22.0 size=1048576 2024-09-19T13:43:04.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.831+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~P9NP1KO2MC22.1 size=173513 2024-09-19T13:43:04.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.831+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=P9NP1KO2MC22 tag=7J1Q7SW9F0Q3 type=write size=2270665 2024-09-19T13:43:04.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.832+0000 7f6ab10d2780 1 < canceled part key=_multipart_X8CWBFNCJG6M.2~KSLNMGCA95E7.0 size=267162 2024-09-19T13:43:04.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.833+0000 7f6ab10d2780 1 < canceled multipart upload key=X8CWBFNCJG6M upload=KSLNMGCA95E7 tag=5RQWRQ97E5YW type=write size=1315738 2024-09-19T13:43:04.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.836+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~P655I6B0BVL3.0 size=1048576 2024-09-19T13:43:04.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~P655I6B0BVL3.1 size=1048576 2024-09-19T13:43:04.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~P655I6B0BVL3.2 size=926453 2024-09-19T13:43:04.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.837+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=P655I6B0BVL3 tag=OFNZCL9NX0S9 type=write size=4072181 2024-09-19T13:43:04.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.839+0000 7f6ab10d2780 1 < completed write operation key=CD4XXORKVS6J tag=2PA4YRKKYEC2 type=write size=275839 2024-09-19T13:43:04.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.841+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~23THZ7XD2BGW.0 size=583275 2024-09-19T13:43:04.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.841+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=23THZ7XD2BGW tag=948700LB947R type=write size=1631851 2024-09-19T13:43:04.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.842+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~AVOGIPMYWNY6.0 size=1048576 2024-09-19T13:43:04.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.843+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~AVOGIPMYWNY6.1 size=1048576 2024-09-19T13:43:04.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.844+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~AVOGIPMYWNY6.2 size=277012 2024-09-19T13:43:04.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.845+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=AVOGIPMYWNY6 tag=BH8ZQ1NSIV2Q type=write size=3422740 2024-09-19T13:43:04.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.846+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=BWGTW0QK201J type=del size=3221916 2024-09-19T13:43:04.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.848+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=EDJ3COBBM43O type=del 2024-09-19T13:43:04.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.850+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~9938S8Q6T4J7.0 size=1048576 2024-09-19T13:43:04.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.850+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~9938S8Q6T4J7.1 size=1048576 2024-09-19T13:43:04.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.851+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~9938S8Q6T4J7.2 size=739854 2024-09-19T13:43:04.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.851+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=9938S8Q6T4J7 tag=DPUE1NNNQCYC type=write size=3885582 2024-09-19T13:43:04.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.852+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~KUNFRY8XP62H.0 size=432667 2024-09-19T13:43:04.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.854+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=KUNFRY8XP62H tag=OSPQ0NS8JBQ5 type=write size=1481243 2024-09-19T13:43:04.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.855+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=D2W33422U17U type=write size=100346 2024-09-19T13:43:04.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.857+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=2BH7Z0LGUCAJ type=del 2024-09-19T13:43:04.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.858+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=OMVJSXCDH9RX type=write size=481430 2024-09-19T13:43:04.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.859+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=YB2CN72IAGX4 type=del 2024-09-19T13:43:04.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.860+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=ZV894B0B3PMJ type=del size=823352 2024-09-19T13:43:04.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.861+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~1OV0B6UVN338.0 size=1048576 2024-09-19T13:43:04.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.862+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~1OV0B6UVN338.1 size=679214 2024-09-19T13:43:04.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.864+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=1OV0B6UVN338 tag=OMZ4FQKY5TDD type=write size=2776366 2024-09-19T13:43:04.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.865+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=MHFU4N5XJ3YQ type=write size=478317 2024-09-19T13:43:04.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.866+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~QH8F2Z9DID44.0 size=1048576 2024-09-19T13:43:04.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.867+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~QH8F2Z9DID44.1 size=86676 2024-09-19T13:43:04.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.869+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=QH8F2Z9DID44 tag=9NP1ADBXDUX9 type=write size=2183828 2024-09-19T13:43:04.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.870+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=V4RBN1S5SVEM type=del size=293667 2024-09-19T13:43:04.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.871+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=7LBYDEJBDE2A type=del 2024-09-19T13:43:04.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.873+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~CEYMWLTE9ZE0.0 size=1048576 2024-09-19T13:43:04.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.874+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~CEYMWLTE9ZE0.1 size=451993 2024-09-19T13:43:04.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.874+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=CEYMWLTE9ZE0 tag=ONDXERCLRR7Y type=write size=2549145 2024-09-19T13:43:04.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.875+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=PZEFEVN7GV83 type=del 2024-09-19T13:43:04.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.877+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=B3XSQU37TK7M type=write size=194013 2024-09-19T13:43:04.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.878+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=UKMG5P29DJ2R type=del 2024-09-19T13:43:04.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.880+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~LYDHH9OSU7OD.0 size=1048576 2024-09-19T13:43:04.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.881+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~LYDHH9OSU7OD.1 size=1048576 2024-09-19T13:43:04.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.882+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~LYDHH9OSU7OD.2 size=759100 2024-09-19T13:43:04.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.882+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=LYDHH9OSU7OD tag=1I29SQQJUPU9 type=write size=3904828 2024-09-19T13:43:04.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.883+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=DTMYQ8P538F8 type=del 2024-09-19T13:43:04.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.884+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=W48UTT5PS8MX type=del size=2606809 2024-09-19T13:43:04.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.885+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=077I9FBRMEMI type=del 2024-09-19T13:43:04.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.887+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=E9ITDV03VEHI type=del size=919703 2024-09-19T13:43:04.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.890+0000 7f6ab10d2780 1 < suggested update operation key=SRABG45EPVN2 tag=Y1R8IJ31CPIJ type=write size=868100 2024-09-19T13:43:04.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.891+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=HISP3OSH49PP type=write size=679899 2024-09-19T13:43:04.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.893+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~P9NP1KO2MC22.0 size=1048576 2024-09-19T13:43:04.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.893+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~P9NP1KO2MC22.1 size=173513 2024-09-19T13:43:04.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.895+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=P9NP1KO2MC22 tag=7J1Q7SW9F0Q3 type=write size=2270665 2024-09-19T13:43:04.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.896+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=IJJQ72G52JUV type=del size=3121006 2024-09-19T13:43:04.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.898+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~P655I6B0BVL3.0 size=1048576 2024-09-19T13:43:04.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.899+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~P655I6B0BVL3.1 size=1048576 2024-09-19T13:43:04.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.900+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~P655I6B0BVL3.2 size=926453 2024-09-19T13:43:04.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.902+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=P655I6B0BVL3 tag=OFNZCL9NX0S9 type=write size=4072181 2024-09-19T13:43:04.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.904+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~C18OTD4PLD04.0 size=141615 2024-09-19T13:43:04.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.904+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=C18OTD4PLD04 tag=YTIMN22PB7TQ type=write size=1190191 2024-09-19T13:43:04.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.905+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~23THZ7XD2BGW.0 size=583275 2024-09-19T13:43:04.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.907+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=23THZ7XD2BGW tag=948700LB947R type=write size=1631851 2024-09-19T13:43:04.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.909+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~98QUCPPNSA1P.0 size=1048576 2024-09-19T13:43:04.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.910+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~98QUCPPNSA1P.1 size=189428 2024-09-19T13:43:04.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.910+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=98QUCPPNSA1P tag=G93IZNCER0ET type=write size=2286580 2024-09-19T13:43:04.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.911+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=BWGTW0QK201J type=del 2024-09-19T13:43:04.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.912+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=H0I8OAO48QSN type=del size=894888 2024-09-19T13:43:04.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.913+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~9938S8Q6T4J7.0 size=1048576 2024-09-19T13:43:04.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.914+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~9938S8Q6T4J7.1 size=1048576 2024-09-19T13:43:04.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.915+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~9938S8Q6T4J7.2 size=739854 2024-09-19T13:43:04.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.917+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=9938S8Q6T4J7 tag=DPUE1NNNQCYC type=write size=3885582 2024-09-19T13:43:04.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.919+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~L80G0Q9PC1Q6.0 size=1048576 2024-09-19T13:43:04.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.919+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~L80G0Q9PC1Q6.1 size=1048576 2024-09-19T13:43:04.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.920+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~L80G0Q9PC1Q6.2 size=302935 2024-09-19T13:43:04.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.920+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=L80G0Q9PC1Q6 tag=E2YK9NKU2R8E type=write size=3448663 2024-09-19T13:43:04.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.922+0000 7f6ab10d2780 1 < suggested update operation key=UPMXNNYUUJR7 tag=D2W33422U17U type=write size=100346 2024-09-19T13:43:04.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.924+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=9STRTGHPQK13 type=del size=134495 2024-09-19T13:43:04.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.925+0000 7f6ab10d2780 -1 < failed to complete operation key=SRABG45EPVN2 tag=OMVJSXCDH9RX type=write size=481430: (22) Invalid argument 2024-09-19T13:43:04.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.927+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~5YB8AIIWMP43.0 size=1048576 2024-09-19T13:43:04.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.928+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~5YB8AIIWMP43.1 size=240896 2024-09-19T13:43:04.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.928+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=5YB8AIIWMP43 tag=AQIEIJDMFM4G type=write size=2338048 2024-09-19T13:43:04.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.929+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=ZV894B0B3PMJ type=del 2024-09-19T13:43:04.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.930+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=HR8RM2JZJDUB type=del size=1442263 2024-09-19T13:43:04.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.931+0000 7f6ab10d2780 1 < canceled operation key=XQLWZA2X91GF tag=MHFU4N5XJ3YQ type=write size=478317 2024-09-19T13:43:04.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.932+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=NBPSBDBUU67A type=del size=1502602 2024-09-19T13:43:04.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.933+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=V4RBN1S5SVEM type=del 2024-09-19T13:43:04.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.934+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=ORH2E9RUYOSH type=del size=3929493 2024-09-19T13:43:04.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.935+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~CEYMWLTE9ZE0.0 size=1048576 2024-09-19T13:43:04.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.936+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~CEYMWLTE9ZE0.1 size=451993 2024-09-19T13:43:04.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.938+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=CEYMWLTE9ZE0 tag=ONDXERCLRR7Y type=write size=2549145 2024-09-19T13:43:04.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.939+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=B22Z04XV7BJC type=del size=3928884 2024-09-19T13:43:04.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.940+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=B3XSQU37TK7M type=write size=194013 2024-09-19T13:43:04.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.942+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~Y5AZF44KPXWX.0 size=1048576 2024-09-19T13:43:04.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.943+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~Y5AZF44KPXWX.1 size=1048576 2024-09-19T13:43:04.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.944+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~Y5AZF44KPXWX.2 size=889256 2024-09-19T13:43:04.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.944+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=Y5AZF44KPXWX tag=K5OLMCNIT3CE type=write size=4034984 2024-09-19T13:43:04.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.944+0000 7f6ab10d2780 1 < canceled part key=_multipart_DTSRVH526PE7.2~LYDHH9OSU7OD.0 size=1048576 2024-09-19T13:43:04.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.945+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~LYDHH9OSU7OD.1 size=1048576 2024-09-19T13:43:04.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.946+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~LYDHH9OSU7OD.2 size=759100 2024-09-19T13:43:04.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.948+0000 7f6ab10d2780 1 < canceled multipart upload key=DTSRVH526PE7 upload=LYDHH9OSU7OD tag=1I29SQQJUPU9 type=write size=3904828 2024-09-19T13:43:04.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.949+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=3EPMD16VON19 type=del size=34183 2024-09-19T13:43:04.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.950+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=W48UTT5PS8MX type=del 2024-09-19T13:43:04.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.951+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=K8CBHZKSVIYQ type=del size=1063517 2024-09-19T13:43:04.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.953+0000 7f6ab10d2780 1 < suggested remove operation key=V8P17ZSOQUSM tag=E9ITDV03VEHI type=del 2024-09-19T13:43:04.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.954+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=RSU8I4FVDDPY type=del size=3884772 2024-09-19T13:43:04.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.956+0000 7f6ab10d2780 1 < suggested remove operation key=RU6OR8SM72GU tag=HISP3OSH49PP type=write 2024-09-19T13:43:04.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.958+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=HMY1JY3LI9ZH type=del size=3055810 2024-09-19T13:43:04.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.959+0000 7f6ab10d2780 1 < canceled operation key=RXXCDV0LTCKS tag=IJJQ72G52JUV type=del size=3121006 2024-09-19T13:43:04.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.960+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=D6Y6IGGLS424 type=write size=18911 2024-09-19T13:43:04.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.961+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~C18OTD4PLD04.0 size=141615 2024-09-19T13:43:04.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.963+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=C18OTD4PLD04 tag=YTIMN22PB7TQ type=write size=1190191 2024-09-19T13:43:04.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.964+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=ZJ544GDLSQAF type=del size=1579744 2024-09-19T13:43:04.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.965+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~98QUCPPNSA1P.0 size=1048576 2024-09-19T13:43:04.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.966+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~98QUCPPNSA1P.1 size=189428 2024-09-19T13:43:04.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.968+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=98QUCPPNSA1P tag=G93IZNCER0ET type=write size=2286580 2024-09-19T13:43:04.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.970+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~34VD69MEJAK0.0 size=1048576 2024-09-19T13:43:04.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.970+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~34VD69MEJAK0.1 size=168129 2024-09-19T13:43:04.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.970+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=34VD69MEJAK0 tag=DLVZM5W1DLY0 type=write size=2265281 2024-09-19T13:43:04.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.972+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=H0I8OAO48QSN type=del 2024-09-19T13:43:04.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.973+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=P30L0BYACZAD type=del size=4059912 2024-09-19T13:43:04.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.974+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~L80G0Q9PC1Q6.0 size=1048576 2024-09-19T13:43:04.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.975+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~L80G0Q9PC1Q6.1 size=1048576 2024-09-19T13:43:04.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.976+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~L80G0Q9PC1Q6.2 size=302935 2024-09-19T13:43:04.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.978+0000 7f6ab10d2780 1 < completed multipart upload key=2KX2NSY41STV upload=L80G0Q9PC1Q6 tag=E2YK9NKU2R8E type=write size=3448663 2024-09-19T13:43:04.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.980+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~59J7GI3JXX67.0 size=986255 2024-09-19T13:43:04.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.980+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=59J7GI3JXX67 tag=Z5SBX1XNWR42 type=write size=2034831 2024-09-19T13:43:04.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.981+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=9STRTGHPQK13 type=del 2024-09-19T13:43:04.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.982+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=4VVGHF2YOQL3 type=del size=1432751 2024-09-19T13:43:04.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.983+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~5YB8AIIWMP43.0 size=1048576 2024-09-19T13:43:04.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.984+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~5YB8AIIWMP43.1 size=240896 2024-09-19T13:43:04.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.986+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=5YB8AIIWMP43 tag=AQIEIJDMFM4G type=write size=2338048 2024-09-19T13:43:04.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.988+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~KVPH8KNZL07X.0 size=1048576 2024-09-19T13:43:04.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.989+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~KVPH8KNZL07X.1 size=1048576 2024-09-19T13:43:04.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.990+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~KVPH8KNZL07X.2 size=516139 2024-09-19T13:43:04.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.990+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=KVPH8KNZL07X tag=XP0WTY2M2SUE type=write size=3661867 2024-09-19T13:43:04.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.992+0000 7f6ab10d2780 1 < completed delete operation key=UPMXNNYUUJR7 tag=HR8RM2JZJDUB type=del 2024-09-19T13:43:04.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.993+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=UDX304FFWFNS type=del size=3226946 2024-09-19T13:43:04.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.995+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=NBPSBDBUU67A type=del 2024-09-19T13:43:04.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.996+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=SMRLCDZUAH5Z type=del size=2392151 2024-09-19T13:43:04.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.997+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=ORH2E9RUYOSH type=del 2024-09-19T13:43:05.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.999+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~OH9V7YF94EVT.0 size=1048576 2024-09-19T13:43:05.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:04.999+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~OH9V7YF94EVT.1 size=1048576 2024-09-19T13:43:05.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.000+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~OH9V7YF94EVT.2 size=38504 2024-09-19T13:43:05.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.000+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=OH9V7YF94EVT tag=E1T8G0WS2FSD type=write size=3184232 2024-09-19T13:43:05.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.001+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=B22Z04XV7BJC type=del 2024-09-19T13:43:05.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.004+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~BAYXCGUZKCSP.0 size=1048576 2024-09-19T13:43:05.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.004+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~BAYXCGUZKCSP.1 size=641198 2024-09-19T13:43:05.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.004+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=BAYXCGUZKCSP tag=HQJO8HQ76XQ6 type=write size=2738350 2024-09-19T13:43:05.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.006+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~Y5AZF44KPXWX.0 size=1048576 2024-09-19T13:43:05.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.007+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~Y5AZF44KPXWX.1 size=1048576 2024-09-19T13:43:05.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.007+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~Y5AZF44KPXWX.2 size=889256 2024-09-19T13:43:05.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.009+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=Y5AZF44KPXWX tag=K5OLMCNIT3CE type=write size=4034984 2024-09-19T13:43:05.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.010+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=L6FIFTQI5RO5 type=del size=3382381 2024-09-19T13:43:05.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.012+0000 7f6ab10d2780 1 < canceled operation key=UX2ICIT36Q3R tag=3EPMD16VON19 type=del size=34183 2024-09-19T13:43:05.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.014+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~UQAUZ9TLV05I.0 size=1048576 2024-09-19T13:43:05.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.015+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~UQAUZ9TLV05I.1 size=541671 2024-09-19T13:43:05.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.015+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=UQAUZ9TLV05I tag=TJ4FD43ZH52R type=write size=2638823 2024-09-19T13:43:05.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.016+0000 7f6ab10d2780 -1 < failed to complete operation key=RU6OR8SM72GU tag=K8CBHZKSVIYQ type=del size=1063517: (22) Invalid argument 2024-09-19T13:43:05.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.017+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=P03FIT754UMO type=del size=3342721 2024-09-19T13:43:05.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.018+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=RSU8I4FVDDPY type=del 2024-09-19T13:43:05.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.020+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VRYE6NRKWE1R.0 size=1048576 2024-09-19T13:43:05.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.021+0000 7f6ab10d2780 1 > prepared part key=_multipart_A14YTABJ1Z3Z.2~VRYE6NRKWE1R.1 size=843815 2024-09-19T13:43:05.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.021+0000 7f6ab10d2780 1 > prepared multipart upload key=A14YTABJ1Z3Z upload=VRYE6NRKWE1R tag=ZTE963IYK9SA type=write size=2940967 2024-09-19T13:43:05.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.022+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=HMY1JY3LI9ZH type=del 2024-09-19T13:43:05.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.023+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=X5U2230X00Y6 type=del size=1756651 2024-09-19T13:43:05.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.024+0000 7f6ab10d2780 1 < completed write operation key=DTSRVH526PE7 tag=D6Y6IGGLS424 type=write size=18911 2024-09-19T13:43:05.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.026+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=BIYM2K5SX7S3 type=del size=403776 2024-09-19T13:43:05.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.027+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=ZJ544GDLSQAF type=del 2024-09-19T13:43:05.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.028+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=N7RXD4TK29Y6 type=del size=2096238 2024-09-19T13:43:05.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.029+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~34VD69MEJAK0.0 size=1048576 2024-09-19T13:43:05.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.030+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~34VD69MEJAK0.1 size=168129 2024-09-19T13:43:05.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.032+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=34VD69MEJAK0 tag=DLVZM5W1DLY0 type=write size=2265281 2024-09-19T13:43:05.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.034+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~AJTZVBJK3E2P.0 size=126227 2024-09-19T13:43:05.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.034+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=AJTZVBJK3E2P tag=ZOAWGW2435I6 type=write size=1174803 2024-09-19T13:43:05.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.035+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=P30L0BYACZAD type=del 2024-09-19T13:43:05.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.037+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~NG1W68U1WZKE.0 size=1048576 2024-09-19T13:43:05.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.037+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~NG1W68U1WZKE.1 size=1048576 2024-09-19T13:43:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.038+0000 7f6ab10d2780 1 > prepared part key=_multipart_2KX2NSY41STV.2~NG1W68U1WZKE.2 size=1027755 2024-09-19T13:43:05.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.038+0000 7f6ab10d2780 1 > prepared multipart upload key=2KX2NSY41STV upload=NG1W68U1WZKE tag=V8RJ19S5GV0M type=write size=4173483 2024-09-19T13:43:05.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.039+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~59J7GI3JXX67.0 size=986255 2024-09-19T13:43:05.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.041+0000 7f6ab10d2780 1 < completed multipart upload key=WDRUV5ERI000 upload=59J7GI3JXX67 tag=Z5SBX1XNWR42 type=write size=2034831 2024-09-19T13:43:05.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.042+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=DH2MTVWZ1ZCU type=del size=142121 2024-09-19T13:43:05.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.043+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=4VVGHF2YOQL3 type=del 2024-09-19T13:43:05.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.044+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=OPD6RDM9D7K8 type=write size=58863 2024-09-19T13:43:05.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.046+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~KVPH8KNZL07X.0 size=1048576 2024-09-19T13:43:05.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.046+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~KVPH8KNZL07X.1 size=1048576 2024-09-19T13:43:05.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.047+0000 7f6ab10d2780 1 < completed part key=_multipart_RXXCDV0LTCKS.2~KVPH8KNZL07X.2 size=516139 2024-09-19T13:43:05.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.049+0000 7f6ab10d2780 1 < completed multipart upload key=RXXCDV0LTCKS upload=KVPH8KNZL07X tag=XP0WTY2M2SUE type=write size=3661867 2024-09-19T13:43:05.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.050+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=SEA1GOV6BBR4 type=del size=2820360 2024-09-19T13:43:05.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.051+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=UDX304FFWFNS type=del 2024-09-19T13:43:05.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.053+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~2MV28CUFRHEN.0 size=207819 2024-09-19T13:43:05.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.053+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=2MV28CUFRHEN tag=J28N3T90BGC6 type=write size=1256395 2024-09-19T13:43:05.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.055+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=SMRLCDZUAH5Z type=del 2024-09-19T13:43:05.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.056+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=74IY3J4CXP7L type=del size=145470 2024-09-19T13:43:05.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.057+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~OH9V7YF94EVT.0 size=1048576 2024-09-19T13:43:05.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.058+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~OH9V7YF94EVT.1 size=1048576 2024-09-19T13:43:05.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.058+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~OH9V7YF94EVT.2 size=38504 2024-09-19T13:43:05.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.060+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=OH9V7YF94EVT tag=E1T8G0WS2FSD type=write size=3184232 2024-09-19T13:43:05.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.062+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~TFLRAYUMT62L.0 size=929538 2024-09-19T13:43:05.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.062+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=TFLRAYUMT62L tag=TF765EKZ93EI type=write size=1978114 2024-09-19T13:43:05.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.062+0000 7f6ab10d2780 1 < canceled part key=_multipart_X1JYDG1ASYAR.2~BAYXCGUZKCSP.0 size=1048576 2024-09-19T13:43:05.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.063+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~BAYXCGUZKCSP.1 size=641198 2024-09-19T13:43:05.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.065+0000 7f6ab10d2780 1 < canceled multipart upload key=X1JYDG1ASYAR upload=BAYXCGUZKCSP tag=HQJO8HQ76XQ6 type=write size=2738350 2024-09-19T13:43:05.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.067+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~T3OXS4IL9F3P.0 size=1048576 2024-09-19T13:43:05.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.068+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~T3OXS4IL9F3P.1 size=1048576 2024-09-19T13:43:05.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.069+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~T3OXS4IL9F3P.2 size=939954 2024-09-19T13:43:05.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.069+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=T3OXS4IL9F3P tag=C4D1ZL6C5R6Q type=write size=4085682 2024-09-19T13:43:05.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.070+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=L6FIFTQI5RO5 type=del 2024-09-19T13:43:05.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.072+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~BGJTXQ44B03M.0 size=1048576 2024-09-19T13:43:05.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.073+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~BGJTXQ44B03M.1 size=184536 2024-09-19T13:43:05.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.073+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=BGJTXQ44B03M tag=TU07ZYFI18JN type=write size=2281688 2024-09-19T13:43:05.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.073+0000 7f6ab10d2780 1 < canceled part key=_multipart_UX2ICIT36Q3R.2~UQAUZ9TLV05I.0 size=1048576 2024-09-19T13:43:05.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.073+0000 7f6ab10d2780 1 < canceled part key=_multipart_UX2ICIT36Q3R.2~UQAUZ9TLV05I.1 size=541671 2024-09-19T13:43:05.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.075+0000 7f6ab10d2780 1 < canceled multipart upload key=UX2ICIT36Q3R upload=UQAUZ9TLV05I tag=TJ4FD43ZH52R type=write size=2638823 2024-09-19T13:43:05.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.077+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~D0WT0RM99VJU.0 size=420598 2024-09-19T13:43:05.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.077+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=D0WT0RM99VJU tag=WMM003RREPP3 type=write size=1469174 2024-09-19T13:43:05.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.079+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=P03FIT754UMO type=del 2024-09-19T13:43:05.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.081+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~7653OJLBPR1W.0 size=1048576 2024-09-19T13:43:05.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.081+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~7653OJLBPR1W.1 size=1048576 2024-09-19T13:43:05.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.082+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~7653OJLBPR1W.2 size=546816 2024-09-19T13:43:05.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.082+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=7653OJLBPR1W tag=1J4U1QXFA4J7 type=write size=3692544 2024-09-19T13:43:05.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.084+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VRYE6NRKWE1R.0 size=1048576 2024-09-19T13:43:05.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.084+0000 7f6ab10d2780 1 < completed part key=_multipart_A14YTABJ1Z3Z.2~VRYE6NRKWE1R.1 size=843815 2024-09-19T13:43:05.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.086+0000 7f6ab10d2780 1 < completed multipart upload key=A14YTABJ1Z3Z upload=VRYE6NRKWE1R tag=ZTE963IYK9SA type=write size=2940967 2024-09-19T13:43:05.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.087+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=BLY98VMGMIH0 type=del size=1141719 2024-09-19T13:43:05.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.089+0000 7f6ab10d2780 1 < canceled operation key=DF003ORZ1HOM tag=X5U2230X00Y6 type=del size=1756651 2024-09-19T13:43:05.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.090+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=DC6DGM4IU10G type=del size=4131249 2024-09-19T13:43:05.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.091+0000 7f6ab10d2780 1 < completed delete operation key=QTGKMAOX2A6U tag=BIYM2K5SX7S3 type=del 2024-09-19T13:43:05.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.092+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=1FW4FOUFDX8A type=del size=3981761 2024-09-19T13:43:05.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.095+0000 7f6ab10d2780 1 < suggested update operation key=VFJIKOLYI0HN tag=N7RXD4TK29Y6 type=del size=2096238 2024-09-19T13:43:05.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.096+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=DC1KTYLO16G0 type=del size=153729 2024-09-19T13:43:05.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.097+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~AJTZVBJK3E2P.0 size=126227 2024-09-19T13:43:05.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.099+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=AJTZVBJK3E2P tag=ZOAWGW2435I6 type=write size=1174803 2024-09-19T13:43:05.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.101+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~5PD52Y75TSGH.0 size=1048576 2024-09-19T13:43:05.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.102+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~5PD52Y75TSGH.1 size=559906 2024-09-19T13:43:05.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.102+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=5PD52Y75TSGH tag=EE2JVY122KFR type=write size=2657058 2024-09-19T13:43:05.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.103+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~NG1W68U1WZKE.0 size=1048576 2024-09-19T13:43:05.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.103+0000 7f6ab10d2780 1 < canceled part key=_multipart_2KX2NSY41STV.2~NG1W68U1WZKE.1 size=1048576 2024-09-19T13:43:05.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.104+0000 7f6ab10d2780 1 < completed part key=_multipart_2KX2NSY41STV.2~NG1W68U1WZKE.2 size=1027755 2024-09-19T13:43:05.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.106+0000 7f6ab10d2780 1 < canceled multipart upload key=2KX2NSY41STV upload=NG1W68U1WZKE tag=V8RJ19S5GV0M type=write size=4173483 2024-09-19T13:43:05.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.107+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=KPV0SFR5XXMF type=del size=2194575 2024-09-19T13:43:05.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.108+0000 7f6ab10d2780 1 < completed delete operation key=PUXLW9NBBQJX tag=DH2MTVWZ1ZCU type=del 2024-09-19T13:43:05.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.109+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=CTV221BVDRNB type=del size=911153 2024-09-19T13:43:05.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.110+0000 7f6ab10d2780 1 < completed write operation key=X8CWBFNCJG6M tag=OPD6RDM9D7K8 type=write size=58863 2024-09-19T13:43:05.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.112+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~8CKFHLO8QEEM.0 size=967403 2024-09-19T13:43:05.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.112+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=8CKFHLO8QEEM tag=WA1YED1M1PNO type=write size=2015979 2024-09-19T13:43:05.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.113+0000 7f6ab10d2780 1 < completed delete operation key=A14YTABJ1Z3Z tag=SEA1GOV6BBR4 type=del 2024-09-19T13:43:05.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.114+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=YY2FQ1T03OMC type=del size=2630107 2024-09-19T13:43:05.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.115+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~2MV28CUFRHEN.0 size=207819 2024-09-19T13:43:05.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.117+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=2MV28CUFRHEN tag=J28N3T90BGC6 type=write size=1256395 2024-09-19T13:43:05.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.118+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=5KSHB6B7FKN2 type=del size=3105691 2024-09-19T13:43:05.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.119+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=74IY3J4CXP7L type=del 2024-09-19T13:43:05.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.120+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=L2DPOLNSSSI0 type=write size=916281 2024-09-19T13:43:05.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.121+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~TFLRAYUMT62L.0 size=929538 2024-09-19T13:43:05.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.123+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=TFLRAYUMT62L tag=TF765EKZ93EI type=write size=1978114 2024-09-19T13:43:05.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.124+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=KJHKAXR5W7LR type=del size=3034953 2024-09-19T13:43:05.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.125+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~T3OXS4IL9F3P.0 size=1048576 2024-09-19T13:43:05.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.126+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~T3OXS4IL9F3P.1 size=1048576 2024-09-19T13:43:05.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.127+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~T3OXS4IL9F3P.2 size=939954 2024-09-19T13:43:05.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.129+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=T3OXS4IL9F3P tag=C4D1ZL6C5R6Q type=write size=4085682 2024-09-19T13:43:05.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.130+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=5UPF1B9ZHDS2 type=write size=837022 2024-09-19T13:43:05.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.131+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~BGJTXQ44B03M.0 size=1048576 2024-09-19T13:43:05.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.132+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~BGJTXQ44B03M.1 size=184536 2024-09-19T13:43:05.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.134+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=BGJTXQ44B03M tag=TU07ZYFI18JN type=write size=2281688 2024-09-19T13:43:05.137 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.135+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=3W7XMRHAB9KK type=del size=3071531 2024-09-19T13:43:05.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.136+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~D0WT0RM99VJU.0 size=420598 2024-09-19T13:43:05.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.138+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=D0WT0RM99VJU tag=WMM003RREPP3 type=write size=1469174 2024-09-19T13:43:05.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.139+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=JW7IMO4JZY9T type=del size=3369400 2024-09-19T13:43:05.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.140+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~7653OJLBPR1W.0 size=1048576 2024-09-19T13:43:05.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.141+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~7653OJLBPR1W.1 size=1048576 2024-09-19T13:43:05.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.142+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~7653OJLBPR1W.2 size=546816 2024-09-19T13:43:05.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.143+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=7653OJLBPR1W tag=1J4U1QXFA4J7 type=write size=3692544 2024-09-19T13:43:05.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.145+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=BOUE37YHGWCR type=write size=22284 2024-09-19T13:43:05.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.147+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=BLY98VMGMIH0 type=del size=1141719 2024-09-19T13:43:05.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.149+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~XYA09NOEBVTI.0 size=1048576 2024-09-19T13:43:05.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.150+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~XYA09NOEBVTI.1 size=1048576 2024-09-19T13:43:05.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.150+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~XYA09NOEBVTI.2 size=960613 2024-09-19T13:43:05.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.150+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=XYA09NOEBVTI tag=27C57J0FADVG type=write size=4106341 2024-09-19T13:43:05.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.151+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=DC6DGM4IU10G type=del 2024-09-19T13:43:05.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.153+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=ONLHYY1B4Y0H type=write size=762598 2024-09-19T13:43:05.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.154+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=1FW4FOUFDX8A type=del 2024-09-19T13:43:05.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.156+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~75UWZ7EY8I9Q.0 size=1048576 2024-09-19T13:43:05.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.156+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~75UWZ7EY8I9Q.1 size=985658 2024-09-19T13:43:05.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.156+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=75UWZ7EY8I9Q tag=HNXAVEBLP0ZH type=write size=3082810 2024-09-19T13:43:05.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.157+0000 7f6ab10d2780 1 < canceled operation key=9IN6E0JQFNAU tag=DC1KTYLO16G0 type=del size=153729 2024-09-19T13:43:05.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.159+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~0K3BUPB9K354.0 size=1048576 2024-09-19T13:43:05.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.160+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~0K3BUPB9K354.1 size=1048576 2024-09-19T13:43:05.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.161+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~0K3BUPB9K354.2 size=526060 2024-09-19T13:43:05.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.161+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=0K3BUPB9K354 tag=6EERW8AYJOGP type=write size=3671788 2024-09-19T13:43:05.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.162+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~5PD52Y75TSGH.0 size=1048576 2024-09-19T13:43:05.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.163+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~5PD52Y75TSGH.1 size=559906 2024-09-19T13:43:05.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.165+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=5PD52Y75TSGH tag=EE2JVY122KFR type=write size=2657058 2024-09-19T13:43:05.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.167+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~WP66PDZ7IC02.0 size=1048576 2024-09-19T13:43:05.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.168+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~WP66PDZ7IC02.1 size=616774 2024-09-19T13:43:05.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.168+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=WP66PDZ7IC02 tag=2B22P62MF7TA type=write size=2713926 2024-09-19T13:43:05.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.169+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=KPV0SFR5XXMF type=del 2024-09-19T13:43:05.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.170+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=79NDW3G30JAG type=del size=1607715 2024-09-19T13:43:05.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.171+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=CTV221BVDRNB type=del 2024-09-19T13:43:05.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.173+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~QORTP0E2I1MZ.0 size=1020932 2024-09-19T13:43:05.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.173+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=QORTP0E2I1MZ tag=QBRTGZ8OIHRI type=write size=2069508 2024-09-19T13:43:05.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.174+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~8CKFHLO8QEEM.0 size=967403 2024-09-19T13:43:05.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.176+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=8CKFHLO8QEEM tag=WA1YED1M1PNO type=write size=2015979 2024-09-19T13:43:05.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.177+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=3J7AKT8JHZQG type=del size=263211 2024-09-19T13:43:05.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.178+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=YY2FQ1T03OMC type=del 2024-09-19T13:43:05.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.179+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=KJVG5QRC0E5Z type=del size=3450844 2024-09-19T13:43:05.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.180+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=5KSHB6B7FKN2 type=del 2024-09-19T13:43:05.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.181+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=8VXWEG8XRHIR type=del size=896577 2024-09-19T13:43:05.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.183+0000 7f6ab10d2780 1 < completed write operation key=13GXIDWI4J9F tag=L2DPOLNSSSI0 type=write size=916281 2024-09-19T13:43:05.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.185+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~JMJ23EI0ELYC.0 size=1048576 2024-09-19T13:43:05.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.185+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~JMJ23EI0ELYC.1 size=1048576 2024-09-19T13:43:05.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.186+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~JMJ23EI0ELYC.2 size=847506 2024-09-19T13:43:05.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.186+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=JMJ23EI0ELYC tag=ZXTA3UR7U9ZE type=write size=3993234 2024-09-19T13:43:05.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.187+0000 7f6ab10d2780 1 < canceled operation key=2KX2NSY41STV tag=KJHKAXR5W7LR type=del size=3034953 2024-09-19T13:43:05.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.189+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~9TM2G8ULXZ2X.0 size=977048 2024-09-19T13:43:05.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.189+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=9TM2G8ULXZ2X tag=2K3BYSYYGKZY type=write size=2025624 2024-09-19T13:43:05.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.191+0000 7f6ab10d2780 1 < canceled operation key=WDRUV5ERI000 tag=5UPF1B9ZHDS2 type=write size=837022 2024-09-19T13:43:05.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.193+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~0F7L86PJXBA3.0 size=1048576 2024-09-19T13:43:05.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.193+0000 7f6ab10d2780 1 > prepared part key=_multipart_EE8F84K0ZAGJ.2~0F7L86PJXBA3.1 size=669935 2024-09-19T13:43:05.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.193+0000 7f6ab10d2780 1 > prepared multipart upload key=EE8F84K0ZAGJ upload=0F7L86PJXBA3 tag=RJMWLODWMDJ3 type=write size=2767087 2024-09-19T13:43:05.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.196+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=3W7XMRHAB9KK type=del 2024-09-19T13:43:05.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.197+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=UYADFR0O12L4 type=del size=377437 2024-09-19T13:43:05.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.198+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=JW7IMO4JZY9T type=del 2024-09-19T13:43:05.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.199+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=XHPNUW4BO0ZI type=del size=1191046 2024-09-19T13:43:05.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.200+0000 7f6ab10d2780 1 < completed write operation key=9Q9DGUSDSE49 tag=BOUE37YHGWCR type=write size=22284 2024-09-19T13:43:05.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.202+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~E1GGZ4CXK4UN.0 size=557805 2024-09-19T13:43:05.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.202+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=E1GGZ4CXK4UN tag=KVQY8TTG6VAQ type=write size=1606381 2024-09-19T13:43:05.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.203+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~XYA09NOEBVTI.0 size=1048576 2024-09-19T13:43:05.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.204+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~XYA09NOEBVTI.1 size=1048576 2024-09-19T13:43:05.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.205+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~XYA09NOEBVTI.2 size=960613 2024-09-19T13:43:05.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.207+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=XYA09NOEBVTI tag=27C57J0FADVG type=write size=4106341 2024-09-19T13:43:05.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.208+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=I69OXU0YO3GN type=del size=2970196 2024-09-19T13:43:05.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.209+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=ONLHYY1B4Y0H type=write size=762598 2024-09-19T13:43:05.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.210+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=FRWP5JGNM3D1 type=del size=1451685 2024-09-19T13:43:05.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.211+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~75UWZ7EY8I9Q.0 size=1048576 2024-09-19T13:43:05.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.212+0000 7f6ab10d2780 1 < completed part key=_multipart_7LHSAN5BBQRW.2~75UWZ7EY8I9Q.1 size=985658 2024-09-19T13:43:05.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.214+0000 7f6ab10d2780 1 < completed multipart upload key=7LHSAN5BBQRW upload=75UWZ7EY8I9Q tag=HNXAVEBLP0ZH type=write size=3082810 2024-09-19T13:43:05.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.215+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=520V30B6FZ2O type=del size=837183 2024-09-19T13:43:05.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.216+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~0K3BUPB9K354.0 size=1048576 2024-09-19T13:43:05.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.217+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~0K3BUPB9K354.1 size=1048576 2024-09-19T13:43:05.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.218+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~0K3BUPB9K354.2 size=526060 2024-09-19T13:43:05.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.220+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=0K3BUPB9K354 tag=6EERW8AYJOGP type=write size=3671788 2024-09-19T13:43:05.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.221+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=WCH86ULT7LYP type=del size=1124876 2024-09-19T13:43:05.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.222+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~WP66PDZ7IC02.0 size=1048576 2024-09-19T13:43:05.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.223+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~WP66PDZ7IC02.1 size=616774 2024-09-19T13:43:05.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.225+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=WP66PDZ7IC02 tag=2B22P62MF7TA type=write size=2713926 2024-09-19T13:43:05.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.226+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=K0MUOENGDLNP type=del size=604274 2024-09-19T13:43:05.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.227+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=79NDW3G30JAG type=del 2024-09-19T13:43:05.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.228+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=UP8U94B2T8KX type=del size=3081314 2024-09-19T13:43:05.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.229+0000 7f6ab10d2780 1 < canceled part key=_multipart_V8P17ZSOQUSM.2~QORTP0E2I1MZ.0 size=1020932 2024-09-19T13:43:05.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.231+0000 7f6ab10d2780 1 < canceled multipart upload key=V8P17ZSOQUSM upload=QORTP0E2I1MZ tag=QBRTGZ8OIHRI type=write size=2069508 2024-09-19T13:43:05.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.232+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=HGVSDLZMDLFP type=del size=3283418 2024-09-19T13:43:05.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.234+0000 7f6ab10d2780 1 < suggested remove operation key=EE8F84K0ZAGJ tag=3J7AKT8JHZQG type=del 2024-09-19T13:43:05.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.236+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~7BZ6H5RN7R1C.0 size=1048576 2024-09-19T13:43:05.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.237+0000 7f6ab10d2780 1 > prepared part key=_multipart_13GXIDWI4J9F.2~7BZ6H5RN7R1C.1 size=1019964 2024-09-19T13:43:05.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.237+0000 7f6ab10d2780 1 > prepared multipart upload key=13GXIDWI4J9F upload=7BZ6H5RN7R1C tag=9L985PFYIA8S type=write size=3117116 2024-09-19T13:43:05.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.240+0000 7f6ab10d2780 1 < suggested remove operation key=RXXCDV0LTCKS tag=KJVG5QRC0E5Z type=del 2024-09-19T13:43:05.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.242+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~AKQPIVONH034.0 size=1048576 2024-09-19T13:43:05.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.243+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~AKQPIVONH034.1 size=1048576 2024-09-19T13:43:05.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.244+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~AKQPIVONH034.2 size=535430 2024-09-19T13:43:05.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.244+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=AKQPIVONH034 tag=G1XIE9UBDWOL type=write size=3681158 2024-09-19T13:43:05.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.246+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=8VXWEG8XRHIR type=del 2024-09-19T13:43:05.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.248+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~8C3BHAAJ93AJ.0 size=1048576 2024-09-19T13:43:05.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.249+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~8C3BHAAJ93AJ.1 size=1048576 2024-09-19T13:43:05.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.250+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~8C3BHAAJ93AJ.2 size=271110 2024-09-19T13:43:05.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.250+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=8C3BHAAJ93AJ tag=VXJ5KL1ZAV3Z type=write size=3416838 2024-09-19T13:43:05.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.251+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~JMJ23EI0ELYC.0 size=1048576 2024-09-19T13:43:05.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.252+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~JMJ23EI0ELYC.1 size=1048576 2024-09-19T13:43:05.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.253+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~JMJ23EI0ELYC.2 size=847506 2024-09-19T13:43:05.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.255+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=JMJ23EI0ELYC tag=ZXTA3UR7U9ZE type=write size=3993234 2024-09-19T13:43:05.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.256+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=93HJZFAF8RXQ type=del size=3921969 2024-09-19T13:43:05.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.257+0000 7f6ab10d2780 1 < canceled part key=_multipart_EE8F84K0ZAGJ.2~9TM2G8ULXZ2X.0 size=977048 2024-09-19T13:43:05.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.258+0000 7f6ab10d2780 1 < canceled multipart upload key=EE8F84K0ZAGJ upload=9TM2G8ULXZ2X tag=2K3BYSYYGKZY type=write size=2025624 2024-09-19T13:43:05.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.260+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=T938YQ7X01HP type=del size=1383596 2024-09-19T13:43:05.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.261+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~0F7L86PJXBA3.0 size=1048576 2024-09-19T13:43:05.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.262+0000 7f6ab10d2780 1 < completed part key=_multipart_EE8F84K0ZAGJ.2~0F7L86PJXBA3.1 size=669935 2024-09-19T13:43:05.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.264+0000 7f6ab10d2780 1 < completed multipart upload key=EE8F84K0ZAGJ upload=0F7L86PJXBA3 tag=RJMWLODWMDJ3 type=write size=2767087 2024-09-19T13:43:05.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.265+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=TWD33SSTZ96G type=write size=669355 2024-09-19T13:43:05.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.267+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=UYADFR0O12L4 type=del 2024-09-19T13:43:05.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.269+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~5AY4P00CSESZ.0 size=1048576 2024-09-19T13:43:05.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.270+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~5AY4P00CSESZ.1 size=1048576 2024-09-19T13:43:05.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.271+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~5AY4P00CSESZ.2 size=882936 2024-09-19T13:43:05.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.271+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=5AY4P00CSESZ tag=BEIA8KAQTQYC type=write size=4028664 2024-09-19T13:43:05.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.272+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=XHPNUW4BO0ZI type=del 2024-09-19T13:43:05.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.273+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=NI1TYVCVJ12Z type=write size=214805 2024-09-19T13:43:05.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.274+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~E1GGZ4CXK4UN.0 size=557805 2024-09-19T13:43:05.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.276+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=E1GGZ4CXK4UN tag=KVQY8TTG6VAQ type=write size=1606381 2024-09-19T13:43:05.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.277+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=7SSHRFT0G4RQ type=write size=607447 2024-09-19T13:43:05.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.278+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=I69OXU0YO3GN type=del 2024-09-19T13:43:05.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.279+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=1G7O0PJZEFNZ type=write size=619498 2024-09-19T13:43:05.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.280+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=FRWP5JGNM3D1 type=del 2024-09-19T13:43:05.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.282+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=O6OSHG914LKE type=del size=4069095 2024-09-19T13:43:05.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.283+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=520V30B6FZ2O type=del 2024-09-19T13:43:05.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.284+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=A61419F1VI68 type=del size=3675341 2024-09-19T13:43:05.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.285+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=WCH86ULT7LYP type=del 2024-09-19T13:43:05.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.287+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~J0KI43V526NT.0 size=728331 2024-09-19T13:43:05.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.287+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=J0KI43V526NT tag=KZN7VI8WY95F type=write size=1776907 2024-09-19T13:43:05.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.288+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=K0MUOENGDLNP type=del 2024-09-19T13:43:05.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.290+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=R3LMTZILMLCZ type=del size=1208173 2024-09-19T13:43:05.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.291+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=UP8U94B2T8KX type=del 2024-09-19T13:43:05.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.292+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=UJAFRCZH3K1X type=del size=1381644 2024-09-19T13:43:05.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.293+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=HGVSDLZMDLFP type=del 2024-09-19T13:43:05.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.294+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=CYEEJDAMDADO type=del size=2422473 2024-09-19T13:43:05.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.295+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~7BZ6H5RN7R1C.0 size=1048576 2024-09-19T13:43:05.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.296+0000 7f6ab10d2780 1 < completed part key=_multipart_13GXIDWI4J9F.2~7BZ6H5RN7R1C.1 size=1019964 2024-09-19T13:43:05.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.298+0000 7f6ab10d2780 1 < completed multipart upload key=13GXIDWI4J9F upload=7BZ6H5RN7R1C tag=9L985PFYIA8S type=write size=3117116 2024-09-19T13:43:05.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.299+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=J9I4NQE19MZO type=write size=919174 2024-09-19T13:43:05.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.299+0000 7f6ab10d2780 1 < canceled part key=_multipart_QTGKMAOX2A6U.2~AKQPIVONH034.0 size=1048576 2024-09-19T13:43:05.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.300+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~AKQPIVONH034.1 size=1048576 2024-09-19T13:43:05.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.301+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~AKQPIVONH034.2 size=535430 2024-09-19T13:43:05.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.303+0000 7f6ab10d2780 1 < canceled multipart upload key=QTGKMAOX2A6U upload=AKQPIVONH034 tag=G1XIE9UBDWOL type=write size=3681158 2024-09-19T13:43:05.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.306+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~FRWBFKB3QZ8Y.0 size=1048576 2024-09-19T13:43:05.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.307+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~FRWBFKB3QZ8Y.1 size=1048576 2024-09-19T13:43:05.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.308+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~FRWBFKB3QZ8Y.2 size=125338 2024-09-19T13:43:05.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.308+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=FRWBFKB3QZ8Y tag=DWGF697BRHYO type=write size=3271066 2024-09-19T13:43:05.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.309+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~8C3BHAAJ93AJ.0 size=1048576 2024-09-19T13:43:05.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.310+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~8C3BHAAJ93AJ.1 size=1048576 2024-09-19T13:43:05.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.311+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~8C3BHAAJ93AJ.2 size=271110 2024-09-19T13:43:05.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.313+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=8C3BHAAJ93AJ tag=VXJ5KL1ZAV3Z type=write size=3416838 2024-09-19T13:43:05.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.314+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=FVIDVYKOKUMV type=del size=189940 2024-09-19T13:43:05.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.316+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=93HJZFAF8RXQ type=del 2024-09-19T13:43:05.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.317+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=0NX4MX4Z8VVJ type=del size=4030266 2024-09-19T13:43:05.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.319+0000 7f6ab10d2780 1 < suggested update operation key=SRABG45EPVN2 tag=T938YQ7X01HP type=del size=1383596 2024-09-19T13:43:05.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.321+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~DWSJM7T1YDD5.0 size=581896 2024-09-19T13:43:05.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.321+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=DWSJM7T1YDD5 tag=M9DA79YIVKPH type=write size=1630472 2024-09-19T13:43:05.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.323+0000 7f6ab10d2780 1 < completed write operation key=P2U09V0G7UUU tag=TWD33SSTZ96G type=write size=669355 2024-09-19T13:43:05.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.324+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=MN9R5HHK1IQQ type=del size=4003376 2024-09-19T13:43:05.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.325+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~5AY4P00CSESZ.0 size=1048576 2024-09-19T13:43:05.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.326+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~5AY4P00CSESZ.1 size=1048576 2024-09-19T13:43:05.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.326+0000 7f6ab10d2780 1 < canceled part key=_multipart_DF003ORZ1HOM.2~5AY4P00CSESZ.2 size=882936 2024-09-19T13:43:05.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.328+0000 7f6ab10d2780 1 < canceled multipart upload key=DF003ORZ1HOM upload=5AY4P00CSESZ tag=BEIA8KAQTQYC type=write size=4028664 2024-09-19T13:43:05.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.329+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=IUL47X2Y43JY type=del size=2400027 2024-09-19T13:43:05.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.330+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=NI1TYVCVJ12Z type=write size=214805 2024-09-19T13:43:05.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.333+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~6G39750P2RLI.0 size=1048576 2024-09-19T13:43:05.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.334+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~6G39750P2RLI.1 size=1048576 2024-09-19T13:43:05.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.334+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~6G39750P2RLI.2 size=412449 2024-09-19T13:43:05.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.334+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=6G39750P2RLI tag=0CAHC0ICC2Z0 type=write size=3558177 2024-09-19T13:43:05.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.337+0000 7f6ab10d2780 1 < suggested update operation key=CD4XXORKVS6J tag=7SSHRFT0G4RQ type=write size=607447 2024-09-19T13:43:05.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.338+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=26UOHVHQOJDY type=del size=3478907 2024-09-19T13:43:05.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.340+0000 7f6ab10d2780 1 < suggested update operation key=TCXAYADSCTZI tag=1G7O0PJZEFNZ type=write size=619498 2024-09-19T13:43:05.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.342+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=NZK7QUPDA63V type=del size=2752702 2024-09-19T13:43:05.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.343+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=O6OSHG914LKE type=del 2024-09-19T13:43:05.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.344+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=7MWZJ16QBLIE type=del size=764843 2024-09-19T13:43:05.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.345+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=A61419F1VI68 type=del 2024-09-19T13:43:05.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.347+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=593KRGVENLHI type=del size=1549840 2024-09-19T13:43:05.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.348+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~J0KI43V526NT.0 size=728331 2024-09-19T13:43:05.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.350+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=J0KI43V526NT tag=KZN7VI8WY95F type=write size=1776907 2024-09-19T13:43:05.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.352+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~VKL8HG37NKYH.0 size=1048576 2024-09-19T13:43:05.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.353+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~VKL8HG37NKYH.1 size=63857 2024-09-19T13:43:05.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.353+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=VKL8HG37NKYH tag=KMTVIPPNWQA3 type=write size=2161009 2024-09-19T13:43:05.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.354+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=R3LMTZILMLCZ type=del 2024-09-19T13:43:05.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.355+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=B05ZAHS1R8LT type=write size=391822 2024-09-19T13:43:05.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.356+0000 7f6ab10d2780 1 < canceled operation key=UPMXNNYUUJR7 tag=UJAFRCZH3K1X type=del size=1381644 2024-09-19T13:43:05.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.357+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=PVM8EKL8I0MT type=del size=2159910 2024-09-19T13:43:05.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.359+0000 7f6ab10d2780 1 < canceled operation key=SDQ64HOD22EM tag=CYEEJDAMDADO type=del size=2422473 2024-09-19T13:43:05.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.360+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=E3XS1WFT9RZE type=del size=1194306 2024-09-19T13:43:05.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.361+0000 7f6ab10d2780 1 < completed write operation key=V8P17ZSOQUSM tag=J9I4NQE19MZO type=write size=919174 2024-09-19T13:43:05.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.363+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=UNSNKJ2EYQ68 type=del size=1346848 2024-09-19T13:43:05.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.364+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~FRWBFKB3QZ8Y.0 size=1048576 2024-09-19T13:43:05.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.365+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~FRWBFKB3QZ8Y.1 size=1048576 2024-09-19T13:43:05.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.366+0000 7f6ab10d2780 1 < completed part key=_multipart_X1JYDG1ASYAR.2~FRWBFKB3QZ8Y.2 size=125338 2024-09-19T13:43:05.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.368+0000 7f6ab10d2780 1 < completed multipart upload key=X1JYDG1ASYAR upload=FRWBFKB3QZ8Y tag=DWGF697BRHYO type=write size=3271066 2024-09-19T13:43:05.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.369+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=JKPVXX9TICCI type=del size=1330542 2024-09-19T13:43:05.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.372+0000 7f6ab10d2780 1 < suggested remove operation key=4OSJA1879NQO tag=FVIDVYKOKUMV type=del 2024-09-19T13:43:05.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.373+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=I64EG1XXK93V type=del size=3211632 2024-09-19T13:43:05.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.375+0000 7f6ab10d2780 1 < suggested update operation key=DF003ORZ1HOM tag=0NX4MX4Z8VVJ type=del size=4030266 2024-09-19T13:43:05.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.377+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~KFH2ODN09AT8.0 size=1030255 2024-09-19T13:43:05.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.377+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=KFH2ODN09AT8 tag=5LXD04JT37TD type=write size=2078831 2024-09-19T13:43:05.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.379+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~DWSJM7T1YDD5.0 size=581896 2024-09-19T13:43:05.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.380+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=DWSJM7T1YDD5 tag=M9DA79YIVKPH type=write size=1630472 2024-09-19T13:43:05.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.382+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~3FG9VOYMER46.0 size=490433 2024-09-19T13:43:05.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.382+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=3FG9VOYMER46 tag=YYZ9JZAP0H25 type=write size=1539009 2024-09-19T13:43:05.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.383+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=MN9R5HHK1IQQ type=del 2024-09-19T13:43:05.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.384+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=4F9CFRBZ51TO type=del size=2865342 2024-09-19T13:43:05.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.387+0000 7f6ab10d2780 1 < suggested remove operation key=VFJIKOLYI0HN tag=IUL47X2Y43JY type=del 2024-09-19T13:43:05.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.388+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=71E1QUZZA2MH type=del size=1281973 2024-09-19T13:43:05.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.389+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~6G39750P2RLI.0 size=1048576 2024-09-19T13:43:05.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.390+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~6G39750P2RLI.1 size=1048576 2024-09-19T13:43:05.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.391+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~6G39750P2RLI.2 size=412449 2024-09-19T13:43:05.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.393+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=6G39750P2RLI tag=0CAHC0ICC2Z0 type=write size=3558177 2024-09-19T13:43:05.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.395+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~EMBLPBY40VEK.0 size=1048576 2024-09-19T13:43:05.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.395+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~EMBLPBY40VEK.1 size=1048576 2024-09-19T13:43:05.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.396+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~EMBLPBY40VEK.2 size=705788 2024-09-19T13:43:05.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.396+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=EMBLPBY40VEK tag=OOTXMD9RP553 type=write size=3851516 2024-09-19T13:43:05.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.399+0000 7f6ab10d2780 1 < suggested remove operation key=9Q9DGUSDSE49 tag=26UOHVHQOJDY type=del 2024-09-19T13:43:05.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.401+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~M28UXRDDA4UD.0 size=254771 2024-09-19T13:43:05.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.401+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=M28UXRDDA4UD tag=KCYDJ04I7P2I type=write size=1303347 2024-09-19T13:43:05.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.402+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=NZK7QUPDA63V type=del 2024-09-19T13:43:05.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.404+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~K89GICL0CBS3.0 size=1048576 2024-09-19T13:43:05.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.405+0000 7f6ab10d2780 1 > prepared part key=_multipart_B0J7E7A0NP4J.2~K89GICL0CBS3.1 size=661891 2024-09-19T13:43:05.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.405+0000 7f6ab10d2780 1 > prepared multipart upload key=B0J7E7A0NP4J upload=K89GICL0CBS3 tag=LX3M6NMZZNJQ type=write size=2759043 2024-09-19T13:43:05.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.405+0000 7f6ab10d2780 -1 < no bi entry to suggest for operation key=VFJIKOLYI0HN tag=7MWZJ16QBLIE type=del size=764843: (2) No such file or directory 2024-09-19T13:43:05.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.407+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=12SQ4KO2IMDL type=del size=226127 2024-09-19T13:43:05.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.408+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=593KRGVENLHI type=del 2024-09-19T13:43:05.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.409+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=X72VABKPDCU5 type=del size=3037640 2024-09-19T13:43:05.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.410+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~VKL8HG37NKYH.0 size=1048576 2024-09-19T13:43:05.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.411+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~VKL8HG37NKYH.1 size=63857 2024-09-19T13:43:05.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.413+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=VKL8HG37NKYH tag=KMTVIPPNWQA3 type=write size=2161009 2024-09-19T13:43:05.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.414+0000 7f6ab10d2780 1 > prepared operation key=A14YTABJ1Z3Z tag=9EAONM2YN44M type=write size=717652 2024-09-19T13:43:05.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.417+0000 7f6ab10d2780 -1 < failed to complete operation key=9Q9DGUSDSE49 tag=B05ZAHS1R8LT type=write size=391822: (22) Invalid argument 2024-09-19T13:43:05.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.418+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=7H1K6O22ZY66 type=del size=4149322 2024-09-19T13:43:05.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.420+0000 7f6ab10d2780 1 < suggested remove operation key=9MCE8PXHBGNF tag=PVM8EKL8I0MT type=del 2024-09-19T13:43:05.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.421+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=R6F2E8OJU3U6 type=write size=247285 2024-09-19T13:43:05.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.423+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=E3XS1WFT9RZE type=del 2024-09-19T13:43:05.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.425+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~QQG05DYZ0I1I.0 size=599431 2024-09-19T13:43:05.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.425+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=QQG05DYZ0I1I tag=327ZRTCKPNQP type=write size=1648007 2024-09-19T13:43:05.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.426+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=UNSNKJ2EYQ68 type=del 2024-09-19T13:43:05.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.427+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=ARVHQGX7S5TM type=del size=1828241 2024-09-19T13:43:05.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.429+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=JKPVXX9TICCI type=del 2024-09-19T13:43:05.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.430+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=R9S9Y3L8QN10 type=del size=184218 2024-09-19T13:43:05.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.431+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=I64EG1XXK93V type=del 2024-09-19T13:43:05.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.432+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=RG7TZE39FAW4 type=write size=614710 2024-09-19T13:43:05.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.434+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~KFH2ODN09AT8.0 size=1030255 2024-09-19T13:43:05.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.435+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=KFH2ODN09AT8 tag=5LXD04JT37TD type=write size=2078831 2024-09-19T13:43:05.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.436+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=ZDN9R0CYLTXT type=del size=2240557 2024-09-19T13:43:05.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.438+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~3FG9VOYMER46.0 size=490433 2024-09-19T13:43:05.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.440+0000 7f6ab10d2780 1 < completed multipart upload key=DF003ORZ1HOM upload=3FG9VOYMER46 tag=YYZ9JZAP0H25 type=write size=1539009 2024-09-19T13:43:05.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.442+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~ZZOBV2N2JBGW.0 size=1048576 2024-09-19T13:43:05.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.443+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~ZZOBV2N2JBGW.1 size=1048576 2024-09-19T13:43:05.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.444+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~ZZOBV2N2JBGW.2 size=506321 2024-09-19T13:43:05.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.444+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=ZZOBV2N2JBGW tag=GU4YREL0EZIY type=write size=3652049 2024-09-19T13:43:05.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.445+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=4F9CFRBZ51TO type=del 2024-09-19T13:43:05.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.446+0000 7f6ab10d2780 1 > prepared operation key=2KX2NSY41STV tag=8YJCS9RHJFD9 type=write size=47562 2024-09-19T13:43:05.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.448+0000 7f6ab10d2780 1 < suggested remove operation key=XQLWZA2X91GF tag=71E1QUZZA2MH type=del 2024-09-19T13:43:05.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.450+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=WQ76LOSH4ZYN type=del size=446249 2024-09-19T13:43:05.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.451+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~EMBLPBY40VEK.0 size=1048576 2024-09-19T13:43:05.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.452+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~EMBLPBY40VEK.1 size=1048576 2024-09-19T13:43:05.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.452+0000 7f6ab10d2780 1 < completed part key=_multipart_9Q9DGUSDSE49.2~EMBLPBY40VEK.2 size=705788 2024-09-19T13:43:05.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.454+0000 7f6ab10d2780 1 < completed multipart upload key=9Q9DGUSDSE49 upload=EMBLPBY40VEK tag=OOTXMD9RP553 type=write size=3851516 2024-09-19T13:43:05.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.456+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=Z89NKHVPXMPS type=del size=2608624 2024-09-19T13:43:05.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.457+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~M28UXRDDA4UD.0 size=254771 2024-09-19T13:43:05.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.458+0000 7f6ab10d2780 1 < completed multipart upload key=P2U09V0G7UUU upload=M28UXRDDA4UD tag=KCYDJ04I7P2I type=write size=1303347 2024-09-19T13:43:05.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.459+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=KVLJWE9K41B8 type=del size=1599768 2024-09-19T13:43:05.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.461+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~K89GICL0CBS3.0 size=1048576 2024-09-19T13:43:05.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.462+0000 7f6ab10d2780 1 < completed part key=_multipart_B0J7E7A0NP4J.2~K89GICL0CBS3.1 size=661891 2024-09-19T13:43:05.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.463+0000 7f6ab10d2780 1 < completed multipart upload key=B0J7E7A0NP4J upload=K89GICL0CBS3 tag=LX3M6NMZZNJQ type=write size=2759043 2024-09-19T13:43:05.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.465+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=EL5NGGDBFJQK type=del size=447306 2024-09-19T13:43:05.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.466+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=12SQ4KO2IMDL type=del 2024-09-19T13:43:05.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.468+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~XZZDPH9TUCMH.0 size=1048576 2024-09-19T13:43:05.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.469+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~XZZDPH9TUCMH.1 size=1014926 2024-09-19T13:43:05.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.469+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=XZZDPH9TUCMH tag=HVW059Z12DLC type=write size=3112078 2024-09-19T13:43:05.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.470+0000 7f6ab10d2780 1 < canceled operation key=B0J7E7A0NP4J tag=X72VABKPDCU5 type=del size=3037640 2024-09-19T13:43:05.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.472+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~3C42PATLA3H6.0 size=1048576 2024-09-19T13:43:05.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.473+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~3C42PATLA3H6.1 size=1048576 2024-09-19T13:43:05.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.474+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~3C42PATLA3H6.2 size=675586 2024-09-19T13:43:05.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.474+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=3C42PATLA3H6 tag=02T92TTNVTLY type=write size=3821314 2024-09-19T13:43:05.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.475+0000 7f6ab10d2780 1 < completed write operation key=A14YTABJ1Z3Z tag=9EAONM2YN44M type=write size=717652 2024-09-19T13:43:05.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.477+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~4Z22T34YO5D5.0 size=1048576 2024-09-19T13:43:05.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.478+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~4Z22T34YO5D5.1 size=921025 2024-09-19T13:43:05.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.478+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=4Z22T34YO5D5 tag=ME3DGMDD21ES type=write size=3018177 2024-09-19T13:43:05.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.479+0000 7f6ab10d2780 -1 < failed to complete operation key=9MCE8PXHBGNF tag=7H1K6O22ZY66 type=del size=4149322: (22) Invalid argument 2024-09-19T13:43:05.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.481+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~BAMC4C4D09G4.0 size=1048576 2024-09-19T13:43:05.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.482+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~BAMC4C4D09G4.1 size=725070 2024-09-19T13:43:05.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.482+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=BAMC4C4D09G4 tag=HXK3Z41C3L7V type=write size=2822222 2024-09-19T13:43:05.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.483+0000 7f6ab10d2780 1 < completed write operation key=4OSJA1879NQO tag=R6F2E8OJU3U6 type=write size=247285 2024-09-19T13:43:05.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.485+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~RC24RK3XZSUD.0 size=1048576 2024-09-19T13:43:05.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.486+0000 7f6ab10d2780 1 > prepared part key=_multipart_PUXLW9NBBQJX.2~RC24RK3XZSUD.1 size=1021781 2024-09-19T13:43:05.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.486+0000 7f6ab10d2780 1 > prepared multipart upload key=PUXLW9NBBQJX upload=RC24RK3XZSUD tag=9OQLLPOOC96W type=write size=3118933 2024-09-19T13:43:05.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.488+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~QQG05DYZ0I1I.0 size=599431 2024-09-19T13:43:05.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.490+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=QQG05DYZ0I1I tag=327ZRTCKPNQP type=write size=1648007 2024-09-19T13:43:05.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.491+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=P6Q4MP20N9X8 type=write size=462001 2024-09-19T13:43:05.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.492+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=ARVHQGX7S5TM type=del 2024-09-19T13:43:05.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.494+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~UUTW1QVXKFY8.0 size=1016143 2024-09-19T13:43:05.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.494+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=UUTW1QVXKFY8 tag=MPSCGA8XQTIJ type=write size=2064719 2024-09-19T13:43:05.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.495+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=R9S9Y3L8QN10 type=del 2024-09-19T13:43:05.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.497+0000 7f6ab10d2780 1 > prepared part key=_multipart_QTGKMAOX2A6U.2~5VPO6B6ZQP94.0 size=725895 2024-09-19T13:43:05.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.497+0000 7f6ab10d2780 1 > prepared multipart upload key=QTGKMAOX2A6U upload=5VPO6B6ZQP94 tag=J09IQM1H55AM type=write size=1774471 2024-09-19T13:43:05.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.498+0000 7f6ab10d2780 1 < completed write operation key=9WTLWBONAOET tag=RG7TZE39FAW4 type=write size=614710 2024-09-19T13:43:05.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.499+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=9H0WVT6HFOAX type=del size=3829579 2024-09-19T13:43:05.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.500+0000 7f6ab10d2780 1 < completed delete operation key=X8CWBFNCJG6M tag=ZDN9R0CYLTXT type=del 2024-09-19T13:43:05.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.501+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=63N2FJ16WA50 type=del size=924684 2024-09-19T13:43:05.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.501+0000 7f6ab10d2780 1 < canceled part key=_multipart_535R757HSXMB.2~ZZOBV2N2JBGW.0 size=1048576 2024-09-19T13:43:05.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.502+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~ZZOBV2N2JBGW.1 size=1048576 2024-09-19T13:43:05.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.503+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~ZZOBV2N2JBGW.2 size=506321 2024-09-19T13:43:05.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.505+0000 7f6ab10d2780 1 < canceled multipart upload key=535R757HSXMB upload=ZZOBV2N2JBGW tag=GU4YREL0EZIY type=write size=3652049 2024-09-19T13:43:05.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.506+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=9WRMG2S303QW type=del size=236613 2024-09-19T13:43:05.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.508+0000 7f6ab10d2780 1 < suggested remove operation key=2KX2NSY41STV tag=8YJCS9RHJFD9 type=write 2024-09-19T13:43:05.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.509+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=72SYN6KLWVPJ type=del size=2987554 2024-09-19T13:43:05.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.510+0000 7f6ab10d2780 1 < canceled operation key=9IN6E0JQFNAU tag=WQ76LOSH4ZYN type=del size=446249 2024-09-19T13:43:05.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.512+0000 7f6ab10d2780 1 > prepared operation key=DF003ORZ1HOM tag=G7MMLWBZMDMH type=del size=1705444 2024-09-19T13:43:05.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.513+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=Z89NKHVPXMPS type=del 2024-09-19T13:43:05.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.515+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~ER9W6K6YR4QH.0 size=1048576 2024-09-19T13:43:05.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.516+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~ER9W6K6YR4QH.1 size=1048576 2024-09-19T13:43:05.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.517+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~ER9W6K6YR4QH.2 size=155689 2024-09-19T13:43:05.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.517+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=ER9W6K6YR4QH tag=P9DN3CJ02ABX type=write size=3301417 2024-09-19T13:43:05.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.519+0000 7f6ab10d2780 1 < suggested remove operation key=QTGKMAOX2A6U tag=KVLJWE9K41B8 type=del 2024-09-19T13:43:05.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.520+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=XNJDJC81CVUN type=del size=1986455 2024-09-19T13:43:05.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.521+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=EL5NGGDBFJQK type=del 2024-09-19T13:43:05.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.524+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~YQ4L2DQA9MOV.0 size=1048576 2024-09-19T13:43:05.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.525+0000 7f6ab10d2780 1 > prepared part key=_multipart_SDQ64HOD22EM.2~YQ4L2DQA9MOV.1 size=69748 2024-09-19T13:43:05.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.525+0000 7f6ab10d2780 1 > prepared multipart upload key=SDQ64HOD22EM upload=YQ4L2DQA9MOV tag=YVXUBX9AGR3F type=write size=2166900 2024-09-19T13:43:05.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.525+0000 7f6ab10d2780 1 < canceled part key=_multipart_P2U09V0G7UUU.2~XZZDPH9TUCMH.0 size=1048576 2024-09-19T13:43:05.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.526+0000 7f6ab10d2780 1 < completed part key=_multipart_P2U09V0G7UUU.2~XZZDPH9TUCMH.1 size=1014926 2024-09-19T13:43:05.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.528+0000 7f6ab10d2780 1 < canceled multipart upload key=P2U09V0G7UUU upload=XZZDPH9TUCMH tag=HVW059Z12DLC type=write size=3112078 2024-09-19T13:43:05.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.530+0000 7f6ab10d2780 1 > prepared part key=_multipart_7LHSAN5BBQRW.2~9J88FMB5NBTE.0 size=1006562 2024-09-19T13:43:05.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.530+0000 7f6ab10d2780 1 > prepared multipart upload key=7LHSAN5BBQRW upload=9J88FMB5NBTE tag=9BV44SWY06ET type=write size=2055138 2024-09-19T13:43:05.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.530+0000 7f6ab10d2780 1 < canceled part key=_multipart_DF003ORZ1HOM.2~3C42PATLA3H6.0 size=1048576 2024-09-19T13:43:05.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.531+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~3C42PATLA3H6.1 size=1048576 2024-09-19T13:43:05.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.532+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~3C42PATLA3H6.2 size=675586 2024-09-19T13:43:05.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.534+0000 7f6ab10d2780 1 < canceled multipart upload key=DF003ORZ1HOM upload=3C42PATLA3H6 tag=02T92TTNVTLY type=write size=3821314 2024-09-19T13:43:05.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.536+0000 7f6ab10d2780 1 > prepared part key=_multipart_RU6OR8SM72GU.2~FZVKISC3AUNQ.0 size=377279 2024-09-19T13:43:05.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.536+0000 7f6ab10d2780 1 > prepared multipart upload key=RU6OR8SM72GU upload=FZVKISC3AUNQ tag=F0NNT9DHV8OX type=write size=1425855 2024-09-19T13:43:05.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.537+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~4Z22T34YO5D5.0 size=1048576 2024-09-19T13:43:05.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.538+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~4Z22T34YO5D5.1 size=921025 2024-09-19T13:43:05.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.540+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=4Z22T34YO5D5 tag=ME3DGMDD21ES type=write size=3018177 2024-09-19T13:43:05.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.542+0000 7f6ab10d2780 1 > prepared part key=_multipart_P2U09V0G7UUU.2~YWAOVTDICIBP.0 size=973498 2024-09-19T13:43:05.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.542+0000 7f6ab10d2780 1 > prepared multipart upload key=P2U09V0G7UUU upload=YWAOVTDICIBP tag=WYEFKFG796XB type=write size=2022074 2024-09-19T13:43:05.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.543+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~BAMC4C4D09G4.0 size=1048576 2024-09-19T13:43:05.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.544+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~BAMC4C4D09G4.1 size=725070 2024-09-19T13:43:05.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.546+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=BAMC4C4D09G4 tag=HXK3Z41C3L7V type=write size=2822222 2024-09-19T13:43:05.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.547+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=BY416H5SHFAM type=del size=169686 2024-09-19T13:43:05.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.548+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~RC24RK3XZSUD.0 size=1048576 2024-09-19T13:43:05.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.549+0000 7f6ab10d2780 1 < completed part key=_multipart_PUXLW9NBBQJX.2~RC24RK3XZSUD.1 size=1021781 2024-09-19T13:43:05.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.550+0000 7f6ab10d2780 1 < completed multipart upload key=PUXLW9NBBQJX upload=RC24RK3XZSUD tag=9OQLLPOOC96W type=write size=3118933 2024-09-19T13:43:05.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.552+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=Q9XYI9HG9BZS type=del size=2057434 2024-09-19T13:43:05.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.554+0000 7f6ab10d2780 1 < suggested remove operation key=4OSJA1879NQO tag=P6Q4MP20N9X8 type=write 2024-09-19T13:43:05.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.555+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=AXCUIMZ6NMMF type=del size=367862 2024-09-19T13:43:05.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.556+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~UUTW1QVXKFY8.0 size=1016143 2024-09-19T13:43:05.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.557+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=UUTW1QVXKFY8 tag=MPSCGA8XQTIJ type=write size=2064719 2024-09-19T13:43:05.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.559+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~11SAK78V2QKE.0 size=1048576 2024-09-19T13:43:05.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.560+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~11SAK78V2QKE.1 size=713924 2024-09-19T13:43:05.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.560+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=11SAK78V2QKE tag=9G80NLF3GTBA type=write size=2811076 2024-09-19T13:43:05.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.561+0000 7f6ab10d2780 1 < completed part key=_multipart_QTGKMAOX2A6U.2~5VPO6B6ZQP94.0 size=725895 2024-09-19T13:43:05.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.563+0000 7f6ab10d2780 1 < completed multipart upload key=QTGKMAOX2A6U upload=5VPO6B6ZQP94 tag=J09IQM1H55AM type=write size=1774471 2024-09-19T13:43:05.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.565+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~85MR90TQCP0V.0 size=1048576 2024-09-19T13:43:05.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.566+0000 7f6ab10d2780 1 > prepared part key=_multipart_DF003ORZ1HOM.2~85MR90TQCP0V.1 size=385370 2024-09-19T13:43:05.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.566+0000 7f6ab10d2780 1 > prepared multipart upload key=DF003ORZ1HOM upload=85MR90TQCP0V tag=D9JMCQEM063D type=write size=2482522 2024-09-19T13:43:05.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.568+0000 7f6ab10d2780 1 < suggested remove operation key=CD4XXORKVS6J tag=9H0WVT6HFOAX type=del 2024-09-19T13:43:05.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.570+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~GBZQT8UB0QO6.0 size=1048576 2024-09-19T13:43:05.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.571+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~GBZQT8UB0QO6.1 size=771704 2024-09-19T13:43:05.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.571+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=GBZQT8UB0QO6 tag=9Q3Z0RZXV4U5 type=write size=2868856 2024-09-19T13:43:05.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.572+0000 7f6ab10d2780 1 < completed delete operation key=P2U09V0G7UUU tag=63N2FJ16WA50 type=del 2024-09-19T13:43:05.576 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.573+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=5IJM3W3FO8XH type=del size=3513329 2024-09-19T13:43:05.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.575+0000 7f6ab10d2780 -1 < failed to complete operation key=4OSJA1879NQO tag=9WRMG2S303QW type=del size=236613: (22) Invalid argument 2024-09-19T13:43:05.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.576+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=UAH38GGGXDUK type=del size=508518 2024-09-19T13:43:05.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.577+0000 7f6ab10d2780 1 < completed delete operation key=TCXAYADSCTZI tag=72SYN6KLWVPJ type=del 2024-09-19T13:43:05.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.579+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~N9KN0F5EWRES.0 size=1048576 2024-09-19T13:43:05.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.580+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~N9KN0F5EWRES.1 size=114856 2024-09-19T13:43:05.582 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.580+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=N9KN0F5EWRES tag=T1DGD6HL2VS9 type=write size=2212008 2024-09-19T13:43:05.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.582+0000 7f6ab10d2780 1 < completed delete operation key=DF003ORZ1HOM tag=G7MMLWBZMDMH type=del 2024-09-19T13:43:05.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.583+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=R46CFK81BKK6 type=del size=3975835 2024-09-19T13:43:05.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.584+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~ER9W6K6YR4QH.0 size=1048576 2024-09-19T13:43:05.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.584+0000 7f6ab10d2780 1 < canceled part key=_multipart_WDRUV5ERI000.2~ER9W6K6YR4QH.1 size=1048576 2024-09-19T13:43:05.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.585+0000 7f6ab10d2780 1 < completed part key=_multipart_WDRUV5ERI000.2~ER9W6K6YR4QH.2 size=155689 2024-09-19T13:43:05.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.587+0000 7f6ab10d2780 1 < canceled multipart upload key=WDRUV5ERI000 upload=ER9W6K6YR4QH tag=P9DN3CJ02ABX type=write size=3301417 2024-09-19T13:43:05.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.589+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=XRLN170UZACZ type=del size=1808536 2024-09-19T13:43:05.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.590+0000 7f6ab10d2780 1 < completed delete operation key=XQLWZA2X91GF tag=XNJDJC81CVUN type=del 2024-09-19T13:43:05.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.591+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=N1BJ6X0TCN9H type=del size=3533549 2024-09-19T13:43:05.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.593+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~YQ4L2DQA9MOV.0 size=1048576 2024-09-19T13:43:05.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.594+0000 7f6ab10d2780 1 < completed part key=_multipart_SDQ64HOD22EM.2~YQ4L2DQA9MOV.1 size=69748 2024-09-19T13:43:05.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.596+0000 7f6ab10d2780 1 < completed multipart upload key=SDQ64HOD22EM upload=YQ4L2DQA9MOV tag=YVXUBX9AGR3F type=write size=2166900 2024-09-19T13:43:05.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.598+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~5XRLX0JUCEAV.0 size=1048576 2024-09-19T13:43:05.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.599+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~5XRLX0JUCEAV.1 size=370555 2024-09-19T13:43:05.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.599+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=5XRLX0JUCEAV tag=74LVG2M2CSQ0 type=write size=2467707 2024-09-19T13:43:05.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.599+0000 7f6ab10d2780 1 < canceled part key=_multipart_7LHSAN5BBQRW.2~9J88FMB5NBTE.0 size=1006562 2024-09-19T13:43:05.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.601+0000 7f6ab10d2780 1 < canceled multipart upload key=7LHSAN5BBQRW upload=9J88FMB5NBTE tag=9BV44SWY06ET type=write size=2055138 2024-09-19T13:43:05.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.603+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~ZZ4I1TXIQJ8Z.0 size=1048576 2024-09-19T13:43:05.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.604+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~ZZ4I1TXIQJ8Z.1 size=539655 2024-09-19T13:43:05.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.604+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=ZZ4I1TXIQJ8Z tag=6DX2AV7MZ8HU type=write size=2636807 2024-09-19T13:43:05.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.605+0000 7f6ab10d2780 1 < completed part key=_multipart_RU6OR8SM72GU.2~FZVKISC3AUNQ.0 size=377279 2024-09-19T13:43:05.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.607+0000 7f6ab10d2780 1 < completed multipart upload key=RU6OR8SM72GU upload=FZVKISC3AUNQ tag=F0NNT9DHV8OX type=write size=1425855 2024-09-19T13:43:05.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.608+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=PXMQ0DPWFP40 type=del size=95279 2024-09-19T13:43:05.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.608+0000 7f6ab10d2780 1 < canceled part key=_multipart_P2U09V0G7UUU.2~YWAOVTDICIBP.0 size=973498 2024-09-19T13:43:05.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.610+0000 7f6ab10d2780 1 < canceled multipart upload key=P2U09V0G7UUU upload=YWAOVTDICIBP tag=WYEFKFG796XB type=write size=2022074 2024-09-19T13:43:05.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.612+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~DYD7Z9VZ6G9E.0 size=1048576 2024-09-19T13:43:05.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.612+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~DYD7Z9VZ6G9E.1 size=1048576 2024-09-19T13:43:05.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.613+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~DYD7Z9VZ6G9E.2 size=98105 2024-09-19T13:43:05.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.613+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=DYD7Z9VZ6G9E tag=UURAUDJQ8EUT type=write size=3243833 2024-09-19T13:43:05.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.614+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=BY416H5SHFAM type=del 2024-09-19T13:43:05.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.615+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=3ICQRUFP5MA6 type=write size=701389 2024-09-19T13:43:05.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.617+0000 7f6ab10d2780 1 < canceled operation key=UX2ICIT36Q3R tag=Q9XYI9HG9BZS type=del size=2057434 2024-09-19T13:43:05.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.618+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=SM8ZD1MIWHYA type=write size=279303 2024-09-19T13:43:05.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.619+0000 7f6ab10d2780 1 < canceled operation key=RU6OR8SM72GU tag=AXCUIMZ6NMMF type=del size=367862 2024-09-19T13:43:05.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.620+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=D7KAC3KI8TKM type=del size=497222 2024-09-19T13:43:05.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.621+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~11SAK78V2QKE.0 size=1048576 2024-09-19T13:43:05.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.622+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~11SAK78V2QKE.1 size=713924 2024-09-19T13:43:05.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.624+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=11SAK78V2QKE tag=9G80NLF3GTBA type=write size=2811076 2024-09-19T13:43:05.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.625+0000 7f6ab10d2780 1 > prepared operation key=7LHSAN5BBQRW tag=14U7MBSNOP1Q type=del size=3522660 2024-09-19T13:43:05.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.625+0000 7f6ab10d2780 1 < canceled part key=_multipart_DF003ORZ1HOM.2~85MR90TQCP0V.0 size=1048576 2024-09-19T13:43:05.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.627+0000 7f6ab10d2780 1 < completed part key=_multipart_DF003ORZ1HOM.2~85MR90TQCP0V.1 size=385370 2024-09-19T13:43:05.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.630+0000 7f6ab10d2780 1 < canceled multipart upload key=DF003ORZ1HOM upload=85MR90TQCP0V tag=D9JMCQEM063D type=write size=2482522 2024-09-19T13:43:05.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.632+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=ZCNKV5PBLPJN type=del size=2850299 2024-09-19T13:43:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.633+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~GBZQT8UB0QO6.0 size=1048576 2024-09-19T13:43:05.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.634+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~GBZQT8UB0QO6.1 size=771704 2024-09-19T13:43:05.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.636+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=GBZQT8UB0QO6 tag=9Q3Z0RZXV4U5 type=write size=2868856 2024-09-19T13:43:05.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.637+0000 7f6ab10d2780 1 > prepared operation key=UPMXNNYUUJR7 tag=HULDIR366NUZ type=write size=168882 2024-09-19T13:43:05.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.638+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=5IJM3W3FO8XH type=del 2024-09-19T13:43:05.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.639+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=O0A5UXRYPFVK type=del size=3461870 2024-09-19T13:43:05.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.641+0000 7f6ab10d2780 1 < completed delete operation key=X1JYDG1ASYAR tag=UAH38GGGXDUK type=del 2024-09-19T13:43:05.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.642+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=J0ZWY4QQ4HU0 type=del size=1130564 2024-09-19T13:43:05.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.643+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~N9KN0F5EWRES.0 size=1048576 2024-09-19T13:43:05.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.644+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~N9KN0F5EWRES.1 size=114856 2024-09-19T13:43:05.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.646+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=N9KN0F5EWRES tag=T1DGD6HL2VS9 type=write size=2212008 2024-09-19T13:43:05.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.647+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=R4FGJTE1QHI2 type=del size=547233 2024-09-19T13:43:05.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.648+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=R46CFK81BKK6 type=del 2024-09-19T13:43:05.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.651+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~ZCLICFXA1JUY.0 size=1048576 2024-09-19T13:43:05.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.652+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~ZCLICFXA1JUY.1 size=731829 2024-09-19T13:43:05.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.652+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=ZCLICFXA1JUY tag=CE9VRE97WIXG type=write size=2828981 2024-09-19T13:43:05.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.653+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=XRLN170UZACZ type=del 2024-09-19T13:43:05.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.655+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~GSBE87ZXNPEV.0 size=1048576 2024-09-19T13:43:05.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.656+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~GSBE87ZXNPEV.1 size=918243 2024-09-19T13:43:05.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.656+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=GSBE87ZXNPEV tag=2T4S2OEG8Y7D type=write size=3015395 2024-09-19T13:43:05.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.657+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=N1BJ6X0TCN9H type=del 2024-09-19T13:43:05.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.660+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~ZH9IE98029LH.0 size=964771 2024-09-19T13:43:05.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.660+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=ZH9IE98029LH tag=M9AXEMVSYUCJ type=write size=2013347 2024-09-19T13:43:05.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.661+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~5XRLX0JUCEAV.0 size=1048576 2024-09-19T13:43:05.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.662+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~5XRLX0JUCEAV.1 size=370555 2024-09-19T13:43:05.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.664+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=5XRLX0JUCEAV tag=74LVG2M2CSQ0 type=write size=2467707 2024-09-19T13:43:05.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.665+0000 7f6ab10d2780 1 > prepared operation key=SRABG45EPVN2 tag=UTK4D29S5QXK type=del size=3198620 2024-09-19T13:43:05.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.667+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~ZZ4I1TXIQJ8Z.0 size=1048576 2024-09-19T13:43:05.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.668+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~ZZ4I1TXIQJ8Z.1 size=539655 2024-09-19T13:43:05.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.670+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=ZZ4I1TXIQJ8Z tag=6DX2AV7MZ8HU type=write size=2636807 2024-09-19T13:43:05.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.671+0000 7f6ab10d2780 1 > prepared operation key=EE8F84K0ZAGJ tag=GLA1CL016LDA type=write size=230977 2024-09-19T13:43:05.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.672+0000 7f6ab10d2780 1 < completed delete operation key=EE8F84K0ZAGJ tag=PXMQ0DPWFP40 type=del 2024-09-19T13:43:05.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.674+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~437IL92C0KLW.0 size=1048576 2024-09-19T13:43:05.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.675+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~437IL92C0KLW.1 size=899695 2024-09-19T13:43:05.677 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.675+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=437IL92C0KLW tag=SJGLN0UZHFD2 type=write size=2996847 2024-09-19T13:43:05.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.676+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~DYD7Z9VZ6G9E.0 size=1048576 2024-09-19T13:43:05.679 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.677+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~DYD7Z9VZ6G9E.1 size=1048576 2024-09-19T13:43:05.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.678+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~DYD7Z9VZ6G9E.2 size=98105 2024-09-19T13:43:05.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.680+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=DYD7Z9VZ6G9E tag=UURAUDJQ8EUT type=write size=3243833 2024-09-19T13:43:05.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.682+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~3UJSW084B3IK.0 size=1048576 2024-09-19T13:43:05.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.683+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~3UJSW084B3IK.1 size=1048576 2024-09-19T13:43:05.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.684+0000 7f6ab10d2780 1 > prepared part key=_multipart_CD4XXORKVS6J.2~3UJSW084B3IK.2 size=469080 2024-09-19T13:43:05.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.684+0000 7f6ab10d2780 1 > prepared multipart upload key=CD4XXORKVS6J upload=3UJSW084B3IK tag=H8Z6BK0VTYQ9 type=write size=3614808 2024-09-19T13:43:05.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.685+0000 7f6ab10d2780 1 < completed write operation key=WDRUV5ERI000 tag=3ICQRUFP5MA6 type=write size=701389 2024-09-19T13:43:05.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.686+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=AD5QUTC1D0U0 type=del size=2564058 2024-09-19T13:43:05.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.687+0000 7f6ab10d2780 1 < completed write operation key=P2U09V0G7UUU tag=SM8ZD1MIWHYA type=write size=279303 2024-09-19T13:43:05.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.688+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=0VPN6P3KF6VT type=write size=887104 2024-09-19T13:43:05.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.690+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=D7KAC3KI8TKM type=del 2024-09-19T13:43:05.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.691+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=LE4PI3JXYO8E type=write size=922532 2024-09-19T13:43:05.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.692+0000 7f6ab10d2780 1 < completed delete operation key=7LHSAN5BBQRW tag=14U7MBSNOP1Q type=del 2024-09-19T13:43:05.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.693+0000 7f6ab10d2780 1 > prepared operation key=SERUGCO68R9W tag=FP0VVBSN7JNF type=write size=677896 2024-09-19T13:43:05.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.694+0000 7f6ab10d2780 1 < canceled operation key=RU6OR8SM72GU tag=ZCNKV5PBLPJN type=del size=2850299 2024-09-19T13:43:05.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.696+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=LEHUKOKQNXE1 type=del size=2777681 2024-09-19T13:43:05.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.697+0000 7f6ab10d2780 1 < completed write operation key=UPMXNNYUUJR7 tag=HULDIR366NUZ type=write size=168882 2024-09-19T13:43:05.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.698+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=H1E6MU2GX5JS type=del size=2942444 2024-09-19T13:43:05.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.699+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=O0A5UXRYPFVK type=del 2024-09-19T13:43:05.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.701+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~P1VN1H62ZXW1.0 size=1048576 2024-09-19T13:43:05.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.702+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~P1VN1H62ZXW1.1 size=1048576 2024-09-19T13:43:05.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.703+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~P1VN1H62ZXW1.2 size=313879 2024-09-19T13:43:05.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.703+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=P1VN1H62ZXW1 tag=9YMXO4HW4A4E type=write size=3459607 2024-09-19T13:43:05.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.705+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=J0ZWY4QQ4HU0 type=del 2024-09-19T13:43:05.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.707+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~HO677RL11VFX.0 size=153100 2024-09-19T13:43:05.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.707+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=HO677RL11VFX tag=Q4PS4X2VUK9A type=write size=1201676 2024-09-19T13:43:05.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.708+0000 7f6ab10d2780 1 < completed delete operation key=SERUGCO68R9W tag=R4FGJTE1QHI2 type=del 2024-09-19T13:43:05.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.709+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=DIV6H12QPDO0 type=del size=451904 2024-09-19T13:43:05.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.710+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~ZCLICFXA1JUY.0 size=1048576 2024-09-19T13:43:05.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.712+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~ZCLICFXA1JUY.1 size=731829 2024-09-19T13:43:05.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.714+0000 7f6ab10d2780 1 < completed multipart upload key=CD4XXORKVS6J upload=ZCLICFXA1JUY tag=CE9VRE97WIXG type=write size=2828981 2024-09-19T13:43:05.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.715+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=WGNPLMYU97EJ type=del size=348015 2024-09-19T13:43:05.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.716+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~GSBE87ZXNPEV.0 size=1048576 2024-09-19T13:43:05.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.717+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~GSBE87ZXNPEV.1 size=918243 2024-09-19T13:43:05.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.719+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=GSBE87ZXNPEV tag=2T4S2OEG8Y7D type=write size=3015395 2024-09-19T13:43:05.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.721+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~N9GVFX3PW0BS.0 size=1048576 2024-09-19T13:43:05.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.722+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~N9GVFX3PW0BS.1 size=1048576 2024-09-19T13:43:05.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.723+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~N9GVFX3PW0BS.2 size=634263 2024-09-19T13:43:05.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.723+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=N9GVFX3PW0BS tag=98RL4Y3333B6 type=write size=3779991 2024-09-19T13:43:05.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.724+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~ZH9IE98029LH.0 size=964771 2024-09-19T13:43:05.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.726+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=ZH9IE98029LH tag=M9AXEMVSYUCJ type=write size=2013347 2024-09-19T13:43:05.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.727+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=9CGZELH903DA type=del size=877590 2024-09-19T13:43:05.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.728+0000 7f6ab10d2780 1 < completed delete operation key=SRABG45EPVN2 tag=UTK4D29S5QXK type=del 2024-09-19T13:43:05.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.730+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~16KWFHJZKPOQ.0 size=1048576 2024-09-19T13:43:05.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.731+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~16KWFHJZKPOQ.1 size=1032998 2024-09-19T13:43:05.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.731+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=16KWFHJZKPOQ tag=851YC1FI6WAA type=write size=3130150 2024-09-19T13:43:05.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.732+0000 7f6ab10d2780 1 < completed write operation key=EE8F84K0ZAGJ tag=GLA1CL016LDA type=write size=230977 2024-09-19T13:43:05.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.733+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=WLTAI0U9MS2Q type=del size=708202 2024-09-19T13:43:05.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.734+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~437IL92C0KLW.0 size=1048576 2024-09-19T13:43:05.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.735+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~437IL92C0KLW.1 size=899695 2024-09-19T13:43:05.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.737+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=437IL92C0KLW tag=SJGLN0UZHFD2 type=write size=2996847 2024-09-19T13:43:05.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.740+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~B230FHOQSWCZ.0 size=1001635 2024-09-19T13:43:05.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.740+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=B230FHOQSWCZ tag=8XUCZZV9JJ1G type=write size=2050211 2024-09-19T13:43:05.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.741+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~3UJSW084B3IK.0 size=1048576 2024-09-19T13:43:05.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.742+0000 7f6ab10d2780 1 < completed part key=_multipart_CD4XXORKVS6J.2~3UJSW084B3IK.1 size=1048576 2024-09-19T13:43:05.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.742+0000 7f6ab10d2780 1 < canceled part key=_multipart_CD4XXORKVS6J.2~3UJSW084B3IK.2 size=469080 2024-09-19T13:43:05.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.744+0000 7f6ab10d2780 1 < canceled multipart upload key=CD4XXORKVS6J upload=3UJSW084B3IK tag=H8Z6BK0VTYQ9 type=write size=3614808 2024-09-19T13:43:05.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.745+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=A1EBV2M8PQR4 type=write size=404430 2024-09-19T13:43:05.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.746+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=AD5QUTC1D0U0 type=del 2024-09-19T13:43:05.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.749+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TUY90Z75FKTM.0 size=1048576 2024-09-19T13:43:05.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.749+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TUY90Z75FKTM.1 size=1048576 2024-09-19T13:43:05.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.751+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~TUY90Z75FKTM.2 size=99125 2024-09-19T13:43:05.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.751+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=TUY90Z75FKTM tag=S05CSALCRQWH type=write size=3244853 2024-09-19T13:43:05.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.752+0000 7f6ab10d2780 1 < canceled operation key=SDQ64HOD22EM tag=0VPN6P3KF6VT type=write size=887104 2024-09-19T13:43:05.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.753+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=DFMJAAL31UFK type=del size=188393 2024-09-19T13:43:05.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.754+0000 7f6ab10d2780 1 < completed write operation key=TCXAYADSCTZI tag=LE4PI3JXYO8E type=write size=922532 2024-09-19T13:43:05.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.755+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=Z9FFHC7OUSL6 type=del size=1860701 2024-09-19T13:43:05.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.756+0000 7f6ab10d2780 1 < completed write operation key=SERUGCO68R9W tag=FP0VVBSN7JNF type=write size=677896 2024-09-19T13:43:05.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.758+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=6GY2JOV510ZL type=del size=3158763 2024-09-19T13:43:05.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.759+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=LEHUKOKQNXE1 type=del 2024-09-19T13:43:05.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.760+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=ZOVF0MVOVLV5 type=del size=142692 2024-09-19T13:43:05.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.761+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=H1E6MU2GX5JS type=del 2024-09-19T13:43:05.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.762+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=L06HZTRJ7235 type=del size=137281 2024-09-19T13:43:05.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.763+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~P1VN1H62ZXW1.0 size=1048576 2024-09-19T13:43:05.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.763+0000 7f6ab10d2780 1 < canceled part key=_multipart_VFJIKOLYI0HN.2~P1VN1H62ZXW1.1 size=1048576 2024-09-19T13:43:05.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.764+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~P1VN1H62ZXW1.2 size=313879 2024-09-19T13:43:05.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.765+0000 7f6ab10d2780 1 < canceled multipart upload key=VFJIKOLYI0HN upload=P1VN1H62ZXW1 tag=9YMXO4HW4A4E type=write size=3459607 2024-09-19T13:43:05.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.767+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=TG9NZ8JD6MIC type=del size=3400084 2024-09-19T13:43:05.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.768+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~HO677RL11VFX.0 size=153100 2024-09-19T13:43:05.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.770+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=HO677RL11VFX tag=Q4PS4X2VUK9A type=write size=1201676 2024-09-19T13:43:05.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.771+0000 7f6ab10d2780 1 > prepared operation key=VFJIKOLYI0HN tag=CZ0544FB4KFB type=del size=1169639 2024-09-19T13:43:05.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.772+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=DIV6H12QPDO0 type=del 2024-09-19T13:43:05.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.773+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=3G8ROTN262JG type=del size=923922 2024-09-19T13:43:05.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.774+0000 7f6ab10d2780 1 < canceled operation key=CD4XXORKVS6J tag=WGNPLMYU97EJ type=del size=348015 2024-09-19T13:43:05.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.776+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~BD0ANGCVZTC0.0 size=1048576 2024-09-19T13:43:05.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.777+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~BD0ANGCVZTC0.1 size=829836 2024-09-19T13:43:05.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.777+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=BD0ANGCVZTC0 tag=0QOVBWYS54FE type=write size=2926988 2024-09-19T13:43:05.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.778+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~N9GVFX3PW0BS.0 size=1048576 2024-09-19T13:43:05.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.779+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~N9GVFX3PW0BS.1 size=1048576 2024-09-19T13:43:05.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.780+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~N9GVFX3PW0BS.2 size=634263 2024-09-19T13:43:05.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.782+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=N9GVFX3PW0BS tag=98RL4Y3333B6 type=write size=3779991 2024-09-19T13:43:05.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.784+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~UAXK4VA5EM9L.0 size=1048576 2024-09-19T13:43:05.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.785+0000 7f6ab10d2780 1 > prepared part key=_multipart_9WTLWBONAOET.2~UAXK4VA5EM9L.1 size=248714 2024-09-19T13:43:05.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.785+0000 7f6ab10d2780 1 > prepared multipart upload key=9WTLWBONAOET upload=UAXK4VA5EM9L tag=TJ17VD7D4IHI type=write size=2345866 2024-09-19T13:43:05.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.786+0000 7f6ab10d2780 1 < completed delete operation key=RXXCDV0LTCKS tag=9CGZELH903DA type=del 2024-09-19T13:43:05.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.788+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~LKX1YJE7QUOI.0 size=455312 2024-09-19T13:43:05.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.788+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=LKX1YJE7QUOI tag=5QTE2CF1AJ5W type=write size=1503888 2024-09-19T13:43:05.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.789+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~16KWFHJZKPOQ.0 size=1048576 2024-09-19T13:43:05.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.790+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~16KWFHJZKPOQ.1 size=1032998 2024-09-19T13:43:05.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.792+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=16KWFHJZKPOQ tag=851YC1FI6WAA type=write size=3130150 2024-09-19T13:43:05.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.793+0000 7f6ab10d2780 1 > prepared operation key=RU6OR8SM72GU tag=DNLZ1H0JP474 type=del size=2601445 2024-09-19T13:43:05.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.795+0000 7f6ab10d2780 1 < completed delete operation key=9IN6E0JQFNAU tag=WLTAI0U9MS2Q type=del 2024-09-19T13:43:05.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.796+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=YS3W3SIMV7JJ type=del size=3427651 2024-09-19T13:43:05.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.797+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~B230FHOQSWCZ.0 size=1001635 2024-09-19T13:43:05.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.799+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=B230FHOQSWCZ tag=8XUCZZV9JJ1G type=write size=2050211 2024-09-19T13:43:05.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.800+0000 7f6ab10d2780 1 > prepared operation key=TCXAYADSCTZI tag=PT3GF3CP1XNJ type=write size=259463 2024-09-19T13:43:05.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.801+0000 7f6ab10d2780 1 < completed write operation key=X8CWBFNCJG6M tag=A1EBV2M8PQR4 type=write size=404430 2024-09-19T13:43:05.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.802+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=M49GC64VODA9 type=del size=3971178 2024-09-19T13:43:05.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.803+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TUY90Z75FKTM.0 size=1048576 2024-09-19T13:43:05.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.804+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TUY90Z75FKTM.1 size=1048576 2024-09-19T13:43:05.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.805+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~TUY90Z75FKTM.2 size=99125 2024-09-19T13:43:05.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.807+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=TUY90Z75FKTM tag=S05CSALCRQWH type=write size=3244853 2024-09-19T13:43:05.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.809+0000 7f6ab10d2780 1 > prepared part key=_multipart_4OSJA1879NQO.2~AWWSWS12PQQ1.0 size=409048 2024-09-19T13:43:05.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.809+0000 7f6ab10d2780 1 > prepared multipart upload key=4OSJA1879NQO upload=AWWSWS12PQQ1 tag=EO3JQRW5H0WT type=write size=1457624 2024-09-19T13:43:05.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.811+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=DFMJAAL31UFK type=del 2024-09-19T13:43:05.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.813+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~R3CY0HCZQF6T.0 size=1048576 2024-09-19T13:43:05.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.814+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~R3CY0HCZQF6T.1 size=1048576 2024-09-19T13:43:05.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.815+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~R3CY0HCZQF6T.2 size=563994 2024-09-19T13:43:05.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.815+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=R3CY0HCZQF6T tag=NVEZBB7RG0K1 type=write size=3709722 2024-09-19T13:43:05.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.817+0000 7f6ab10d2780 1 < suggested update operation key=XQLWZA2X91GF tag=Z9FFHC7OUSL6 type=del size=1860701 2024-09-19T13:43:05.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.819+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~27P9DA38E53P.0 size=1048576 2024-09-19T13:43:05.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.820+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~27P9DA38E53P.1 size=1048576 2024-09-19T13:43:05.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.821+0000 7f6ab10d2780 1 > prepared part key=_multipart_TCXAYADSCTZI.2~27P9DA38E53P.2 size=786367 2024-09-19T13:43:05.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.821+0000 7f6ab10d2780 1 > prepared multipart upload key=TCXAYADSCTZI upload=27P9DA38E53P tag=DPEHCT11ATLA type=write size=3932095 2024-09-19T13:43:05.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.823+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=6GY2JOV510ZL type=del 2024-09-19T13:43:05.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.824+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=FFKGRFLHGLX0 type=del size=314020 2024-09-19T13:43:05.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.825+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=ZOVF0MVOVLV5 type=del 2024-09-19T13:43:05.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.827+0000 7f6ab10d2780 1 > prepared operation key=13GXIDWI4J9F tag=4TZ4XYL71SX1 type=del size=762874 2024-09-19T13:43:05.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.828+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=L06HZTRJ7235 type=del 2024-09-19T13:43:05.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.830+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~3XI5MNVACD32.0 size=1048576 2024-09-19T13:43:05.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.831+0000 7f6ab10d2780 1 > prepared part key=_multipart_9MCE8PXHBGNF.2~3XI5MNVACD32.1 size=260021 2024-09-19T13:43:05.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.831+0000 7f6ab10d2780 1 > prepared multipart upload key=9MCE8PXHBGNF upload=3XI5MNVACD32 tag=N9JBQR59810P type=write size=2357173 2024-09-19T13:43:05.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.832+0000 7f6ab10d2780 1 < completed delete operation key=WDRUV5ERI000 tag=TG9NZ8JD6MIC type=del 2024-09-19T13:43:05.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.833+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=YC1QM1EY1D1R type=del size=1549019 2024-09-19T13:43:05.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.835+0000 7f6ab10d2780 1 < completed delete operation key=VFJIKOLYI0HN tag=CZ0544FB4KFB type=del 2024-09-19T13:43:05.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.837+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~M39NLWIDK48A.0 size=1048576 2024-09-19T13:43:05.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.838+0000 7f6ab10d2780 1 > prepared part key=_multipart_V8P17ZSOQUSM.2~M39NLWIDK48A.1 size=533958 2024-09-19T13:43:05.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.838+0000 7f6ab10d2780 1 > prepared multipart upload key=V8P17ZSOQUSM upload=M39NLWIDK48A tag=1NPBXKLO456I type=write size=2631110 2024-09-19T13:43:05.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.839+0000 7f6ab10d2780 1 < completed delete operation key=B0J7E7A0NP4J tag=3G8ROTN262JG type=del 2024-09-19T13:43:05.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.841+0000 7f6ab10d2780 1 > prepared part key=_multipart_DTSRVH526PE7.2~QV44CG23AXM4.0 size=433738 2024-09-19T13:43:05.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.841+0000 7f6ab10d2780 1 > prepared multipart upload key=DTSRVH526PE7 upload=QV44CG23AXM4 tag=4LJWPMCZT0TE type=write size=1482314 2024-09-19T13:43:05.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.842+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~BD0ANGCVZTC0.0 size=1048576 2024-09-19T13:43:05.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.843+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~BD0ANGCVZTC0.1 size=829836 2024-09-19T13:43:05.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.845+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=BD0ANGCVZTC0 tag=0QOVBWYS54FE type=write size=2926988 2024-09-19T13:43:05.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.846+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=29ERAO3KXYMC type=del size=1582271 2024-09-19T13:43:05.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.848+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~UAXK4VA5EM9L.0 size=1048576 2024-09-19T13:43:05.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.849+0000 7f6ab10d2780 1 < completed part key=_multipart_9WTLWBONAOET.2~UAXK4VA5EM9L.1 size=248714 2024-09-19T13:43:05.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.851+0000 7f6ab10d2780 1 < completed multipart upload key=9WTLWBONAOET upload=UAXK4VA5EM9L tag=TJ17VD7D4IHI type=write size=2345866 2024-09-19T13:43:05.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.852+0000 7f6ab10d2780 1 > prepared operation key=9Q9DGUSDSE49 tag=G3KM44MLMNTS type=del size=77138 2024-09-19T13:43:05.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.853+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~LKX1YJE7QUOI.0 size=455312 2024-09-19T13:43:05.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.855+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=LKX1YJE7QUOI tag=5QTE2CF1AJ5W type=write size=1503888 2024-09-19T13:43:05.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.856+0000 7f6ab10d2780 1 > prepared operation key=SDQ64HOD22EM tag=19AJ2A351B0H type=del size=2636571 2024-09-19T13:43:05.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.858+0000 7f6ab10d2780 1 < completed delete operation key=RU6OR8SM72GU tag=DNLZ1H0JP474 type=del 2024-09-19T13:43:05.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.859+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=3IUMS2G79CCV type=del size=1884469 2024-09-19T13:43:05.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.860+0000 7f6ab10d2780 1 < completed delete operation key=13GXIDWI4J9F tag=YS3W3SIMV7JJ type=del 2024-09-19T13:43:05.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.861+0000 7f6ab10d2780 1 > prepared operation key=DTSRVH526PE7 tag=AA63DCA3N765 type=del size=3963743 2024-09-19T13:43:05.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.862+0000 7f6ab10d2780 1 < canceled operation key=TCXAYADSCTZI tag=PT3GF3CP1XNJ type=write size=259463 2024-09-19T13:43:05.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.864+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=TX2LQCWFPFDO type=del size=1933870 2024-09-19T13:43:05.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.865+0000 7f6ab10d2780 1 < canceled operation key=QTGKMAOX2A6U tag=M49GC64VODA9 type=del size=3971178 2024-09-19T13:43:05.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.866+0000 7f6ab10d2780 1 > prepared operation key=4OSJA1879NQO tag=LKOY5QO101AO type=del size=1457636 2024-09-19T13:43:05.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.867+0000 7f6ab10d2780 1 < completed part key=_multipart_4OSJA1879NQO.2~AWWSWS12PQQ1.0 size=409048 2024-09-19T13:43:05.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.869+0000 7f6ab10d2780 1 < completed multipart upload key=4OSJA1879NQO upload=AWWSWS12PQQ1 tag=EO3JQRW5H0WT type=write size=1457624 2024-09-19T13:43:05.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.871+0000 7f6ab10d2780 1 > prepared part key=_multipart_UPMXNNYUUJR7.2~0ZHFVZ568BT4.0 size=414560 2024-09-19T13:43:05.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.871+0000 7f6ab10d2780 1 > prepared multipart upload key=UPMXNNYUUJR7 upload=0ZHFVZ568BT4 tag=IA9BW8TXLBAR type=write size=1463136 2024-09-19T13:43:05.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.872+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~R3CY0HCZQF6T.0 size=1048576 2024-09-19T13:43:05.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.873+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~R3CY0HCZQF6T.1 size=1048576 2024-09-19T13:43:05.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.873+0000 7f6ab10d2780 1 < canceled part key=_multipart_TCXAYADSCTZI.2~R3CY0HCZQF6T.2 size=563994 2024-09-19T13:43:05.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.874+0000 7f6ab10d2780 1 < canceled multipart upload key=TCXAYADSCTZI upload=R3CY0HCZQF6T tag=NVEZBB7RG0K1 type=write size=3709722 2024-09-19T13:43:05.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.875+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=6PHDKY6RUTH6 type=del size=2268693 2024-09-19T13:43:05.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.877+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~27P9DA38E53P.0 size=1048576 2024-09-19T13:43:05.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.878+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~27P9DA38E53P.1 size=1048576 2024-09-19T13:43:05.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.878+0000 7f6ab10d2780 1 < completed part key=_multipart_TCXAYADSCTZI.2~27P9DA38E53P.2 size=786367 2024-09-19T13:43:05.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.880+0000 7f6ab10d2780 1 < completed multipart upload key=TCXAYADSCTZI upload=27P9DA38E53P tag=DPEHCT11ATLA type=write size=3932095 2024-09-19T13:43:05.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.881+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=15R0H5HQW57A type=del size=1855525 2024-09-19T13:43:05.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.882+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=FFKGRFLHGLX0 type=del 2024-09-19T13:43:05.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.884+0000 7f6ab10d2780 1 > prepared part key=_multipart_SERUGCO68R9W.2~5MWRWSWATJLL.0 size=2631 2024-09-19T13:43:05.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.884+0000 7f6ab10d2780 1 > prepared multipart upload key=SERUGCO68R9W upload=5MWRWSWATJLL tag=YTGVMSNCJUVE type=write size=1051207 2024-09-19T13:43:05.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.885+0000 7f6ab10d2780 1 < canceled operation key=13GXIDWI4J9F tag=4TZ4XYL71SX1 type=del size=762874 2024-09-19T13:43:05.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.886+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=0ZWVZLOEX57W type=del size=3347750 2024-09-19T13:43:05.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.888+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~3XI5MNVACD32.0 size=1048576 2024-09-19T13:43:05.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.888+0000 7f6ab10d2780 1 < completed part key=_multipart_9MCE8PXHBGNF.2~3XI5MNVACD32.1 size=260021 2024-09-19T13:43:05.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.890+0000 7f6ab10d2780 1 < completed multipart upload key=9MCE8PXHBGNF upload=3XI5MNVACD32 tag=N9JBQR59810P type=write size=2357173 2024-09-19T13:43:05.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.891+0000 7f6ab10d2780 1 > prepared operation key=V8P17ZSOQUSM tag=QGTVI471D6B7 type=del size=1636251 2024-09-19T13:43:05.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.892+0000 7f6ab10d2780 1 < completed delete operation key=9Q9DGUSDSE49 tag=YC1QM1EY1D1R type=del 2024-09-19T13:43:05.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.894+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~A7QE3XJ64A8J.0 size=790617 2024-09-19T13:43:05.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.894+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=A7QE3XJ64A8J tag=9HWF1172VFBL type=write size=1839193 2024-09-19T13:43:05.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.896+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~M39NLWIDK48A.0 size=1048576 2024-09-19T13:43:05.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.896+0000 7f6ab10d2780 1 < completed part key=_multipart_V8P17ZSOQUSM.2~M39NLWIDK48A.1 size=533958 2024-09-19T13:43:05.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.898+0000 7f6ab10d2780 1 < completed multipart upload key=V8P17ZSOQUSM upload=M39NLWIDK48A tag=1NPBXKLO456I type=write size=2631110 2024-09-19T13:43:05.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.900+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~CS24E9600L2W.0 size=1048576 2024-09-19T13:43:05.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.901+0000 7f6ab10d2780 1 > prepared part key=_multipart_UX2ICIT36Q3R.2~CS24E9600L2W.1 size=865197 2024-09-19T13:43:05.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.901+0000 7f6ab10d2780 1 > prepared multipart upload key=UX2ICIT36Q3R upload=CS24E9600L2W tag=3B8HZQLMSGZZ type=write size=2962349 2024-09-19T13:43:05.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.902+0000 7f6ab10d2780 1 < completed part key=_multipart_DTSRVH526PE7.2~QV44CG23AXM4.0 size=433738 2024-09-19T13:43:05.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.904+0000 7f6ab10d2780 1 < completed multipart upload key=DTSRVH526PE7 upload=QV44CG23AXM4 tag=4LJWPMCZT0TE type=write size=1482314 2024-09-19T13:43:05.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.905+0000 7f6ab10d2780 1 > prepared operation key=9MCE8PXHBGNF tag=QWVX12VFDJV5 type=del size=3195300 2024-09-19T13:43:05.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.906+0000 7f6ab10d2780 1 < completed delete operation key=9MCE8PXHBGNF tag=29ERAO3KXYMC type=del 2024-09-19T13:43:05.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.907+0000 7f6ab10d2780 1 > prepared operation key=9WTLWBONAOET tag=ZTR8AYD5KVJG type=del size=2397943 2024-09-19T13:43:05.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.908+0000 7f6ab10d2780 1 < canceled operation key=9Q9DGUSDSE49 tag=G3KM44MLMNTS type=del size=77138 2024-09-19T13:43:05.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.910+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~LSFJPLROJ6YB.0 size=1048576 2024-09-19T13:43:05.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.911+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~LSFJPLROJ6YB.1 size=1048576 2024-09-19T13:43:05.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.912+0000 7f6ab10d2780 1 > prepared part key=_multipart_SRABG45EPVN2.2~LSFJPLROJ6YB.2 size=824702 2024-09-19T13:43:05.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.912+0000 7f6ab10d2780 1 > prepared multipart upload key=SRABG45EPVN2 upload=LSFJPLROJ6YB tag=TPQPRMWTOCKU type=write size=3970430 2024-09-19T13:43:05.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.913+0000 7f6ab10d2780 1 < completed delete operation key=SDQ64HOD22EM tag=19AJ2A351B0H type=del 2024-09-19T13:43:05.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.914+0000 7f6ab10d2780 1 > prepared operation key=CD4XXORKVS6J tag=GA50L50T5TPL type=del size=1955099 2024-09-19T13:43:05.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.915+0000 7f6ab10d2780 1 < completed delete operation key=UX2ICIT36Q3R tag=3IUMS2G79CCV type=del 2024-09-19T13:43:05.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.918+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~5ZJT90H6QJH9.0 size=1048576 2024-09-19T13:43:05.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.919+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~5ZJT90H6QJH9.1 size=87195 2024-09-19T13:43:05.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.919+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=5ZJT90H6QJH9 tag=BVLCINLA6CMV type=write size=2184347 2024-09-19T13:43:05.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.920+0000 7f6ab10d2780 1 < completed delete operation key=DTSRVH526PE7 tag=AA63DCA3N765 type=del 2024-09-19T13:43:05.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.922+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~400ZX78LWEQY.0 size=661375 2024-09-19T13:43:05.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.922+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=400ZX78LWEQY tag=9G576PJGI97G type=write size=1709951 2024-09-19T13:43:05.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.923+0000 7f6ab10d2780 1 < completed delete operation key=535R757HSXMB tag=TX2LQCWFPFDO type=del 2024-09-19T13:43:05.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.925+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~MN2DU2H33CSM.0 size=1048576 2024-09-19T13:43:05.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.926+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~MN2DU2H33CSM.1 size=1048576 2024-09-19T13:43:05.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.927+0000 7f6ab10d2780 1 > prepared part key=_multipart_X8CWBFNCJG6M.2~MN2DU2H33CSM.2 size=970680 2024-09-19T13:43:05.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.927+0000 7f6ab10d2780 1 > prepared multipart upload key=X8CWBFNCJG6M upload=MN2DU2H33CSM tag=2LTR5UYFF86Q type=write size=4116408 2024-09-19T13:43:05.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.928+0000 7f6ab10d2780 1 < completed delete operation key=4OSJA1879NQO tag=LKOY5QO101AO type=del 2024-09-19T13:43:05.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.930+0000 7f6ab10d2780 1 > prepared operation key=X8CWBFNCJG6M tag=OTAIQMM5N800 type=del size=637183 2024-09-19T13:43:05.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.931+0000 7f6ab10d2780 1 < completed part key=_multipart_UPMXNNYUUJR7.2~0ZHFVZ568BT4.0 size=414560 2024-09-19T13:43:05.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.933+0000 7f6ab10d2780 1 < completed multipart upload key=UPMXNNYUUJR7 upload=0ZHFVZ568BT4 tag=IA9BW8TXLBAR type=write size=1463136 2024-09-19T13:43:05.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.935+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~MW5F1HMPG1G5.0 size=1048576 2024-09-19T13:43:05.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.936+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~MW5F1HMPG1G5.1 size=1048576 2024-09-19T13:43:05.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.937+0000 7f6ab10d2780 1 > prepared part key=_multipart_535R757HSXMB.2~MW5F1HMPG1G5.2 size=457103 2024-09-19T13:43:05.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.937+0000 7f6ab10d2780 1 > prepared multipart upload key=535R757HSXMB upload=MW5F1HMPG1G5 tag=WMRS19N50PSP type=write size=3602831 2024-09-19T13:43:05.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.938+0000 7f6ab10d2780 1 < completed delete operation key=V8P17ZSOQUSM tag=6PHDKY6RUTH6 type=del 2024-09-19T13:43:05.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.939+0000 7f6ab10d2780 1 > prepared operation key=9IN6E0JQFNAU tag=GADEI02P0WJU type=write size=683171 2024-09-19T13:43:05.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.941+0000 7f6ab10d2780 1 < suggested update operation key=PUXLW9NBBQJX tag=15R0H5HQW57A type=del size=1855525 2024-09-19T13:43:05.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.942+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=X00VIW74BPBT type=del size=71140 2024-09-19T13:43:05.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.943+0000 7f6ab10d2780 1 < completed part key=_multipart_SERUGCO68R9W.2~5MWRWSWATJLL.0 size=2631 2024-09-19T13:43:05.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.945+0000 7f6ab10d2780 1 < completed multipart upload key=SERUGCO68R9W upload=5MWRWSWATJLL tag=YTGVMSNCJUVE type=write size=1051207 2024-09-19T13:43:05.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.947+0000 7f6ab10d2780 1 > prepared part key=_multipart_VFJIKOLYI0HN.2~FA5MKFCDCDD9.0 size=985320 2024-09-19T13:43:05.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.947+0000 7f6ab10d2780 1 > prepared multipart upload key=VFJIKOLYI0HN upload=FA5MKFCDCDD9 tag=JZF6CGYGEH7W type=write size=2033896 2024-09-19T13:43:05.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.949+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=0ZWVZLOEX57W type=del size=3347750 2024-09-19T13:43:05.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.950+0000 7f6ab10d2780 1 > prepared operation key=WDRUV5ERI000 tag=0XM5FEPIQ7YD type=write size=1014217 2024-09-19T13:43:05.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.953+0000 7f6ab10d2780 1 < suggested update operation key=V8P17ZSOQUSM tag=QGTVI471D6B7 type=del size=1636251 2024-09-19T13:43:05.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.955+0000 7f6ab10d2780 1 > prepared part key=_multipart_9IN6E0JQFNAU.2~V28JZ8O1QGZO.0 size=545890 2024-09-19T13:43:05.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.955+0000 7f6ab10d2780 1 > prepared multipart upload key=9IN6E0JQFNAU upload=V28JZ8O1QGZO tag=31BSWW7FJT7K type=write size=1594466 2024-09-19T13:43:05.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.956+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~A7QE3XJ64A8J.0 size=790617 2024-09-19T13:43:05.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.958+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=A7QE3XJ64A8J tag=9HWF1172VFBL type=write size=1839193 2024-09-19T13:43:05.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.959+0000 7f6ab10d2780 1 > prepared operation key=B0J7E7A0NP4J tag=HLW30HAE73UH type=del size=4146530 2024-09-19T13:43:05.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.960+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~CS24E9600L2W.0 size=1048576 2024-09-19T13:43:05.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.961+0000 7f6ab10d2780 1 < completed part key=_multipart_UX2ICIT36Q3R.2~CS24E9600L2W.1 size=865197 2024-09-19T13:43:05.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.962+0000 7f6ab10d2780 1 < completed multipart upload key=UX2ICIT36Q3R upload=CS24E9600L2W tag=3B8HZQLMSGZZ type=write size=2962349 2024-09-19T13:43:05.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.964+0000 7f6ab10d2780 1 > prepared part key=_multipart_X1JYDG1ASYAR.2~JU49MNZOXFAB.0 size=954814 2024-09-19T13:43:05.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.964+0000 7f6ab10d2780 1 > prepared multipart upload key=X1JYDG1ASYAR upload=JU49MNZOXFAB tag=F8H1NY2DCGVI type=write size=2003390 2024-09-19T13:43:05.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.966+0000 7f6ab10d2780 1 < suggested update operation key=9MCE8PXHBGNF tag=QWVX12VFDJV5 type=del size=3195300 2024-09-19T13:43:05.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.968+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~F7Q5B3GJQQGM.0 size=1048576 2024-09-19T13:43:05.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.969+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~F7Q5B3GJQQGM.1 size=1048576 2024-09-19T13:43:05.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.970+0000 7f6ab10d2780 1 > prepared part key=_multipart_RXXCDV0LTCKS.2~F7Q5B3GJQQGM.2 size=572106 2024-09-19T13:43:05.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.970+0000 7f6ab10d2780 1 > prepared multipart upload key=RXXCDV0LTCKS upload=F7Q5B3GJQQGM tag=58AR2BFLO0WS type=write size=3717834 2024-09-19T13:43:05.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.971+0000 7f6ab10d2780 1 < completed delete operation key=9WTLWBONAOET tag=ZTR8AYD5KVJG type=del 2024-09-19T13:43:05.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.972+0000 7f6ab10d2780 1 > prepared operation key=535R757HSXMB tag=K94SVURBTH11 type=del size=2101470 2024-09-19T13:43:05.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.973+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~LSFJPLROJ6YB.0 size=1048576 2024-09-19T13:43:05.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.974+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~LSFJPLROJ6YB.1 size=1048576 2024-09-19T13:43:05.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.975+0000 7f6ab10d2780 1 < completed part key=_multipart_SRABG45EPVN2.2~LSFJPLROJ6YB.2 size=824702 2024-09-19T13:43:05.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.976+0000 7f6ab10d2780 1 < completed multipart upload key=SRABG45EPVN2 upload=LSFJPLROJ6YB tag=TPQPRMWTOCKU type=write size=3970430 2024-09-19T13:43:05.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.978+0000 7f6ab10d2780 1 > prepared operation key=UX2ICIT36Q3R tag=AK8UGDKSG69C type=write size=728808 2024-09-19T13:43:05.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.979+0000 7f6ab10d2780 1 < completed delete operation key=CD4XXORKVS6J tag=GA50L50T5TPL type=del 2024-09-19T13:43:05.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.980+0000 7f6ab10d2780 1 > prepared operation key=P2U09V0G7UUU tag=RJT4AGT06KJ5 type=del size=1283180 2024-09-19T13:43:05.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.981+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~5ZJT90H6QJH9.0 size=1048576 2024-09-19T13:43:05.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.982+0000 7f6ab10d2780 1 < completed part key=_multipart_VFJIKOLYI0HN.2~5ZJT90H6QJH9.1 size=87195 2024-09-19T13:43:05.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.983+0000 7f6ab10d2780 1 < completed multipart upload key=VFJIKOLYI0HN upload=5ZJT90H6QJH9 tag=BVLCINLA6CMV type=write size=2184347 2024-09-19T13:43:05.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.984+0000 7f6ab10d2780 1 > prepared operation key=X1JYDG1ASYAR tag=C6V6UHQGJHCF type=write size=365052 2024-09-19T13:43:05.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.985+0000 7f6ab10d2780 1 < completed part key=_multipart_9IN6E0JQFNAU.2~400ZX78LWEQY.0 size=661375 2024-09-19T13:43:05.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.987+0000 7f6ab10d2780 1 < completed multipart upload key=9IN6E0JQFNAU upload=400ZX78LWEQY tag=9G576PJGI97G type=write size=1709951 2024-09-19T13:43:05.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.988+0000 7f6ab10d2780 1 > prepared operation key=QTGKMAOX2A6U tag=EF6VZBBLGHH5 type=del size=1570257 2024-09-19T13:43:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.989+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~MN2DU2H33CSM.0 size=1048576 2024-09-19T13:43:05.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.990+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~MN2DU2H33CSM.1 size=1048576 2024-09-19T13:43:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.991+0000 7f6ab10d2780 1 < completed part key=_multipart_X8CWBFNCJG6M.2~MN2DU2H33CSM.2 size=970680 2024-09-19T13:43:05.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.993+0000 7f6ab10d2780 1 < completed multipart upload key=X8CWBFNCJG6M upload=MN2DU2H33CSM tag=2LTR5UYFF86Q type=write size=4116408 2024-09-19T13:43:05.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.994+0000 7f6ab10d2780 1 > prepared operation key=PUXLW9NBBQJX tag=8BBKN4E0UZ5J type=del size=1283009 2024-09-19T13:43:05.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.996+0000 7f6ab10d2780 1 < suggested update operation key=X8CWBFNCJG6M tag=OTAIQMM5N800 type=del size=637183 2024-09-19T13:43:05.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.997+0000 7f6ab10d2780 1 > prepared operation key=RXXCDV0LTCKS tag=X8OR8UOMGCNB type=write size=478892 2024-09-19T13:43:06.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.998+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~MW5F1HMPG1G5.0 size=1048576 2024-09-19T13:43:06.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:05.999+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~MW5F1HMPG1G5.1 size=1048576 2024-09-19T13:43:06.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.000+0000 7f6ab10d2780 1 < completed part key=_multipart_535R757HSXMB.2~MW5F1HMPG1G5.2 size=457103 2024-09-19T13:43:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.001+0000 7f6ab10d2780 1 < completed multipart upload key=535R757HSXMB upload=MW5F1HMPG1G5 tag=WMRS19N50PSP type=write size=3602831 2024-09-19T13:43:06.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.002+0000 7f6ab10d2780 1 > prepared operation key=XQLWZA2X91GF tag=M0ZPHKZE64NE type=del size=3287092 2024-09-19T13:43:06.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.003+0000 7f6ab10d2780 1 < completed write operation key=9IN6E0JQFNAU tag=GADEI02P0WJU type=write size=683171 2024-09-19T13:43:06.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.005+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~S7BYZCQP7G3G.0 size=1048576 2024-09-19T13:43:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.006+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~S7BYZCQP7G3G.1 size=1048576 2024-09-19T13:43:06.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.007+0000 7f6ab10d2780 1 > prepared part key=_multipart_WDRUV5ERI000.2~S7BYZCQP7G3G.2 size=502955 2024-09-19T13:43:06.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.007+0000 7f6ab10d2780 1 > prepared multipart upload key=WDRUV5ERI000 upload=S7BYZCQP7G3G tag=X9A8UJQKDQ0I type=write size=3648683 2024-09-19T13:43:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.008+0000 7f6ab10d2780 1 < canceled operation key=RXXCDV0LTCKS tag=X00VIW74BPBT type=del size=71140 2024-09-19T13:43:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.010+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~BWCOMTV1VXGG.0 size=1048576 2024-09-19T13:43:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.011+0000 7f6ab10d2780 1 > prepared part key=_multipart_9Q9DGUSDSE49.2~BWCOMTV1VXGG.1 size=122780 2024-09-19T13:43:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:43:06.011+0000 7f6ab10d2780 1 > prepared multipart upload key=9Q9DGUSDSE49 upload=BWCOMTV1VXGG tag=B3ZQP9SRVIZV type=write size=2219932 2024-09-19T13:43:06.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] cls_rgw_stats.simulate (8393 ms) 2024-09-19T13:43:06.013 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 1 test from cls_rgw_stats (8393 ms total) 2024-09-19T13:43:06.013 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:43:06.013 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:43:06.635 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 1 test from 1 test suite ran. (10884 ms total) 2024-09-19T13:43:06.635 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 1 test. 2024-09-19T13:43:06.638 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:43:06.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:43:06.718 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-19T13:43:06.719 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-19T13:43:06.719 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-19T13:43:06.803 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:43:06.803 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-19T13:43:06.804 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:43:08.646 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 31 tests from CmpOmap 2024-09-19T13:43:08.646 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-19T13:43:08.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (15 ms) 2024-09-19T13:43:08.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-19T13:43:08.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-09-19T13:43:08.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-19T13:43:08.672 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-19T13:43:08.672 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-19T13:43:08.675 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-19T13:43:08.675 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-19T13:43:08.681 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-19T13:43:08.681 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-19T13:43:08.686 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2024-09-19T13:43:08.686 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-19T13:43:08.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-19T13:43:08.689 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-19T13:43:08.693 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-19T13:43:08.693 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-19T13:43:08.697 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-19T13:43:08.697 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-19T13:43:08.702 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-19T13:43:08.702 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-19T13:43:08.702 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-19T13:43:08.702 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-19T13:43:08.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-19T13:43:08.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-19T13:43:08.710 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-19T13:43:08.710 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-19T13:43:08.716 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-19T13:43:08.716 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-19T13:43:08.723 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-19T13:43:08.723 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-19T13:43:08.729 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-19T13:43:08.729 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-19T13:43:08.736 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-19T13:43:08.736 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-19T13:43:08.744 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (7 ms) 2024-09-19T13:43:08.744 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-19T13:43:08.747 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-19T13:43:08.747 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-19T13:43:08.749 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-19T13:43:08.749 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-19T13:43:08.750 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (0 ms) 2024-09-19T13:43:08.750 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-19T13:43:08.751 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-19T13:43:08.751 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-19T13:43:08.757 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-19T13:43:08.757 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-19T13:43:08.763 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (5 ms) 2024-09-19T13:43:08.763 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-19T13:43:08.770 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-19T13:43:08.770 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-19T13:43:08.778 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-09-19T13:43:08.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-19T13:43:08.780 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-19T13:43:08.780 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-19T13:43:08.783 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-09-19T13:43:08.783 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-19T13:43:08.784 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-19T13:43:08.784 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-19T13:43:08.784 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-19T13:43:08.784 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-19T13:43:08.790 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (6 ms) 2024-09-19T13:43:08.791 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 31 tests from CmpOmap (145 ms total) 2024-09-19T13:43:08.791 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:43:08.791 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:43:09.662 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 31 tests from 1 test suite ran. (2858 ms total) 2024-09-19T13:43:09.662 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 31 tests. 2024-09-19T13:43:09.664 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:43:09.664 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:43:09.707 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-19T13:43:09.708 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-19T13:43:09.708 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-19T13:43:09.793 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:43:09.793 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:43:09.794 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:43:09.794 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-19T13:43:09.794 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-19T13:43:12.677 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2879 ms) 2024-09-19T13:43:12.677 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-19T13:43:15.704 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3031 ms) 2024-09-19T13:43:15.704 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-19T13:43:18.724 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Reserve (3020 ms) 2024-09-19T13:43:18.724 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-19T13:43:21.742 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3018 ms) 2024-09-19T13:43:21.742 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-19T13:43:24.759 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Commit (3017 ms) 2024-09-19T13:43:24.759 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-19T13:43:27.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Stats (3020 ms) 2024-09-19T13:43:27.779 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-19T13:43:31.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4020 ms) 2024-09-19T13:43:31.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-19T13:43:34.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Abort (3023 ms) 2024-09-19T13:43:34.822 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-19T13:43:37.842 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveError (3020 ms) 2024-09-19T13:43:37.842 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-19T13:43:40.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.CommitError (3018 ms) 2024-09-19T13:43:40.860 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-19T13:43:43.892 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AbortError (3032 ms) 2024-09-19T13:43:43.892 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-19T13:43:46.902 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3010 ms) 2024-09-19T13:43:46.902 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-19T13:43:49.930 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3028 ms) 2024-09-19T13:43:49.930 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-19T13:43:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3019 ms) 2024-09-19T13:43:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-19T13:43:55.967 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3018 ms) 2024-09-19T13:43:55.967 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-19T13:43:58.981 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3014 ms) 2024-09-19T13:43:58.981 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-19T13:44:01.997 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3016 ms) 2024-09-19T13:44:01.998 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-19T13:44:05.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.Cleanup (3019 ms) 2024-09-19T13:44:05.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-19T13:44:15.102 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10086 ms) 2024-09-19T13:44:15.102 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-19T13:44:18.110 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3008 ms) 2024-09-19T13:44:18.110 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-19T13:44:31.407 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13298 ms) 2024-09-19T13:44:31.408 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-19T13:44:35.429 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4022 ms) 2024-09-19T13:44:35.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-19T13:44:41.510 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6080 ms) 2024-09-19T13:44:41.510 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-19T13:44:46.540 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5030 ms) 2024-09-19T13:44:46.540 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from TestCls2PCQueue (96746 ms total) 2024-09-19T13:44:46.540 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:44:46.540 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:44:46.540 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (96746 ms total) 2024-09-19T13:44:46.540 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-19T13:44:46.543 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:44:46.543 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:44:46.587 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-19T13:44:46.588 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-19T13:44:46.588 DEBUG:teuthology.orchestra.run.smithi094:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-19T13:44:46.683 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:44:46.683 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:44:46.684 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T13:44:46.684 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:44:48.549 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from ClsAccount 2024-09-19T13:44:48.549 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.add 2024-09-19T13:44:48.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.add (20 ms) 2024-09-19T13:44:48.569 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.get 2024-09-19T13:44:48.573 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-19T13:44:48.574 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.rm 2024-09-19T13:44:49.333 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.rm (759 ms) 2024-09-19T13:44:49.333 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] ClsAccount.list 2024-09-19T13:44:49.353 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] ClsAccount.list (21 ms) 2024-09-19T13:44:49.354 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from ClsAccount (805 ms total) 2024-09-19T13:44:49.354 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:44:49.354 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:44:49.556 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (2873 ms total) 2024-09-19T13:44:49.556 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-19T13:44:49.561 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:44:49.561 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:44:49.603 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-19T13:44:49.604 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-19T13:44:49.604 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-19T13:44:49.696 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:44:49.696 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:44:49.697 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-19T13:44:49.697 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:44:51.565 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 6 tests from rgw_gc_log 2024-09-19T13:44:51.565 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-19T13:44:51.580 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.init_existing_queue (15 ms) 2024-09-19T13:44:51.580 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-19T13:44:51.583 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-19T13:44:51.583 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-19T13:44:51.586 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-19T13:44:51.587 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-19T13:44:51.588 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-19T13:44:51.588 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-19T13:44:51.590 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-09-19T13:44:51.591 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-19T13:44:51.592 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-09-19T13:44:51.592 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 6 tests from rgw_gc_log (27 ms total) 2024-09-19T13:44:51.592 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:44:51.592 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:44:52.573 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 6 tests from 1 test suite ran. (2876 ms total) 2024-09-19T13:44:52.573 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 6 tests. 2024-09-19T13:44:52.576 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:44:52.576 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:44:52.620 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-19T13:44:52.622 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-19T13:44:52.622 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:Running main() from gmock_main.cc 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from TestRGWObj 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.underscore 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.721 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i= 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.722 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.723 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.724 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.725 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.726 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.727 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i= 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.728 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.729 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.730 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.731 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.732 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.733 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns= i=v1 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.734 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.735 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.736 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.737 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.738 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.739 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.740 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.741 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.742 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: _obj[v1] 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: _obj ns=ns i=v1 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.743 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.744 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.745 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.746 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.747 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.748 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_obj", 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-19T13:44:52.749 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i= 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.750 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.751 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.752 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.753 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.754 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.755 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i= 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.756 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.757 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.758 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.759 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.760 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.761 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-19T13:44:52.762 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns= i=v1 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.763 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.764 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.765 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.766 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.767 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.768 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:parsed: obj[v1] 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:stripped: obj ns=ns i=v1 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout: "obj1": { 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.769 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.770 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "obj2": { 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.771 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3": { 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.772 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "obj3-2": { 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.773 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "obj", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "v1", 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.774 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.775 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.776 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.777 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.777 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.777 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.777 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.777 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.777 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.778 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.779 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.780 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.780 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.780 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.780 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.781 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.781 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.781 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.781 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.781 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.781 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.782 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.783 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.784 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.785 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.786 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.787 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.788 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.789 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.790 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.791 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.791 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.791 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.791 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.791 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.791 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.792 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.792 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.792 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.792 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.792 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.793 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.794 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.795 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:44:52.796 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.797 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.798 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.799 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.800 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.801 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.802 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.803 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.804 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.805 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.806 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.807 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.808 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.809 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.810 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.811 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.812 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.813 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.814 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.815 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.816 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.817 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.818 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.819 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.820 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.821 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.822 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.823 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.824 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-19T13:44:52.825 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.826 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.827 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.828 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.829 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.830 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.831 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.832 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.833 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.834 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.835 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.836 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.837 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.838 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.839 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.840 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.841 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.842 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.843 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.843 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.843 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.843 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.843 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.843 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.844 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.845 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.846 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.847 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.848 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.849 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.850 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.851 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.852 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.853 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.854 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.855 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.856 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.857 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.858 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.859 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.860 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.860 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.860 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.860 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.860 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.860 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.861 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-19T13:44:52.862 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.863 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.863 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.863 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.863 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.863 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.864 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.864 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.864 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.864 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.864 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.864 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.865 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.865 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.865 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.865 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.865 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.865 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.866 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.867 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.868 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.869 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.870 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.871 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.872 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.873 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.874 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.875 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.876 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.877 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.878 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.879 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.880 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.881 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.882 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.883 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.884 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.885 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.886 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.887 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": "default-placement.data", 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.888 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "test", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": "", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": "" 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.889 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.890 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "obj": { 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.891 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.892 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.893 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.894 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.895 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.895 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.895 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.896 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.896 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.896 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.896 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.896 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-19T13:44:52.897 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-19T13:44:52.897 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.897 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.897 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.897 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-19T13:44:52.897 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.898 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.899 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.899 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.899 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.899 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.899 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker_myobj 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.900 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker_myobj", 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.901 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker_myobj 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.902 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.903 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.904 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns_myobj 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.905 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.906 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.907 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.908 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.909 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.910 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.911 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.912 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:44:52.913 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.914 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "myobj", 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-19T13:44:52.915 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.916 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker___myobj 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj", 2024-09-19T13:44:52.917 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.918 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.919 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker___myobj 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.920 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.921 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns__myobj 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.922 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.923 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.924 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.925 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.926 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj" 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.927 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-19T13:44:52.928 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.929 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.930 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.931 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.932 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.933 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.934 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker___myobj_ 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker___myobj_", 2024-09-19T13:44:52.935 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.936 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker___myobj_ 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.937 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.938 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.939 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.940 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "", 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.941 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.942 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:44:52.943 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "marker__myobj_" 2024-09-19T13:44:52.944 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.944 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.944 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.944 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.944 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.944 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.945 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "" 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj": { 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj": { 2024-09-19T13:44:52.946 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.947 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: "raw_obj2": { 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: "pool": ".data-pool", 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: "loc": "" 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: "new_obj2": { 2024-09-19T13:44:52.948 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket": { 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "ebtest", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "marker": "marker", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_id": "bucket-id", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "tenant": "", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "explicit_placement": { 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "data_pool": ".data-pool", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "data_extra_pool": "", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "index_pool": ".index-pool" 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "key": { 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "name": "_myobj_", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "instance": "inst", 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: "ns": "ns" 2024-09-19T13:44:52.949 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-19T13:44:52.950 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 4 tests. 2024-09-19T13:44:52.950 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:44:52.950 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:44:52.991 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-19T13:44:52.992 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-19T13:44:52.992 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-19T13:44:53.555 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:44:53.555 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:44:53.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.604+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.605+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.605+0000 7f0b45f26800 20 realm 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.605+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.606+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.606+0000 7f0b45f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.606+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.606+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.606+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.607+0000 7f0b45f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:44:53.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.607+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.607+0000 7f0b45f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:44:53.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.607+0000 7f0b45f26800 20 searching for the correct realm 2024-09-19T13:44:53.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.612+0000 7f0b41c4b640 0 -- 172.21.15.94:0/3338401031 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f0b3c035040 msgr2=0x7f0b3c036940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:44:53.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.818+0000 7f0b4244c640 0 -- 172.21.15.94:0/3338401031 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f0b2c0ba820 msgr2=0x7f0b2c0aa0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:44:53.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.825+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:44:53.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 zone default found 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 4 Realm: () 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 zonegroup default 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.826+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 started sync module instance, tier type = 2024-09-19T13:44:53.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.827+0000 7f0b45f26800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=0 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=1 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=2 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=3 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=4 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=5 2024-09-19T13:44:53.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.837+0000 7f0b45f26800 20 add_watcher() i=6 2024-09-19T13:44:53.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.838+0000 7f0b45f26800 20 add_watcher() i=7 2024-09-19T13:44:53.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.838+0000 7f0b45f26800 2 all 8 watchers are set, enabling cache 2024-09-19T13:44:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.840+0000 7f09ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:44:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.840+0000 7f0b45f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:44:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.840+0000 7f0b45f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:44:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.840+0000 7f0b45f26800 5 note: GC not initialized 2024-09-19T13:44:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.841+0000 7f09ee7fc640 20 reqs_thread_entry: start 2024-09-19T13:44:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.841+0000 7f0b45f26800 20 init_complete bucket index max shards: 11 2024-09-19T13:44:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.841+0000 7f0b45f26800 20 Filter name: none 2024-09-19T13:44:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.841+0000 7f095ffff640 20 reqs_thread_entry: start 2024-09-19T13:44:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.841+0000 7f0b45f26800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-19T13:44:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.841+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.842+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.842+0000 7f0b45f26800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-19T13:44:53.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.842+0000 7f0b45f26800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T13:44:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.842+0000 7f0b45f26800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-19T13:44:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.842+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 cache get: name=default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= : miss 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 20 rados->read ofs=0 len=0 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 cache put: name=default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= info.flags=0x0 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 adding default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= to cache LRU end 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 cache get: name=default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= : hit (negative entry) 2024-09-19T13:44:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.843+0000 7f0b45f26800 10 cache get: name=default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= : hit (negative entry) 2024-09-19T13:44:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.845+0000 7f0b45f26800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-19T13:44:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.845+0000 7f0b45f26800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T13:44:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.845+0000 7f0b45f26800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-19T13:44:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.845+0000 7f0a257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954818 cookie 94883441118176 notifier 5321 bl.length()=697 2024-09-19T13:44:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.845+0000 7f0a257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-19T13:44:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.845+0000 7f0a257fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T13:44:53.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.847+0000 7f0b45f26800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-19T13:44:53.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.847+0000 7f0b45f26800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T13:44:53.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.847+0000 7f0b45f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-19T13:44:53.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.847+0000 7f0a257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954819 cookie 94883441114768 notifier 5321 bl.length()=194 2024-09-19T13:44:53.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.847+0000 7f0a257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-19T13:44:53.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.847+0000 7f0a257fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T13:44:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.849+0000 7f0b45f26800 10 cache put: name=default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= info.flags=0x7 2024-09-19T13:44:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.849+0000 7f0b45f26800 10 moving default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= to cache LRU end 2024-09-19T13:44:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.849+0000 7f0b45f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:wp7Mcv51VSuMZNgP9eoAwdmNCyA=, ofs0, ns] 2024-09-19T13:44:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.849+0000 7f0a257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954817 cookie 94883441122080 notifier 5321 bl.length()=203 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.849+0000 7f0a257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= info.flags=0x7 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.849+0000 7f0a257fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+wp7Mcv51VSuMZNgP9eoAwdmNCyA= to cache LRU end 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "ceph-test-librgw-file", 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "librgw test user", 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "librgw@example.com", 2024-09-19T13:44:53.852 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "ceph-test-librgw-file", 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "wp7Mcv51VSuMZNgP9eoAwdmNCyA=", 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "FvmnEwV/lTndLii3M/o6ILwY5j/eGtnXjanUgDgUO1lFhiyVimDjJg==", 2024-09-19T13:44:53.853 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-19T13:44:53.844795Z" 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-19T13:44:53.854 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-19T13:44:53.855 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-19T13:44:53.856 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-19T13:44:53.844783Z", 2024-09-19T13:44:53.856 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-19T13:44:53.856 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-19T13:44:53.856 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:44:53.856 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:44:53.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.851+0000 7f09ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:44:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.853+0000 7f0b45f26800 20 remove_watcher() i=0 2024-09-19T13:44:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.853+0000 7f0b45f26800 2 removed watcher, disabling cache 2024-09-19T13:44:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.854+0000 7f0b45f26800 20 remove_watcher() i=1 2024-09-19T13:44:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.855+0000 7f0b45f26800 20 remove_watcher() i=2 2024-09-19T13:44:53.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.856+0000 7f0b45f26800 20 remove_watcher() i=3 2024-09-19T13:44:53.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.858+0000 7f0b45f26800 20 remove_watcher() i=4 2024-09-19T13:44:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.859+0000 7f0b45f26800 20 remove_watcher() i=5 2024-09-19T13:44:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.860+0000 7f0b45f26800 20 remove_watcher() i=6 2024-09-19T13:44:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:53.861+0000 7f0b45f26800 20 remove_watcher() i=7 2024-09-19T13:44:53.873 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.1 2024-09-19T13:44:53.895 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:44:53.895 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:44:53.895 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-19T13:44:53.895 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:44:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:44:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:44:54.482 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (587 ms) 2024-09-19T13:44:54.482 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T13:44:54.483 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-19T13:44:54.483 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:44:54.483 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T13:44:54.483 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T13:44:54.491 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-19T13:44:54.494 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/f1 2024-09-19T13:44:54.498 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/f2 2024-09-19T13:44:54.500 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/f1 2024-09-19T13:44:54.503 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-19T13:44:54.506 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-19T13:44:54.508 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-19T13:44:54.511 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-19T13:44:54.514 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-19T13:44:54.517 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-19T13:44:54.520 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-19T13:44:54.522 INFO:tasks.workunit.client.0.smithi094.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-19T13:44:54.525 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (42 ms) 2024-09-19T13:44:54.525 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T13:44:54.617 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (93 ms) 2024-09-19T13:44:54.617 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T13:44:54.617 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T13:44:54.618 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T13:44:54.634 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-09-19T13:44:54.634 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T13:44:54.674 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (40 ms) 2024-09-19T13:44:54.674 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T13:44:54.674 INFO:tasks.workunit.client.0.smithi094.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-19T13:44:54.680 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-19T13:44:54.680 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T13:44:54.680 INFO:tasks.workunit.client.0.smithi094.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-19T13:44:54.686 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (5 ms) 2024-09-19T13:44:54.686 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T13:44:54.686 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_0 2024-09-19T13:44:54.686 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:44:54.686 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:44:54.686 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_1 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_2 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:44:54.687 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_0 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_0 2024-09-19T13:44:54.688 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:44:54.689 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_1 2024-09-19T13:44:54.689 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:44:54.689 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_1 2024-09-19T13:44:54.689 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_0 2024-09-19T13:44:54.689 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:44:54.690 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_1 2024-09-19T13:44:54.690 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:44:54.690 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_2 2024-09-19T13:44:54.690 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_0 2024-09-19T13:44:54.691 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:44:54.691 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_1 2024-09-19T13:44:54.692 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:44:54.692 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-19T13:44:54.692 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (173 ms) 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:44:54.866 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T13:44:54.867 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T13:44:54.872 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-19T13:44:54.873 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-19T13:44:54.876 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-19T13:44:54.877 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-19T13:44:54.880 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:44:54.881 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:44:54.881 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-19T13:44:54.882 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-19T13:44:54.882 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:44:54.883 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:44:54.884 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-19T13:44:54.886 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-19T13:44:54.886 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-19T13:44:54.886 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-19T13:44:54.886 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo (foo): DIR 2024-09-19T13:44:54.886 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot (nfsroot): DIR 2024-09-19T13:44:54.886 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:44:54.887 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:44:54.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:54.884+0000 7fb4c86328c0 -1 shutting down 2024-09-19T13:44:54.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:44:54.885+0000 7fb39dd1f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63916, si_uid : 1000, si_addr0x3e80000f9ac, si_status0 2024-09-19T13:45:24.788 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29901 ms) 2024-09-19T13:45:24.788 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30892 ms total) 2024-09-19T13:45:24.788 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:45:24.788 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:45:24.788 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30892 ms total) 2024-09-19T13:45:24.788 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-19T13:45:24.794 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.2 2024-09-19T13:45:24.818 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:45:24.818 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:45:24.818 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-19T13:45:24.818 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:45:24.826 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:45:24.826 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:45:25.003 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (185 ms) 2024-09-19T13:45:25.003 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T13:45:25.005 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-19T13:45:25.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:45:25.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:45:25.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T13:45:25.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-19T13:45:25.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T13:45:25.006 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-19T13:45:25.007 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T13:45:25.007 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T13:45:25.007 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T13:45:25.007 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-19T13:45:25.007 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T13:45:25.007 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-19T13:45:25.008 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T13:45:25.008 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-19T13:45:25.008 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T13:45:25.008 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-19T13:45:25.008 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T13:45:25.008 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T13:45:25.009 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T13:45:25.009 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-19T13:45:25.009 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T13:45:25.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-19T13:45:25.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T13:45:25.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T13:45:25.012 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T13:45:25.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T13:45:25.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T13:45:25.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T13:45:25.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T13:45:25.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-19T13:45:25.013 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:45:25.014 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T13:45:25.014 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:45:25.014 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:45:25.014 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:45:25.014 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:45:25.014 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:45:25.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:45:25.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:45:25.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:45:25.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:45:25.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:45:25.015 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:45:25.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:45:25.002+0000 7fab567248c0 -1 shutting down 2024-09-19T13:45:25.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:45:25.003+0000 7faa2e5f3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64535, si_uid : 1000, si_addr0x3e80000fc17, si_status0 2024-09-19T13:45:55.121 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30117 ms) 2024-09-19T13:45:55.122 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30303 ms total) 2024-09-19T13:45:55.122 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:45:55.122 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:45:55.122 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30303 ms total) 2024-09-19T13:45:55.122 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-19T13:45:55.127 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1.3 2024-09-19T13:45:55.152 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:45:55.152 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:45:55.152 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW 2024-09-19T13:45:55.152 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:45:55.163 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:45:55.163 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:45:55.539 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (387 ms) 2024-09-19T13:45:55.539 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T13:45:55.540 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-19T13:45:55.540 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:45:55.540 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T13:45:55.540 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T13:45:55.545 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-19T13:45:55.545 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T13:45:55.601 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETUP_DIRS1 (56 ms) 2024-09-19T13:45:55.601 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T13:45:55.601 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T13:45:55.601 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T13:45:55.601 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_0 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:45:55.602 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout:scanning objects in /bdirs1/dir_2 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_0 2024-09-19T13:45:55.603 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_0 2024-09-19T13:45:55.604 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:45:55.604 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_0/sfile_1 2024-09-19T13:45:55.604 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:45:55.604 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_1 2024-09-19T13:45:55.604 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_0 2024-09-19T13:45:55.605 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:45:55.605 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_1/sfile_1 2024-09-19T13:45:55.606 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:45:55.606 INFO:tasks.workunit.client.0.smithi094.stdout:read back objects in /bdirs1/dir_2 2024-09-19T13:45:55.606 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_0 2024-09-19T13:45:55.607 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:45:55.607 INFO:tasks.workunit.client.0.smithi094.stdout:reading 0,256 dir_2/sfile_1 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:45:55.609 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T13:45:55.610 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T13:45:55.615 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-19T13:45:55.615 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-19T13:45:55.618 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-19T13:45:55.620 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-19T13:45:55.623 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:45:55.624 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:45:55.624 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-19T13:45:55.624 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-19T13:45:55.625 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:45:55.625 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:45:55.626 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-19T13:45:55.628 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot/foo (foo): DIR 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:/nfsroot (nfsroot): DIR 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:45:55.629 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:45:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:45:55.626+0000 7ff09b1278c0 -1 shutting down 2024-09-19T13:45:55.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:45:55.627+0000 7fef730bd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65154, si_uid : 1000, si_addr0x3e80000fe82, si_status0 2024-09-19T13:46:25.606 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29978 ms) 2024-09-19T13:46:25.606 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 24 tests from LibRGW (30454 ms total) 2024-09-19T13:46:25.606 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:46:25.606 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:46:25.606 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 24 tests from 1 test suite ran. (30454 ms total) 2024-09-19T13:46:25.607 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 24 tests. 2024-09-19T13:46:25.612 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2.1 2024-09-19T13:46:25.637 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T13:46:25.637 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:46:25.637 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW 2024-09-19T13:46:25.638 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:46:25.647 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:46:25.647 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:46:26.027 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-19T13:46:26.027 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:46:26.027 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:46:26.027 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:46:26.035 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-19T13:46:26.035 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:46:26.035 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T13:46:26.035 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-19T13:46:26.046 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave0 2024-09-19T13:46:26.055 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave1 2024-09-19T13:46:26.065 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave2 2024-09-19T13:46:26.073 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave3 2024-09-19T13:46:26.083 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave4 2024-09-19T13:46:26.093 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave5 2024-09-19T13:46:26.101 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave6 2024-09-19T13:46:26.109 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave7 2024-09-19T13:46:26.116 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave8 2024-09-19T13:46:26.124 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave9 2024-09-19T13:46:26.124 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (89 ms) 2024-09-19T13:46:26.124 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (257 ms) 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:46:26.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:46:26.380+0000 7fe427ea08c0 -1 shutting down 2024-09-19T13:46:26.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:46:26.382+0000 7fe301bdd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65773, si_uid : 1000, si_addr0x3e8000100ed, si_status0 2024-09-19T13:46:56.458 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30075 ms) 2024-09-19T13:46:56.458 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW (30819 ms total) 2024-09-19T13:46:56.458 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:46:56.458 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:46:56.458 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (30819 ms total) 2024-09-19T13:46:56.459 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-19T13:46:56.464 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2.2 2024-09-19T13:46:56.489 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T13:46:56.489 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:46:56.489 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW 2024-09-19T13:46:56.489 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:46:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:46:56.498 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:46:56.721 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (233 ms) 2024-09-19T13:46:56.721 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:46:56.722 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T13:46:56.722 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:46:56.722 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T13:46:56.722 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:46:56.752 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-19T13:46:56.752 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-19T13:46:56.762 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave0 2024-09-19T13:46:56.769 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave1 2024-09-19T13:46:56.778 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave2 2024-09-19T13:46:56.785 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave3 2024-09-19T13:46:56.793 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave4 2024-09-19T13:46:56.800 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave5 2024-09-19T13:46:56.808 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave6 2024-09-19T13:46:56.816 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave7 2024-09-19T13:46:56.823 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave8 2024-09-19T13:46:56.831 INFO:tasks.workunit.client.0.smithi094.stdout:created: sorrydave9 2024-09-19T13:46:56.831 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (79 ms) 2024-09-19T13:46:56.831 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-19T13:46:57.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (261 ms) 2024-09-19T13:46:57.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:46:57.093 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:46:57.093 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:46:57.093 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:46:57.093 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:46:57.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:46:57.090+0000 7f8d1852b8c0 -1 shutting down 2024-09-19T13:46:57.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:46:57.091+0000 7f8bf04a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66394, si_uid : 1000, si_addr0x3e80001035a, si_status0 2024-09-19T13:47:26.963 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29871 ms) 2024-09-19T13:47:26.963 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 9 tests from LibRGW (30474 ms total) 2024-09-19T13:47:26.963 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:47:26.963 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:47:26.963 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 9 tests from 1 test suite ran. (30474 ms total) 2024-09-19T13:47:26.964 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 9 tests. 2024-09-19T13:47:26.969 INFO:tasks.workunit.client.0.smithi094.stdout:phase 3.1 2024-09-19T13:47:27.287 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-19T13:47:27.288 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:47:27.288 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW 2024-09-19T13:47:27.288 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:47:27.296 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:47:27.297 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:47:27.690 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-19T13:47:27.690 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:47:27.691 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:47:27.691 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:47:27.699 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-19T13:47:27.699 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:47:27.701 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-19T13:47:27.702 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:47:27.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-19T13:47:27.703 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE1 2024-09-19T13:47:27.768 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE1 (64 ms) 2024-09-19T13:47:27.768 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE2 2024-09-19T13:47:27.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE2 (31 ms) 2024-09-19T13:47:27.799 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:47:27.800 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:47:27.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:47:27.798+0000 7f6336e538c0 -1 shutting down 2024-09-19T13:47:27.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:47:27.800+0000 7f6210b92640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67014, si_uid : 1000, si_addr0x3e8000105c6, si_status0 2024-09-19T13:47:57.904 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30105 ms) 2024-09-19T13:47:57.905 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW (30616 ms total) 2024-09-19T13:47:57.905 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:47:57.905 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:47:57.905 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 13 tests from 1 test suite ran. (30616 ms total) 2024-09-19T13:47:57.905 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 13 tests. 2024-09-19T13:47:57.912 INFO:tasks.workunit.client.0.smithi094.stdout:phase 3.2 2024-09-19T13:47:58.230 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-19T13:47:58.230 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:47:58.230 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW 2024-09-19T13:47:58.230 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:47:58.238 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:47:58.238 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:47:58.429 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (199 ms) 2024-09-19T13:47:58.429 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:47:58.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:47:58.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:47:58.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T13:47:58.430 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:47:58.434 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-19T13:47:58.434 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:47:58.437 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-19T13:47:58.438 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE1 2024-09-19T13:47:58.515 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE1 (77 ms) 2024-09-19T13:47:58.515 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LARGE2 2024-09-19T13:47:58.515 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-19T13:47:58.515 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:47:58.516 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:47:58.516 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:47:58.521 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-19T13:47:58.521 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:47:58.547 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (26 ms) 2024-09-19T13:47:58.547 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:47:58.547 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:47:58.547 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:47:58.548 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:47:58.548 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:47:58.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:47:58.545+0000 7fba19f528c0 -1 shutting down 2024-09-19T13:47:58.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:47:58.546+0000 7fb8f3c91640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67633, si_uid : 1000, si_addr0x3e800010831, si_status0 2024-09-19T13:48:28.519 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29972 ms) 2024-09-19T13:48:28.519 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 13 tests from LibRGW (30289 ms total) 2024-09-19T13:48:28.519 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:48:28.519 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:48:28.519 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 13 tests from 1 test suite ran. (30289 ms total) 2024-09-19T13:48:28.519 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 13 tests. 2024-09-19T13:48:28.526 INFO:tasks.workunit.client.0.smithi094.stdout:phase 4.1 2024-09-19T13:48:28.551 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T13:48:28.551 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:48:28.551 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW 2024-09-19T13:48:28.551 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TVAR 2024-09-19T13:48:28.552 INFO:tasks.workunit.client.0.smithi094.stdout:read i1: 64001 2024-09-19T13:48:28.552 INFO:tasks.workunit.client.0.smithi094.stdout:read s1: blunderbuss 2024-09-19T13:48:28.552 INFO:tasks.workunit.client.0.smithi094.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-19T13:48:28.552 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:48:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:48:28.562 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:48:29.146 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (596 ms) 2024-09-19T13:48:29.147 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:48:29.147 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:48:29.147 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:48:29.164 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2024-09-19T13:48:29.164 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:48:29.587 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_0 2024-09-19T13:48:29.587 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_1 2024-09-19T13:48:29.587 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_2 2024-09-19T13:48:29.587 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_3 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_4 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_5 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_6 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_7 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_8 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_9 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_10 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_11 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_12 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_13 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_14 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_15 2024-09-19T13:48:29.588 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_16 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_17 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_18 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_19 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_20 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_21 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_22 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_23 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_24 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_25 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_26 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_27 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_28 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_29 2024-09-19T13:48:29.589 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_30 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_31 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_32 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_33 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_34 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_35 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_36 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_37 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_38 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_39 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_40 2024-09-19T13:48:29.590 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_41 2024-09-19T13:48:29.591 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_42 2024-09-19T13:48:29.591 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_43 2024-09-19T13:48:29.591 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_44 2024-09-19T13:48:29.591 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_45 2024-09-19T13:48:29.591 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_46 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_47 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_48 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_49 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_50 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_51 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_52 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_53 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_54 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_55 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_56 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_57 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_58 2024-09-19T13:48:29.592 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_59 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_60 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_61 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_62 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_63 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_64 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_65 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_66 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_67 2024-09-19T13:48:29.593 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_68 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_69 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_70 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_71 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_72 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_73 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_74 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_75 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_76 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_77 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_78 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_79 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_80 2024-09-19T13:48:29.594 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_81 2024-09-19T13:48:29.595 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_82 2024-09-19T13:48:29.595 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_83 2024-09-19T13:48:29.595 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_84 2024-09-19T13:48:29.595 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_85 2024-09-19T13:48:29.595 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_86 2024-09-19T13:48:29.595 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_87 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_88 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_89 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_90 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_91 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_92 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_93 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_94 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_95 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_96 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_97 2024-09-19T13:48:29.596 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_98 2024-09-19T13:48:29.597 INFO:tasks.workunit.client.0.smithi094.stdout:created: dmarker:f_99 2024-09-19T13:48:29.597 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (423 ms) 2024-09-19T13:48:29.597 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:48:29.598 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-19T13:48:29.598 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-19T13:48:29.598 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T13:48:29.598 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T13:48:29.599 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T13:48:29.600 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T13:48:29.601 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T13:48:29.602 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T13:48:29.603 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T13:48:29.604 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T13:48:29.605 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T13:48:29.606 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T13:48:29.607 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T13:48:29.608 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T13:48:29.609 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T13:48:29.610 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T13:48:29.611 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T13:48:29.612 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T13:48:29.613 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T13:48:29.614 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:48:29.615 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:48:29.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:48:29.589+0000 7fa07d7248c0 -1 shutting down 2024-09-19T13:48:29.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:48:29.591+0000 7f9f55724640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68252, si_uid : 1000, si_addr0x3e800010a9c, si_status0 2024-09-19T13:48:59.449 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (29858 ms) 2024-09-19T13:48:59.449 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW (30898 ms total) 2024-09-19T13:48:59.449 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:48:59.449 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:48:59.449 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (30898 ms total) 2024-09-19T13:48:59.450 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-19T13:48:59.455 INFO:tasks.workunit.client.0.smithi094.stdout:phase 4.2 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TVAR 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:read i1: 64001 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:read s1: blunderbuss 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-19T13:48:59.480 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:48:59.488 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:48:59.488 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:48:59.660 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (180 ms) 2024-09-19T13:48:59.660 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:48:59.660 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:48:59.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:48:59.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2024-09-19T13:48:59.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:48:59.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:48:59.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:48:59.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:48:59.669 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-19T13:48:59.671 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T13:48:59.671 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T13:48:59.671 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T13:48:59.672 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T13:48:59.673 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T13:48:59.674 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T13:48:59.675 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T13:48:59.676 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T13:48:59.677 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T13:48:59.678 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:48:59.679 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:48:59.680 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:48:59.680 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:48:59.680 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:48:59.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:48:59.669+0000 7f79dd70c8c0 -1 shutting down 2024-09-19T13:48:59.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:48:59.670+0000 7f78b744b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68871, si_uid : 1000, si_addr0x3e800010d07, si_status0 2024-09-19T13:49:30.046 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30375 ms) 2024-09-19T13:49:30.046 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 11 tests from LibRGW (30566 ms total) 2024-09-19T13:49:30.047 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:49:30.047 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:49:30.047 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 11 tests from 1 test suite ran. (30566 ms total) 2024-09-19T13:49:30.047 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 11 tests. 2024-09-19T13:49:30.052 INFO:tasks.workunit.client.0.smithi094.stdout:phase 5.1 2024-09-19T13:49:30.086 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-19T13:49:30.086 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:49:30.086 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW 2024-09-19T13:49:30.086 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:49:30.096 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:49:30.096 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:49:30.270 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (185 ms) 2024-09-19T13:49:30.270 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:49:30.272 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:49:30.272 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:49:30.280 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-19T13:49:30.280 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:49:30.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-19T13:49:30.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-19T13:49:30.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-19T13:49:30.283 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:49:30.285 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-19T13:49:30.285 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-19T13:49:30.285 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-19T13:49:30.285 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-19T13:49:30.288 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-19T13:49:30.288 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEV 2024-09-19T13:49:30.290 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:49:30.291 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:49:30.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:49:30.288+0000 7f4705d428c0 -1 shutting down 2024-09-19T13:49:30.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:49:30.289+0000 7f45ddd47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69490, si_uid : 1000, si_addr0x3e800010f72, si_status0 2024-09-19T13:50:00.656 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30366 ms) 2024-09-19T13:50:00.657 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW (30570 ms total) 2024-09-19T13:50:00.657 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:50:00.657 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:50:00.657 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 19 tests from 1 test suite ran. (30570 ms total) 2024-09-19T13:50:00.657 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 19 tests. 2024-09-19T13:50:00.662 INFO:tasks.workunit.client.0.smithi094.stdout:phase 5.2 2024-09-19T13:50:00.696 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-19T13:50:00.696 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:50:00.697 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW 2024-09-19T13:50:00.697 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:50:00.704 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:50:00.704 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:50:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-19T13:50:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:50:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:50:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:50:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T13:50:01.085 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:50:01.090 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-19T13:50:01.090 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:50:01.091 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.WRITEV 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-19T13:50:01.092 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:50:01.100 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-19T13:50:01.100 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:50:01.127 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-19T13:50:01.127 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:50:01.127 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:50:01.128 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:50:01.128 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:50:01.128 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:50:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:50:01.125+0000 7f661f6c18c0 -1 shutting down 2024-09-19T13:50:01.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:50:01.126+0000 7f64f6981640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70109, si_uid : 1000, si_addr0x3e8000111dd, si_status0 2024-09-19T13:50:31.444 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30316 ms) 2024-09-19T13:50:31.445 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 19 tests from LibRGW (30747 ms total) 2024-09-19T13:50:31.445 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:50:31.445 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:50:31.445 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 19 tests from 1 test suite ran. (30747 ms total) 2024-09-19T13:50:31.445 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 19 tests. 2024-09-19T13:50:31.451 INFO:tasks.workunit.client.0.smithi094.stdout:phase 6.1 2024-09-19T13:50:31.476 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-19T13:50:31.476 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment set-up. 2024-09-19T13:50:31.476 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from LibRGW 2024-09-19T13:50:31.476 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:50:31.483 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:50:31.483 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:50:31.660 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-09-19T13:50:31.660 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:50:31.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T13:50:31.661 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-19T13:50:31.678 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CREATE_BUCKETS (18 ms) 2024-09-19T13:50:31.678 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-19T13:50:31.684 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-19T13:50:31.684 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-19T13:50:31.699 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.TOPDIR_RENAME (14 ms) 2024-09-19T13:50:31.699 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-19T13:50:31.718 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SUBDIR_RENAME (20 ms) 2024-09-19T13:50:31.718 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-19T13:50:31.738 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (20 ms) 2024-09-19T13:50:31.738 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:50:31.738 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:50:31.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:50:31.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:50:31.739 INFO:tasks.workunit.client.0.smithi094.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:50:31.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:50:31.736+0000 7fd8aff1f8c0 -1 shutting down 2024-09-19T13:50:31.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:50:31.737+0000 7fd787227640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70731, si_uid : 1000, si_addr0x3e80001144b, si_status0 2024-09-19T13:51:01.977 INFO:tasks.workunit.client.0.smithi094.stdout:[ OK ] LibRGW.SHUTDOWN (30238 ms) 2024-09-19T13:51:01.978 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] 10 tests from LibRGW (30501 ms total) 2024-09-19T13:51:01.978 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:51:01.978 INFO:tasks.workunit.client.0.smithi094.stdout:[----------] Global test environment tear-down 2024-09-19T13:51:01.978 INFO:tasks.workunit.client.0.smithi094.stdout:[==========] 10 tests from 1 test suite ran. (30501 ms total) 2024-09-19T13:51:01.978 INFO:tasks.workunit.client.0.smithi094.stdout:[ PASSED ] 10 tests. 2024-09-19T13:51:01.984 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:51:01.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:51:02.027 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-19T13:51:02.028 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-19T13:51:02.029 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-19T13:51:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z ']' 2024-09-19T13:51:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T13:51:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T13:51:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T13:51:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T13:51:02.101 INFO:tasks.workunit.client.0.smithi094.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-19T13:51:02.138 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:51:02.138 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:51:02.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.172+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 realm 2024-09-19T13:51:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:51:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.174+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.175+0000 7f8f0c73d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:51:02.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.175+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.175+0000 7f8f0c73d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:51:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.175+0000 7f8f0c73d800 20 searching for the correct realm 2024-09-19T13:51:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.178+0000 7f8f08c2b640 0 -- 172.21.15.94:0/2859548173 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f8ef008a2b0 msgr2=0x7f8ef007ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:51:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.183+0000 7f8f0842a640 0 -- 172.21.15.94:0/2859548173 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8ef007b170 msgr2=0x7f8ef007f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:51:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:51:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:51:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:51:02.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:51:02.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:51:02.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:51:02.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.389+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:51:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:51:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 zone default found 2024-09-19T13:51:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 4 Realm: () 2024-09-19T13:51:02.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 zonegroup default 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.390+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.391+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.391+0000 7f8f0c73d800 20 started sync module instance, tier type = 2024-09-19T13:51:02.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.391+0000 7f8f0c73d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:51:02.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=0 2024-09-19T13:51:02.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=1 2024-09-19T13:51:02.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=2 2024-09-19T13:51:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=3 2024-09-19T13:51:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=4 2024-09-19T13:51:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=5 2024-09-19T13:51:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.400+0000 7f8f0c73d800 20 add_watcher() i=6 2024-09-19T13:51:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.401+0000 7f8f0c73d800 20 add_watcher() i=7 2024-09-19T13:51:02.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.401+0000 7f8f0c73d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:51:02.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.403+0000 7f8dbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.403+0000 7f8f0c73d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.403+0000 7f8f0c73d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.403+0000 7f8f0c73d800 5 note: GC not initialized 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.403+0000 7f8dbd7e2640 20 reqs_thread_entry: start 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.403+0000 7f8f0c73d800 20 init_complete bucket index max shards: 11 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 Filter name: none 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8d2effd640 20 reqs_thread_entry: start 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-19T13:51:02.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-19T13:51:02.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 rados->read ofs=0 len=0 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.404+0000 7f8f0c73d800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.405+0000 7f8f0c73d800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.405+0000 7f8f0c73d800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.405+0000 7f8f0c73d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.406+0000 7f8de77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954867 cookie 94509147636464 notifier 5775 bl.length()=677 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.406+0000 7f8de77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-19T13:51:02.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.406+0000 7f8de77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T13:51:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.407+0000 7f8f0c73d800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-19T13:51:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.407+0000 7f8f0c73d800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T13:51:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.407+0000 7f8f0c73d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-19T13:51:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.408+0000 7f8de77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954824 cookie 94509147621808 notifier 5775 bl.length()=187 2024-09-19T13:51:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.408+0000 7f8de77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-19T13:51:02.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.408+0000 7f8de77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T13:51:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.410+0000 7f8f0c73d800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-19T13:51:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.410+0000 7f8f0c73d800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T13:51:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.410+0000 7f8f0c73d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-19T13:51:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.410+0000 7f8de6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954825 cookie 94509147621808 notifier 5775 bl.length()=197 2024-09-19T13:51:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.410+0000 7f8de6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-19T13:51:02.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.410+0000 7f8de6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "ceph-test-maven", 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "maven test user", 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "sigv4@example.com", 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "ceph-test-maven", 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-19T13:51:02.413 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-19T13:51:02.406309Z" 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-19T13:51:02.414 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-19T13:51:02.415 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-19T13:51:02.406295Z", 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:51:02.416 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:51:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.411+0000 7f8dbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:51:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.413+0000 7f8f0c73d800 20 remove_watcher() i=0 2024-09-19T13:51:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.413+0000 7f8f0c73d800 2 removed watcher, disabling cache 2024-09-19T13:51:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.414+0000 7f8f0c73d800 20 remove_watcher() i=1 2024-09-19T13:51:02.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.415+0000 7f8f0c73d800 20 remove_watcher() i=2 2024-09-19T13:51:02.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.416+0000 7f8f0c73d800 20 remove_watcher() i=3 2024-09-19T13:51:02.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.418+0000 7f8f0c73d800 20 remove_watcher() i=4 2024-09-19T13:51:02.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.418+0000 7f8f0c73d800 20 remove_watcher() i=5 2024-09-19T13:51:02.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.419+0000 7f8f0c73d800 20 remove_watcher() i=6 2024-09-19T13:51:02.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:51:02.420+0000 7f8f0c73d800 20 remove_watcher() i=7 2024-09-19T13:51:02.432 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z ']' 2024-09-19T13:51:02.432 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-19T13:51:02.432 INFO:tasks.workunit.client.0.smithi094.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-19T13:51:02.433 INFO:tasks.workunit.client.0.smithi094.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi094.front.sepia.ceph.com:80 2024-09-19T13:51:02.433 INFO:tasks.workunit.client.0.smithi094.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi094.front.sepia.ceph.com:80 2024-09-19T13:51:02.433 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-19T13:51:02.433 INFO:tasks.workunit.client.0.smithi094.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-19T13:51:02.433 INFO:tasks.workunit.client.0.smithi094.stderr:+ ./mvnw clean package 2024-09-19T13:51:02.488 INFO:tasks.workunit.client.0.smithi094.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-19T13:51:04.027 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Scanning for projects... 2024-09-19T13:51:04.138 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-19T13:51:04.220 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 67 kB/s) 2024-09-19T13:51:04.230 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-19T13:51:04.272 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 63/83 kB Progress (1): 79/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-19T13:51:04.279 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-19T13:51:04.300 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 50/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-19T13:51:04.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:04.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-19T13:51:04.323 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jcksum 1.0 2024-09-19T13:51:04.324 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] from pom.xml 2024-09-19T13:51:04.324 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-19T13:51:04.326 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-19T13:51:04.342 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-19T13:51:04.349 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-19T13:51:04.364 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-19T13:51:04.367 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-19T13:51:04.383 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-19T13:51:04.390 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-19T13:51:04.405 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-19T13:51:04.417 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-19T13:51:04.433 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-19T13:51:04.439 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-19T13:51:04.455 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-19T13:51:04.457 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-19T13:51:04.472 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-19T13:51:04.474 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-19T13:51:04.491 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-19T13:51:04.495 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-19T13:51:04.510 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-19T13:51:04.515 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-19T13:51:04.531 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-19T13:51:04.536 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-19T13:51:04.551 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-19T13:51:04.556 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-19T13:51:04.573 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-19T13:51:04.579 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-19T13:51:04.595 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-19T13:51:04.598 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-19T13:51:04.614 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-19T13:51:04.617 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-19T13:51:04.634 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-19T13:51:04.638 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-19T13:51:04.653 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-19T13:51:04.659 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-19T13:51:04.674 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-19T13:51:04.677 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-19T13:51:04.694 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-19T13:51:04.700 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-19T13:51:04.715 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-19T13:51:04.717 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-19T13:51:04.732 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-19T13:51:04.735 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-19T13:51:04.750 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-19T13:51:04.753 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-19T13:51:04.769 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-19T13:51:04.773 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-19T13:51:04.788 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-19T13:51:04.802 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-19T13:51:04.817 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-09-19T13:51:04.819 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-19T13:51:04.834 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-19T13:51:04.839 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-19T13:51:04.857 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-19T13:51:04.861 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-19T13:51:04.877 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-19T13:51:04.879 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-19T13:51:04.895 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-19T13:51:04.896 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-19T13:51:04.913 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-09-19T13:51:04.916 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-19T13:51:04.932 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-19T13:51:04.936 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-19T13:51:04.951 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-19T13:51:04.955 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-19T13:51:04.970 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-19T13:51:04.975 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-19T13:51:04.990 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-19T13:51:04.994 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-19T13:51:05.010 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-19T13:51:05.014 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-19T13:51:05.029 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-19T13:51:05.033 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-19T13:51:05.048 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-19T13:51:05.050 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-19T13:51:05.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-19T13:51:05.067 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-19T13:51:05.081 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-19T13:51:05.084 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-19T13:51:05.099 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-19T13:51:05.104 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-19T13:51:05.119 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-19T13:51:05.123 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-19T13:51:05.138 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-19T13:51:05.141 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-19T13:51:05.157 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-19T13:51:05.161 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-19T13:51:05.177 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-19T13:51:05.181 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-19T13:51:05.196 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-19T13:51:05.201 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-19T13:51:05.217 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-19T13:51:05.219 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-19T13:51:05.235 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-19T13:51:05.238 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-19T13:51:05.254 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-19T13:51:05.257 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-19T13:51:05.272 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-19T13:51:05.275 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-19T13:51:05.290 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-19T13:51:05.295 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-19T13:51:05.310 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-19T13:51:05.314 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-19T13:51:05.329 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-19T13:51:05.330 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-19T13:51:05.345 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-19T13:51:05.349 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-19T13:51:05.364 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-19T13:51:05.366 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-19T13:51:05.382 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-19T13:51:05.384 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-19T13:51:05.399 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.2 MB/s) 2024-09-19T13:51:05.402 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-19T13:51:05.417 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-19T13:51:05.420 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-19T13:51:05.436 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-19T13:51:05.438 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-19T13:51:05.453 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-19T13:51:05.457 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-19T13:51:05.472 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-19T13:51:05.474 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-19T13:51:05.491 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-19T13:51:05.496 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-19T13:51:05.511 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 979 kB/s) 2024-09-19T13:51:05.516 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-19T13:51:05.531 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-19T13:51:05.533 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-19T13:51:05.549 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-19T13:51:05.553 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-19T13:51:05.569 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-19T13:51:05.573 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-19T13:51:05.589 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-19T13:51:05.592 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-19T13:51:05.608 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-19T13:51:05.614 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-19T13:51:05.629 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-19T13:51:05.631 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-19T13:51:05.645 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-19T13:51:05.648 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-19T13:51:05.662 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-19T13:51:05.664 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-19T13:51:05.679 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-19T13:51:05.681 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-19T13:51:05.695 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 136 kB/s) 2024-09-19T13:51:05.698 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-19T13:51:05.713 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-19T13:51:05.715 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-19T13:51:05.729 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-19T13:51:05.731 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-19T13:51:05.746 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-19T13:51:05.748 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-19T13:51:05.763 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-19T13:51:05.765 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-19T13:51:05.779 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-19T13:51:05.782 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-19T13:51:05.796 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-19T13:51:05.800 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-19T13:51:05.815 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-19T13:51:05.817 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-19T13:51:05.833 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-19T13:51:05.834 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-19T13:51:05.849 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-19T13:51:05.851 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-19T13:51:05.867 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-19T13:51:05.870 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-19T13:51:05.885 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-19T13:51:05.887 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-19T13:51:05.901 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-19T13:51:05.917 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-19T13:51:05.999 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 40 MB/s) 2024-09-19T13:51:06.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-19T13:51:06.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-19T13:51:06.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-19T13:51:06.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-19T13:51:06.001 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-19T13:51:06.018 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.0 MB/s) 2024-09-19T13:51:06.019 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-19T13:51:06.034 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 486 kB/s) 2024-09-19T13:51:06.034 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-19T13:51:06.054 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (1): 12/16 kB Progress (2): 12/16 kB | 1.4/98 kB Progress (2): 14/16 kB | 1.4/98 kB Progress (2): 14/16 kB | 2.8/98 kB Progress (2): 15/16 kB | 2.8/98 kB Progress (2): 15/16 kB | 4.1/98 kB Progress (3): 15/16 kB | 4.1/98 kB | 1.4/71 kB Progress (4): 15/16 kB | 4.1/98 kB | 1.4/71 kB | 1.4/49 kB Progress (4): 15/16 kB | 4.1/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 15/16 kB | 5.5/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 16 kB | 5.5/98 kB | 2.8/71 kB | 1.4/49 kB Progress (4): 16 kB | 5.5/98 kB | 4.1/71 kB | 1.4/49 kB Progress (4): 16 kB | 5.5/98 kB | 4.1/71 kB | 2.8/49 kB Progress (4): 16 kB | 5.5/98 kB | 5.5/71 kB | 2.8/49 kB Progress (4): 16 kB | 6.9/98 kB | 5.5/71 kB | 2.8/49 kB Progress (4): 16 kB | 6.9/98 kB | 6.9/71 kB | 2.8/49 kB Progress (4): 16 kB | 6.9/98 kB | 6.9/71 kB | 4.1/49 kB Progress (4): 16 kB | 6.9/98 kB | 8.3/71 kB | 4.1/49 kB Progress (4): 16 kB | 8.3/98 kB | 8.3/71 kB | 4.1/49 kB Progress (4): 16 kB | 8.3/98 kB | 9.7/71 kB | 4.1/49 kB Progress (4): 16 kB | 8.3/98 kB | 9.7/71 kB | 5.5/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 343 kB/s) 2024-09-19T13:51:06.054 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 9.7/98 kB | 9.7/71 kB | 5.5/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-19T13:51:06.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 9.7/98 kB | 9.7/71 kB | 6.9/49 kB Progress (3): 11/98 kB | 9.7/71 kB | 6.9/49 kB Progress (3): 11/98 kB | 11/71 kB | 6.9/49 kB Progress (3): 12/98 kB | 11/71 kB | 6.9/49 kB Progress (3): 12/98 kB | 12/71 kB | 6.9/49 kB Progress (3): 12/98 kB | 12/71 kB | 8.3/49 kB Progress (3): 12/98 kB | 14/71 kB | 8.3/49 kB Progress (3): 14/98 kB | 14/71 kB | 8.3/49 kB Progress (3): 14/98 kB | 15/71 kB | 8.3/49 kB Progress (3): 15/98 kB | 15/71 kB | 8.3/49 kB Progress (3): 15/98 kB | 16/71 kB | 8.3/49 kB Progress (3): 16/98 kB | 16/71 kB | 8.3/49 kB Progress (3): 16/98 kB | 16/71 kB | 9.7/49 kB Progress (3): 18/98 kB | 16/71 kB | 9.7/49 kB Progress (3): 18/98 kB | 16/71 kB | 11/49 kB Progress (3): 19/98 kB | 16/71 kB | 11/49 kB Progress (3): 19/98 kB | 16/71 kB | 12/49 kB Progress (3): 21/98 kB | 16/71 kB | 12/49 kB Progress (4): 21/98 kB | 16/71 kB | 12/49 kB | 16/782 kB Progress (4): 21/98 kB | 16/71 kB | 14/49 kB | 16/782 kB Progress (4): 22/98 kB | 16/71 kB | 14/49 kB | 16/782 kB Progress (4): 22/98 kB | 16/71 kB | 15/49 kB | 16/782 kB Progress (4): 23/98 kB | 16/71 kB | 15/49 kB | 16/782 kB Progress (4): 23/98 kB | 16/71 kB | 15/49 kB | 33/782 kB Progress (4): 23/98 kB | 16/71 kB | 16/49 kB | 33/782 kB Progress (4): 25/98 kB | 16/71 kB | 16/49 kB | 33/782 kB Progress (4): 25/98 kB | 16/71 kB | 18/49 kB | 33/782 kB Progress (4): 26/98 kB | 16/71 kB | 18/49 kB | 33/782 kB Progress (4): 26/98 kB | 16/71 kB | 19/49 kB | 33/782 kB Progress (4): 26/98 kB | 16/71 kB | 19/49 kB | 49/782 kB Progress (4): 26/98 kB | 16/71 kB | 21/49 kB | 49/782 kB Progress (4): 27/98 kB | 16/71 kB | 21/49 kB | 49/782 kB Progress (4): 27/98 kB | 16/71 kB | 22/49 kB | 49/782 kB Progress (4): 29/98 kB | 16/71 kB | 22/49 kB | 49/782 kB Progress (4): 29/98 kB | 16/71 kB | 23/49 kB | 49/782 kB Progress (4): 30/98 kB | 16/71 kB | 23/49 kB | 49/782 kB Progress (4): 30/98 kB | 16/71 kB | 23/49 kB | 65/782 kB Progress (4): 30/98 kB | 16/71 kB | 25/49 kB | 65/782 kB Progress (4): 30/98 kB | 16/71 kB | 26/49 kB | 65/782 kB Progress (4): 30/98 kB | 16/71 kB | 27/49 kB | 65/782 kB Progress (4): 30/98 kB | 16/71 kB | 29/49 kB | 65/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 65/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 81/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 98/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 114/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 122/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 130/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 147/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 163/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 180/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 196/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 212/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 229/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 245/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 262/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 278/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 294/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 311/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 327/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 343/782 kB Progress (4): 30/98 kB | 16/71 kB | 30/49 kB | 360/782 kB Progress (4): 32/98 kB | 16/71 kB | 30/49 kB | 360/782 kB Progress (4): 33/98 kB | 16/71 kB | 30/49 kB | 360/782 kB Progress (4): 34/98 kB | 16/71 kB | 30/49 kB | 360/782 kB Progress (4): 34/98 kB | 16/71 kB | 30/49 kB | 376/782 kB Progress (4): 34/98 kB | 16/71 kB | 31/49 kB | 376/782 kB Progress (4): 36/98 kB | 16/71 kB | 31/49 kB | 376/782 kB Progress (4): 36/98 kB | 16/71 kB | 33/49 kB | 376/782 kB Progress (4): 36/98 kB | 16/71 kB | 34/49 kB | 376/782 kB Progress (4): 36/98 kB | 16/71 kB | 36/49 kB | 376/782 kB Progress (4): 36/98 kB | 33/71 kB | 36/49 kB | 376/782 kB Progress (4): 36/98 kB | 33/71 kB | 37/49 kB | 376/782 kB Progress (4): 36/98 kB | 33/71 kB | 37/49 kB | 393/782 kB Progress (4): 36/98 kB | 33/71 kB | 38/49 kB | 393/782 kB Progress (4): 36/98 kB | 33/71 kB | 40/49 kB | 393/782 kB Progress (4): 37/98 kB | 33/71 kB | 40/49 kB | 393/782 kB Progress (4): 37/98 kB | 33/71 kB | 41/49 kB | 393/782 kB Progress (4): 38/98 kB | 33/71 kB | 41/49 kB | 393/782 kB Progress (4): 40/98 kB | 33/71 kB | 41/49 kB | 393/782 kB Progress (4): 40/98 kB | 33/71 kB | 41/49 kB | 409/782 kB Progress (4): 41/98 kB | 33/71 kB | 41/49 kB | 409/782 kB Progress (4): 43/98 kB | 33/71 kB | 41/49 kB | 409/782 kB Progress (4): 44/98 kB | 33/71 kB | 41/49 kB | 409/782 kB Progress (4): 45/98 kB | 33/71 kB | 41/49 kB | 409/782 kB Progress (4): 45/98 kB | 33/71 kB | 41/49 kB | 425/782 kB Progress (4): 45/98 kB | 33/71 kB | 42/49 kB | 425/782 kB Progress (4): 45/98 kB | 33/71 kB | 42/49 kB | 442/782 kB Progress (4): 45/98 kB | 33/71 kB | 44/49 kB | 442/782 kB Progress (4): 45/98 kB | 33/71 kB | 45/49 kB | 442/782 kB Progress (4): 45/98 kB | 33/71 kB | 45/49 kB | 446/782 kB Progress (4): 45/98 kB | 33/71 kB | 47/49 kB | 446/782 kB Progress (4): 45/98 kB | 33/71 kB | 48/49 kB | 446/782 kB Progress (4): 45/98 kB | 33/71 kB | 49 kB | 446/782 kB Progress (4): 45/98 kB | 33/71 kB | 49 kB | 458/782 kB Progress (4): 47/98 kB | 33/71 kB | 49 kB | 458/782 kB Progress (4): 48/98 kB | 33/71 kB | 49 kB | 458/782 kB Progress (5): 48/98 kB | 33/71 kB | 49 kB | 458/782 kB | 1.4/11 kB Progress (5): 48/98 kB | 33/71 kB | 49 kB | 475/782 kB | 1.4/11 kB Progress (5): 48/98 kB | 33/71 kB | 49 kB | 475/782 kB | 2.8/11 kB Progress (5): 49/98 kB | 33/71 kB | 49 kB | 475/782 kB | 2.8/11 kB Progress (5): 49/98 kB | 33/71 kB | 49 kB | 475/782 kB | 4.1/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 807 kB/s) 2024-09-19T13:51:06.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 49/98 kB | 49/71 kB | 475/782 kB | 4.1/11 kB Progress (4): 51/98 kB | 49/71 kB | 475/782 kB | 4.1/11 kB Progress (4): 51/98 kB | 49/71 kB | 491/782 kB | 4.1/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-19T13:51:06.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 51/98 kB | 49/71 kB | 491/782 kB | 5.5/11 kB Progress (4): 52/98 kB | 49/71 kB | 491/782 kB | 5.5/11 kB Progress (4): 52/98 kB | 49/71 kB | 495/782 kB | 5.5/11 kB Progress (4): 54/98 kB | 49/71 kB | 495/782 kB | 5.5/11 kB Progress (4): 54/98 kB | 49/71 kB | 495/782 kB | 6.9/11 kB Progress (4): 55/98 kB | 49/71 kB | 495/782 kB | 6.9/11 kB Progress (4): 55/98 kB | 49/71 kB | 495/782 kB | 8.3/11 kB Progress (4): 56/98 kB | 49/71 kB | 495/782 kB | 8.3/11 kB Progress (4): 56/98 kB | 49/71 kB | 495/782 kB | 9.7/11 kB Progress (4): 58/98 kB | 49/71 kB | 495/782 kB | 9.7/11 kB Progress (4): 58/98 kB | 49/71 kB | 511/782 kB | 9.7/11 kB Progress (4): 59/98 kB | 49/71 kB | 511/782 kB | 9.7/11 kB Progress (4): 59/98 kB | 49/71 kB | 511/782 kB | 11/11 kB Progress (4): 61/98 kB | 49/71 kB | 511/782 kB | 11/11 kB Progress (4): 61/98 kB | 49/71 kB | 511/782 kB | 11 kB Progress (4): 61/98 kB | 49/71 kB | 528/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 186 kB/s) 2024-09-19T13:51:06.065 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-19T13:51:06.070 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 61/98 kB | 49/71 kB | 544/782 kB Progress (3): 61/98 kB | 49/71 kB | 561/782 kB Progress (3): 61/98 kB | 49/71 kB | 577/782 kB Progress (3): 61/98 kB | 49/71 kB | 593/782 kB Progress (3): 61/98 kB | 49/71 kB | 610/782 kB Progress (3): 61/98 kB | 49/71 kB | 626/782 kB Progress (3): 61/98 kB | 49/71 kB | 642/782 kB Progress (3): 61/98 kB | 49/71 kB | 659/782 kB Progress (3): 61/98 kB | 49/71 kB | 675/782 kB Progress (3): 61/98 kB | 49/71 kB | 692/782 kB Progress (3): 61/98 kB | 49/71 kB | 708/782 kB Progress (3): 61/98 kB | 49/71 kB | 724/782 kB Progress (3): 61/98 kB | 49/71 kB | 741/782 kB Progress (3): 61/98 kB | 49/71 kB | 757/782 kB Progress (3): 61/98 kB | 49/71 kB | 774/782 kB Progress (3): 61/98 kB | 49/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-19T13:51:06.070 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-19T13:51:06.071 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 62/98 kB | 49/71 kB Progress (2): 62/98 kB | 49/71 kB Progress (2): 62/98 kB | 66/71 kB Progress (2): 62/98 kB | 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 980 kB/s) 2024-09-19T13:51:06.071 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-19T13:51:06.074 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 78/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-19T13:51:06.074 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-19T13:51:06.081 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/30 kB Progress (1): 2.8/30 kB Progress (1): 4.1/30 kB Progress (1): 5.5/30 kB Progress (1): 6.9/30 kB Progress (1): 8.3/30 kB Progress (1): 9.7/30 kB Progress (2): 9.7/30 kB | 16/205 kB Progress (2): 11/30 kB | 16/205 kB Progress (2): 12/30 kB | 16/205 kB Progress (2): 14/30 kB | 16/205 kB Progress (2): 15/30 kB | 16/205 kB Progress (2): 17/30 kB | 16/205 kB Progress (2): 18/30 kB | 16/205 kB Progress (2): 19/30 kB | 16/205 kB Progress (2): 21/30 kB | 16/205 kB Progress (2): 22/30 kB | 16/205 kB Progress (2): 22/30 kB | 33/205 kB Progress (2): 23/30 kB | 33/205 kB Progress (2): 25/30 kB | 33/205 kB Progress (2): 26/30 kB | 33/205 kB Progress (2): 28/30 kB | 33/205 kB Progress (2): 29/30 kB | 33/205 kB Progress (2): 30 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 377 kB/s) 2024-09-19T13:51:06.081 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-19T13:51:06.087 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 49/205 kB Progress (2): 49/205 kB | 16/81 kB Progress (2): 49/205 kB | 33/81 kB Progress (2): 49/205 kB | 49/81 kB Progress (2): 49/205 kB | 64/81 kB Progress (2): 49/205 kB | 81/81 kB Progress (2): 49/205 kB | 81 kB Progress (3): 49/205 kB | 81 kB | 16/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 956 kB/s) 2024-09-19T13:51:06.087 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-19T13:51:06.089 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 49/205 kB | 33/798 kB Progress (3): 49/205 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-19T13:51:06.089 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-19T13:51:06.104 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 66/205 kB | 33/798 kB Progress (2): 66/205 kB | 49/798 kB Progress (2): 66/205 kB | 63/798 kB Progress (2): 82/205 kB | 63/798 kB Progress (2): 98/205 kB | 63/798 kB Progress (2): 115/205 kB | 63/798 kB Progress (2): 131/205 kB | 63/798 kB Progress (2): 147/205 kB | 63/798 kB Progress (2): 164/205 kB | 63/798 kB Progress (2): 180/205 kB | 63/798 kB Progress (3): 180/205 kB | 63/798 kB | 16/182 kB Progress (3): 197/205 kB | 63/798 kB | 16/182 kB Progress (3): 197/205 kB | 63/798 kB | 33/182 kB Progress (3): 197/205 kB | 79/798 kB | 33/182 kB Progress (3): 197/205 kB | 95/798 kB | 33/182 kB Progress (3): 197/205 kB | 95/798 kB | 49/182 kB Progress (3): 197/205 kB | 95/798 kB | 62/182 kB Progress (3): 197/205 kB | 112/798 kB | 62/182 kB Progress (3): 205 kB | 112/798 kB | 62/182 kB Progress (4): 205 kB | 112/798 kB | 62/182 kB | 16/151 kB Progress (4): 205 kB | 128/798 kB | 62/182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-19T13:51:06.104 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-19T13:51:06.105 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 128/798 kB | 62/182 kB | 33/151 kB Progress (3): 128/798 kB | 62/182 kB | 49/151 kB Progress (3): 128/798 kB | 62/182 kB | 63/151 kB Progress (3): 145/798 kB | 62/182 kB | 63/151 kB Progress (3): 145/798 kB | 62/182 kB | 79/151 kB Progress (3): 157/798 kB | 62/182 kB | 79/151 kB Progress (3): 157/798 kB | 62/182 kB | 96/151 kB Progress (4): 157/798 kB | 62/182 kB | 96/151 kB | 16/27 kB Progress (4): 157/798 kB | 62/182 kB | 112/151 kB | 16/27 kB Progress (4): 157/798 kB | 62/182 kB | 112/151 kB | 27 kB Progress (4): 173/798 kB | 62/182 kB | 112/151 kB | 27 kB Progress (4): 173/798 kB | 62/182 kB | 128/151 kB | 27 kB Progress (4): 173/798 kB | 62/182 kB | 145/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 268 kB/s) 2024-09-19T13:51:06.106 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-19T13:51:06.106 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 173/798 kB | 62/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.5 MB/s) 2024-09-19T13:51:06.106 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-19T13:51:06.115 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 173/798 kB | 78/182 kB Progress (2): 173/798 kB | 94/182 kB Progress (2): 173/798 kB | 111/182 kB Progress (2): 190/798 kB | 111/182 kB Progress (2): 206/798 kB | 111/182 kB Progress (2): 206/798 kB | 127/182 kB Progress (2): 222/798 kB | 127/182 kB Progress (2): 239/798 kB | 127/182 kB Progress (2): 239/798 kB | 144/182 kB Progress (2): 239/798 kB | 160/182 kB Progress (2): 255/798 kB | 160/182 kB Progress (2): 271/798 kB | 160/182 kB Progress (2): 271/798 kB | 176/182 kB Progress (2): 288/798 kB | 176/182 kB Progress (2): 288/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-19T13:51:06.115 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 304/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-19T13:51:06.118 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 321/798 kB Progress (1): 337/798 kB Progress (1): 353/798 kB Progress (1): 370/798 kB Progress (2): 370/798 kB | 16/30 kB Progress (2): 386/798 kB | 16/30 kB Progress (2): 386/798 kB | 30 kB Progress (2): 403/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 261 kB/s) 2024-09-19T13:51:06.118 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-19T13:51:06.121 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 419/798 kB Progress (2): 419/798 kB | 16/385 kB Progress (3): 419/798 kB | 16/385 kB | 13 kB Progress (3): 419/798 kB | 33/385 kB | 13 kB Progress (3): 419/798 kB | 49/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 111 kB/s) 2024-09-19T13:51:06.121 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-19T13:51:06.127 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 419/798 kB | 66/385 kB Progress (2): 419/798 kB | 82/385 kB Progress (2): 419/798 kB | 98/385 kB Progress (2): 419/798 kB | 113/385 kB Progress (2): 419/798 kB | 129/385 kB Progress (2): 419/798 kB | 145/385 kB Progress (2): 419/798 kB | 162/385 kB Progress (2): 419/798 kB | 178/385 kB Progress (2): 435/798 kB | 178/385 kB Progress (2): 435/798 kB | 195/385 kB Progress (2): 435/798 kB | 211/385 kB Progress (2): 452/798 kB | 211/385 kB Progress (2): 452/798 kB | 227/385 kB Progress (2): 452/798 kB | 244/385 kB Progress (2): 468/798 kB | 244/385 kB Progress (2): 468/798 kB | 260/385 kB Progress (2): 484/798 kB | 260/385 kB Progress (2): 484/798 kB | 277/385 kB Progress (2): 484/798 kB | 293/385 kB Progress (2): 501/798 kB | 293/385 kB Progress (2): 501/798 kB | 309/385 kB Progress (2): 501/798 kB | 326/385 kB Progress (2): 517/798 kB | 326/385 kB Progress (2): 517/798 kB | 342/385 kB Progress (2): 534/798 kB | 342/385 kB Progress (2): 534/798 kB | 358/385 kB Progress (2): 550/798 kB | 358/385 kB Progress (2): 550/798 kB | 375/385 kB Progress (2): 550/798 kB | 385 kB Progress (2): 566/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-19T13:51:06.127 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 583/798 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-19T13:51:06.131 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 599/798 kB Progress (1): 616/798 kB Progress (1): 632/798 kB Progress (1): 648/798 kB Progress (1): 665/798 kB Progress (1): 681/798 kB Progress (2): 681/798 kB | 16/75 kB Progress (2): 697/798 kB | 16/75 kB Progress (2): 697/798 kB | 33/75 kB Progress (2): 697/798 kB | 49/75 kB Progress (2): 714/798 kB | 49/75 kB Progress (2): 730/798 kB | 49/75 kB Progress (2): 730/798 kB | 64/75 kB Progress (2): 747/798 kB | 64/75 kB Progress (2): 747/798 kB | 75 kB Progress (2): 763/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 582 kB/s) 2024-09-19T13:51:06.131 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-19T13:51:06.132 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 779/798 kB Progress (1): 796/798 kB Progress (1): 798 kB Progress (2): 798 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.1 MB/s) 2024-09-19T13:51:06.132 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-19T13:51:06.149 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 65/780 kB Progress (1): 81/780 kB Progress (1): 98/780 kB Progress (1): 114/780 kB Progress (1): 130/780 kB Progress (1): 147/780 kB Progress (1): 163/780 kB Progress (1): 180/780 kB Progress (2): 180/780 kB | 16/329 kB Progress (2): 196/780 kB | 16/329 kB Progress (2): 212/780 kB | 16/329 kB Progress (2): 229/780 kB | 16/329 kB Progress (2): 229/780 kB | 32/329 kB Progress (2): 245/780 kB | 32/329 kB Progress (2): 262/780 kB | 32/329 kB Progress (2): 262/780 kB | 49/329 kB Progress (2): 262/780 kB | 65/329 kB Progress (2): 262/780 kB | 81/329 kB Progress (3): 262/780 kB | 81/329 kB | 16/501 kB Progress (3): 262/780 kB | 81/329 kB | 33/501 kB Progress (3): 262/780 kB | 81/329 kB | 49/501 kB Progress (3): 262/780 kB | 81/329 kB | 62/501 kB Progress (3): 262/780 kB | 81/329 kB | 78/501 kB Progress (3): 262/780 kB | 81/329 kB | 95/501 kB Progress (3): 262/780 kB | 81/329 kB | 111/501 kB Progress (3): 262/780 kB | 81/329 kB | 127/501 kB Progress (3): 262/780 kB | 81/329 kB | 144/501 kB Progress (3): 262/780 kB | 81/329 kB | 160/501 kB Progress (3): 262/780 kB | 81/329 kB | 177/501 kB Progress (3): 262/780 kB | 81/329 kB | 193/501 kB Progress (3): 262/780 kB | 81/329 kB | 209/501 kB Progress (3): 262/780 kB | 81/329 kB | 226/501 kB Progress (3): 262/780 kB | 81/329 kB | 242/501 kB Progress (3): 278/780 kB | 81/329 kB | 242/501 kB Progress (3): 278/780 kB | 81/329 kB | 258/501 kB Progress (3): 294/780 kB | 81/329 kB | 258/501 kB Progress (3): 294/780 kB | 81/329 kB | 275/501 kB Progress (3): 294/780 kB | 81/329 kB | 291/501 kB Progress (3): 311/780 kB | 81/329 kB | 291/501 kB Progress (4): 311/780 kB | 81/329 kB | 291/501 kB | 16/354 kB Progress (4): 311/780 kB | 81/329 kB | 308/501 kB | 16/354 kB Progress (4): 327/780 kB | 81/329 kB | 308/501 kB | 16/354 kB Progress (4): 327/780 kB | 81/329 kB | 324/501 kB | 16/354 kB Progress (4): 327/780 kB | 81/329 kB | 324/501 kB | 33/354 kB Progress (4): 327/780 kB | 81/329 kB | 340/501 kB | 33/354 kB Progress (4): 343/780 kB | 81/329 kB | 340/501 kB | 33/354 kB Progress (5): 343/780 kB | 81/329 kB | 340/501 kB | 33/354 kB | 16/41 kB Progress (5): 343/780 kB | 81/329 kB | 340/501 kB | 49/354 kB | 16/41 kB Progress (5): 343/780 kB | 81/329 kB | 357/501 kB | 49/354 kB | 16/41 kB Progress (5): 343/780 kB | 81/329 kB | 357/501 kB | 49/354 kB | 33/41 kB Progress (5): 360/780 kB | 81/329 kB | 357/501 kB | 49/354 kB | 33/41 kB Progress (5): 360/780 kB | 81/329 kB | 357/501 kB | 62/354 kB | 33/41 kB Progress (5): 360/780 kB | 81/329 kB | 373/501 kB | 62/354 kB | 33/41 kB Progress (5): 360/780 kB | 81/329 kB | 373/501 kB | 62/354 kB | 41 kB Progress (5): 376/780 kB | 81/329 kB | 373/501 kB | 62/354 kB | 41 kB Progress (5): 376/780 kB | 81/329 kB | 390/501 kB | 62/354 kB | 41 kB Progress (5): 376/780 kB | 81/329 kB | 390/501 kB | 79/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 288 kB/s) 2024-09-19T13:51:06.149 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 376/780 kB | 81/329 kB | 406/501 kB | 79/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-19T13:51:06.165 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 393/780 kB | 81/329 kB | 406/501 kB | 79/354 kB Progress (4): 393/780 kB | 81/329 kB | 406/501 kB | 95/354 kB Progress (4): 393/780 kB | 81/329 kB | 422/501 kB | 95/354 kB Progress (4): 409/780 kB | 81/329 kB | 422/501 kB | 95/354 kB Progress (4): 409/780 kB | 81/329 kB | 422/501 kB | 112/354 kB Progress (4): 409/780 kB | 97/329 kB | 422/501 kB | 112/354 kB Progress (4): 409/780 kB | 97/329 kB | 439/501 kB | 112/354 kB Progress (4): 425/780 kB | 97/329 kB | 439/501 kB | 112/354 kB Progress (4): 425/780 kB | 97/329 kB | 439/501 kB | 128/354 kB Progress (4): 425/780 kB | 113/329 kB | 439/501 kB | 128/354 kB Progress (4): 425/780 kB | 113/329 kB | 455/501 kB | 128/354 kB Progress (4): 442/780 kB | 113/329 kB | 455/501 kB | 128/354 kB Progress (4): 442/780 kB | 113/329 kB | 471/501 kB | 128/354 kB Progress (4): 442/780 kB | 113/329 kB | 471/501 kB | 144/354 kB Progress (4): 442/780 kB | 113/329 kB | 488/501 kB | 144/354 kB Progress (4): 458/780 kB | 113/329 kB | 488/501 kB | 144/354 kB Progress (4): 458/780 kB | 113/329 kB | 501 kB | 144/354 kB Progress (4): 458/780 kB | 113/329 kB | 501 kB | 161/354 kB Progress (4): 475/780 kB | 113/329 kB | 501 kB | 161/354 kB Progress (4): 475/780 kB | 113/329 kB | 501 kB | 177/354 kB Progress (4): 475/780 kB | 130/329 kB | 501 kB | 177/354 kB Progress (4): 491/780 kB | 130/329 kB | 501 kB | 177/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 491/780 kB | 146/329 kB | 177/354 kB Progress (3): 507/780 kB | 146/329 kB | 177/354 kB Progress (3): 507/780 kB | 146/329 kB | 193/354 kB Progress (4): 507/780 kB | 146/329 kB | 193/354 kB | 6.4 kB Progress (4): 524/780 kB | 146/329 kB | 193/354 kB | 6.4 kB Progress (4): 524/780 kB | 162/329 kB | 193/354 kB | 6.4 kB Progress (4): 524/780 kB | 162/329 kB | 210/354 kB | 6.4 kB Progress (4): 540/780 kB | 162/329 kB | 210/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 40 kB/s) 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 540/780 kB | 179/329 kB | 210/354 kB Progress (3): 540/780 kB | 179/329 kB | 226/354 kB Progress (3): 556/780 kB | 179/329 kB | 226/354 kB Progress (3): 556/780 kB | 195/329 kB | 226/354 kB Progress (3): 573/780 kB | 195/329 kB | 226/354 kB Progress (3): 573/780 kB | 195/329 kB | 243/354 kB Progress (3): 589/780 kB | 195/329 kB | 243/354 kB Progress (3): 589/780 kB | 212/329 kB | 243/354 kB Progress (3): 589/780 kB | 212/329 kB | 259/354 kB Progress (3): 606/780 kB | 212/329 kB | 259/354 kB Progress (3): 606/780 kB | 228/329 kB | 259/354 kB Progress (3): 606/780 kB | 228/329 kB | 275/354 kB Progress (3): 622/780 kB | 228/329 kB | 275/354 kB Progress (3): 622/780 kB | 244/329 kB | 275/354 kB Progress (3): 622/780 kB | 244/329 kB | 292/354 kB Progress (3): 638/780 kB | 244/329 kB | 292/354 kB Progress (3): 638/780 kB | 261/329 kB | 292/354 kB Progress (3): 638/780 kB | 261/329 kB | 308/354 kB Progress (3): 655/780 kB | 261/329 kB | 308/354 kB Progress (3): 655/780 kB | 277/329 kB | 308/354 kB Progress (3): 655/780 kB | 277/329 kB | 325/354 kB Progress (3): 671/780 kB | 277/329 kB | 325/354 kB Progress (3): 671/780 kB | 294/329 kB | 325/354 kB Progress (3): 671/780 kB | 294/329 kB | 341/354 kB Progress (3): 688/780 kB | 294/329 kB | 341/354 kB Progress (3): 688/780 kB | 310/329 kB | 341/354 kB Progress (3): 688/780 kB | 310/329 kB | 354 kB Progress (3): 704/780 kB | 310/329 kB | 354 kB Progress (3): 720/780 kB | 310/329 kB | 354 kB Progress (3): 720/780 kB | 326/329 kB | 354 kB Progress (3): 720/780 kB | 329 kB | 354 kB Progress (3): 737/780 kB | 329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-19T13:51:06.166 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 753/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-19T13:51:06.167 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 769/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.8 MB/s) 2024-09-19T13:51:06.167 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-19T13:51:06.183 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/586 kB Progress (2): 16/586 kB | 16/211 kB Progress (2): 33/586 kB | 16/211 kB Progress (2): 33/586 kB | 33/211 kB Progress (2): 49/586 kB | 33/211 kB Progress (2): 49/586 kB | 49/211 kB Progress (2): 66/586 kB | 49/211 kB Progress (2): 66/586 kB | 66/211 kB Progress (2): 82/586 kB | 66/211 kB Progress (2): 82/586 kB | 82/211 kB Progress (2): 98/586 kB | 82/211 kB Progress (2): 98/586 kB | 98/211 kB Progress (2): 115/586 kB | 98/211 kB Progress (2): 115/586 kB | 115/211 kB Progress (2): 131/586 kB | 115/211 kB Progress (2): 131/586 kB | 131/211 kB Progress (2): 147/586 kB | 131/211 kB Progress (2): 147/586 kB | 147/211 kB Progress (2): 164/586 kB | 147/211 kB Progress (2): 164/586 kB | 164/211 kB Progress (2): 180/586 kB | 164/211 kB Progress (2): 180/586 kB | 180/211 kB Progress (2): 197/586 kB | 180/211 kB Progress (2): 197/586 kB | 197/211 kB Progress (2): 213/586 kB | 197/211 kB Progress (2): 213/586 kB | 211 kB Progress (2): 229/586 kB | 211 kB Progress (2): 246/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-19T13:51:06.183 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 246/586 kB | 14 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-19T13:51:06.183 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 246/586 kB | 14 kB | 16/106 kB Progress (3): 256/586 kB | 14 kB | 16/106 kB Progress (3): 256/586 kB | 14 kB | 33/106 kB Progress (3): 272/586 kB | 14 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-19T13:51:06.183 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-19T13:51:06.184 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 272/586 kB | 49/106 kB Progress (2): 289/586 kB | 49/106 kB Progress (3): 289/586 kB | 49/106 kB | 6.8 kB Progress (3): 305/586 kB | 49/106 kB | 6.8 kB Progress (3): 305/586 kB | 66/106 kB | 6.8 kB Progress (3): 321/586 kB | 66/106 kB | 6.8 kB Progress (3): 321/586 kB | 82/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-19T13:51:06.184 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-19T13:51:06.184 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 338/586 kB | 82/106 kB Progress (2): 338/586 kB | 98/106 kB Progress (2): 338/586 kB | 106 kB Progress (2): 354/586 kB | 106 kB Progress (2): 370/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 594 kB/s) 2024-09-19T13:51:06.184 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-19T13:51:06.186 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 387/586 kB Progress (1): 403/586 kB Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-19T13:51:06.186 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-19T13:51:06.197 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/245 kB Progress (2): 33/205 kB | 16/245 kB Progress (2): 33/205 kB | 33/245 kB Progress (2): 49/205 kB | 33/245 kB Progress (2): 49/205 kB | 49/245 kB Progress (2): 65/205 kB | 49/245 kB Progress (2): 65/205 kB | 63/245 kB Progress (2): 81/205 kB | 63/245 kB Progress (2): 81/205 kB | 79/245 kB Progress (3): 81/205 kB | 79/245 kB | 16/16 kB Progress (3): 81/205 kB | 79/245 kB | 16 kB Progress (3): 98/205 kB | 79/245 kB | 16 kB Progress (3): 98/205 kB | 96/245 kB | 16 kB Progress (3): 114/205 kB | 96/245 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 85 kB/s) 2024-09-19T13:51:06.197 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-19T13:51:06.200 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 114/205 kB | 96/245 kB | 15 kB Progress (3): 114/205 kB | 112/245 kB | 15 kB Progress (3): 130/205 kB | 112/245 kB | 15 kB Progress (3): 130/205 kB | 128/245 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 79 kB/s) 2024-09-19T13:51:06.200 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 147/205 kB | 128/245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-19T13:51:06.200 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 147/205 kB | 145/245 kB Progress (2): 163/205 kB | 145/245 kB Progress (2): 163/205 kB | 161/245 kB Progress (2): 180/205 kB | 161/245 kB Progress (2): 180/205 kB | 177/245 kB Progress (2): 196/205 kB | 177/245 kB Progress (2): 205 kB | 177/245 kB Progress (2): 205 kB | 194/245 kB Progress (2): 205 kB | 210/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-19T13:51:06.200 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-19T13:51:06.201 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 227/245 kB Progress (1): 243/245 kB Progress (1): 245 kB Progress (2): 245 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-19T13:51:06.201 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-19T13:51:06.201 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-19T13:51:06.212 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 108 kB/s) 2024-09-19T13:51:06.213 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 115 kB/s) 2024-09-19T13:51:06.216 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (2): 49/184 kB | 16/17 kB Progress (2): 49/184 kB | 17 kB Progress (2): 66/184 kB | 17 kB Progress (2): 82/184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 82 kB/s) 2024-09-19T13:51:06.217 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 98/184 kB Progress (1): 111/184 kB Progress (1): 127/184 kB Progress (1): 143/184 kB Progress (1): 160/184 kB Progress (1): 176/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 859 kB/s) 2024-09-19T13:51:06.243 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:06.243 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-19T13:51:06.248 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-19T13:51:06.263 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-19T13:51:06.265 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-19T13:51:06.280 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-19T13:51:06.282 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-19T13:51:06.296 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-19T13:51:06.300 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-19T13:51:06.314 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-19T13:51:06.319 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-19T13:51:06.335 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 62/153 kB Progress (1): 79/153 kB Progress (1): 95/153 kB Progress (1): 112/153 kB Progress (1): 128/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-19T13:51:06.336 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-19T13:51:06.353 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 114/215 kB Progress (1): 130/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 179/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-19T13:51:06.389 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:06.389 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-19T13:51:06.391 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-19T13:51:06.406 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-19T13:51:06.407 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-19T13:51:06.421 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-19T13:51:06.424 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-19T13:51:06.439 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-19T13:51:06.441 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-19T13:51:06.455 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-19T13:51:06.458 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-19T13:51:06.473 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-19T13:51:06.474 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-19T13:51:06.489 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-19T13:51:06.491 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-19T13:51:06.506 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-19T13:51:06.507 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-19T13:51:06.521 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 211 kB/s) 2024-09-19T13:51:06.522 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-19T13:51:06.536 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-19T13:51:06.538 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-19T13:51:06.552 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-19T13:51:06.554 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-19T13:51:06.569 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-19T13:51:06.570 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-19T13:51:06.584 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-19T13:51:06.586 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-19T13:51:06.600 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-19T13:51:06.603 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-19T13:51:06.618 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-19T13:51:06.623 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-19T13:51:06.637 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-19T13:51:06.639 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-19T13:51:06.654 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-19T13:51:06.660 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-19T13:51:06.675 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-19T13:51:06.680 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-19T13:51:06.696 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-19T13:51:06.697 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-19T13:51:06.697 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-19T13:51:06.697 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-19T13:51:06.697 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-19T13:51:06.697 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-19T13:51:06.713 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/269 kB Progress (2): 2.5 kB | 33/269 kB Progress (3): 2.5 kB | 33/269 kB | 16/55 kB Progress (3): 2.5 kB | 49/269 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-19T13:51:06.713 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-19T13:51:06.713 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 49/269 kB | 16/55 kB | 8.5 kB Progress (3): 49/269 kB | 33/55 kB | 8.5 kB Progress (3): 66/269 kB | 33/55 kB | 8.5 kB Progress (4): 66/269 kB | 33/55 kB | 8.5 kB | 16/41 kB Progress (4): 66/269 kB | 49/55 kB | 8.5 kB | 16/41 kB Progress (4): 82/269 kB | 49/55 kB | 8.5 kB | 16/41 kB Progress (4): 82/269 kB | 55 kB | 8.5 kB | 16/41 kB Progress (4): 82/269 kB | 55 kB | 8.5 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-19T13:51:06.713 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-19T13:51:06.713 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 82/269 kB | 55 kB | 41 kB Progress (3): 98/269 kB | 55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-19T13:51:06.714 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 115/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-19T13:51:06.715 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-19T13:51:06.732 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 65/327 kB | 33/587 kB Progress (2): 65/327 kB | 49/587 kB Progress (2): 65/327 kB | 62/587 kB Progress (2): 81/327 kB | 62/587 kB Progress (2): 81/327 kB | 78/587 kB Progress (2): 97/327 kB | 78/587 kB Progress (2): 97/327 kB | 94/587 kB Progress (2): 114/327 kB | 94/587 kB Progress (2): 114/327 kB | 111/587 kB Progress (2): 130/327 kB | 111/587 kB Progress (2): 130/327 kB | 127/587 kB Progress (2): 147/327 kB | 127/587 kB Progress (2): 147/327 kB | 144/587 kB Progress (2): 163/327 kB | 144/587 kB Progress (2): 163/327 kB | 160/587 kB Progress (2): 179/327 kB | 160/587 kB Progress (2): 179/327 kB | 176/587 kB Progress (2): 196/327 kB | 176/587 kB Progress (2): 196/327 kB | 193/587 kB Progress (2): 212/327 kB | 193/587 kB Progress (2): 212/327 kB | 209/587 kB Progress (2): 228/327 kB | 209/587 kB Progress (2): 228/327 kB | 226/587 kB Progress (2): 245/327 kB | 226/587 kB Progress (2): 245/327 kB | 242/587 kB Progress (2): 261/327 kB | 242/587 kB Progress (2): 261/327 kB | 258/587 kB Progress (2): 278/327 kB | 258/587 kB Progress (2): 278/327 kB | 275/587 kB Progress (2): 294/327 kB | 275/587 kB Progress (2): 294/327 kB | 291/587 kB Progress (2): 310/327 kB | 291/587 kB Progress (2): 310/327 kB | 307/587 kB Progress (2): 327/327 kB | 307/587 kB Progress (2): 327 kB | 307/587 kB Progress (2): 327 kB | 324/587 kB Progress (2): 327 kB | 340/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-19T13:51:06.736 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 357/587 kB Progress (1): 373/587 kB Progress (1): 389/587 kB Progress (1): 406/587 kB Progress (1): 422/587 kB Progress (1): 439/587 kB Progress (1): 455/587 kB Progress (1): 471/587 kB Progress (1): 488/587 kB Progress (1): 504/587 kB Progress (1): 520/587 kB Progress (1): 537/587 kB Progress (1): 553/587 kB Progress (1): 570/587 kB Progress (1): 586/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-19T13:51:06.765 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-19T13:51:06.766 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:06.766 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-19T13:51:06.769 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-19T13:51:06.784 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-19T13:51:06.786 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-19T13:51:06.800 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-19T13:51:06.802 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-19T13:51:06.816 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-19T13:51:06.818 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-19T13:51:06.832 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-19T13:51:06.835 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-19T13:51:06.850 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-19T13:51:06.851 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-19T13:51:06.866 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-19T13:51:06.867 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-19T13:51:06.883 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-19T13:51:06.887 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-19T13:51:06.902 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-19T13:51:06.904 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-19T13:51:06.920 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-19T13:51:06.923 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-19T13:51:06.938 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 148 kB/s) 2024-09-19T13:51:06.941 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-19T13:51:06.956 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-19T13:51:06.959 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-19T13:51:06.975 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-19T13:51:06.977 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-19T13:51:06.993 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-19T13:51:06.996 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-19T13:51:07.011 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-19T13:51:07.014 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-19T13:51:07.028 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-19T13:51:07.031 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-19T13:51:07.046 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 167 kB/s) 2024-09-19T13:51:07.050 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-19T13:51:07.065 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-19T13:51:07.068 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-19T13:51:07.083 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-19T13:51:07.087 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-19T13:51:07.102 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-19T13:51:07.104 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-19T13:51:07.119 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-19T13:51:07.121 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-19T13:51:07.136 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-19T13:51:07.140 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-19T13:51:07.155 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-19T13:51:07.157 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-19T13:51:07.172 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-19T13:51:07.178 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-19T13:51:07.193 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-19T13:51:07.194 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-19T13:51:07.194 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-19T13:51:07.194 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-19T13:51:07.194 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-19T13:51:07.194 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-19T13:51:07.210 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Progress (3): 4.2 kB | 16/122 kB | 16/55 kB Progress (3): 4.2 kB | 32/122 kB | 16/55 kB Progress (4): 4.2 kB | 32/122 kB | 16/55 kB | 16/27 kB Progress (4): 4.2 kB | 32/122 kB | 33/55 kB | 16/27 kB Progress (5): 4.2 kB | 32/122 kB | 33/55 kB | 16/27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-19T13:51:07.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 49/122 kB | 33/55 kB | 16/27 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-19T13:51:07.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 49/122 kB | 33/55 kB | 27 kB | 16/334 kB Progress (4): 49/122 kB | 49/55 kB | 27 kB | 16/334 kB Progress (4): 49/122 kB | 49/55 kB | 27 kB | 33/334 kB Progress (4): 65/122 kB | 49/55 kB | 27 kB | 33/334 kB Progress (4): 65/122 kB | 55 kB | 27 kB | 33/334 kB Progress (4): 65/122 kB | 55 kB | 27 kB | 49/334 kB Progress (4): 81/122 kB | 55 kB | 27 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-19T13:51:07.211 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-19T13:51:07.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 81/122 kB | 55 kB | 64/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-19T13:51:07.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 98/122 kB | 64/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-19T13:51:07.211 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 98/122 kB | 81/334 kB Progress (2): 114/122 kB | 81/334 kB Progress (2): 114/122 kB | 97/334 kB Progress (2): 122 kB | 97/334 kB Progress (2): 122 kB | 114/334 kB Progress (2): 122 kB | 130/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-19T13:51:07.213 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 146/334 kB Progress (1): 163/334 kB Progress (1): 179/334 kB Progress (1): 195/334 kB Progress (1): 212/334 kB Progress (1): 228/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 277/334 kB Progress (1): 294/334 kB Progress (1): 310/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-19T13:51:07.223 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 33/267 kB | 4.7 kB Progress (3): 33/267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-19T13:51:07.223 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 33/267 kB | 23 kB Progress (2): 49/267 kB | 23 kB Progress (2): 64/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-19T13:51:07.225 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 80/267 kB Progress (1): 97/267 kB Progress (1): 113/267 kB Progress (1): 130/267 kB Progress (1): 146/267 kB Progress (1): 162/267 kB Progress (1): 179/267 kB Progress (1): 195/267 kB Progress (1): 212/267 kB Progress (1): 228/267 kB Progress (1): 244/267 kB Progress (1): 261/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-19T13:51:07.273 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-19T13:51:07.274 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-19T13:51:07.921 INFO:tasks.workunit.client.0.smithi094.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-19T13:51:07.922 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:07.922 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-19T13:51:07.922 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-19T13:51:07.922 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:07.922 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-19T13:51:07.928 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-19T13:51:07.928 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-19T13:51:08.136 INFO:tasks.workunit.client.0.smithi094.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-19T13:51:08.136 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:08.136 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-19T13:51:08.141 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-19T13:51:08.156 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-19T13:51:08.160 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-19T13:51:08.175 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-19T13:51:08.180 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-19T13:51:08.195 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-19T13:51:08.198 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-19T13:51:08.213 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-19T13:51:08.217 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-19T13:51:08.232 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-19T13:51:08.236 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-19T13:51:08.250 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-19T13:51:08.254 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-19T13:51:08.269 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-19T13:51:08.272 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-19T13:51:08.286 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-19T13:51:08.288 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-19T13:51:08.302 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-19T13:51:08.305 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-19T13:51:08.320 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-19T13:51:08.322 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-19T13:51:08.337 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-19T13:51:08.340 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-19T13:51:08.355 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-19T13:51:08.357 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-19T13:51:08.372 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-19T13:51:08.374 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-19T13:51:08.389 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-19T13:51:08.391 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-19T13:51:08.406 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-19T13:51:08.409 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-19T13:51:08.424 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-19T13:51:08.426 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-19T13:51:08.440 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-19T13:51:08.443 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-19T13:51:08.458 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-19T13:51:08.461 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-19T13:51:08.475 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-19T13:51:08.478 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-19T13:51:08.493 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-19T13:51:08.496 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-19T13:51:08.510 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-19T13:51:08.512 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-19T13:51:08.526 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-19T13:51:08.527 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-19T13:51:08.542 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-19T13:51:08.544 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-19T13:51:08.558 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-19T13:51:08.560 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-19T13:51:08.574 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-19T13:51:08.577 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-19T13:51:08.592 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 197 kB/s) 2024-09-19T13:51:08.594 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-19T13:51:08.607 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-19T13:51:08.609 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-19T13:51:08.623 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-19T13:51:08.625 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-19T13:51:08.640 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-19T13:51:08.642 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-19T13:51:08.656 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-19T13:51:08.660 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-19T13:51:08.674 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-19T13:51:08.678 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-19T13:51:08.693 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-19T13:51:08.694 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-19T13:51:08.709 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-19T13:51:08.712 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-19T13:51:08.726 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-19T13:51:08.728 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-19T13:51:08.742 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-19T13:51:08.745 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-19T13:51:08.759 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-19T13:51:08.761 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-19T13:51:08.775 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-19T13:51:08.779 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-19T13:51:08.793 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-19T13:51:08.795 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-19T13:51:08.810 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-19T13:51:08.812 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-19T13:51:08.826 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-19T13:51:08.828 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-19T13:51:08.842 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-19T13:51:08.845 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-19T13:51:08.859 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-19T13:51:08.862 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-19T13:51:08.876 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-19T13:51:08.879 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-19T13:51:08.894 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-19T13:51:08.897 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-19T13:51:08.911 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-19T13:51:08.914 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-19T13:51:08.929 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-19T13:51:08.932 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-19T13:51:08.946 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-19T13:51:08.948 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-19T13:51:08.963 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-19T13:51:08.964 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-19T13:51:08.978 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-19T13:51:08.981 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-19T13:51:08.995 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-19T13:51:08.997 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-19T13:51:09.011 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-19T13:51:09.013 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-19T13:51:09.027 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-19T13:51:09.029 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-19T13:51:09.043 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-19T13:51:09.046 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-19T13:51:09.060 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-19T13:51:09.063 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-19T13:51:09.077 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-19T13:51:09.079 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-19T13:51:09.094 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-19T13:51:09.099 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-19T13:51:09.113 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-19T13:51:09.116 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-19T13:51:09.131 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-19T13:51:09.133 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-19T13:51:09.147 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-19T13:51:09.149 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-19T13:51:09.163 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-19T13:51:09.165 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-19T13:51:09.180 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-19T13:51:09.183 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-19T13:51:09.197 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-19T13:51:09.203 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-19T13:51:09.222 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 79/308 kB Progress (1): 95/308 kB Progress (1): 112/308 kB Progress (1): 128/308 kB Progress (1): 144/308 kB Progress (1): 161/308 kB Progress (1): 177/308 kB Progress (1): 194/308 kB Progress (1): 210/308 kB Progress (1): 226/308 kB Progress (1): 243/308 kB Progress (1): 259/308 kB Progress (1): 275/308 kB Progress (1): 292/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-19T13:51:09.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-19T13:51:09.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-19T13:51:09.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-19T13:51:09.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-19T13:51:09.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-19T13:51:09.240 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 16/118 kB Progress (2): 63/171 kB | 16/118 kB Progress (2): 79/171 kB | 16/118 kB Progress (2): 79/171 kB | 33/118 kB Progress (3): 79/171 kB | 33/118 kB | 8.2 kB Progress (4): 79/171 kB | 33/118 kB | 8.2 kB | 14 kB Progress (4): 95/171 kB | 33/118 kB | 8.2 kB | 14 kB Progress (4): 95/171 kB | 49/118 kB | 8.2 kB | 14 kB Progress (5): 95/171 kB | 49/118 kB | 8.2 kB | 14 kB | 16/26 kB Progress (5): 112/171 kB | 49/118 kB | 8.2 kB | 14 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 799 kB/s) 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 112/171 kB | 66/118 kB | 8.2 kB | 16/26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 112/171 kB | 66/118 kB | 8.2 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 128/171 kB | 66/118 kB | 26 kB Progress (3): 128/171 kB | 82/118 kB | 26 kB Progress (3): 144/171 kB | 82/118 kB | 26 kB Progress (3): 144/171 kB | 98/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 144/171 kB | 115/118 kB Progress (2): 144/171 kB | 118 kB Progress (2): 161/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-19T13:51:09.241 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-19T13:51:09.257 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/136 kB Progress (3): 16/146 kB | 16/136 kB | 16/61 kB Progress (3): 16/146 kB | 33/136 kB | 16/61 kB Progress (3): 33/146 kB | 33/136 kB | 16/61 kB Progress (3): 33/146 kB | 33/136 kB | 33/61 kB Progress (3): 33/146 kB | 49/136 kB | 33/61 kB Progress (3): 33/146 kB | 49/136 kB | 49/61 kB Progress (3): 49/146 kB | 49/136 kB | 49/61 kB Progress (3): 49/146 kB | 63/136 kB | 49/61 kB Progress (3): 49/146 kB | 63/136 kB | 61 kB Progress (3): 65/146 kB | 63/136 kB | 61 kB Progress (3): 65/146 kB | 80/136 kB | 61 kB Progress (4): 65/146 kB | 80/136 kB | 61 kB | 16/58 kB Progress (4): 81/146 kB | 80/136 kB | 61 kB | 16/58 kB Progress (4): 81/146 kB | 96/136 kB | 61 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-19T13:51:09.257 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-19T13:51:09.257 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 81/146 kB | 96/136 kB | 33/58 kB Progress (3): 98/146 kB | 96/136 kB | 33/58 kB Progress (3): 98/146 kB | 112/136 kB | 33/58 kB Progress (3): 98/146 kB | 112/136 kB | 49/58 kB Progress (3): 98/146 kB | 112/136 kB | 58 kB Progress (3): 114/146 kB | 112/136 kB | 58 kB Progress (3): 114/146 kB | 129/136 kB | 58 kB Progress (3): 114/146 kB | 136 kB | 58 kB Progress (4): 114/146 kB | 136 kB | 58 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-19T13:51:09.257 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 130/146 kB | 136 kB | 16/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-19T13:51:09.257 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 130/146 kB | 136 kB | 33/501 kB Progress (3): 146 kB | 136 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.1 MB/s) 2024-09-19T13:51:09.257 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 146 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.4 MB/s) 2024-09-19T13:51:09.262 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-19T13:51:09.270 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 81/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (2): 114/124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-19T13:51:09.302 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 31 MB/s) 2024-09-19T13:51:09.394 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:09.394 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-19T13:51:09.397 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-19T13:51:09.411 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-19T13:51:09.413 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-19T13:51:09.427 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-19T13:51:09.429 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-19T13:51:09.444 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-19T13:51:09.446 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-19T13:51:09.461 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-19T13:51:09.463 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-19T13:51:09.478 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-19T13:51:09.480 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-19T13:51:09.494 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-19T13:51:09.496 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-19T13:51:09.511 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-19T13:51:09.513 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-19T13:51:09.528 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-19T13:51:09.530 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-19T13:51:09.545 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-19T13:51:09.548 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-19T13:51:09.563 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-19T13:51:09.565 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-19T13:51:09.579 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-19T13:51:09.581 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-19T13:51:09.595 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-19T13:51:09.597 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-19T13:51:09.611 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-19T13:51:09.616 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-19T13:51:09.630 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-19T13:51:09.631 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-19T13:51:09.631 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-19T13:51:09.631 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-19T13:51:09.631 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-19T13:51:09.631 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-19T13:51:09.649 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/211 kB Progress (3): 16/79 kB | 16/211 kB | 16/26 kB Progress (4): 16/79 kB | 16/211 kB | 16/26 kB | 16/58 kB Progress (5): 16/79 kB | 16/211 kB | 16/26 kB | 16/58 kB | 0/1.0 MB Progress (5): 33/79 kB | 16/211 kB | 16/26 kB | 16/58 kB | 0/1.0 MB Progress (5): 33/79 kB | 16/211 kB | 26 kB | 16/58 kB | 0/1.0 MB Progress (5): 33/79 kB | 33/211 kB | 26 kB | 16/58 kB | 0/1.0 MB Progress (5): 33/79 kB | 33/211 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 33/79 kB | 33/211 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/79 kB | 33/211 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/79 kB | 49/211 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 66/79 kB | 49/211 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 66/79 kB | 49/211 kB | 26 kB | 49/58 kB | 0/1.0 MB Progress (5): 66/79 kB | 49/211 kB | 26 kB | 49/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-19T13:51:09.649 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-19T13:51:09.649 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (4): 66/79 kB | 63/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 63/211 kB | 58 kB | 0/1.0 MB Progress (4): 79 kB | 63/211 kB | 58 kB | 0/1.0 MB Progress (4): 79 kB | 63/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 80/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 80/211 kB | 58 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-19T13:51:09.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-19T13:51:09.650 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-19T13:51:09.651 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 96/211 kB | 0.1/1.0 MB Progress (2): 96/211 kB | 0.1/1.0 MB Progress (2): 96/211 kB | 0.1/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 129/211 kB | 0.1/1.0 MB Progress (2): 129/211 kB | 0.1/1.0 MB Progress (2): 129/211 kB | 0.2/1.0 MB Progress (2): 145/211 kB | 0.2/1.0 MB Progress (2): 145/211 kB | 0.2/1.0 MB Progress (2): 158/211 kB | 0.2/1.0 MB Progress (2): 158/211 kB | 0.2/1.0 MB Progress (2): 174/211 kB | 0.2/1.0 MB Progress (2): 174/211 kB | 0.2/1.0 MB Progress (2): 174/211 kB | 0.2/1.0 MB Progress (2): 190/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Progress (2): 211 kB | 0.3/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-19T13:51:09.662 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (3): 0.9/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 32/267 kB Progress (3): 1.0/1.0 MB | 49/116 kB | 32/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 32/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 1.0/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 1.0/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 1.0/1.0 MB | 82/116 kB | 65/267 kB Progress (3): 1.0/1.0 MB | 82/116 kB | 65/267 kB Progress (3): 1.0/1.0 MB | 98/116 kB | 65/267 kB Progress (3): 1.0 MB | 98/116 kB | 65/267 kB Progress (3): 1.0 MB | 98/116 kB | 81/267 kB Progress (3): 1.0 MB | 115/116 kB | 81/267 kB Progress (3): 1.0 MB | 116 kB | 81/267 kB Progress (3): 1.0 MB | 116 kB | 97/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-19T13:51:09.662 INFO:tasks.workunit.client.0.smithi094.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 33 MB/s) 2024-09-19T13:51:09.664 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 179/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 228/267 kB Progress (1): 245/267 kB Progress (1): 261/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.1 MB/s) 2024-09-19T13:51:09.791 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-19T13:51:09.814 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:51:09.815 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] BUILD SUCCESS 2024-09-19T13:51:09.815 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:51:09.815 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Total time: 5.818 s 2024-09-19T13:51:09.816 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Finished at: 2024-09-19T13:51:09Z 2024-09-19T13:51:09.816 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:51:09.839 INFO:tasks.workunit.client.0.smithi094.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-19T13:51:09.848 INFO:tasks.workunit.client.0.smithi094.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-19T13:51:10.919 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Scanning for projects... 2024-09-19T13:51:10.991 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:10.992 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-19T13:51:10.992 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Building jcksum 1.0 2024-09-19T13:51:10.992 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] from pom.xml 2024-09-19T13:51:10.992 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-19T13:51:11.283 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:11.283 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-19T13:51:11.400 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-19T13:51:11.400 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:11.400 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-19T13:51:11.516 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-19T13:51:11.516 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:11.516 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-19T13:51:11.518 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-19T13:51:11.518 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:11.518 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-19T13:51:11.525 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-19T13:51:11.525 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:11.525 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-19T13:51:11.740 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-19T13:51:11.980 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-19T13:51:12.170 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-19T13:51:12.179 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-19T13:51:12.197 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-19T13:51:12.201 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-19T13:51:12.219 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-19T13:51:12.223 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-19T13:51:12.239 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-19T13:51:12.241 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-19T13:51:12.257 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-19T13:51:12.259 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-19T13:51:12.276 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-19T13:51:12.278 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-19T13:51:12.294 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-19T13:51:12.299 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-19T13:51:12.320 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 17/27 kB Progress (1): 19/27 kB Progress (1): 20/27 kB Progress (1): 21/27 kB Progress (1): 23/27 kB Progress (1): 24/27 kB Progress (1): 25/27 kB Progress (1): 27/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-19T13:51:12.322 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-19T13:51:12.322 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-19T13:51:12.322 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-19T13:51:12.322 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-19T13:51:12.323 INFO:tasks.workunit.client.0.smithi094.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-19T13:51:12.342 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 836 kB/s) 2024-09-19T13:51:12.375 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 2.8/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 2.8/189 kB Progress (2): 4.1/7.7 kB | 4.1/189 kB Progress (2): 5.5/7.7 kB | 4.1/189 kB Progress (2): 5.5/7.7 kB | 5.5/189 kB Progress (2): 6.9/7.7 kB | 5.5/189 kB Progress (3): 6.9/7.7 kB | 5.5/189 kB | 16/103 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 16/103 kB | 1.4/169 kB Progress (4): 7.7 kB | 5.5/189 kB | 16/103 kB | 1.4/169 kB Progress (4): 7.7 kB | 6.9/189 kB | 16/103 kB | 1.4/169 kB Progress (4): 7.7 kB | 6.9/189 kB | 16/103 kB | 2.8/169 kB Progress (4): 7.7 kB | 8.3/189 kB | 16/103 kB | 2.8/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-09-19T13:51:12.400 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (3): 8.3/189 kB | 16/103 kB | 4.1/169 kB Progress (3): 9.7/189 kB | 16/103 kB | 4.1/169 kB Progress (3): 9.7/189 kB | 16/103 kB | 5.5/169 kB Progress (3): 11/189 kB | 16/103 kB | 5.5/169 kB Progress (3): 11/189 kB | 16/103 kB | 6.9/169 kB Progress (3): 12/189 kB | 16/103 kB | 6.9/169 kB Progress (3): 12/189 kB | 16/103 kB | 8.3/169 kB Progress (3): 14/189 kB | 16/103 kB | 8.3/169 kB Progress (3): 14/189 kB | 16/103 kB | 9.7/169 kB Progress (3): 15/189 kB | 16/103 kB | 9.7/169 kB Progress (3): 15/189 kB | 16/103 kB | 11/169 kB Progress (3): 16/189 kB | 16/103 kB | 11/169 kB Progress (3): 16/189 kB | 16/103 kB | 12/169 kB Progress (3): 16/189 kB | 16/103 kB | 14/169 kB Progress (3): 16/189 kB | 16/103 kB | 15/169 kB Progress (3): 16/189 kB | 16/103 kB | 16/169 kB Progress (3): 32/189 kB | 16/103 kB | 16/169 kB Progress (3): 32/189 kB | 33/103 kB | 16/169 kB Progress (3): 32/189 kB | 49/103 kB | 16/169 kB Progress (3): 49/189 kB | 49/103 kB | 16/169 kB Progress (3): 49/189 kB | 49/103 kB | 32/169 kB Progress (3): 49/189 kB | 49/103 kB | 49/169 kB Progress (3): 65/189 kB | 49/103 kB | 49/169 kB Progress (3): 65/189 kB | 66/103 kB | 49/169 kB Progress (3): 78/189 kB | 66/103 kB | 49/169 kB Progress (3): 78/189 kB | 82/103 kB | 49/169 kB Progress (3): 94/189 kB | 82/103 kB | 49/169 kB Progress (3): 94/189 kB | 82/103 kB | 65/169 kB Progress (3): 94/189 kB | 98/103 kB | 65/169 kB Progress (3): 94/189 kB | 98/103 kB | 81/169 kB Progress (3): 111/189 kB | 98/103 kB | 81/169 kB Progress (3): 111/189 kB | 103 kB | 81/169 kB Progress (3): 111/189 kB | 103 kB | 98/169 kB Progress (3): 127/189 kB | 103 kB | 98/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-19T13:51:12.409 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (2): 143/189 kB | 98/169 kB Progress (2): 143/189 kB | 114/169 kB Progress (2): 143/189 kB | 130/169 kB Progress (2): 143/189 kB | 147/169 kB Progress (2): 160/189 kB | 147/169 kB Progress (2): 176/189 kB | 147/169 kB Progress (2): 189 kB | 147/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-19T13:51:12.410 INFO:tasks.workunit.client.0.smithi094.stdout:Progress (1): 163/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-19T13:51:12.424 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:12.424 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------- 2024-09-19T13:51:12.424 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] T E S T S 2024-09-19T13:51:12.424 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------- 2024-09-19T13:51:12.846 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-19T13:51:12.885 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjects.java: starting test run: 2024-09-19T13:51:12.984 INFO:tasks.workunit.client.0.smithi094.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T13:51:12.985 INFO:tasks.workunit.client.0.smithi094.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T13:51:12.985 INFO:tasks.workunit.client.0.smithi094.stdout: EndpointUrl=http://smithi094.front.sepia.ceph.com:80 2024-09-19T13:51:12.985 INFO:tasks.workunit.client.0.smithi094.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-19T13:51:13.084 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Environment Variables Read 2024-09-19T13:51:13.385 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: S3 Client Initialized 2024-09-19T13:51:13.385 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-19T13:51:13.385 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-19T13:51:13.385 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-19T13:51:13.385 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-19T13:51:13.385 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-19T13:51:13.485 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-19T13:51:13.485 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-19T13:51:13.485 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-19T13:51:13.486 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-19T13:51:13.486 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-19T13:51:13.486 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generating File 2024-09-19T13:51:13.486 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: File Generated 2024-09-19T13:51:13.486 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Generated Big Files 2024-09-19T13:51:13.585 INFO:tasks.workunit.client.0.smithi094.stdout:HeadBucketResponse() 2024-09-19T13:51:13.585 INFO:tasks.workunit.client.0.smithi094.stdout:sheik is ready 2024-09-19T13:51:13.585 INFO:tasks.workunit.client.0.smithi094.stdout:DEBUG: Test Bucket Created 2024-09-19T13:51:13.685 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-19T13:51:13.785 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-19T13:51:13.858 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-19T13:51:13.885 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-19T13:51:13.943 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-19T13:51:13.979 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-19T13:51:13.985 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-19T13:51:14.047 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-19T13:51:14.085 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-19T13:51:14.186 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-19T13:51:16.189 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-19T13:51:16.590 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-19T13:51:18.578 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-0b 2024-09-19T13:51:18.579 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-8b 2024-09-19T13:51:18.580 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-200b 2024-09-19T13:51:18.582 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-21983b 2024-09-19T13:51:18.583 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-5519b 2024-09-19T13:51:18.584 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-204329b 2024-09-19T13:51:18.586 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-256k 2024-09-19T13:51:18.587 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-1m 2024-09-19T13:51:18.589 INFO:tasks.workunit.client.0.smithi094.stdout:arg: file-1038757b 2024-09-19T13:51:18.592 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-0b 2024-09-19T13:51:18.623 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.681 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-8b 2024-09-19T13:51:18.681 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.692 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-200b 2024-09-19T13:51:18.692 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.793 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-21983b 2024-09-19T13:51:18.793 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.854 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-5519b 2024-09-19T13:51:18.854 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.893 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-204329b 2024-09-19T13:51:18.893 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.938 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-256k 2024-09-19T13:51:18.938 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.978 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-1m 2024-09-19T13:51:18.978 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:18.993 INFO:tasks.workunit.client.0.smithi094.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-19T13:51:19.018 INFO:tasks.workunit.client.0.smithi094.stdout:PutObjectResponse 2024-09-19T13:51:19.093 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-19T13:51:19.294 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-19T13:51:19.794 INFO:tasks.workunit.client.0.smithi094.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-19T13:51:22.110 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.258 s -- in io.ceph.jcksum.PutObjects 2024-09-19T13:51:22.153 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:22.153 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Results: 2024-09-19T13:51:22.153 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:22.153 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-19T13:51:22.153 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] 2024-09-19T13:51:22.155 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:51:22.155 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] BUILD SUCCESS 2024-09-19T13:51:22.155 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:51:22.157 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Total time: 11.255 s 2024-09-19T13:51:22.157 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] Finished at: 2024-09-19T13:51:22Z 2024-09-19T13:51:22.157 INFO:tasks.workunit.client.0.smithi094.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:51:22.179 INFO:tasks.workunit.client.0.smithi094.stderr:+ exit 2024-09-19T13:51:22.180 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:51:22.180 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:51:22.258 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-19T13:51:22.258 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T13:51:22.611 DEBUG:teuthology.parallel:result is None 2024-09-19T13:51:22.611 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:51:22.649 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:51:22.649 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:51:22.717 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:51:22.717 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:51:22.728 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:51:22.728 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:51:22.728 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:51:22.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:51:22.787 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:51:22.787 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:51:22.855 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:51:22.856 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:51:22.924 INFO:tasks.workunit:timeout=3h 2024-09-19T13:51:22.924 INFO:tasks.workunit:cleanup=True 2024-09-19T13:51:22.925 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:51:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:52:22.094 INFO:tasks.workunit.client.0.smithi094.stderr:Updating files: 98% (12562/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-19T13:52:22.469 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.470 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-19T13:52:22.471 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.471 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-19T13:52:22.471 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.471 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:52:22.471 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:52:22.471 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:52:22.476 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:52:22.544 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:52:22.546 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:52:22.547 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:52:22.595 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:52:22.643 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:52:22.682 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:52:22.683 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:52:22.683 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:52:22.722 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:52:22.725 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:52:22.725 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:52:22.794 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-19T13:52:22.796 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-19T13:52:22.796 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-19T13:52:22.869 INFO:tasks.workunit.client.0.smithi094.stdout:INFO: fully qualified domain name: smithi094.front.sepia.ceph.com 2024-09-19T13:52:22.869 INFO:tasks.workunit.client.0.smithi094.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-19T13:52:22.869 INFO:tasks.workunit.client.0.smithi094.stdout:== TESTING VERSIONED BUCKET == 2024-09-19T13:52:25.393 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-19T13:52:25.569 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-19T13:52:25.575 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T13:52:25.618 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-19T13:52:25.618 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-19T13:52:25.618 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-19T13:52:25.773 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-19T13:52:25.778 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-19T13:52:26.504 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-19T13:52:27.316 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-19T13:52:27.318 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T13:52:27.847 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T13:52:27.849 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T13:52:27.930 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T13:52:27.931 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T13:52:27.987 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T13:52:27.989 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T13:52:28.038 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:52:28.039 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T13:52:28.114 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:52:28.116 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-19T13:52:28.261 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:52:28.262 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T13:52:28.266 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T13:52:28.267 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T13:52:28.277 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T13:52:28.278 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T13:52:28.279 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T13:52:28.281 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-19T13:52:28.282 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:52:28.356 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T13:52:29.477 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-19T13:52:29.708 INFO:tasks.workunit.client.0.smithi094.stdout:INFO: creating user 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout:{ 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "user_id": "testid", 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "display_name": "M. Tester", 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "email": "tester@ceph.com", 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "suspended": 0, 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "max_buckets": 1000, 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "subusers": [], 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: "keys": [ 2024-09-19T13:52:30.020 INFO:tasks.workunit.client.0.smithi094.stdout: { 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "user": "testid", 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "access_key": "0555b35654ad1656d804", 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "active": true, 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-19T13:52:30.012892Z" 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: } 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: ], 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "swift_keys": [], 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "caps": [], 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "default_placement": "", 2024-09-19T13:52:30.021 INFO:tasks.workunit.client.0.smithi094.stdout: "default_storage_class": "", 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "placement_tags": [], 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "bucket_quota": { 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "user_quota": { 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "enabled": false, 2024-09-19T13:52:30.022 INFO:tasks.workunit.client.0.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size": -1, 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "max_objects": -1 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: }, 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "temp_url_keys": [], 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "type": "rgw", 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "mfa_ids": [], 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "account_id": "", 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "path": "/", 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "create_date": "2024-09-19T13:52:30.012868Z", 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "tags": [], 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: "group_ids": [] 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout:} 2024-09-19T13:52:30.023 INFO:tasks.workunit.client.0.smithi094.stdout: 2024-09-19T13:52:30.270 INFO:tasks.workunit.client.0.smithi094.stderr:5+0 records in 2024-09-19T13:52:30.270 INFO:tasks.workunit.client.0.smithi094.stderr:5+0 records out 2024-09-19T13:52:30.270 INFO:tasks.workunit.client.0.smithi094.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0146822 s, 357 MB/s 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:bucket nams is reupload-bkt-132669 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:endpoint is http://smithi094.front.sepia.ceph.com:80 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:start UploadId=2~l7tP2dlqcxUtNK7MVL-KyRk0XdmUDFY 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:phase 1 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 2} 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.353 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:phase 2 uploaded part {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1} 2024-09-19T13:52:31.354 INFO:tasks.workunit.client.0.smithi094.stdout:aborting multipart upload, parts=[{'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 1}, {'ETag': '"d16209b2aabd574e86cf2c63f008f4d3"', 'PartNumber': 2}] 2024-09-19T13:52:32.113 INFO:tasks.workunit.client.0.smithi094.stdout:radosgw-admin bucket radoslist: 2024-09-19T13:52:32.170 INFO:tasks.workunit.client.0.smithi094.stdout:rados ls: 2024-09-19T13:52:32.174 INFO:tasks.workunit.client.0.smithi094.stdout:== PASSED == 2024-09-19T13:52:32.174 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:52:32.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:52:32.254 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-19T13:52:32.254 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T13:52:32.606 DEBUG:teuthology.parallel:result is None 2024-09-19T13:52:32.607 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:52:32.645 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:52:32.645 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:52:32.714 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:52:32.714 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-19T13:52:32.754 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-19T13:52:32.754 INFO:tasks.ragweed:Downloading ragweed... 2024-09-19T13:52:32.755 INFO:tasks.ragweed:Using branch 'wip-yuval-test' for ragweed 2024-09-19T13:52:32.755 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b wip-yuval-test https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T13:52:32.783 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-19T13:52:32.813 INFO:teuthology.orchestra.run.smithi094.stderr:fatal: Remote branch wip-yuval-test not found in upstream origin 2024-09-19T13:52:32.813 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-19T13:52:32.814 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-19T13:52:32.815 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T13:52:32.883 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-19T13:52:33.022 INFO:tasks.ragweed:Creating rgw users... 2024-09-19T13:52:33.023 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-19T13:52:33.023 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key GBRAMBKPCDRRHQRXOFWJ --secret 14NcaiaWvGo+DxexITCW7Hy4ZBIehVU5iPCabat/qg2Ev/myoVNa4g== --email ragweed.client.0+test@test.test --system false 2024-09-19T13:52:33.130 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:52:33.130 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:52:33.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.161+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 realm 2024-09-19T13:52:33.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:52:33.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.162+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.163+0000 7f8870739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:33.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.163+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.164+0000 7f8870739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:52:33.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.164+0000 7f8870739800 20 searching for the correct realm 2024-09-19T13:52:33.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.168+0000 7f886bbc6640 0 -- 172.21.15.94:0/3177605418 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f886404dbf0 msgr2=0x7f8864041980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:52:33.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.171+0000 7f886cbc8640 0 -- 172.21.15.94:0/3177605418 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7f885400b040 msgr2=0x7f8854044390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:52:33.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:52:33.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:52:33.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:52:33.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:52:33.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:52:33.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:52:33.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.175+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:33.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:52:33.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 zone default found 2024-09-19T13:52:33.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 4 Realm: () 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 zonegroup default 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.176+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.177+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.177+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.177+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.177+0000 7f8870739800 20 started sync module instance, tier type = 2024-09-19T13:52:33.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.177+0000 7f8870739800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=0 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=1 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=2 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=3 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=4 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=5 2024-09-19T13:52:33.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.186+0000 7f8870739800 20 add_watcher() i=6 2024-09-19T13:52:33.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.187+0000 7f8870739800 20 add_watcher() i=7 2024-09-19T13:52:33.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.187+0000 7f8870739800 2 all 8 watchers are set, enabling cache 2024-09-19T13:52:33.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.188+0000 7f87237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:33.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:52:33.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:52:33.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 5 note: GC not initialized 2024-09-19T13:52:33.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f87227dc640 20 reqs_thread_entry: start 2024-09-19T13:52:33.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 init_complete bucket index max shards: 11 2024-09-19T13:52:33.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 Filter name: none 2024-09-19T13:52:33.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f871b7fe640 20 reqs_thread_entry: start 2024-09-19T13:52:33.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-19T13:52:33.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.189+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 cache get: name=default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ : miss 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 cache put: name=default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ info.flags=0x0 2024-09-19T13:52:33.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 adding default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ to cache LRU end 2024-09-19T13:52:33.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 cache get: name=default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ : hit (negative entry) 2024-09-19T13:52:33.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.190+0000 7f8870739800 10 cache get: name=default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ : hit (negative entry) 2024-09-19T13:52:33.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.191+0000 7f8870739800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-19T13:52:33.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.191+0000 7f8870739800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T13:52:33.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.191+0000 7f8870739800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-19T13:52:33.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.192+0000 7f87437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856727 cookie 94627864871088 notifier 5898 bl.length()=675 2024-09-19T13:52:33.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.192+0000 7f87437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-19T13:52:33.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.192+0000 7f87437fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T13:52:33.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.194+0000 7f8870739800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-19T13:52:33.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.194+0000 7f8870739800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T13:52:33.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.194+0000 7f8870739800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-19T13:52:33.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.194+0000 7f87437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856714 cookie 94627864880128 notifier 5898 bl.length()=202 2024-09-19T13:52:33.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.194+0000 7f87437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-19T13:52:33.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.194+0000 7f87437fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T13:52:33.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.196+0000 7f8870739800 10 cache put: name=default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ info.flags=0x7 2024-09-19T13:52:33.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.196+0000 7f8870739800 10 moving default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ to cache LRU end 2024-09-19T13:52:33.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.196+0000 7f8870739800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:GBRAMBKPCDRRHQRXOFWJ, ofs0, ns] 2024-09-19T13:52:33.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.196+0000 7f87437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856721 cookie 94627864888272 notifier 5898 bl.length()=190 2024-09-19T13:52:33.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.196+0000 7f87437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ info.flags=0x7 2024-09-19T13:52:33.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.196+0000 7f87437fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GBRAMBKPCDRRHQRXOFWJ to cache LRU end 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "ragweed.client.0", 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T13:52:33.199 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "ragweed.client.0", 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "GBRAMBKPCDRRHQRXOFWJ", 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "14NcaiaWvGo+DxexITCW7Hy4ZBIehVU5iPCabat/qg2Ev/myoVNa4g==", 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T13:52:33.191901Z" 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T13:52:33.200 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T13:52:33.201 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T13:52:33.191890Z", 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T13:52:33.202 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:52:33.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.197+0000 7f87237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:33.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.200+0000 7f8870739800 20 remove_watcher() i=0 2024-09-19T13:52:33.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.200+0000 7f8870739800 2 removed watcher, disabling cache 2024-09-19T13:52:33.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.201+0000 7f8870739800 20 remove_watcher() i=1 2024-09-19T13:52:33.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.202+0000 7f8870739800 20 remove_watcher() i=2 2024-09-19T13:52:33.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.203+0000 7f8870739800 20 remove_watcher() i=3 2024-09-19T13:52:33.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.204+0000 7f8870739800 20 remove_watcher() i=4 2024-09-19T13:52:33.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.205+0000 7f8870739800 20 remove_watcher() i=5 2024-09-19T13:52:33.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.206+0000 7f8870739800 20 remove_watcher() i=6 2024-09-19T13:52:33.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.207+0000 7f8870739800 20 remove_watcher() i=7 2024-09-19T13:52:33.219 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-19T13:52:33.219 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key SLRBMPMIHJBMNBGGXEMC --secret y7Li4NjOSGO51BBOF8Bnnwc9Ff7hC4Km/uHZyQy03xPdFehtXbXQqA== --email sysuser.client.0+test@test.test --system true 2024-09-19T13:52:33.285 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:52:33.286 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:52:33.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.316+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 realm 2024-09-19T13:52:33.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:52:33.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.318+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.319+0000 7fa245d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:33.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.319+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.319+0000 7fa245d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:52:33.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.319+0000 7fa245d19800 20 searching for the correct realm 2024-09-19T13:52:33.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.323+0000 7fa24400b640 0 -- 172.21.15.94:0/3959740625 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fa2380ce8f0 msgr2=0x7fa2380aba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:52:33.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.326+0000 7fa24380a640 0 -- 172.21.15.94:0/3959740625 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa2380bcbb0 msgr2=0x7fa2380bbea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.534+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:33.537 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 zone default found 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 4 Realm: () 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 zonegroup default 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.535+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.536+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.536+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.536+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.536+0000 7fa245d19800 20 started sync module instance, tier type = 2024-09-19T13:52:33.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.536+0000 7fa245d19800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:52:33.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=0 2024-09-19T13:52:33.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=1 2024-09-19T13:52:33.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=2 2024-09-19T13:52:33.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=3 2024-09-19T13:52:33.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=4 2024-09-19T13:52:33.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=5 2024-09-19T13:52:33.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.545+0000 7fa245d19800 20 add_watcher() i=6 2024-09-19T13:52:33.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.546+0000 7fa245d19800 20 add_watcher() i=7 2024-09-19T13:52:33.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.546+0000 7fa245d19800 2 all 8 watchers are set, enabling cache 2024-09-19T13:52:33.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa0f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:33.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:52:33.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 5 note: GC not initialized 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa0f8fe1640 20 reqs_thread_entry: start 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 20 init_complete bucket index max shards: 11 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 20 Filter name: none 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa0727fc640 20 reqs_thread_entry: start 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-19T13:52:33.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.548+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache get: name=default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC : miss 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 20 rados->read ofs=0 len=0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:33.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache put: name=default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC info.flags=0x0 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 adding default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC to cache LRU end 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache get: name=default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC : hit (negative entry) 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.549+0000 7fa245d19800 10 cache get: name=default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC : hit (negative entry) 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.551+0000 7fa245d19800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.551+0000 7fa245d19800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.551+0000 7fa245d19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.551+0000 7fa122ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856715 cookie 94904124726640 notifier 5916 bl.length()=675 2024-09-19T13:52:33.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.551+0000 7fa122ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-19T13:52:33.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.551+0000 7fa122ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T13:52:33.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.553+0000 7fa245d19800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-19T13:52:33.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.553+0000 7fa245d19800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T13:52:33.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.553+0000 7fa245d19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-19T13:52:33.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.553+0000 7fa122ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856728 cookie 94904124724144 notifier 5916 bl.length()=202 2024-09-19T13:52:33.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.553+0000 7fa122ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-19T13:52:33.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.553+0000 7fa122ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T13:52:33.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.555+0000 7fa245d19800 10 cache put: name=default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC info.flags=0x7 2024-09-19T13:52:33.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.555+0000 7fa245d19800 10 moving default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC to cache LRU end 2024-09-19T13:52:33.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.555+0000 7fa245d19800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:SLRBMPMIHJBMNBGGXEMC, ofs0, ns] 2024-09-19T13:52:33.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.555+0000 7fa1227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856714 cookie 94904124730640 notifier 5916 bl.length()=190 2024-09-19T13:52:33.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.555+0000 7fa1227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC info.flags=0x7 2024-09-19T13:52:33.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.555+0000 7fa1227fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SLRBMPMIHJBMNBGGXEMC to cache LRU end 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "sysuser.client.0", 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "sysuser.client.0", 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "SLRBMPMIHJBMNBGGXEMC", 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "y7Li4NjOSGO51BBOF8Bnnwc9Ff7hC4Km/uHZyQy03xPdFehtXbXQqA==", 2024-09-19T13:52:33.558 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T13:52:33.551022Z" 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "system": true, 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:52:33.559 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T13:52:33.560 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T13:52:33.551010Z", 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:52:33.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.556+0000 7fa0f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:33.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.559+0000 7fa245d19800 20 remove_watcher() i=0 2024-09-19T13:52:33.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.559+0000 7fa245d19800 2 removed watcher, disabling cache 2024-09-19T13:52:33.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.560+0000 7fa245d19800 20 remove_watcher() i=1 2024-09-19T13:52:33.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.561+0000 7fa245d19800 20 remove_watcher() i=2 2024-09-19T13:52:33.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.562+0000 7fa245d19800 20 remove_watcher() i=3 2024-09-19T13:52:33.565 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.563+0000 7fa245d19800 20 remove_watcher() i=4 2024-09-19T13:52:33.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.564+0000 7fa245d19800 20 remove_watcher() i=5 2024-09-19T13:52:33.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.565+0000 7fa245d19800 20 remove_watcher() i=6 2024-09-19T13:52:33.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:33.566+0000 7fa245d19800 20 remove_watcher() i=7 2024-09-19T13:52:33.578 INFO:tasks.ragweed:Configuring ragweed... 2024-09-19T13:52:33.579 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:52:33.579 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-19T13:52:33.607 INFO:tasks.ragweed:Configuring boto... 2024-09-19T13:52:33.623 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:52:33.623 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-19T13:52:33.676 DEBUG:teuthology.orchestra.run.smithi094:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-19T13:52:33.871 INFO:teuthology.orchestra.run.smithi094.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-19T13:52:34.034 INFO:teuthology.orchestra.run.smithi094.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-19T13:52:34.578 INFO:teuthology.orchestra.run.smithi094.stdout:py installdeps: -rrequirements.txt 2024-09-19T13:52:40.610 INFO:teuthology.orchestra.run.smithi094.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-19T13:52:43.999 INFO:teuthology.orchestra.run.smithi094.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=cfb7663ff781fdeb3e5136e603aa0e0ea4ba8957e3c43ae594c0ab109d9bb2c6,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-19T13:52:44.000 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test-pre: PYTHONHASHSEED='2533389815' 2024-09-19T13:52:44.000 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-19T13:52:44.201 INFO:teuthology.orchestra.run.smithi094.stdout:============================= test session starts ============================== 2024-09-19T13:52:44.202 INFO:teuthology.orchestra.run.smithi094.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-19T13:52:44.202 INFO:teuthology.orchestra.run.smithi094.stdout:cachedir: .tox/py/.pytest_cache 2024-09-19T13:52:44.202 INFO:teuthology.orchestra.run.smithi094.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T13:52:44.202 INFO:teuthology.orchestra.run.smithi094.stdout:configfile: pytest.ini 2024-09-19T13:52:44.296 INFO:teuthology.orchestra.run.smithi094.stdout:collecting ... collected 9 items 2024-09-19T13:52:44.296 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:52:44.750 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-19T13:52:45.309 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-19T13:52:45.732 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-19T13:52:46.320 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-19T13:52:46.842 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-19T13:52:52.999 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-19T13:52:54.213 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-19T13:52:55.295 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout:=============================== warnings summary =============================== 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout: import imp 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-19T13:52:57.440 INFO:teuthology.orchestra.run.smithi094.stdout:======================== 9 passed, 1 warning in 13.24s ========================= 2024-09-19T13:52:57.470 INFO:teuthology.orchestra.run.smithi094.stdout:___________________________________ summary ____________________________________ 2024-09-19T13:52:57.470 INFO:teuthology.orchestra.run.smithi094.stdout: py: commands succeeded 2024-09-19T13:52:57.470 INFO:teuthology.orchestra.run.smithi094.stdout: congratulations :) 2024-09-19T13:52:57.488 INFO:tasks.ragweed:Cleaning up boto... 2024-09-19T13:52:57.488 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-19T13:52:57.516 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-19T13:52:57.614 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:52:57.614 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:52:57.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.644+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 realm 2024-09-19T13:52:57.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:52:57.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.646+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.647+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:57.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.647+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.647+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:52:57.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.647+0000 7f52eef25800 20 searching for the correct realm 2024-09-19T13:52:57.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.650+0000 7f52ea332640 0 -- 172.21.15.94:0/2313755375 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f52dc084060 msgr2=0x7f52dc072070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:52:57.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.653+0000 7f52eab33640 0 -- 172.21.15.94:0/2313755375 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f52e00609f0 msgr2=0x7f52e0098290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:52:57.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:52:57.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:52:57.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:52:57.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:52:57.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.859+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 zone default found 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 4 Realm: () 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:52:57.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 zonegroup default 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.860+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.861+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.861+0000 7f52eef25800 20 started sync module instance, tier type = 2024-09-19T13:52:57.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.861+0000 7f52eef25800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=0 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=1 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=2 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=3 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=4 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=5 2024-09-19T13:52:57.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.869+0000 7f52eef25800 20 add_watcher() i=6 2024-09-19T13:52:57.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.870+0000 7f52eef25800 20 add_watcher() i=7 2024-09-19T13:52:57.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.870+0000 7f52eef25800 2 all 8 watchers are set, enabling cache 2024-09-19T13:52:57.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.872+0000 7f51a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:57.874 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.872+0000 7f52eef25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:52:57.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.872+0000 7f52eef25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:52:57.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.906+0000 7f511bfff640 20 reqs_thread_entry: start 2024-09-19T13:52:57.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.906+0000 7f52eef25800 20 init_complete bucket index max shards: 11 2024-09-19T13:52:57.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.906+0000 7f52eef25800 20 Filter name: none 2024-09-19T13:52:57.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.906+0000 7f5119ffb640 20 reqs_thread_entry: start 2024-09-19T13:52:57.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.906+0000 7f52eef25800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-19T13:52:57.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.906+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.907+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.907+0000 7f52eef25800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.907+0000 7f52eef25800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.907+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.907+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 : miss 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.907+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.908+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=426 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.908+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 info.flags=0x17 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.908+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 to cache LRU end 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.908+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.908+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:57.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.908+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 2024-09-19T13:52:57.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.909+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-19T13:52:57.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.909+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-19T13:52:57.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.909+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-19T13:52:57.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.909+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-19T13:52:57.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.910+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-19T13:52:57.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.910+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-19T13:52:57.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.910+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-19T13:52:57.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.911+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-19T13:52:57.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.911+0000 7f52eef25800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-19T13:52:57.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.912+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da41e420 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55d3da6bfca8 s->prefetch_data=0 2024-09-19T13:52:57.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.912+0000 7f52eef25800 10 manifest: total_size = 5299 2024-09-19T13:52:57.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.912+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.637549451338095219 2024-09-19T13:52:57.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.912+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da41e420 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55d3da6bfca8 s->prefetch_data=0 2024-09-19T13:52:57.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.912+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6bfca8 2024-09-19T13:52:57.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.912+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.1 2024-09-19T13:52:57.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.914+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da41e420 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55d3da64aeb8 s->prefetch_data=0 2024-09-19T13:52:57.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.915+0000 7f52eef25800 10 manifest: total_size = 4854 2024-09-19T13:52:57.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.915+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10183799366741586193 2024-09-19T13:52:57.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.915+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da41e420 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55d3da64aeb8 s->prefetch_data=0 2024-09-19T13:52:57.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.915+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64aeb8 2024-09-19T13:52:57.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.915+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.2 2024-09-19T13:52:57.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.916+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-19T13:52:57.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.917+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64a420 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55d3da64aeb8 s->prefetch_data=0 2024-09-19T13:52:57.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.917+0000 7f52eef25800 10 manifest: total_size = 5254 2024-09-19T13:52:57.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.917+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15588482401989710927 2024-09-19T13:52:57.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.917+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64a420 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55d3da64aeb8 s->prefetch_data=0 2024-09-19T13:52:57.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.917+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64aeb8 2024-09-19T13:52:57.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.917+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.2 2024-09-19T13:52:57.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.918+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.919+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6c1740 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.920+0000 7f52eef25800 10 manifest: total_size = 13086 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.920+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11062582240563417791 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.920+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6c1740 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.920+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64a9a8 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.920+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.3 2024-09-19T13:52:57.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.920+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-19T13:52:57.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.922+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da41e420 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.922+0000 7f52eef25800 10 manifest: total_size = 13072 2024-09-19T13:52:57.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.922+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3706101454180333099 2024-09-19T13:52:57.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.922+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da41e420 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.922+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64a9a8 2024-09-19T13:52:57.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.922+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.4 2024-09-19T13:52:57.925 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.923+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-19T13:52:57.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.924+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64dc90 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.925+0000 7f52eef25800 10 manifest: total_size = 7639 2024-09-19T13:52:57.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.925+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18433569607257436694 2024-09-19T13:52:57.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.925+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64dc90 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.925+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64a9a8 2024-09-19T13:52:57.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.925+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.4 2024-09-19T13:52:57.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.926+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-19T13:52:57.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.927+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e0098b20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.927+0000 7f52eef25800 10 manifest: total_size = 7516 2024-09-19T13:52:57.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.927+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9314514524496368442 2024-09-19T13:52:57.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.927+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e0098b20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.927+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64a9a8 2024-09-19T13:52:57.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.927+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.5 2024-09-19T13:52:57.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.928+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-19T13:52:57.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6c0890 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f52eef25800 10 manifest: total_size = 7812 2024-09-19T13:52:57.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.843017291017667423 2024-09-19T13:52:57.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6c0890 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64a9a8 2024-09-19T13:52:57.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.7 2024-09-19T13:52:57.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.930+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-19T13:52:57.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.932+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e0078550 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.933+0000 7f52eef25800 10 manifest: total_size = 8745 2024-09-19T13:52:57.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.933+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10645726293300081903 2024-09-19T13:52:57.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.933+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e0078550 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55d3da64a9a8 s->prefetch_data=0 2024-09-19T13:52:57.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.933+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64a9a8 2024-09-19T13:52:57.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.933+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5.8 2024-09-19T13:52:57.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.933+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-19T13:52:57.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.935+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:57.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.935+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:57.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.936+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-19T13:52:57.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.936+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:57.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.936+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:57.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.936+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:57.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.936+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:57.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.936+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:57.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.938+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-19T13:52:57.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.938+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.938+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=204 2024-09-19T13:52:57.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.938+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-19T13:52:57.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.938+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-19T13:52:57.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.939+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-19T13:52:57.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.939+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-19T13:52:57.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.940+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660508 cookie 94368390191456 notifier 5946 bl.length()=162 2024-09-19T13:52:57.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.941+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 from cache 2024-09-19T13:52:57.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.941+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5, ofs0, ns] 2024-09-19T13:52:57.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.941+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660503 cookie 94368390210400 notifier 5946 bl.length()=219 2024-09-19T13:52:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.944+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 : miss 2024-09-19T13:52:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.944+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.944+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.944+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 info.flags=0x0 2024-09-19T13:52:57.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.944+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5 to cache LRU end 2024-09-19T13:52:57.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.946+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 : miss 2024-09-19T13:52:57.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.946+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.947+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=457 2024-09-19T13:52:57.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.947+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 info.flags=0x17 2024-09-19T13:52:57.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.947+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 to cache LRU end 2024-09-19T13:52:57.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.947+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:57.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.947+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:57.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.947+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 2024-09-19T13:52:57.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.950+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo 2024-09-19T13:52:57.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.950+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6c1180 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:57.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.951+0000 7f52eef25800 10 manifest: total_size = 18874368 2024-09-19T13:52:57.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.951+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17983851643832591495 2024-09-19T13:52:57.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.951+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6c1180 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:57.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.951+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:57.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.951+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12.10 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:57.956 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17983851643832591495 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.1 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.2 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.3 2024-09-19T13:52:57.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-19T13:52:57.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.4 2024-09-19T13:52:57.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-19T13:52:57.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:57.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.953+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17983851643832591495 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.955+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.955+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.955+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.956+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.956+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.956+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.956+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:57.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.956+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:57.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.957+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-19T13:52:57.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.957+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.958+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=235 2024-09-19T13:52:57.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.958+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-19T13:52:57.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.958+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-19T13:52:57.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.959+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-19T13:52:57.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.959+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-19T13:52:57.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.959+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660541 cookie 94368390195920 notifier 5946 bl.length()=191 2024-09-19T13:52:57.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.961+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 from cache 2024-09-19T13:52:57.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.961+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12, ofs0, ns] 2024-09-19T13:52:57.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.961+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660509 cookie 94368390205392 notifier 5946 bl.length()=249 2024-09-19T13:52:57.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.963+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 : miss 2024-09-19T13:52:57.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.963+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.964+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.964+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 info.flags=0x0 2024-09-19T13:52:57.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.964+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12 to cache LRU end 2024-09-19T13:52:57.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.965+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 : miss 2024-09-19T13:52:57.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.965+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.966+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=464 2024-09-19T13:52:57.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.966+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 info.flags=0x17 2024-09-19T13:52:57.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.966+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 to cache LRU end 2024-09-19T13:52:57.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.966+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:57.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.966+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:57.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.966+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 2024-09-19T13:52:57.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo 2024-09-19T13:52:57.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc070330 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55d3da64c898 s->prefetch_data=0 2024-09-19T13:52:57.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 10 manifest: total_size = 1667 2024-09-19T13:52:57.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14276244405284523020 2024-09-19T13:52:57.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc070330 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55d3da64c898 s->prefetch_data=0 2024-09-19T13:52:57.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da64c898 2024-09-19T13:52:57.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.970+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13.10 2024-09-19T13:52:57.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-19T13:52:57.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-19T13:52:57.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-19T13:52:57.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-19T13:52:57.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-19T13:52:57.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-19T13:52:57.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14276244405284523020 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:57.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.1 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.2 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.3 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.4 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:57.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.972+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14276244405284523020 2024-09-19T13:52:57.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.973+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-19T13:52:57.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:57.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.974+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.976+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-19T13:52:57.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.976+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.977+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=242 2024-09-19T13:52:57.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.977+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-19T13:52:57.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.977+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-19T13:52:57.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.978+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-19T13:52:57.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.978+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-19T13:52:57.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.978+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660498 cookie 94368390199984 notifier 5946 bl.length()=198 2024-09-19T13:52:57.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.979+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 from cache 2024-09-19T13:52:57.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.979+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13, ofs0, ns] 2024-09-19T13:52:57.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.980+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660542 cookie 94368390195920 notifier 5946 bl.length()=256 2024-09-19T13:52:57.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.983+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 : miss 2024-09-19T13:52:57.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.983+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.983+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:57.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.983+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 info.flags=0x0 2024-09-19T13:52:57.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.983+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13 to cache LRU end 2024-09-19T13:52:57.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.985+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 : miss 2024-09-19T13:52:57.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.985+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:57.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.986+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=459 2024-09-19T13:52:57.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.986+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 info.flags=0x17 2024-09-19T13:52:57.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.986+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 to cache LRU end 2024-09-19T13:52:57.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.986+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:57.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.986+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:57.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.986+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 2024-09-19T13:52:57.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.989+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo[Y66sor-0eHeVCriwejoxenfA0L.A.H6] 2024-09-19T13:52:57.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.989+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11.10 2024-09-19T13:52:57.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.990+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da649e60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55d3da6400c8 s->prefetch_data=0 2024-09-19T13:52:57.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.990+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to wa4y1wm5ycned0swll2qbyl51aipsc2k 2024-09-19T13:52:57.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.990+0000 7f52eef25800 20 get_obj_state_impl: setting s->olh_tag to 3s6z1zd96e56gmjjf354vu11ggqpf53h 2024-09-19T13:52:57.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.990+0000 7f52eef25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3s6z1zd96e56gmjjf354vu11ggqpf53h 2024-09-19T13:52:57.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.991+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11.10 2024-09-19T13:52:57.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11.10 2024-09-19T13:52:57.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-19T13:52:57.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 olh_log_entry: epoch=3 op=3 key=foo[Y66sor-0eHeVCriwejoxenfA0L.A.H6] 2024-09-19T13:52:57.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da649e60 obj=test-client.0-r-test-multipart-index-versioning.1:_:Y66sor-0eHeVCriwejoxenfA0L.A.H6_foo state=0x55d3da663cf8 s->prefetch_data=0 2024-09-19T13:52:57.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 10 manifest: total_size = 1667 2024-09-19T13:52:57.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18114709180214060987 2024-09-19T13:52:57.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da649e60 obj=test-client.0-r-test-multipart-index-versioning.1:_:Y66sor-0eHeVCriwejoxenfA0L.A.H6_foo state=0x55d3da663cf8 s->prefetch_data=0 2024-09-19T13:52:57.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da663cf8 2024-09-19T13:52:57.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.993+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11.10 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-19T13:52:57.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18114709180214060987 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.1 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-19T13:52:57.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.2 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.3 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.4 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.996+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18114709180214060987 2024-09-19T13:52:58.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.997+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo[Y66sor-0eHeVCriwejoxenfA0L.A.H6] 2024-09-19T13:52:58.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.998+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da649e60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55d3da6400c8 s->prefetch_data=0 2024-09-19T13:52:58.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:57.999+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11.10 2024-09-19T13:52:58.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11.10 2024-09-19T13:52:58.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.001+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.003+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-19T13:52:58.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.003+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.003+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=237 2024-09-19T13:52:58.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.003+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-19T13:52:58.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.003+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-19T13:52:58.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.004+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-19T13:52:58.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.004+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-19T13:52:58.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.004+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660499 cookie 94368390199984 notifier 5946 bl.length()=193 2024-09-19T13:52:58.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.006+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 from cache 2024-09-19T13:52:58.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.006+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11, ofs0, ns] 2024-09-19T13:52:58.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.006+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660536 cookie 94368390213552 notifier 5946 bl.length()=251 2024-09-19T13:52:58.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.008+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 : miss 2024-09-19T13:52:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.008+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.009+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.009+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 info.flags=0x0 2024-09-19T13:52:58.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.009+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11 to cache LRU end 2024-09-19T13:52:58.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.010+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 : miss 2024-09-19T13:52:58.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.010+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.011+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=449 2024-09-19T13:52:58.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.011+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 info.flags=0x17 2024-09-19T13:52:58.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.011+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 to cache LRU end 2024-09-19T13:52:58.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.011+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.011+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.011+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 2024-09-19T13:52:58.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.015+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo 2024-09-19T13:52:58.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.015+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da662710 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55d3da59e678 s->prefetch_data=0 2024-09-19T13:52:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.016+0000 7f52eef25800 10 manifest: total_size = 26085 2024-09-19T13:52:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.016+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10372120100355539126 2024-09-19T13:52:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.016+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da662710 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55d3da59e678 s->prefetch_data=0 2024-09-19T13:52:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.016+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da59e678 2024-09-19T13:52:58.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.016+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10.10 2024-09-19T13:52:58.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-09-19T13:52:58.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7673 2024-09-19T13:52:58.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7671 2024-09-19T13:52:58.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-19T13:52:58.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6299129 part_ofs=7673 rule->part_size=7671 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7674 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6306800 part_ofs=15344 rule->part_size=7674 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=23018 stripe_ofs=23018 part_ofs=23018 rule->part_size=3067 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6314474 part_ofs=23018 rule->part_size=3067 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=26085 stripe_ofs=26085 part_ofs=26085 rule->part_size=3067 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10372120100355539126 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.1 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.2 2024-09-19T13:52:58.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-19T13:52:58.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.3 2024-09-19T13:52:58.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-19T13:52:58.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.4 2024-09-19T13:52:58.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-19T13:52:58.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.018+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10372120100355539126 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.019+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.019+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.019+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.020+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.020+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.020+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.020+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.020+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.022+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-19T13:52:58.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.022+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.022+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=227 2024-09-19T13:52:58.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.022+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-19T13:52:58.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.022+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-19T13:52:58.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.023+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-19T13:52:58.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.023+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-19T13:52:58.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.023+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660510 cookie 94368390205392 notifier 5946 bl.length()=183 2024-09-19T13:52:58.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.025+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 from cache 2024-09-19T13:52:58.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.025+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10, ofs0, ns] 2024-09-19T13:52:58.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.025+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660504 cookie 94368390208064 notifier 5946 bl.length()=241 2024-09-19T13:52:58.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.028+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 : miss 2024-09-19T13:52:58.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.028+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.028+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.028+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 info.flags=0x0 2024-09-19T13:52:58.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.028+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10 to cache LRU end 2024-09-19T13:52:58.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 : miss 2024-09-19T13:52:58.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T13:52:58.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 info.flags=0x17 2024-09-19T13:52:58.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 to cache LRU end 2024-09-19T13:52:58.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.030+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 2024-09-19T13:52:58.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.031+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-19T13:52:58.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.031+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-19T13:52:58.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.032+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T13:52:58.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.033+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-19T13:52:58.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.033+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-19T13:52:58.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.033+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T13:52:58.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.033+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-19T13:52:58.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.033+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T13:52:58.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.033+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-19T13:52:58.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.034+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-19T13:52:58.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.034+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-19T13:52:58.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.034+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-19T13:52:58.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.035+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64ab60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.035+0000 7f52eef25800 10 manifest: total_size = 22651 2024-09-19T13:52:58.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.035+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _mNXzqmdDA1_4I1jf7Qsa_0qJ69hKkq0 2024-09-19T13:52:58.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.035+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64ab60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.035+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.035+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.0 2024-09-19T13:52:58.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _mNXzqmdDA1_4I1jf7Qsa_0qJ69hKkq0 2024-09-19T13:52:58.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.Nvxx-1WqvK7ScqceayxVFCLghfZynt6_0 2024-09-19T13:52:58.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T13:52:58.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.037+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _mNXzqmdDA1_4I1jf7Qsa_0qJ69hKkq0 2024-09-19T13:52:58.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.038+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-19T13:52:58.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.038+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64ab60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.039+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.039+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _L-VekVF6gSX7QA3O8K10tcB-XOmWk2j 2024-09-19T13:52:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.039+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64ab60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.039+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.039+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.2 2024-09-19T13:52:58.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _L-VekVF6gSX7QA3O8K10tcB-XOmWk2j 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.zHDTV1cpVkc0LZvtN004okSdIM2pOej_1 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.041+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _L-VekVF6gSX7QA3O8K10tcB-XOmWk2j 2024-09-19T13:52:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.042+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-19T13:52:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.043+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64ab60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.043+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.043+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.271034142389335688 2024-09-19T13:52:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.043+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64ab60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.043+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.043+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.3 2024-09-19T13:52:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.271034142389335688 2024-09-19T13:52:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.1S-eL4MofIXHatP2TcGRbnumrJ7GYP7_0 2024-09-19T13:52:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 336 2024-09-19T13:52:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.045+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.271034142389335688 2024-09-19T13:52:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.046+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T13:52:58.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.046+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59f8a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.047+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.047+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _GsFP6vp8amFsJktGHr9ZeP_iLaDHntD 2024-09-19T13:52:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.047+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59f8a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.047+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.047+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.5 2024-09-19T13:52:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _GsFP6vp8amFsJktGHr9ZeP_iLaDHntD 2024-09-19T13:52:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.5LxH_b84LqsynuSsA9WSrgN4ovdTxaC_0 2024-09-19T13:52:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T13:52:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.052 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.049+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _GsFP6vp8amFsJktGHr9ZeP_iLaDHntD 2024-09-19T13:52:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-19T13:52:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _3xb7ywYbSq4cXSy6zARJ4fK8pFt-HIS 2024-09-19T13:52:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.051+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.5 2024-09-19T13:52:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _3xb7ywYbSq4cXSy6zARJ4fK8pFt-HIS 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.rJ2KjFuwoOVNUhiJj-x5eH-bampMQZi_0 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.053+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _3xb7ywYbSq4cXSy6zARJ4fK8pFt-HIS 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.054+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-19T13:52:58.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.054+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.055+0000 7f52eef25800 10 manifest: total_size = 22651 2024-09-19T13:52:58.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.055+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6562230009405359236 2024-09-19T13:52:58.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.055+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.055+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.055+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.5 2024-09-19T13:52:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.057+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.057+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.057+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _iyr_tFwWR-KjkzmoM0e7AtxEN8u78bp 2024-09-19T13:52:58.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.057+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.057+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.057+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.7 2024-09-19T13:52:58.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.058+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T13:52:58.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _iyr_tFwWR-KjkzmoM0e7AtxEN8u78bp 2024-09-19T13:52:58.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.XwCtx0ss6vxMklymHFdZe7Lq7kAVCoo_1 2024-09-19T13:52:58.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T13:52:58.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.060+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _iyr_tFwWR-KjkzmoM0e7AtxEN8u78bp 2024-09-19T13:52:58.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.061+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.062+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-19T13:52:58.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.062+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.062+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17823109519062831232 2024-09-19T13:52:58.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.062+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.062+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.062+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.7 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17823109519062831232 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.5cm_GYJWeKbSQsjNOV087hXIulTn67O_0 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.064+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17823109519062831232 2024-09-19T13:52:58.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T13:52:58.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64f6a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f52eef25800 10 manifest: total_size = 22651 2024-09-19T13:52:58.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to __mAH1rcSCWM15v9IriHi21d_KoekyA5 2024-09-19T13:52:58.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64f6a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.065+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.7 2024-09-19T13:52:58.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.067+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e007c950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.068+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.068+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17744116815885040236 2024-09-19T13:52:58.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.068+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e007c950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.068+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.068+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.8 2024-09-19T13:52:58.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.068+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17744116815885040236 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.5cm_GYJWeKbSQsjNOV087hXIulTn67O_0 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.070+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17744116815885040236 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e0098b90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f52eef25800 10 manifest: total_size = 22651 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _QMBN4X6KshiLPQwn37EBRSyyANCvY1h 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e0098b90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.073 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.071+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.8 2024-09-19T13:52:58.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _QMBN4X6KshiLPQwn37EBRSyyANCvY1h 2024-09-19T13:52:58.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.YZFkf7X17a62kx6FFy6iVhjIpzEKdkT_0 2024-09-19T13:52:58.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T13:52:58.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.073+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _QMBN4X6KshiLPQwn37EBRSyyANCvY1h 2024-09-19T13:52:58.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.074+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-19T13:52:58.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.074+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da666110 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.075+0000 7f52eef25800 10 manifest: total_size = 5242880 2024-09-19T13:52:58.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.075+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14116827651221924344 2024-09-19T13:52:58.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.075+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da666110 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55d3da647978 s->prefetch_data=0 2024-09-19T13:52:58.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.075+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da647978 2024-09-19T13:52:58.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.075+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16.9 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14116827651221924344 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.1S-eL4MofIXHatP2TcGRbnumrJ7GYP7_0 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-19T13:52:58.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.077+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14116827651221924344 2024-09-19T13:52:58.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.078+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-19T13:52:58.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.078+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.078+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.079+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.079+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.079+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.079+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.079+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.080+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-19T13:52:58.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.080+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.081+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=233 2024-09-19T13:52:58.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.081+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-19T13:52:58.083 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.081+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-19T13:52:58.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.082+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-19T13:52:58.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.082+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-19T13:52:58.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.082+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660500 cookie 94368390199984 notifier 5946 bl.length()=189 2024-09-19T13:52:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.084+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 from cache 2024-09-19T13:52:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.084+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16, ofs0, ns] 2024-09-19T13:52:58.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.084+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660537 cookie 94368390213552 notifier 5946 bl.length()=247 2024-09-19T13:52:58.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.087+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 : miss 2024-09-19T13:52:58.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.087+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.087+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.087+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 info.flags=0x0 2024-09-19T13:52:58.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.087+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16 to cache LRU end 2024-09-19T13:52:58.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 : miss 2024-09-19T13:52:58.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T13:52:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 info.flags=0x17 2024-09-19T13:52:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 to cache LRU end 2024-09-19T13:52:58.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.090+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.091+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.091+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.092+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.092+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-19T13:52:58.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.092+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-19T13:52:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.092+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T13:52:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.093+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-19T13:52:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.093+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T13:52:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.093+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-19T13:52:58.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.093+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-19T13:52:58.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.093+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-19T13:52:58.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-19T13:52:58.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59f980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 10 manifest: total_size = 541681 2024-09-19T13:52:58.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _Qe_uFToxGVaV611J5b_GfdJU52EgHiy 2024-09-19T13:52:58.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59f980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da646598 2024-09-19T13:52:58.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.094+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.0 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _Qe_uFToxGVaV611J5b_GfdJU52EgHiy 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.qC5YQbewVh8sLY8oeENLBdNa4WWFy5X_0 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.097+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _Qe_uFToxGVaV611J5b_GfdJU52EgHiy 2024-09-19T13:52:58.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-19T13:52:58.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da666130 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _v5VcC_qDolr43-DAT4wbNNfOa8oYZTO 2024-09-19T13:52:58.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da666130 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da646598 2024-09-19T13:52:58.101 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.098+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.2 2024-09-19T13:52:58.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.103 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _v5VcC_qDolr43-DAT4wbNNfOa8oYZTO 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.vg5vPbZ9pXqPFFMcTFYG2zZ1VsvLQoL_1 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.vg5vPbZ9pXqPFFMcTFYG2zZ1VsvLQoL_2 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.101+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _v5VcC_qDolr43-DAT4wbNNfOa8oYZTO 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.102+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.102+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4092450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.103+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.103+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3555879556170395542 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.103+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4092450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.103+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da646598 2024-09-19T13:52:58.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.103+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.3 2024-09-19T13:52:58.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:58.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3555879556170395542 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.1 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.2 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.3 2024-09-19T13:52:58.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.105+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3555879556170395542 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.106+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.106+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e00988f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.107+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.107+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _hrueVRvGngP2rAnE1biUeNKbZNns6XW 2024-09-19T13:52:58.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.107+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e00988f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.107+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da646598 2024-09-19T13:52:58.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.107+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.5 2024-09-19T13:52:58.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _hrueVRvGngP2rAnE1biUeNKbZNns6XW 2024-09-19T13:52:58.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.zKDfxi23r32Eh0SlK-vWCvM8rSE9C5b_0 2024-09-19T13:52:58.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T13:52:58.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.zKDfxi23r32Eh0SlK-vWCvM8rSE9C5b_1 2024-09-19T13:52:58.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-19T13:52:58.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.109+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _hrueVRvGngP2rAnE1biUeNKbZNns6XW 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.110+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.110+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011b60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.111+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.111+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _5koifZir7H_Vl6y3tpii__rSm2ZAYsP 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.111+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011b60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55d3da646598 s->prefetch_data=0 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.111+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da646598 2024-09-19T13:52:58.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.111+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.5 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _5koifZir7H_Vl6y3tpii__rSm2ZAYsP 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.2REKJabVDUfPnESbqTHC4PmMVlhYvk8_0 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.2REKJabVDUfPnESbqTHC4PmMVlhYvk8_1 2024-09-19T13:52:58.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-19T13:52:58.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.113+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _5koifZir7H_Vl6y3tpii__rSm2ZAYsP 2024-09-19T13:52:58.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-19T13:52:58.116 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e00988f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f52eef25800 10 manifest: total_size = 541681 2024-09-19T13:52:58.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7097248307896449016 2024-09-19T13:52:58.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e00988f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.114+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.5 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-19T13:52:58.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7097248307896449016 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.1 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.2 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.3 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.117+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7097248307896449016 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0b62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _Ingtq7PbPqxNttB1pBdbn8KLXogaHkG 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0b62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.118+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.7 2024-09-19T13:52:58.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _Ingtq7PbPqxNttB1pBdbn8KLXogaHkG 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.S4gkouREHCF6qd8QaQdxEcMZB_8Orz2_1 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.S4gkouREHCF6qd8QaQdxEcMZB_8Orz2_2 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.121+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _Ingtq7PbPqxNttB1pBdbn8KLXogaHkG 2024-09-19T13:52:58.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-19T13:52:58.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0b62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16637810149587228229 2024-09-19T13:52:58.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0b62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.123+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.7 2024-09-19T13:52:58.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:58.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16637810149587228229 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.1 2024-09-19T13:52:58.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-19T13:52:58.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.2 2024-09-19T13:52:58.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-19T13:52:58.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.3 2024-09-19T13:52:58.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-19T13:52:58.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.125+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16637810149587228229 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.126+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.126+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011b60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.127+0000 7f52eef25800 10 manifest: total_size = 541681 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.127+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11011647298678443696 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.127+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011b60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.127+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.127+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.7 2024-09-19T13:52:58.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T13:52:58.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-19T13:52:58.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-19T13:52:58.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T13:52:58.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-19T13:52:58.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-19T13:52:58.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11011647298678443696 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.1 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.2 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-19T13:52:58.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.3 2024-09-19T13:52:58.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-19T13:52:58.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.129+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11011647298678443696 2024-09-19T13:52:58.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-19T13:52:58.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e00988f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11962411664658680868 2024-09-19T13:52:58.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e00988f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.130+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.8 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11962411664658680868 2024-09-19T13:52:58.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.1 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.2 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.3 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.133+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11962411664658680868 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da641ff0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f52eef25800 10 manifest: total_size = 541681 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to _fTsc9-dCQ83A3xz8siESBXLLro80ITt 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da641ff0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.134+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.8 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: _fTsc9-dCQ83A3xz8siESBXLLro80ITt 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.Dfig3OgGYEJyaBHH1L2ya3CqWG0FtCk_0 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.136+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _fTsc9-dCQ83A3xz8siESBXLLro80ITt 2024-09-19T13:52:58.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.137+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-19T13:52:58.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.138+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0b62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.138+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.138+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15900940591159676587 2024-09-19T13:52:58.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.138+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0b62b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.138+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.138+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17.9 2024-09-19T13:52:58.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:58.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15900940591159676587 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.1 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.2 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-19T13:52:58.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.3 2024-09-19T13:52:58.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-19T13:52:58.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.140+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15900940591159676587 2024-09-19T13:52:58.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.141+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.141+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.141+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.142+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.142+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.142+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.142+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.142+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.144+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-19T13:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.144+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.144+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=243 2024-09-19T13:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.144+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-19T13:52:58.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.144+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-19T13:52:58.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.145+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-19T13:52:58.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.145+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-19T13:52:58.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.145+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660492 cookie 94368390202704 notifier 5946 bl.length()=199 2024-09-19T13:52:58.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.147+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 from cache 2024-09-19T13:52:58.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.147+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17, ofs0, ns] 2024-09-19T13:52:58.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.147+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660501 cookie 94368390199984 notifier 5946 bl.length()=257 2024-09-19T13:52:58.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.150+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 : miss 2024-09-19T13:52:58.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.150+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.150+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.150+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 info.flags=0x0 2024-09-19T13:52:58.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.150+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17 to cache LRU end 2024-09-19T13:52:58.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 : miss 2024-09-19T13:52:58.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T13:52:58.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 info.flags=0x17 2024-09-19T13:52:58.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 to cache LRU end 2024-09-19T13:52:58.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.152+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 2024-09-19T13:52:58.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.154+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T13:52:58.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.154+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T13:52:58.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.155+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T13:52:58.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.156+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55d3da6675a8 s->prefetch_data=0 2024-09-19T13:52:58.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.156+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.156+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10126325535086859496 2024-09-19T13:52:58.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.156+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55d3da6675a8 s->prefetch_data=0 2024-09-19T13:52:58.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.156+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6675a8 2024-09-19T13:52:58.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.156+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15.3 2024-09-19T13:52:58.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10126325535086859496 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-FROZEN.2~zpL2xvXz8yR84Q4EVgXkwGwV18tTrq6.1 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-19T13:52:58.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-FROZEN.2~zpL2xvXz8yR84Q4EVgXkwGwV18tTrq6.2 2024-09-19T13:52:58.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-19T13:52:58.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-FROZEN.2~zpL2xvXz8yR84Q4EVgXkwGwV18tTrq6.3 2024-09-19T13:52:58.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-19T13:52:58.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.158+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10126325535086859496 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.159+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.160+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55d3da6675a8 s->prefetch_data=0 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.160+0000 7f52eef25800 10 manifest: total_size = 541681 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.160+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14352301157512827912 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.160+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc058220 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55d3da6675a8 s->prefetch_data=0 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.160+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6675a8 2024-09-19T13:52:58.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.160+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15.5 2024-09-19T13:52:58.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T13:52:58.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-19T13:52:58.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-19T13:52:58.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T13:52:58.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-19T13:52:58.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-19T13:52:58.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-19T13:52:58.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-19T13:52:58.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14352301157512827912 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-STANDARD.2~1qF1VHLUBA5fOzMMQMM0Pndjzsn7YFs.1 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-STANDARD.2~1qF1VHLUBA5fOzMMQMM0Pndjzsn7YFs.2 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-19T13:52:58.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-STANDARD.2~1qF1VHLUBA5fOzMMQMM0Pndjzsn7YFs.3 2024-09-19T13:52:58.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-19T13:52:58.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.162+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14352301157512827912 2024-09-19T13:52:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.163+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T13:52:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.163+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da666110 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.164+0000 7f52eef25800 10 manifest: total_size = 11534336 2024-09-19T13:52:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.164+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10350445801339671693 2024-09-19T13:52:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.164+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da666110 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55d3da6404f8 s->prefetch_data=0 2024-09-19T13:52:58.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.164+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da6404f8 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.164+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15.7 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10350445801339671693 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-LUKEWARM.2~-zF-2eHqwguIFqelL_jjgxixyYSpz5t.1 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-LUKEWARM.2~-zF-2eHqwguIFqelL_jjgxixyYSpz5t.2 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-LUKEWARM.2~-zF-2eHqwguIFqelL_jjgxixyYSpz5t.3 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.167+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10350445801339671693 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.168+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.168+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.168+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.169+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.169+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.169+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.169+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.169+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.170+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-19T13:52:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.170+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.171+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=238 2024-09-19T13:52:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.171+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-19T13:52:58.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.171+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-19T13:52:58.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.172+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-19T13:52:58.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.172+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-19T13:52:58.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.172+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660505 cookie 94368390208064 notifier 5946 bl.length()=194 2024-09-19T13:52:58.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.174+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 from cache 2024-09-19T13:52:58.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.174+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15, ofs0, ns] 2024-09-19T13:52:58.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.174+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660502 cookie 94368390199984 notifier 5946 bl.length()=252 2024-09-19T13:52:58.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.177+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 : miss 2024-09-19T13:52:58.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.177+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.177+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.177+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 info.flags=0x0 2024-09-19T13:52:58.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.177+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15 to cache LRU end 2024-09-19T13:52:58.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.179+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 : miss 2024-09-19T13:52:58.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.179+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.180+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=450 2024-09-19T13:52:58.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.180+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 info.flags=0x17 2024-09-19T13:52:58.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.180+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 to cache LRU end 2024-09-19T13:52:58.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.180+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.180+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.180+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 2024-09-19T13:52:58.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.181+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T13:52:58.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.182+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T13:52:58.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.183+0000 7f52eef25800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T13:52:58.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.183+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64dc90 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55d3da660528 s->prefetch_data=0 2024-09-19T13:52:58.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.184+0000 7f52eef25800 10 manifest: total_size = 10485760 2024-09-19T13:52:58.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.184+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15330635729167985165 2024-09-19T13:52:58.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.184+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64dc90 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55d3da660528 s->prefetch_data=0 2024-09-19T13:52:58.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.184+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da660528 2024-09-19T13:52:58.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.184+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14.3 2024-09-19T13:52:58.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15330635729167985165 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.R4wiPcq4PlgZtk7ERzGrM_W2Um5PF28_0 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.R4wiPcq4PlgZtk7ERzGrM_W2Um5PF28_1 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.186+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15330635729167985165 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.187+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.188+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc070330 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55d3da660528 s->prefetch_data=0 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.188+0000 7f52eef25800 10 manifest: total_size = 53502 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.188+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12635635537406710412 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.188+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc070330 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55d3da660528 s->prefetch_data=0 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.188+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da660528 2024-09-19T13:52:58.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.188+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14.5 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.190+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011b60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55d3da660528 s->prefetch_data=0 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.191+0000 7f52eef25800 10 manifest: total_size = 10485760 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.191+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7468057247646171623 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.191+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011b60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55d3da660528 s->prefetch_data=0 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.191+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da660528 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.191+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14.7 2024-09-19T13:52:58.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.191+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T13:52:58.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7468057247646171623 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.PBHe--_ZWbL2kC0gH7BqFmoEsgd1KBE_0 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.PBHe--_ZWbL2kC0gH7BqFmoEsgd1KBE_1 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T13:52:58.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.193+0000 7f52eef25800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7468057247646171623 2024-09-19T13:52:58.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.194+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.194+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.194+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.195+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.195+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.195+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.195+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.195+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.197+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-19T13:52:58.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.197+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.197+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=228 2024-09-19T13:52:58.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.197+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-19T13:52:58.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.197+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-19T13:52:58.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.198+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-19T13:52:58.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.198+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-19T13:52:58.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.198+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660503 cookie 94368390199984 notifier 5946 bl.length()=184 2024-09-19T13:52:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.200+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 from cache 2024-09-19T13:52:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.200+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14, ofs0, ns] 2024-09-19T13:52:58.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.200+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660543 cookie 94368390195920 notifier 5946 bl.length()=242 2024-09-19T13:52:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.202+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 : miss 2024-09-19T13:52:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.202+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.203+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.203+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 info.flags=0x0 2024-09-19T13:52:58.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.203+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14 to cache LRU end 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 : miss 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 info.flags=0x17 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 to cache LRU end 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.205+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 2024-09-19T13:52:58.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.206+0000 7f52eef25800 10 cls_bucket_list_unordered: got ___ 2024-09-19T13:52:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.207+0000 7f52eef25800 10 cls_bucket_list_unordered: got __ _ 2024-09-19T13:52:58.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.208+0000 7f52eef25800 10 cls_bucket_list_unordered: got __ 2024-09-19T13:52:58.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.208+0000 7f52eef25800 10 cls_bucket_list_unordered: got obj 2024-09-19T13:52:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.209+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da669400 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.209+0000 7f52eef25800 10 manifest: total_size = 0 2024-09-19T13:52:58.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.209+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7098186490714402450 2024-09-19T13:52:58.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.209+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da669400 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.209+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666598 2024-09-19T13:52:58.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.209+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7.2 2024-09-19T13:52:58.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.211+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da669400 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.212+0000 7f52eef25800 10 manifest: total_size = 0 2024-09-19T13:52:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.212+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12489646678472454536 2024-09-19T13:52:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.212+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da669400 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.212+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666598 2024-09-19T13:52:58.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.212+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7.3 2024-09-19T13:52:58.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.213+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-19T13:52:58.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.214+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.215+0000 7f52eef25800 10 manifest: total_size = 0 2024-09-19T13:52:58.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.215+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14094100432733900593 2024-09-19T13:52:58.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.215+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.215+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666598 2024-09-19T13:52:58.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.215+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7.6 2024-09-19T13:52:58.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.215+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T13:52:58.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.217+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.217+0000 7f52eef25800 10 manifest: total_size = 0 2024-09-19T13:52:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.217+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12103458646157680217 2024-09-19T13:52:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.217+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55d3da666598 s->prefetch_data=0 2024-09-19T13:52:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.217+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666598 2024-09-19T13:52:58.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.217+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7.8 2024-09-19T13:52:58.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.218+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-19T13:52:58.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.219+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.219+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.220+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-19T13:52:58.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.220+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.220+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.220+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.220+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.220+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.222+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-19T13:52:58.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.222+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.223+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T13:52:58.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.223+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-19T13:52:58.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.223+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-19T13:52:58.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.224+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-19T13:52:58.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.224+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-19T13:52:58.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.224+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660544 cookie 94368390195920 notifier 5946 bl.length()=181 2024-09-19T13:52:58.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.225+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 from cache 2024-09-19T13:52:58.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.225+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7, ofs0, ns] 2024-09-19T13:52:58.228 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.226+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660545 cookie 94368390195920 notifier 5946 bl.length()=238 2024-09-19T13:52:58.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.228+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 : miss 2024-09-19T13:52:58.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.228+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.228+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.228+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 info.flags=0x0 2024-09-19T13:52:58.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.228+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7 to cache LRU end 2024-09-19T13:52:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.230+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 : miss 2024-09-19T13:52:58.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.230+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.231+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T13:52:58.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.231+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 info.flags=0x17 2024-09-19T13:52:58.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.231+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 to cache LRU end 2024-09-19T13:52:58.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.231+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.231+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.231+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 2024-09-19T13:52:58.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.232+0000 7f52eef25800 10 cls_bucket_list_unordered: got ___ 2024-09-19T13:52:58.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.234+0000 7f52eef25800 10 cls_bucket_list_unordered: got __ _ 2024-09-19T13:52:58.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.235+0000 7f52eef25800 10 cls_bucket_list_unordered: got __ 2024-09-19T13:52:58.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.235+0000 7f52eef25800 10 cls_bucket_list_unordered: got obj 2024-09-19T13:52:58.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.236+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6492f0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.236+0000 7f52eef25800 10 manifest: total_size = 24595 2024-09-19T13:52:58.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.236+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13737709220463852516 2024-09-19T13:52:58.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.236+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6492f0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.236+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da645588 2024-09-19T13:52:58.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.236+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8.2 2024-09-19T13:52:58.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.239+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6492f0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.239+0000 7f52eef25800 10 manifest: total_size = 38 2024-09-19T13:52:58.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.239+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14517916411785826007 2024-09-19T13:52:58.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.239+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da6492f0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.239+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da645588 2024-09-19T13:52:58.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.239+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8.3 2024-09-19T13:52:58.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.240+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=___ 2024-09-19T13:52:58.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.241+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64d9b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.242+0000 7f52eef25800 10 manifest: total_size = 527 2024-09-19T13:52:58.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.242+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6935328530385704030 2024-09-19T13:52:58.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.242+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64d9b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.242+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da645588 2024-09-19T13:52:58.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.242+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8.6 2024-09-19T13:52:58.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.242+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T13:52:58.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.244+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64d9b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.244+0000 7f52eef25800 10 manifest: total_size = 24595 2024-09-19T13:52:58.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.244+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1204585809050133963 2024-09-19T13:52:58.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.244+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da64d9b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55d3da645588 s->prefetch_data=0 2024-09-19T13:52:58.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.244+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da645588 2024-09-19T13:52:58.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.244+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8.8 2024-09-19T13:52:58.247 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.245+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=__ 2024-09-19T13:52:58.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.246+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.246+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.247+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=obj 2024-09-19T13:52:58.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.248+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.248+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.248+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.248+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.248+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.249+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-19T13:52:58.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.249+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.250+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T13:52:58.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.250+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-19T13:52:58.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.250+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-19T13:52:58.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.250+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-19T13:52:58.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.250+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-19T13:52:58.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.251+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660546 cookie 94368390195920 notifier 5946 bl.length()=181 2024-09-19T13:52:58.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.252+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 from cache 2024-09-19T13:52:58.254 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.252+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8, ofs0, ns] 2024-09-19T13:52:58.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.253+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660547 cookie 94368390195920 notifier 5946 bl.length()=238 2024-09-19T13:52:58.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.255+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 : miss 2024-09-19T13:52:58.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.255+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.255+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.255+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 info.flags=0x0 2024-09-19T13:52:58.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.255+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8 to cache LRU end 2024-09-19T13:52:58.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.257+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 : miss 2024-09-19T13:52:58.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.257+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.258+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T13:52:58.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.258+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 info.flags=0x17 2024-09-19T13:52:58.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.258+0000 7f52eef25800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 to cache LRU end 2024-09-19T13:52:58.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.258+0000 7f52eef25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.258+0000 7f52eef25800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T13:52:58.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.258+0000 7f52eef25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 2024-09-19T13:52:58.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.259+0000 7f52eef25800 10 cls_bucket_list_unordered: got ___ 2024-09-19T13:52:58.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.259+0000 7f52eef25800 10 cls_bucket_list_unordered: got __ _ 2024-09-19T13:52:58.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.260+0000 7f52eef25800 10 cls_bucket_list_unordered: got __ 2024-09-19T13:52:58.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.261+0000 7f52eef25800 10 cls_bucket_list_unordered: got obj 2024-09-19T13:52:58.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.262+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.263+0000 7f52eef25800 10 manifest: total_size = 1035 2024-09-19T13:52:58.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.263+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2582458145574420494 2024-09-19T13:52:58.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.263+0000 7f52eef25800 20 get_obj_state: octx=0x7f52dc0f60e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.263+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666d68 2024-09-19T13:52:58.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.263+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9.2 2024-09-19T13:52:58.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.265+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59fc90 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.265+0000 7f52eef25800 10 manifest: total_size = 49187 2024-09-19T13:52:58.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.265+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15012020097848764187 2024-09-19T13:52:58.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.265+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59fc90 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.265+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666d68 2024-09-19T13:52:58.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.266+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9.3 2024-09-19T13:52:58.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.266+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=___ 2024-09-19T13:52:58.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.267+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011780 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.268+0000 7f52eef25800 10 manifest: total_size = 49187 2024-09-19T13:52:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.268+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5882909535343408317 2024-09-19T13:52:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.268+0000 7f52eef25800 20 get_obj_state: octx=0x7f52e4011780 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.268+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666d68 2024-09-19T13:52:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.268+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9.6 2024-09-19T13:52:58.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.268+0000 7f51ce7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T13:52:58.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.270+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59fc90 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.270+0000 7f52eef25800 10 manifest: total_size = 49187 2024-09-19T13:52:58.272 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.270+0000 7f52eef25800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5656807658752471822 2024-09-19T13:52:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.270+0000 7f52eef25800 20 get_obj_state: octx=0x55d3da59fc90 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55d3da666d68 s->prefetch_data=0 2024-09-19T13:52:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.270+0000 7f52eef25800 20 prepare_atomic_modification: state is not atomic. state=0x55d3da666d68 2024-09-19T13:52:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.270+0000 7f52eef25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9.8 2024-09-19T13:52:58.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.271+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=__ 2024-09-19T13:52:58.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.273+0000 7f52eef25800 20 list_objects_ordered: starting attempt 1 2024-09-19T13:52:58.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.273+0000 7f52eef25800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T13:52:58.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.274+0000 7f51cdffb640 20 handle_completion(): completion ok for obj=obj 2024-09-19T13:52:58.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.274+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T13:52:58.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.274+0000 7f52eef25800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T13:52:58.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.274+0000 7f52eef25800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T13:52:58.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.274+0000 7f52eef25800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T13:52:58.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.274+0000 7f52eef25800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9])"; uploads.size()=0; is_truncated=0 2024-09-19T13:52:58.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.276+0000 7f52eef25800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-19T13:52:58.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.276+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.277+0000 7f52eef25800 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T13:52:58.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.277+0000 7f52eef25800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-19T13:52:58.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.277+0000 7f52eef25800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-19T13:52:58.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.277+0000 7f52eef25800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-19T13:52:58.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.277+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-19T13:52:58.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.278+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660548 cookie 94368390195920 notifier 5946 bl.length()=181 2024-09-19T13:52:58.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.279+0000 7f52eef25800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 from cache 2024-09-19T13:52:58.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.279+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9, ofs0, ns] 2024-09-19T13:52:58.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.280+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660549 cookie 94368390195920 notifier 5946 bl.length()=238 2024-09-19T13:52:58.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.282+0000 7f52eef25800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 : miss 2024-09-19T13:52:58.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.282+0000 7f52eef25800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.282+0000 7f52eef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.282+0000 7f52eef25800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 info.flags=0x0 2024-09-19T13:52:58.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.282+0000 7f52eef25800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9 to cache LRU end 2024-09-19T13:52:58.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.284+0000 7f52eef25800 10 removing key index: GBRAMBKPCDRRHQRXOFWJ 2024-09-19T13:52:58.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.285+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:GBRAMBKPCDRRHQRXOFWJ, ofs0, ns] 2024-09-19T13:52:58.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.285+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660506 cookie 94368390208064 notifier 5946 bl.length()=170 2024-09-19T13:52:58.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.285+0000 7f52eef25800 10 removing email index: ragweed.client.0+test@test.test 2024-09-19T13:52:58.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.287+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-19T13:52:58.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.287+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660504 cookie 94368390199984 notifier 5946 bl.length()=182 2024-09-19T13:52:58.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.287+0000 7f52eef25800 10 removing user buckets index 2024-09-19T13:52:58.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.288+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-19T13:52:58.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.289+0000 7f51ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660507 cookie 94368390208064 notifier 5946 bl.length()=173 2024-09-19T13:52:58.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.289+0000 7f52eef25800 10 removing user index: ragweed.client.0 2024-09-19T13:52:58.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.290+0000 7f52eef25800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-19T13:52:58.292 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.290+0000 7f52eef25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-19T13:52:58.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.290+0000 7f51cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660511 cookie 94368390205392 notifier 5946 bl.length()=165 2024-09-19T13:52:58.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.292+0000 7f51a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:58.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.294+0000 7f52eef25800 20 remove_watcher() i=0 2024-09-19T13:52:58.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.294+0000 7f52eef25800 2 removed watcher, disabling cache 2024-09-19T13:52:58.296 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.294+0000 7f52eef25800 20 remove_watcher() i=1 2024-09-19T13:52:58.297 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.295+0000 7f52eef25800 20 remove_watcher() i=2 2024-09-19T13:52:58.298 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.296+0000 7f52eef25800 20 remove_watcher() i=3 2024-09-19T13:52:58.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.297+0000 7f52eef25800 20 remove_watcher() i=4 2024-09-19T13:52:58.300 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.298+0000 7f52eef25800 20 remove_watcher() i=5 2024-09-19T13:52:58.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.299+0000 7f52eef25800 20 remove_watcher() i=6 2024-09-19T13:52:58.302 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.300+0000 7f52eef25800 20 remove_watcher() i=7 2024-09-19T13:52:58.312 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-19T13:52:58.368 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:52:58.368 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:52:58.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.398+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 realm 2024-09-19T13:52:58.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:52:58.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.400+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.401+0000 7fd430133800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.401+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.401+0000 7fd430133800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:52:58.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.401+0000 7fd430133800 20 searching for the correct realm 2024-09-19T13:52:58.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.404+0000 7fd42b675640 0 -- 172.21.15.94:0/2622406010 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd41c01b040 msgr2=0x7fd41c06bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:52:58.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.408+0000 7fd42be76640 0 -- 172.21.15.94:0/2622406010 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd420061450 msgr2=0x7fd4200618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:52:58.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:52:58.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:52:58.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:52:58.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:52:58.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.613+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 zone default found 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 4 Realm: () 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:52:58.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 zonegroup default 2024-09-19T13:52:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.614+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.615+0000 7fd430133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:52:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.615+0000 7fd430133800 20 started sync module instance, tier type = 2024-09-19T13:52:58.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.615+0000 7fd430133800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:52:58.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=0 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=1 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=2 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=3 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=4 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=5 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.623+0000 7fd430133800 20 add_watcher() i=6 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.624+0000 7fd430133800 20 add_watcher() i=7 2024-09-19T13:52:58.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.624+0000 7fd430133800 2 all 8 watchers are set, enabling cache 2024-09-19T13:52:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.626+0000 7fd2e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.626+0000 7fd430133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:52:58.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.626+0000 7fd430133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:52:58.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.659+0000 7fd2e0fe1640 20 reqs_thread_entry: start 2024-09-19T13:52:58.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.659+0000 7fd430133800 20 init_complete bucket index max shards: 11 2024-09-19T13:52:58.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.659+0000 7fd430133800 20 Filter name: none 2024-09-19T13:52:58.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.659+0000 7fd25a7fc640 20 reqs_thread_entry: start 2024-09-19T13:52:58.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.659+0000 7fd430133800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-19T13:52:58.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.659+0000 7fd430133800 20 rados->read ofs=0 len=0 2024-09-19T13:52:58.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.660+0000 7fd430133800 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T13:52:58.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.660+0000 7fd430133800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-19T13:52:58.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.660+0000 7fd430133800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T13:52:58.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.660+0000 7fd430133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:52:58.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.660+0000 7fd430133800 10 removing key index: SLRBMPMIHJBMNBGGXEMC 2024-09-19T13:52:58.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.661+0000 7fd430133800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:SLRBMPMIHJBMNBGGXEMC, ofs0, ns] 2024-09-19T13:52:58.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.662+0000 7fd30affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660493 cookie 94257469024016 notifier 5964 bl.length()=170 2024-09-19T13:52:58.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.662+0000 7fd430133800 10 removing email index: sysuser.client.0+test@test.test 2024-09-19T13:52:58.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.663+0000 7fd430133800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-19T13:52:58.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.663+0000 7fd30affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660512 cookie 94257469026768 notifier 5964 bl.length()=182 2024-09-19T13:52:58.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.664+0000 7fd430133800 10 removing user buckets index 2024-09-19T13:52:58.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.665+0000 7fd430133800 10 removing user index: sysuser.client.0 2024-09-19T13:52:58.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.666+0000 7fd430133800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-19T13:52:58.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.666+0000 7fd430133800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-19T13:52:58.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.666+0000 7fd30a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660505 cookie 94257469019504 notifier 5964 bl.length()=165 2024-09-19T13:52:58.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.667+0000 7fd2e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:52:58.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.669+0000 7fd430133800 20 remove_watcher() i=0 2024-09-19T13:52:58.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.669+0000 7fd430133800 2 removed watcher, disabling cache 2024-09-19T13:52:58.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.670+0000 7fd430133800 20 remove_watcher() i=1 2024-09-19T13:52:58.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.671+0000 7fd430133800 20 remove_watcher() i=2 2024-09-19T13:52:58.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.672+0000 7fd430133800 20 remove_watcher() i=3 2024-09-19T13:52:58.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.673+0000 7fd430133800 20 remove_watcher() i=4 2024-09-19T13:52:58.676 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.674+0000 7fd430133800 20 remove_watcher() i=5 2024-09-19T13:52:58.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.675+0000 7fd430133800 20 remove_watcher() i=6 2024-09-19T13:52:58.678 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T13:52:58.676+0000 7fd430133800 20 remove_watcher() i=7 2024-09-19T13:52:58.689 INFO:tasks.ragweed:Removing ragweed... 2024-09-19T13:52:58.689 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T13:52:58.763 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:52:58.773 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:52:58.773 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:52:58.774 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:52:58.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:52:58.803 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:52:58.803 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:52:58.871 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:52:58.871 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:52:58.940 INFO:tasks.workunit:timeout=3h 2024-09-19T13:52:58.940 INFO:tasks.workunit:cleanup=True 2024-09-19T13:52:58.941 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:52:59.010 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:53:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:53:59.012 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:53:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:53:59.012 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:53:59.013 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:53:59.016 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:53:59.086 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:53:59.088 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:53:59.088 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:53:59.136 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:53:59.185 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:53:59.224 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:53:59.225 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:53:59.225 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:53:59.263 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:53:59.267 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T13:53:59.267 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:53:59.337 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-19T13:53:59.338 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-19T13:53:59.339 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-19T13:53:59.410 INFO:tasks.workunit.client.0.smithi094.stderr:+ ulimit -c 0 2024-09-19T13:53:59.411 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-19T13:53:59.411 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:53:59.411 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:54:01.699 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-19T13:54:01.700 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:54:01.701 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T13:54:01.701 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-19T13:54:01.701 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T13:54:01.702 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-19T13:54:01.924 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-19T13:54:02.119 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-19T13:54:02.124 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T13:54:02.169 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-19T13:54:02.169 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-19T13:54:02.169 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-19T13:54:02.322 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-19T13:54:02.327 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-19T13:54:03.052 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-19T13:54:03.100 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-19T13:54:03.869 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-19T13:54:03.870 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T13:54:04.400 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T13:54:04.401 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T13:54:04.446 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T13:54:04.447 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T13:54:04.502 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T13:54:04.503 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T13:54:04.552 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:54:04.553 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T13:54:04.629 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:54:04.630 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-19T13:54:04.824 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:54:04.825 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T13:54:04.829 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T13:54:04.831 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T13:54:04.840 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T13:54:04.842 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T13:54:04.843 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T13:54:04.844 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-19T13:54:04.846 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:54:04.918 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T13:54:05.953 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-19T13:54:06.069 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-19T13:54:06.194 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-19T13:54:06.228 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:06.228 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:06.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.264+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 realm 2024-09-19T13:54:06.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:06.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.266+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.267+0000 7ff2f8332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:06.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.267+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.268+0000 7ff2f8332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:06.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.268+0000 7ff2f8332800 20 searching for the correct realm 2024-09-19T13:54:06.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.271+0000 7ff2f37bb640 0 -- 172.21.15.94:0/3475458239 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7ff2e40d4040 msgr2=0x7ff2e40bf9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:06.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.275+0000 7ff2f3fbc640 0 -- 172.21.15.94:0/3475458239 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff2dc024890 msgr2=0x7ff2dc0807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:06.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.482+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 zone default found 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 4 Realm: () 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 zonegroup default 2024-09-19T13:54:06.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.483+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.484+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.484+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.484+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.484+0000 7ff2f8332800 20 started sync module instance, tier type = 2024-09-19T13:54:06.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.484+0000 7ff2f8332800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:06.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=0 2024-09-19T13:54:06.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=1 2024-09-19T13:54:06.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=2 2024-09-19T13:54:06.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=3 2024-09-19T13:54:06.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=4 2024-09-19T13:54:06.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=5 2024-09-19T13:54:06.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.494+0000 7ff2f8332800 20 add_watcher() i=6 2024-09-19T13:54:06.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.495+0000 7ff2f8332800 20 add_watcher() i=7 2024-09-19T13:54:06.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.495+0000 7ff2f8332800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:06.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.497+0000 7ff1a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:06.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.497+0000 7ff2f8332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:06.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.497+0000 7ff2f8332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.497+0000 7ff2f8332800 5 note: GC not initialized 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.497+0000 7ff1a8fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 Filter name: none 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff1227fc640 20 reqs_thread_entry: start 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 rados_obj.operate() r=0 bl.length=22 2024-09-19T13:54:06.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-19T13:54:06.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T13:54:06.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-19T13:54:06.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.498+0000 7ff2f8332800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.499+0000 7ff2f8332800 20 rados_obj.operate() r=0 bl.length=420 2024-09-19T13:54:06.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.499+0000 7ff2f8332800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.499+0000 7ff2f8332800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.499+0000 7ff2f8332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.499+0000 7ff2f8332800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.499+0000 7ff2f8332800 20 get_user_info_from_index found 0 xattrs 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.500+0000 7ff1a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.502+0000 7ff2f8332800 20 remove_watcher() i=0 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.502+0000 7ff2f8332800 2 removed watcher, disabling cache 2024-09-19T13:54:06.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.504+0000 7ff2f8332800 20 remove_watcher() i=1 2024-09-19T13:54:06.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.505+0000 7ff2f8332800 20 remove_watcher() i=2 2024-09-19T13:54:06.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.506+0000 7ff2f8332800 20 remove_watcher() i=3 2024-09-19T13:54:06.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.507+0000 7ff2f8332800 20 remove_watcher() i=4 2024-09-19T13:54:06.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.508+0000 7ff2f8332800 20 remove_watcher() i=5 2024-09-19T13:54:06.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.509+0000 7ff2f8332800 20 remove_watcher() i=6 2024-09-19T13:54:06.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.510+0000 7ff2f8332800 20 remove_watcher() i=7 2024-09-19T13:54:06.743 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard add 2024-09-19T13:54:06.743 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:06.744 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:54:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:06.773 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:06.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.807+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.809+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.809+0000 7f441f973800 20 realm 2024-09-19T13:54:06.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.809+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.809+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.809+0000 7f441f973800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:06.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.809+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.810+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.810+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.810+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:06.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.810+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.811+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:06.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.811+0000 7f441f973800 20 searching for the correct realm 2024-09-19T13:54:06.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.814+0000 7f4414c5c640 0 -- 172.21.15.94:0/940167677 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f441006d070 msgr2=0x7f44100588c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:06.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.818+0000 7f4414c5c640 0 -- 172.21.15.94:0/940167677 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f42e8087390 msgr2=0x7f42e80897c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:06.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:06.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.822+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:06.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:06.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 zone default found 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 4 Realm: () 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 zonegroup default 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.823+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.824+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.824+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.824+0000 7f441f973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.824+0000 7f441f973800 20 started sync module instance, tier type = 2024-09-19T13:54:06.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.824+0000 7f441f973800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:06.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=0 2024-09-19T13:54:06.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=1 2024-09-19T13:54:06.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=2 2024-09-19T13:54:06.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=3 2024-09-19T13:54:06.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=4 2024-09-19T13:54:06.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=5 2024-09-19T13:54:06.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.833+0000 7f441f973800 20 add_watcher() i=6 2024-09-19T13:54:06.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.834+0000 7f441f973800 20 add_watcher() i=7 2024-09-19T13:54:06.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.834+0000 7f441f973800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:06.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f42d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:06.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f441f973800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f441f973800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f441f973800 5 note: GC not initialized 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f42d2fe5640 20 reqs_thread_entry: start 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f441f973800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f441f973800 20 Filter name: none 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.836+0000 7f42d0fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:06.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.837+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.837+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:06.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.837+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.838+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:06.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.838+0000 7f441f973800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:06.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.838+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.838+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:06.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.838+0000 7f441f973800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.839+0000 7f441f973800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:06.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.839+0000 7f441f973800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:06.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.841+0000 7f42d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:06.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.843+0000 7f441f973800 20 remove_watcher() i=0 2024-09-19T13:54:06.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.843+0000 7f441f973800 2 removed watcher, disabling cache 2024-09-19T13:54:06.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.844+0000 7f441f973800 20 remove_watcher() i=1 2024-09-19T13:54:06.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.845+0000 7f441f973800 20 remove_watcher() i=2 2024-09-19T13:54:06.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.846+0000 7f441f973800 20 remove_watcher() i=3 2024-09-19T13:54:06.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.847+0000 7f441f973800 20 remove_watcher() i=4 2024-09-19T13:54:06.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.848+0000 7f441f973800 20 remove_watcher() i=5 2024-09-19T13:54:06.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.849+0000 7f441f973800 20 remove_watcher() i=6 2024-09-19T13:54:06.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.849+0000 7f441f973800 20 remove_watcher() i=7 2024-09-19T13:54:06.861 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:06.861 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:06.861 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-19T13:54:06.861 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:06.862 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-19T13:54:06.893 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:06.893 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:06.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.929+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.930+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.930+0000 7f8e49923800 20 realm 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.930+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.930+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.930+0000 7f8e49923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.930+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.931+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.931+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.932+0000 7f8e49923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:06.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.932+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.932+0000 7f8e49923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:06.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.932+0000 7f8e49923800 20 searching for the correct realm 2024-09-19T13:54:06.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.936+0000 7f8e3ce0b640 0 -- 172.21.15.94:0/858760403 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x560c65169050 msgr2=0x560c6516b4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:06.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.939+0000 7f8e3ce0b640 0 -- 172.21.15.94:0/858760403 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f8e3806b020 msgr2=0x7f8e380aea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:06.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:06.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:06.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.943+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:06.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:06.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 zone default found 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 4 Realm: () 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 zonegroup default 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.944+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.945+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.945+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.945+0000 7f8e49923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:06.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.945+0000 7f8e49923800 20 started sync module instance, tier type = 2024-09-19T13:54:06.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.945+0000 7f8e49923800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=0 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=1 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=2 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=3 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=4 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=5 2024-09-19T13:54:06.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=6 2024-09-19T13:54:06.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 20 add_watcher() i=7 2024-09-19T13:54:06.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.954+0000 7f8e49923800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:06.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.956+0000 7f8cfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:06.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.956+0000 7f8e49923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:06.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.956+0000 7f8e49923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:06.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.956+0000 7f8e49923800 5 note: GC not initialized 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8cfa7e4640 20 reqs_thread_entry: start 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 20 Filter name: none 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8c6bfff640 20 reqs_thread_entry: start 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:06.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.957+0000 7f8e49923800 20 rados->read ofs=0 len=0 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.958+0000 7f8e49923800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.958+0000 7f8e49923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.958+0000 7f8e49923800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.958+0000 7f8e49923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.958+0000 7f8e49923800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:06.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.958+0000 7f8e49923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:06.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.960+0000 7f8cfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:06.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.962+0000 7f8e49923800 20 remove_watcher() i=0 2024-09-19T13:54:06.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.962+0000 7f8e49923800 2 removed watcher, disabling cache 2024-09-19T13:54:06.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.963+0000 7f8e49923800 20 remove_watcher() i=1 2024-09-19T13:54:06.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.964+0000 7f8e49923800 20 remove_watcher() i=2 2024-09-19T13:54:06.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.965+0000 7f8e49923800 20 remove_watcher() i=3 2024-09-19T13:54:06.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.966+0000 7f8e49923800 20 remove_watcher() i=4 2024-09-19T13:54:06.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.967+0000 7f8e49923800 20 remove_watcher() i=5 2024-09-19T13:54:06.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.968+0000 7f8e49923800 20 remove_watcher() i=6 2024-09-19T13:54:06.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:06.969+0000 7f8e49923800 20 remove_watcher() i=7 2024-09-19T13:54:06.982 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard list 2024-09-19T13:54:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:07.008 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:07.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.044+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.045+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.045+0000 7f9eedf2a800 20 realm 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.045+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.046+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.046+0000 7f9eedf2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.046+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.046+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.046+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.047+0000 7f9eedf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:07.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.047+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.047+0000 7f9eedf2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:07.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.047+0000 7f9eedf2a800 20 searching for the correct realm 2024-09-19T13:54:07.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.050+0000 7f9ee1416640 0 -- 172.21.15.94:0/1276082393 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55d96ef9bda0 msgr2=0x55d96ef9e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:07.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.054+0000 7f9ee9c17640 0 -- 172.21.15.94:0/1276082393 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9ed406b710 msgr2=0x7f9ed409a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:07.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:07.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:07.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:07.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.058+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:07.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 20 zone default found 2024-09-19T13:54:07.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 4 Realm: () 2024-09-19T13:54:07.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:07.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 20 zonegroup default 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.059+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.060+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.060+0000 7f9eedf2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.060+0000 7f9eedf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.060+0000 7f9eedf2a800 20 started sync module instance, tier type = 2024-09-19T13:54:07.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.060+0000 7f9eedf2a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:07.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=0 2024-09-19T13:54:07.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=1 2024-09-19T13:54:07.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=2 2024-09-19T13:54:07.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=3 2024-09-19T13:54:07.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=4 2024-09-19T13:54:07.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=5 2024-09-19T13:54:07.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.069+0000 7f9eedf2a800 20 add_watcher() i=6 2024-09-19T13:54:07.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.070+0000 7f9eedf2a800 20 add_watcher() i=7 2024-09-19T13:54:07.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.070+0000 7f9eedf2a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:07.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.071+0000 7f9d9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9eedf2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9eedf2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9eedf2a800 5 note: GC not initialized 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9d9a7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9eedf2a800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9eedf2a800 20 Filter name: none 2024-09-19T13:54:07.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.072+0000 7f9d0bfff640 20 reqs_thread_entry: start 2024-09-19T13:54:07.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.078+0000 7f9d9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:07.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.081+0000 7f9eedf2a800 20 remove_watcher() i=0 2024-09-19T13:54:07.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.081+0000 7f9eedf2a800 2 removed watcher, disabling cache 2024-09-19T13:54:07.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.082+0000 7f9eedf2a800 20 remove_watcher() i=1 2024-09-19T13:54:07.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.083+0000 7f9eedf2a800 20 remove_watcher() i=2 2024-09-19T13:54:07.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.085+0000 7f9eedf2a800 20 remove_watcher() i=3 2024-09-19T13:54:07.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.085+0000 7f9eedf2a800 20 remove_watcher() i=4 2024-09-19T13:54:07.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.086+0000 7f9eedf2a800 20 remove_watcher() i=5 2024-09-19T13:54:07.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.087+0000 7f9eedf2a800 20 remove_watcher() i=6 2024-09-19T13:54:07.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.088+0000 7f9eedf2a800 20 remove_watcher() i=7 2024-09-19T13:54:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:bucket name a-bucket 2024-09-19T13:54:07.100 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard process 2024-09-19T13:54:07.100 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:07.101 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard process 2024-09-19T13:54:07.128 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:07.128 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:07.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.164+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 realm 2024-09-19T13:54:07.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:07.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.165+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.166+0000 7f01d3287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:07.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.166+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.167+0000 7f01d3287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:07.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.167+0000 7f01d3287800 20 searching for the correct realm 2024-09-19T13:54:07.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.170+0000 7f01d0570640 0 -- 172.21.15.94:0/2551778336 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5620b5bc8a50 msgr2=0x5620b5bcaf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:07.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.173+0000 7f01d0d71640 0 -- 172.21.15.94:0/2551778336 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f01c4008410 msgr2=0x7f01c4008870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.177+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 zone default found 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 4 Realm: () 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 zonegroup default 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.178+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.179+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.179+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.179+0000 7f01d3287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:07.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.179+0000 7f01d3287800 20 started sync module instance, tier type = 2024-09-19T13:54:07.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.179+0000 7f01d3287800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=0 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=1 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=2 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=3 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=4 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=5 2024-09-19T13:54:07.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.188+0000 7f01d3287800 20 add_watcher() i=6 2024-09-19T13:54:07.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.189+0000 7f01d3287800 20 add_watcher() i=7 2024-09-19T13:54:07.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.189+0000 7f01d3287800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:07.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.190+0000 7f00877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:07.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f01d3287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:07.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f01d3287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:07.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f01d3287800 5 note: GC not initialized 2024-09-19T13:54:07.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f00867e4640 20 reqs_thread_entry: start 2024-09-19T13:54:07.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f01d3287800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:07.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f01d3287800 20 Filter name: none 2024-09-19T13:54:07.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f007ffff640 20 reqs_thread_entry: start 2024-09-19T13:54:07.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.191+0000 7f01d3287800 20 processing logshard = reshard.0000000000 2024-09-19T13:54:07.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.194+0000 7f01d3287800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-19T13:54:07.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.194+0000 7f01d3287800 20 processing logshard = reshard.0000000001 2024-09-19T13:54:07.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.196+0000 7f01d3287800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-19T13:54:07.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.196+0000 7f01d3287800 20 processing logshard = reshard.0000000002 2024-09-19T13:54:07.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.199+0000 7f01d3287800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-19T13:54:07.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.199+0000 7f01d3287800 20 processing logshard = reshard.0000000003 2024-09-19T13:54:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.201+0000 7f01d3287800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-19T13:54:07.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.201+0000 7f01d3287800 20 processing logshard = reshard.0000000004 2024-09-19T13:54:07.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.204+0000 7f01d3287800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-19T13:54:07.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.204+0000 7f01d3287800 20 processing logshard = reshard.0000000005 2024-09-19T13:54:07.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.206+0000 7f01d3287800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-19T13:54:07.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.206+0000 7f01d3287800 20 processing logshard = reshard.0000000006 2024-09-19T13:54:07.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.207+0000 7f01d3287800 20 process_entry resharding a-bucket 2024-09-19T13:54:07.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.207+0000 7f01d3287800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:54:07.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.207+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:07.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-19T13:54:07.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 20 rados->read ofs=0 len=0 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.208+0000 7f01d3287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.214+0000 7f01d3287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.214+0000 7f01d3287800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.214+0000 7f01d3287800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.214+0000 7f01d3287800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f00a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 94698487995408 notifier 5801 bl.length()=911 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f00a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f00a7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f00a7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:54:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:54:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:54:07.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.215+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.0 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.0 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.1 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.1 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.2 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.2 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.3 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.3 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.4 2024-09-19T13:54:07.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.4 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.5 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.5 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.6 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.6 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.7 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.7 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.8 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.8 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.9 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.9 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.10 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.10 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.11 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.11 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.219+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.0 2024-09-19T13:54:07.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.220+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1 2024-09-19T13:54:07.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.220+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2 2024-09-19T13:54:07.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.221+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3 2024-09-19T13:54:07.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.221+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.4 2024-09-19T13:54:07.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.222+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.5 2024-09-19T13:54:07.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.222+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.6 2024-09-19T13:54:07.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.223+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.7 2024-09-19T13:54:07.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.223+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.8 2024-09-19T13:54:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.224+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.9 2024-09-19T13:54:07.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.224+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.10 2024-09-19T13:54:07.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.225+0000 7f01d3287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:07.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.225+0000 7f01d3287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:07.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.226+0000 7f01d3287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.226+0000 7f01d3287800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.226+0000 7f01d3287800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.226+0000 7f01d3287800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f00a7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595108 cookie 94698487995408 notifier 5801 bl.length()=911 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f00a7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f00a7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f00a7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:54:07.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:54:07.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:54:07.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.227+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:54:07.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.230+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.0 2024-09-19T13:54:07.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.230+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1 2024-09-19T13:54:07.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.230+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2 2024-09-19T13:54:07.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.231+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3 2024-09-19T13:54:07.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.231+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.4 2024-09-19T13:54:07.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.231+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.5 2024-09-19T13:54:07.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.232+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.6 2024-09-19T13:54:07.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.232+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.7 2024-09-19T13:54:07.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.232+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.8 2024-09-19T13:54:07.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.233+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.9 2024-09-19T13:54:07.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.233+0000 7f01d3287800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.10 2024-09-19T13:54:07.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.234+0000 7f01d3287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:07.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.234+0000 7f01d3287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:07.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f01d3287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f01d3287800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f01d3287800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f01d3287800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:54:07.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f00a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595109 cookie 94698487995408 notifier 5801 bl.length()=879 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f00a77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f00a77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.235+0000 7f00a77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.236+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.236+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.236+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:54:07.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.236+0000 7f01d3287800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:54:07.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.238+0000 7f01d3287800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-19T13:54:07.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.239+0000 7f01d3287800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-19T13:54:07.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.241+0000 7f01d3287800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-19T13:54:07.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.241+0000 7f01d3287800 20 processing logshard = reshard.0000000007 2024-09-19T13:54:07.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.243+0000 7f01d3287800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-19T13:54:07.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.243+0000 7f01d3287800 20 processing logshard = reshard.0000000008 2024-09-19T13:54:07.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.246+0000 7f01d3287800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-19T13:54:07.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.246+0000 7f01d3287800 20 processing logshard = reshard.0000000009 2024-09-19T13:54:07.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.248+0000 7f01d3287800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-19T13:54:07.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.248+0000 7f01d3287800 20 processing logshard = reshard.0000000010 2024-09-19T13:54:07.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.250+0000 7f01d3287800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-19T13:54:07.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.250+0000 7f01d3287800 20 processing logshard = reshard.0000000011 2024-09-19T13:54:07.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.253+0000 7f01d3287800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-19T13:54:07.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.253+0000 7f01d3287800 20 processing logshard = reshard.0000000012 2024-09-19T13:54:07.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.255+0000 7f01d3287800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-19T13:54:07.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.255+0000 7f01d3287800 20 processing logshard = reshard.0000000013 2024-09-19T13:54:07.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.258+0000 7f01d3287800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-19T13:54:07.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.258+0000 7f01d3287800 20 processing logshard = reshard.0000000014 2024-09-19T13:54:07.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.260+0000 7f01d3287800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-19T13:54:07.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.260+0000 7f01d3287800 20 processing logshard = reshard.0000000015 2024-09-19T13:54:07.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.263+0000 7f01d3287800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-19T13:54:07.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.263+0000 7f00877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:07.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.265+0000 7f01d3287800 20 remove_watcher() i=0 2024-09-19T13:54:07.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.265+0000 7f01d3287800 2 removed watcher, disabling cache 2024-09-19T13:54:07.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.266+0000 7f01d3287800 20 remove_watcher() i=1 2024-09-19T13:54:07.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.267+0000 7f01d3287800 20 remove_watcher() i=2 2024-09-19T13:54:07.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.268+0000 7f01d3287800 20 remove_watcher() i=3 2024-09-19T13:54:07.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.269+0000 7f01d3287800 20 remove_watcher() i=4 2024-09-19T13:54:07.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.270+0000 7f01d3287800 20 remove_watcher() i=5 2024-09-19T13:54:07.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.271+0000 7f01d3287800 20 remove_watcher() i=6 2024-09-19T13:54:07.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:07.272+0000 7f01d3287800 20 remove_watcher() i=7 2024-09-19T13:54:12.289 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:54:12.321 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:12.321 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:12.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.361+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.363+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.363+0000 7fe404a0f800 20 realm 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.363+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.364+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.364+0000 7fe404a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.364+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.364+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.364+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.365+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.365+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.365+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:12.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.365+0000 7fe404a0f800 20 searching for the correct realm 2024-09-19T13:54:12.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.369+0000 7fe402d01640 0 -- 172.21.15.94:0/1167682549 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x555ad131e4b0 msgr2=0x555ad13208e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:12.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.373+0000 7fe3f9cff640 0 -- 172.21.15.94:0/1167682549 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe3f40ce040 msgr2=0x7fe3f40ae940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:12.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.378+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 zone default found 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 4 Realm: () 2024-09-19T13:54:12.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 zonegroup default 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.379+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.380+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.380+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.380+0000 7fe404a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.380+0000 7fe404a0f800 20 started sync module instance, tier type = 2024-09-19T13:54:12.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.380+0000 7fe404a0f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:12.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=0 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=1 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=2 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=3 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=4 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=5 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.389+0000 7fe404a0f800 20 add_watcher() i=6 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.390+0000 7fe404a0f800 20 add_watcher() i=7 2024-09-19T13:54:12.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.390+0000 7fe404a0f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:12.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.392+0000 7fe2b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.392+0000 7fe404a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.392+0000 7fe404a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.392+0000 7fe404a0f800 5 note: GC not initialized 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.392+0000 7fe2337fe640 20 reqs_thread_entry: start 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.393+0000 7fe404a0f800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.393+0000 7fe404a0f800 20 Filter name: none 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.393+0000 7fe2317fa640 20 reqs_thread_entry: start 2024-09-19T13:54:12.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.393+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.393+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:12.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.393+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.394+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:12.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.394+0000 7fe404a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:12.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.394+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.394+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:12.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.395+0000 7fe404a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.395+0000 7fe404a0f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:12.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.395+0000 7fe404a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:12.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.397+0000 7fe2b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:12.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.399+0000 7fe404a0f800 20 remove_watcher() i=0 2024-09-19T13:54:12.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.399+0000 7fe404a0f800 2 removed watcher, disabling cache 2024-09-19T13:54:12.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.400+0000 7fe404a0f800 20 remove_watcher() i=1 2024-09-19T13:54:12.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.401+0000 7fe404a0f800 20 remove_watcher() i=2 2024-09-19T13:54:12.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.402+0000 7fe404a0f800 20 remove_watcher() i=3 2024-09-19T13:54:12.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.403+0000 7fe404a0f800 20 remove_watcher() i=4 2024-09-19T13:54:12.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.404+0000 7fe404a0f800 20 remove_watcher() i=5 2024-09-19T13:54:12.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.405+0000 7fe404a0f800 20 remove_watcher() i=6 2024-09-19T13:54:12.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.406+0000 7fe404a0f800 20 remove_watcher() i=7 2024-09-19T13:54:12.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:12.418 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:12.418 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-19T13:54:12.419 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:12.419 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard add non empty bucket 2024-09-19T13:54:12.419 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:12.490 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:54:12.518 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:12.519 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:12.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.554+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 realm 2024-09-19T13:54:12.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:12.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.556+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.557+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.557+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.557+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:12.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.557+0000 7fbcc4487800 20 searching for the correct realm 2024-09-19T13:54:12.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.560+0000 7fbcb9770640 0 -- 172.21.15.94:0/3277768844 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fbcb4083070 msgr2=0x7fbcb409e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:12.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.564+0000 7fbcc1f71640 0 -- 172.21.15.94:0/3277768844 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fbcac045940 msgr2=0x7fbcac07da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.772+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 zone default found 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 4 Realm: () 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 zonegroup default 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.773+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.774+0000 7fbcc4487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.774+0000 7fbcc4487800 20 started sync module instance, tier type = 2024-09-19T13:54:12.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.774+0000 7fbcc4487800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:12.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=0 2024-09-19T13:54:12.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=1 2024-09-19T13:54:12.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=2 2024-09-19T13:54:12.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=3 2024-09-19T13:54:12.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=4 2024-09-19T13:54:12.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=5 2024-09-19T13:54:12.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.783+0000 7fbcc4487800 20 add_watcher() i=6 2024-09-19T13:54:12.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.784+0000 7fbcc4487800 20 add_watcher() i=7 2024-09-19T13:54:12.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.784+0000 7fbcc4487800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:12.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbb737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:12.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbcc4487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbcc4487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbcc4487800 5 note: GC not initialized 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbb727fc640 20 reqs_thread_entry: start 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbcc4487800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbcc4487800 20 Filter name: none 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.786+0000 7fbae3fff640 20 reqs_thread_entry: start 2024-09-19T13:54:12.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.787+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.787+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.787+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.787+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.787+0000 7fbcc4487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.787+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.788+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:12.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.788+0000 7fbcc4487800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.788+0000 7fbcc4487800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:12.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.788+0000 7fbcc4487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:12.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.790+0000 7fbb737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:12.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.792+0000 7fbcc4487800 20 remove_watcher() i=0 2024-09-19T13:54:12.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.792+0000 7fbcc4487800 2 removed watcher, disabling cache 2024-09-19T13:54:12.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.793+0000 7fbcc4487800 20 remove_watcher() i=1 2024-09-19T13:54:12.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.794+0000 7fbcc4487800 20 remove_watcher() i=2 2024-09-19T13:54:12.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.795+0000 7fbcc4487800 20 remove_watcher() i=3 2024-09-19T13:54:12.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.796+0000 7fbcc4487800 20 remove_watcher() i=4 2024-09-19T13:54:12.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.797+0000 7fbcc4487800 20 remove_watcher() i=5 2024-09-19T13:54:12.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.798+0000 7fbcc4487800 20 remove_watcher() i=6 2024-09-19T13:54:12.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.799+0000 7fbcc4487800 20 remove_watcher() i=7 2024-09-19T13:54:12.810 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:12.810 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:12.810 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-19T13:54:12.810 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:12.812 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-19T13:54:12.842 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:12.842 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:12.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.877+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 realm 2024-09-19T13:54:12.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:12.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.879+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.880+0000 7f5dfdd44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.880+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.880+0000 7f5dfdd44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:12.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.880+0000 7f5dfdd44800 20 searching for the correct realm 2024-09-19T13:54:12.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.884+0000 7f5df302d640 0 -- 172.21.15.94:0/1704051537 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x5592120052e0 msgr2=0x559212007730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:12.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.887+0000 7f5df302d640 0 -- 172.21.15.94:0/1704051537 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f5dec04cbd0 msgr2=0x7f5dec070730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:12.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:12.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:12.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:12.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:12.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:12.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:12.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.891+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 zone default found 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 4 Realm: () 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:12.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 zonegroup default 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.892+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.893+0000 7f5dfdd44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.893+0000 7f5dfdd44800 20 started sync module instance, tier type = 2024-09-19T13:54:12.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.893+0000 7f5dfdd44800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=0 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=1 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=2 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=3 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=4 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=5 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.901+0000 7f5dfdd44800 20 add_watcher() i=6 2024-09-19T13:54:12.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.902+0000 7f5dfdd44800 20 add_watcher() i=7 2024-09-19T13:54:12.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.902+0000 7f5dfdd44800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:12.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.904+0000 7f5cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:12.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.904+0000 7f5dfdd44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:12.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.904+0000 7f5dfdd44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 5 note: GC not initialized 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5cb0fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 20 Filter name: none 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5c2a7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:54:12.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.905+0000 7f5dfdd44800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.906+0000 7f5dfdd44800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:12.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.906+0000 7f5dfdd44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:12.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.906+0000 7f5dfdd44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:12.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.906+0000 7f5dfdd44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:12.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.906+0000 7f5dfdd44800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:12.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.906+0000 7f5dfdd44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:12.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.908+0000 7f5cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:12.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.910+0000 7f5dfdd44800 20 remove_watcher() i=0 2024-09-19T13:54:12.911 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.910+0000 7f5dfdd44800 2 removed watcher, disabling cache 2024-09-19T13:54:12.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.911+0000 7f5dfdd44800 20 remove_watcher() i=1 2024-09-19T13:54:12.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.912+0000 7f5dfdd44800 20 remove_watcher() i=2 2024-09-19T13:54:12.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.913+0000 7f5dfdd44800 20 remove_watcher() i=3 2024-09-19T13:54:12.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.914+0000 7f5dfdd44800 20 remove_watcher() i=4 2024-09-19T13:54:12.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.915+0000 7f5dfdd44800 20 remove_watcher() i=5 2024-09-19T13:54:12.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.916+0000 7f5dfdd44800 20 remove_watcher() i=6 2024-09-19T13:54:12.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.917+0000 7f5dfdd44800 20 remove_watcher() i=7 2024-09-19T13:54:12.929 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard list 2024-09-19T13:54:12.956 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:12.957 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:12.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.991+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 realm 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:12.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.993+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.994+0000 7fe35652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:12.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.994+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:12.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.994+0000 7fe35652c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:12.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.994+0000 7fe35652c800 20 searching for the correct realm 2024-09-19T13:54:12.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:12.997+0000 7fe34bfff640 0 -- 172.21.15.94:0/2513597605 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe344044040 msgr2=0x7fe344046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:13.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.204+0000 7fe3522da640 0 -- 172.21.15.94:0/2513597605 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe33c021020 msgr2=0x7fe33c07c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.410+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 zone default found 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 4 Realm: () 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 zonegroup default 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.411+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 started sync module instance, tier type = 2024-09-19T13:54:13.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.412+0000 7fe35652c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=0 2024-09-19T13:54:13.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=1 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=2 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=3 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=4 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=5 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.421+0000 7fe35652c800 20 add_watcher() i=6 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.422+0000 7fe35652c800 20 add_watcher() i=7 2024-09-19T13:54:13.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.422+0000 7fe35652c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.424+0000 7fe208fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.424+0000 7fe35652c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.424+0000 7fe35652c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.424+0000 7fe35652c800 5 note: GC not initialized 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.424+0000 7fe1837fe640 20 reqs_thread_entry: start 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.425+0000 7fe35652c800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.425+0000 7fe35652c800 20 Filter name: none 2024-09-19T13:54:13.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.425+0000 7fe1817fa640 20 reqs_thread_entry: start 2024-09-19T13:54:13.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.431+0000 7fe208fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:13.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.433+0000 7fe35652c800 20 remove_watcher() i=0 2024-09-19T13:54:13.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.433+0000 7fe35652c800 2 removed watcher, disabling cache 2024-09-19T13:54:13.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.434+0000 7fe35652c800 20 remove_watcher() i=1 2024-09-19T13:54:13.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.435+0000 7fe35652c800 20 remove_watcher() i=2 2024-09-19T13:54:13.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.436+0000 7fe35652c800 20 remove_watcher() i=3 2024-09-19T13:54:13.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.438+0000 7fe35652c800 20 remove_watcher() i=4 2024-09-19T13:54:13.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.439+0000 7fe35652c800 20 remove_watcher() i=5 2024-09-19T13:54:13.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.440+0000 7fe35652c800 20 remove_watcher() i=6 2024-09-19T13:54:13.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.441+0000 7fe35652c800 20 remove_watcher() i=7 2024-09-19T13:54:13.452 INFO:tasks.workunit.client.0.smithi094.stderr:bucket name a-bucket 2024-09-19T13:54:13.452 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard process non empty bucket 2024-09-19T13:54:13.452 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:13.455 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshard process 2024-09-19T13:54:13.480 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:13.480 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:13.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.515+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 realm 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.517+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.518+0000 7f2249b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:13.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.518+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.518+0000 7f2249b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:13.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.518+0000 7f2249b75800 20 searching for the correct realm 2024-09-19T13:54:13.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.521+0000 7f2247e60640 0 -- 172.21.15.94:0/1525469519 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f2230067d80 msgr2=0x7f22300667f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:13.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.525+0000 7f224765f640 0 -- 172.21.15.94:0/1525469519 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f223007db90 msgr2=0x7f223000b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:13.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.732+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 zone default found 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 4 Realm: () 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 zonegroup default 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.733+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 started sync module instance, tier type = 2024-09-19T13:54:13.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.734+0000 7f2249b75800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:13.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=0 2024-09-19T13:54:13.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=1 2024-09-19T13:54:13.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=2 2024-09-19T13:54:13.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=3 2024-09-19T13:54:13.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=4 2024-09-19T13:54:13.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=5 2024-09-19T13:54:13.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.744+0000 7f2249b75800 20 add_watcher() i=6 2024-09-19T13:54:13.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.745+0000 7f2249b75800 20 add_watcher() i=7 2024-09-19T13:54:13.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.745+0000 7f2249b75800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:13.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f20fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:13.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f2249b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f2249b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f2249b75800 5 note: GC not initialized 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f20fcfe1640 20 reqs_thread_entry: start 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f2249b75800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f2249b75800 20 Filter name: none 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f20767fc640 20 reqs_thread_entry: start 2024-09-19T13:54:13.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.747+0000 7f2249b75800 20 processing logshard = reshard.0000000000 2024-09-19T13:54:13.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.751+0000 7f2249b75800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-19T13:54:13.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.751+0000 7f2249b75800 20 processing logshard = reshard.0000000001 2024-09-19T13:54:13.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.753+0000 7f2249b75800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-19T13:54:13.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.753+0000 7f2249b75800 20 processing logshard = reshard.0000000002 2024-09-19T13:54:13.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.755+0000 7f2249b75800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-19T13:54:13.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.755+0000 7f2249b75800 20 processing logshard = reshard.0000000003 2024-09-19T13:54:13.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.758+0000 7f2249b75800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-19T13:54:13.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.758+0000 7f2249b75800 20 processing logshard = reshard.0000000004 2024-09-19T13:54:13.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.761+0000 7f2249b75800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-19T13:54:13.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.762+0000 7f2249b75800 20 processing logshard = reshard.0000000005 2024-09-19T13:54:13.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.764+0000 7f2249b75800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-19T13:54:13.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.764+0000 7f2249b75800 20 processing logshard = reshard.0000000006 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 20 process_entry resharding a-bucket 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:54:13.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.766+0000 7f2249b75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.767+0000 7f2249b75800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.767+0000 7f2249b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.767+0000 7f2249b75800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.767+0000 7f2249b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.767+0000 7f2249b75800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.767+0000 7f2249b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:13.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f212a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94412025887008 notifier 6153 bl.length()=911 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f212a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f212a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f212a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:54:13.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.775+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:54:13.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:54:13.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:54:13.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:54:13.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.0 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.780+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.0 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.781+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.1 2024-09-19T13:54:13.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.781+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.1 2024-09-19T13:54:13.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.781+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.2 2024-09-19T13:54:13.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.781+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.2 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.782+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.3 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.782+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.3 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.782+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.4 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.782+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.4 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.783+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.5 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.783+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.5 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.784+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.6 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.784+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.6 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.784+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.7 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.784+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.7 2024-09-19T13:54:13.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.785+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.8 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.785+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.8 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.785+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.9 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.785+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.9 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.786+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.10 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.786+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.10 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.786+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.11 2024-09-19T13:54:13.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.786+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.11 2024-09-19T13:54:13.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.789+0000 7f2249b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:13.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.789+0000 7f2249b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f212a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595111 cookie 94412025887008 notifier 6153 bl.length()=911 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f212a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f212a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f212a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:54:13.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:54:13.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:54:13.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.791+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:54:13.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.794+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.0 2024-09-19T13:54:13.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.794+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.0 2024-09-19T13:54:13.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.794+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.1 2024-09-19T13:54:13.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.794+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.1 2024-09-19T13:54:13.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.795+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.2 2024-09-19T13:54:13.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.795+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.2 2024-09-19T13:54:13.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.795+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.3 2024-09-19T13:54:13.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.795+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.3 2024-09-19T13:54:13.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.795+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.4 2024-09-19T13:54:13.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.795+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.4 2024-09-19T13:54:13.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.796+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.5 2024-09-19T13:54:13.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.796+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.5 2024-09-19T13:54:13.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.796+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.6 2024-09-19T13:54:13.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.796+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.6 2024-09-19T13:54:13.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.796+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.7 2024-09-19T13:54:13.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.796+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.7 2024-09-19T13:54:13.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.797+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.8 2024-09-19T13:54:13.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.797+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.8 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.797+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.9 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.797+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.9 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.798+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.10 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.798+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.10 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.798+0000 7f2249b75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.11 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.798+0000 7f2249b75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.1.11 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.798+0000 7f2249b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:13.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.798+0000 7f2249b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:54:13.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:54:13.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f212a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595112 cookie 94412025887008 notifier 6153 bl.length()=879 2024-09-19T13:54:13.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f212a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:54:13.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f212a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:54:13.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f212a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:54:13.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:54:13.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:54:13.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:54:13.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.800+0000 7f2249b75800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:54:13.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.803+0000 7f2249b75800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-19T13:54:13.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.805+0000 7f2249b75800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-19T13:54:13.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.807+0000 7f2249b75800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-19T13:54:13.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.807+0000 7f2249b75800 20 processing logshard = reshard.0000000007 2024-09-19T13:54:13.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.809+0000 7f2249b75800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-19T13:54:13.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.809+0000 7f2249b75800 20 processing logshard = reshard.0000000008 2024-09-19T13:54:13.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.811+0000 7f2249b75800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-19T13:54:13.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.811+0000 7f2249b75800 20 processing logshard = reshard.0000000009 2024-09-19T13:54:13.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.814+0000 7f2249b75800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-19T13:54:13.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.814+0000 7f2249b75800 20 processing logshard = reshard.0000000010 2024-09-19T13:54:13.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.816+0000 7f2249b75800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-19T13:54:13.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.816+0000 7f2249b75800 20 processing logshard = reshard.0000000011 2024-09-19T13:54:13.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.818+0000 7f2249b75800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-19T13:54:13.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.818+0000 7f2249b75800 20 processing logshard = reshard.0000000012 2024-09-19T13:54:13.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.821+0000 7f2249b75800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-19T13:54:13.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.821+0000 7f2249b75800 20 processing logshard = reshard.0000000013 2024-09-19T13:54:13.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.823+0000 7f2249b75800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-19T13:54:13.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.823+0000 7f2249b75800 20 processing logshard = reshard.0000000014 2024-09-19T13:54:13.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.825+0000 7f2249b75800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-19T13:54:13.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.825+0000 7f2249b75800 20 processing logshard = reshard.0000000015 2024-09-19T13:54:13.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.828+0000 7f2249b75800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-19T13:54:13.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.829+0000 7f20fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:13.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.831+0000 7f2249b75800 20 remove_watcher() i=0 2024-09-19T13:54:13.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.831+0000 7f2249b75800 2 removed watcher, disabling cache 2024-09-19T13:54:13.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.832+0000 7f2249b75800 20 remove_watcher() i=1 2024-09-19T13:54:13.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.833+0000 7f2249b75800 20 remove_watcher() i=2 2024-09-19T13:54:13.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.834+0000 7f2249b75800 20 remove_watcher() i=3 2024-09-19T13:54:13.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.835+0000 7f2249b75800 20 remove_watcher() i=4 2024-09-19T13:54:13.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.836+0000 7f2249b75800 20 remove_watcher() i=5 2024-09-19T13:54:13.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.837+0000 7f2249b75800 20 remove_watcher() i=6 2024-09-19T13:54:13.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.838+0000 7f2249b75800 20 remove_watcher() i=7 2024-09-19T13:54:13.851 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:54:13.879 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:13.880 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:13.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.914+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 realm 2024-09-19T13:54:13.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:13.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:13.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.916+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.917+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:13.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.917+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:13.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.917+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:13.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.917+0000 7f949272c800 20 searching for the correct realm 2024-09-19T13:54:13.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:13.920+0000 7f9487fff640 0 -- 172.21.15.94:0/740187871 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x564ce9214030 msgr2=0x564ce9216420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:14.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.126+0000 7f948e44f640 0 -- 172.21.15.94:0/740187871 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f947805a670 msgr2=0x7f947808f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.533+0000 7f949272c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.533+0000 7f949272c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.533+0000 7f949272c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.533+0000 7f949272c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.533+0000 7f949272c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.533+0000 7f949272c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.534+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.534+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.534+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.534+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:14.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.534+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 zone default found 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 4 Realm: () 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 zonegroup default 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.535+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.536+0000 7f949272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.536+0000 7f949272c800 20 started sync module instance, tier type = 2024-09-19T13:54:14.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.536+0000 7f949272c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:14.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.546+0000 7f949272c800 20 add_watcher() i=0 2024-09-19T13:54:14.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.546+0000 7f949272c800 20 add_watcher() i=1 2024-09-19T13:54:14.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.546+0000 7f949272c800 20 add_watcher() i=2 2024-09-19T13:54:14.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.546+0000 7f949272c800 20 add_watcher() i=3 2024-09-19T13:54:14.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.546+0000 7f949272c800 20 add_watcher() i=4 2024-09-19T13:54:14.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.546+0000 7f949272c800 20 add_watcher() i=5 2024-09-19T13:54:14.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.547+0000 7f949272c800 20 add_watcher() i=6 2024-09-19T13:54:14.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.547+0000 7f949272c800 20 add_watcher() i=7 2024-09-19T13:54:14.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.547+0000 7f949272c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:14.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.549+0000 7f9344fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:14.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f949272c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:14.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f949272c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:14.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f949272c800 5 note: GC not initialized 2024-09-19T13:54:14.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f92bf7fe640 20 reqs_thread_entry: start 2024-09-19T13:54:14.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f949272c800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:14.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f949272c800 20 Filter name: none 2024-09-19T13:54:14.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f92bd7fa640 20 reqs_thread_entry: start 2024-09-19T13:54:14.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.550+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.551+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:14.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.551+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.552+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:14.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.552+0000 7f949272c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:14.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.552+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.552+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:54:14.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.552+0000 7f949272c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.553+0000 7f949272c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:54:14.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.553+0000 7f949272c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:14.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.555+0000 7f9344fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:14.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.557+0000 7f949272c800 20 remove_watcher() i=0 2024-09-19T13:54:14.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.557+0000 7f949272c800 2 removed watcher, disabling cache 2024-09-19T13:54:14.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.558+0000 7f949272c800 20 remove_watcher() i=1 2024-09-19T13:54:14.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.559+0000 7f949272c800 20 remove_watcher() i=2 2024-09-19T13:54:14.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.560+0000 7f949272c800 20 remove_watcher() i=3 2024-09-19T13:54:14.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.561+0000 7f949272c800 20 remove_watcher() i=4 2024-09-19T13:54:14.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.562+0000 7f949272c800 20 remove_watcher() i=5 2024-09-19T13:54:14.564 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.564+0000 7f949272c800 20 remove_watcher() i=6 2024-09-19T13:54:14.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.565+0000 7f949272c800 20 remove_watcher() i=7 2024-09-19T13:54:14.576 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:14.577 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:14.577 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-19T13:54:14.577 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:14.577 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-19T13:54:14.577 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:14.762 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T13:54:14.790 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:14.790 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:14.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.825+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 realm 2024-09-19T13:54:14.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:14.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.827+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.828+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:14.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.828+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.829+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:14.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.829+0000 7f540b81d800 20 searching for the correct realm 2024-09-19T13:54:14.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.832+0000 7f54067ea640 0 -- 172.21.15.94:0/3354875881 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f53f801f070 msgr2=0x7f53f806f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:14.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.835+0000 7f54077ec640 0 -- 172.21.15.94:0/3354875881 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7f53fc068040 msgr2=0x7f53fc068480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:14.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:14.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.839+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 zone default found 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 4 Realm: () 2024-09-19T13:54:14.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 zonegroup default 2024-09-19T13:54:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.840+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.841+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.841+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.841+0000 7f540b81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.841+0000 7f540b81d800 20 started sync module instance, tier type = 2024-09-19T13:54:14.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.841+0000 7f540b81d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=0 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=1 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=2 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=3 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=4 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=5 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=6 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 20 add_watcher() i=7 2024-09-19T13:54:14.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.850+0000 7f540b81d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:14.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.852+0000 7f52bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:14.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f540b81d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:14.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f540b81d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:14.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f540b81d800 5 note: GC not initialized 2024-09-19T13:54:14.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f5237fff640 20 reqs_thread_entry: start 2024-09-19T13:54:14.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f540b81d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:14.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f540b81d800 20 Filter name: none 2024-09-19T13:54:14.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f5235ffb640 20 reqs_thread_entry: start 2024-09-19T13:54:14.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.853+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.854+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.854+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:14.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:14.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.855+0000 7f540b81d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:14.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.857+0000 7f52bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:14.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.859+0000 7f540b81d800 20 remove_watcher() i=0 2024-09-19T13:54:14.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.859+0000 7f540b81d800 2 removed watcher, disabling cache 2024-09-19T13:54:14.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.861+0000 7f540b81d800 20 remove_watcher() i=1 2024-09-19T13:54:14.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.862+0000 7f540b81d800 20 remove_watcher() i=2 2024-09-19T13:54:14.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.863+0000 7f540b81d800 20 remove_watcher() i=3 2024-09-19T13:54:14.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.864+0000 7f540b81d800 20 remove_watcher() i=4 2024-09-19T13:54:14.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.865+0000 7f540b81d800 20 remove_watcher() i=5 2024-09-19T13:54:14.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.866+0000 7f540b81d800 20 remove_watcher() i=6 2024-09-19T13:54:14.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.866+0000 7f540b81d800 20 remove_watcher() i=7 2024-09-19T13:54:14.878 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:14.878 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:14.878 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:14.878 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:14.879 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-19T13:54:14.913 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:14.913 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:14.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.948+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 realm 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:14.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.950+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.951+0000 7f67003a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:14.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.951+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:14.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.951+0000 7f67003a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:14.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.951+0000 7f67003a7800 20 searching for the correct realm 2024-09-19T13:54:14.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.954+0000 7f66fe692640 0 -- 172.21.15.94:0/1341477644 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f66f407d040 msgr2=0x7f66f4064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:14.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:14.958+0000 7f66fde91640 0 -- 172.21.15.94:0/1341477644 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f66f4064920 msgr2=0x7f66f407c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:15.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.165+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:15.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 zone default found 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 4 Realm: () 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 zonegroup default 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.166+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.167+0000 7f67003a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.167+0000 7f67003a7800 20 started sync module instance, tier type = 2024-09-19T13:54:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.167+0000 7f67003a7800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=0 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=1 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=2 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=3 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=4 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=5 2024-09-19T13:54:15.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.176+0000 7f67003a7800 20 add_watcher() i=6 2024-09-19T13:54:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.177+0000 7f67003a7800 20 add_watcher() i=7 2024-09-19T13:54:15.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.177+0000 7f67003a7800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:15.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.178+0000 7f65af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:15.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.178+0000 7f67003a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:15.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.178+0000 7f67003a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:15.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.178+0000 7f67003a7800 5 note: GC not initialized 2024-09-19T13:54:15.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f65ae7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 20 Filter name: none 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f6523fff640 20 reqs_thread_entry: start 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 : miss 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.179+0000 7f67003a7800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.180+0000 7f67003a7800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.180+0000 7f67003a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.180+0000 7f67003a7800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.180+0000 7f67003a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.180+0000 7f67003a7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.180+0000 7f67003a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 2024-09-19T13:54:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.181+0000 7f67003a7800 -1 Injecting error=-5 at location=init_index 2024-09-19T13:54:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.181+0000 7f67003a7800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-19T13:54:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.183+0000 7f65af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:15.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.185+0000 7f67003a7800 20 remove_watcher() i=0 2024-09-19T13:54:15.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.185+0000 7f67003a7800 2 removed watcher, disabling cache 2024-09-19T13:54:15.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.186+0000 7f67003a7800 20 remove_watcher() i=1 2024-09-19T13:54:15.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.187+0000 7f67003a7800 20 remove_watcher() i=2 2024-09-19T13:54:15.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.188+0000 7f67003a7800 20 remove_watcher() i=3 2024-09-19T13:54:15.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.189+0000 7f67003a7800 20 remove_watcher() i=4 2024-09-19T13:54:15.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.190+0000 7f67003a7800 20 remove_watcher() i=5 2024-09-19T13:54:15.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.191+0000 7f67003a7800 20 remove_watcher() i=6 2024-09-19T13:54:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.191+0000 7f67003a7800 20 remove_watcher() i=7 2024-09-19T13:54:15.204 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T13:54:15.233 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:15.233 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:15.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.268+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.270+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.270+0000 7fe565f2a800 20 realm 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.270+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.270+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.270+0000 7fe565f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.270+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.271+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.271+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.271+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:15.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.271+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.272+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:15.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.272+0000 7fe565f2a800 20 searching for the correct realm 2024-09-19T13:54:15.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.274+0000 7fe561416640 0 -- 172.21.15.94:0/3836412040 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe554038060 msgr2=0x7fe554068180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:15.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.480+0000 7fe561c17640 0 -- 172.21.15.94:0/3836412040 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe5580a2450 msgr2=0x7fe5580a28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:15.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:15.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:15.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:15.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.686+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 zone default found 2024-09-19T13:54:15.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 4 Realm: () 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 zonegroup default 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.687+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.688+0000 7fe565f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.688+0000 7fe565f2a800 20 started sync module instance, tier type = 2024-09-19T13:54:15.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.688+0000 7fe565f2a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:15.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=0 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=1 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=2 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=3 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=4 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=5 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.697+0000 7fe565f2a800 20 add_watcher() i=6 2024-09-19T13:54:15.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.698+0000 7fe565f2a800 20 add_watcher() i=7 2024-09-19T13:54:15.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.698+0000 7fe565f2a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:15.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.700+0000 7fe4137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:15.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.700+0000 7fe565f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:15.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.700+0000 7fe565f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:15.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.700+0000 7fe565f2a800 5 note: GC not initialized 2024-09-19T13:54:15.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe4127fc640 20 reqs_thread_entry: start 2024-09-19T13:54:15.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe565f2a800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:15.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe565f2a800 20 Filter name: none 2024-09-19T13:54:15.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe383fff640 20 reqs_thread_entry: start 2024-09-19T13:54:15.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.701+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.702+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.702+0000 7fe565f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.702+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.702+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.702+0000 7fe565f2a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.703+0000 7fe565f2a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:15.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.703+0000 7fe565f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:15.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.704+0000 7fe4137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:15.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.707+0000 7fe565f2a800 20 remove_watcher() i=0 2024-09-19T13:54:15.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.707+0000 7fe565f2a800 2 removed watcher, disabling cache 2024-09-19T13:54:15.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.708+0000 7fe565f2a800 20 remove_watcher() i=1 2024-09-19T13:54:15.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.709+0000 7fe565f2a800 20 remove_watcher() i=2 2024-09-19T13:54:15.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.710+0000 7fe565f2a800 20 remove_watcher() i=3 2024-09-19T13:54:15.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.711+0000 7fe565f2a800 20 remove_watcher() i=4 2024-09-19T13:54:15.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.712+0000 7fe565f2a800 20 remove_watcher() i=5 2024-09-19T13:54:15.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.713+0000 7fe565f2a800 20 remove_watcher() i=6 2024-09-19T13:54:15.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.714+0000 7fe565f2a800 20 remove_watcher() i=7 2024-09-19T13:54:15.725 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:15.725 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:15.725 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:15.777 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:54:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:15.807 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:15.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.844+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 realm 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.846+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.847+0000 7fa50fa87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:15.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.847+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.848+0000 7fa50fa87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:15.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.848+0000 7fa50fa87800 20 searching for the correct realm 2024-09-19T13:54:15.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.851+0000 7fa504d70640 0 -- 172.21.15.94:0/2190125674 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x56263d580a70 msgr2=0x56263d582f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:15.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.855+0000 7fa50d571640 0 -- 172.21.15.94:0/2190125674 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa4f80c9df0 msgr2=0x7fa4f8057040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:15.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.859+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:15.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 zone default found 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 4 Realm: () 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 zonegroup default 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.860+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 started sync module instance, tier type = 2024-09-19T13:54:15.864 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.861+0000 7fa50fa87800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=0 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=1 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=2 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=3 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=4 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=5 2024-09-19T13:54:15.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.870+0000 7fa50fa87800 20 add_watcher() i=6 2024-09-19T13:54:15.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.871+0000 7fa50fa87800 20 add_watcher() i=7 2024-09-19T13:54:15.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.871+0000 7fa50fa87800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:15.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.872+0000 7fa3c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:15.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.872+0000 7fa50fa87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:15.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa50fa87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:15.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa50fa87800 5 note: GC not initialized 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa3c27e4640 20 reqs_thread_entry: start 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa50fa87800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa50fa87800 20 Filter name: none 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa333fff640 20 reqs_thread_entry: start 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa50fa87800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.873+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 : miss 2024-09-19T13:54:15.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:15.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:15.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.876 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.874+0000 7fa50fa87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20, ofs0, ns] 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa3f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595103 cookie 94722237951840 notifier 5969 bl.length()=995 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa3f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa3f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa3f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): orig_sources= new_sources= 2024-09-19T13:54:15.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): potential sources added=[] removed=[] 2024-09-19T13:54:15.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): orig_dests= new_dests= 2024-09-19T13:54:15.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.880+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): potential dests added=[] removed=[] 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.0 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.0 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.1 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.1 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.2 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.2 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.3 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.3 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.4 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.4 2024-09-19T13:54:15.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.5 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.5 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.6 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.6 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.7 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.884+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.7 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.8 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.8 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.9 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.9 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.10 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.10 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.11 2024-09-19T13:54:15.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1.11 2024-09-19T13:54:15.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.0 2024-09-19T13:54:15.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1 2024-09-19T13:54:15.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.885+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.2 2024-09-19T13:54:15.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.886+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.3 2024-09-19T13:54:15.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.886+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.4 2024-09-19T13:54:15.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.887+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.5 2024-09-19T13:54:15.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.887+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.6 2024-09-19T13:54:15.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.888+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.7 2024-09-19T13:54:15.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.889+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.8 2024-09-19T13:54:15.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.889+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.9 2024-09-19T13:54:15.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.890+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.10 2024-09-19T13:54:15.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.893+0000 7fa50fa87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:15.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.893+0000 7fa50fa87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20, ofs0, ns] 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa3dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94722237951840 notifier 5969 bl.length()=995 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa3dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa3dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa3dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): orig_sources= new_sources= 2024-09-19T13:54:15.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): potential sources added=[] removed=[] 2024-09-19T13:54:15.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): orig_dests= new_dests= 2024-09-19T13:54:15.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.895+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): potential dests added=[] removed=[] 2024-09-19T13:54:15.898 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.897+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.0 2024-09-19T13:54:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.898+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.1 2024-09-19T13:54:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.898+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.2 2024-09-19T13:54:15.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.898+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.3 2024-09-19T13:54:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.899+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.4 2024-09-19T13:54:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.899+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.5 2024-09-19T13:54:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.899+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.6 2024-09-19T13:54:15.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.899+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.7 2024-09-19T13:54:15.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.900+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.8 2024-09-19T13:54:15.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.900+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.9 2024-09-19T13:54:15.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.900+0000 7fa50fa87800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20.10 2024-09-19T13:54:15.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.901+0000 7fa50fa87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:15.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.901+0000 7fa50fa87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 2024-09-19T13:54:15.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa50fa87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa50fa87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa50fa87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa50fa87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20, ofs0, ns] 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa3dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94722237951840 notifier 5969 bl.length()=963 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa3dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 info.flags=0x17 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa3dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 to cache LRU end 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.902+0000 7fa3dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.903+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): orig_sources= new_sources= 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.903+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): potential sources added=[] removed=[] 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.903+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): orig_dests= new_dests= 2024-09-19T13:54:15.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.903+0000 7fa50fa87800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20]): potential dests added=[] removed=[] 2024-09-19T13:54:15.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.905+0000 7fa50fa87800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-19T13:54:15.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.907+0000 7fa3c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:15.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.909+0000 7fa50fa87800 20 remove_watcher() i=0 2024-09-19T13:54:15.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.909+0000 7fa50fa87800 2 removed watcher, disabling cache 2024-09-19T13:54:15.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.910+0000 7fa50fa87800 20 remove_watcher() i=1 2024-09-19T13:54:15.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.911+0000 7fa50fa87800 20 remove_watcher() i=2 2024-09-19T13:54:15.913 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.912+0000 7fa50fa87800 20 remove_watcher() i=3 2024-09-19T13:54:15.914 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.913+0000 7fa50fa87800 20 remove_watcher() i=4 2024-09-19T13:54:15.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.914+0000 7fa50fa87800 20 remove_watcher() i=5 2024-09-19T13:54:15.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.916+0000 7fa50fa87800 20 remove_watcher() i=6 2024-09-19T13:54:15.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.916+0000 7fa50fa87800 20 remove_watcher() i=7 2024-09-19T13:54:15.929 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T13:54:15.958 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:15.958 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:15.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.993+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.995+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.995+0000 7f3443b2e800 20 realm 2024-09-19T13:54:15.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.995+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.995+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.995+0000 7f3443b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:15.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.995+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.996+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:15.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.996+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.996+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:15.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.996+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:15.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.997+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:15.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:15.997+0000 7f3443b2e800 20 searching for the correct realm 2024-09-19T13:54:16.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.202+0000 7f343ff65640 0 -- 172.21.15.94:0/4150446257 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f342804b060 msgr2=0x7f3428077120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:16.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.205+0000 7f343f764640 0 -- 172.21.15.94:0/4150446257 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3428077750 msgr2=0x7f34280940b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:16.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.411+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 zone default found 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 4 Realm: () 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 zonegroup default 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.412+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.413+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.413+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.413+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.413+0000 7f3443b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.413+0000 7f3443b2e800 20 started sync module instance, tier type = 2024-09-19T13:54:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.413+0000 7f3443b2e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:16.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=0 2024-09-19T13:54:16.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=1 2024-09-19T13:54:16.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=2 2024-09-19T13:54:16.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=3 2024-09-19T13:54:16.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=4 2024-09-19T13:54:16.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=5 2024-09-19T13:54:16.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.423+0000 7f3443b2e800 20 add_watcher() i=6 2024-09-19T13:54:16.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.424+0000 7f3443b2e800 20 add_watcher() i=7 2024-09-19T13:54:16.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.424+0000 7f3443b2e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.426+0000 7f32f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.426+0000 7f3443b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.426+0000 7f3443b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.426+0000 7f3443b2e800 5 note: GC not initialized 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.427+0000 7f32f4fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.427+0000 7f3443b2e800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.427+0000 7f3443b2e800 20 Filter name: none 2024-09-19T13:54:16.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.427+0000 7f326e7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:16.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.427+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.428+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.428+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.428+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.428+0000 7f3443b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.428+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.429+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.429+0000 7f3443b2e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.429+0000 7f3443b2e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.429+0000 7f3443b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:16.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.431+0000 7f32f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:16.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.433+0000 7f3443b2e800 20 remove_watcher() i=0 2024-09-19T13:54:16.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.433+0000 7f3443b2e800 2 removed watcher, disabling cache 2024-09-19T13:54:16.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.434+0000 7f3443b2e800 20 remove_watcher() i=1 2024-09-19T13:54:16.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.435+0000 7f3443b2e800 20 remove_watcher() i=2 2024-09-19T13:54:16.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.436+0000 7f3443b2e800 20 remove_watcher() i=3 2024-09-19T13:54:16.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.437+0000 7f3443b2e800 20 remove_watcher() i=4 2024-09-19T13:54:16.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.438+0000 7f3443b2e800 20 remove_watcher() i=5 2024-09-19T13:54:16.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.439+0000 7f3443b2e800 20 remove_watcher() i=6 2024-09-19T13:54:16.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.440+0000 7f3443b2e800 20 remove_watcher() i=7 2024-09-19T13:54:16.452 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:16.452 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:16.452 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:54:16.453 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:16.529 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-19T13:54:16.529 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:16.696 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T13:54:16.725 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:16.725 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:16.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.760+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 realm 2024-09-19T13:54:16.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:16.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.762+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.763+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:16.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.763+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.763+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:16.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.763+0000 7fd8eab3c800 20 searching for the correct realm 2024-09-19T13:54:16.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.766+0000 7fd8de080640 0 -- 172.21.15.94:0/1114596261 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd8d804b420 msgr2=0x7fd8d804b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:16.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.769+0000 7fd8e6881640 0 -- 172.21.15.94:0/1114596261 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd8d00773a0 msgr2=0x7fd8d0097120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:16.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:16.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:16.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:16.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:16.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:16.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:16.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.974+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:16.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 zone default found 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 4 Realm: () 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:16.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 zonegroup default 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.975+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 started sync module instance, tier type = 2024-09-19T13:54:16.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.976+0000 7fd8eab3c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=0 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=1 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=2 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=3 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=4 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=5 2024-09-19T13:54:16.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.987+0000 7fd8eab3c800 20 add_watcher() i=6 2024-09-19T13:54:16.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.988+0000 7fd8eab3c800 20 add_watcher() i=7 2024-09-19T13:54:16.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.988+0000 7fd8eab3c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:16.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.990+0000 7fd79d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:16.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.990+0000 7fd8eab3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:16.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd8eab3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:16.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd8eab3c800 5 note: GC not initialized 2024-09-19T13:54:16.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd717fff640 20 reqs_thread_entry: start 2024-09-19T13:54:16.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd8eab3c800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:16.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd8eab3c800 20 Filter name: none 2024-09-19T13:54:16.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd715ffb640 20 reqs_thread_entry: start 2024-09-19T13:54:16.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.991+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.992+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.992+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.992+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.992+0000 7fd8eab3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.992+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.993+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.993+0000 7fd8eab3c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.993+0000 7fd8eab3c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:16.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.993+0000 7fd8eab3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:16.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.995+0000 7fd79d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:16.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.997+0000 7fd8eab3c800 20 remove_watcher() i=0 2024-09-19T13:54:16.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.997+0000 7fd8eab3c800 2 removed watcher, disabling cache 2024-09-19T13:54:16.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.998+0000 7fd8eab3c800 20 remove_watcher() i=1 2024-09-19T13:54:17.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:16.999+0000 7fd8eab3c800 20 remove_watcher() i=2 2024-09-19T13:54:17.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.000+0000 7fd8eab3c800 20 remove_watcher() i=3 2024-09-19T13:54:17.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.001+0000 7fd8eab3c800 20 remove_watcher() i=4 2024-09-19T13:54:17.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.002+0000 7fd8eab3c800 20 remove_watcher() i=5 2024-09-19T13:54:17.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.003+0000 7fd8eab3c800 20 remove_watcher() i=6 2024-09-19T13:54:17.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.004+0000 7fd8eab3c800 20 remove_watcher() i=7 2024-09-19T13:54:17.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:17.015 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:17.015 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:17.016 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:17.017 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-19T13:54:17.053 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:17.053 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:17.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.088+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.089+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.089+0000 7fc71200d800 20 realm 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.089+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.089+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.089+0000 7fc71200d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.089+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.090+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.090+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.090+0000 7fc71200d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.090+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.091+0000 7fc71200d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:17.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.091+0000 7fc71200d800 20 searching for the correct realm 2024-09-19T13:54:17.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.092+0000 7fc70faf7640 0 -- 172.21.15.94:0/1356184720 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x55dad90cb710 msgr2=0x7fc708061bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:17.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.297+0000 7fc7102f8640 0 -- 172.21.15.94:0/1356184720 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fc704045040 msgr2=0x7fc704045930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:17.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.302+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 zone default found 2024-09-19T13:54:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 4 Realm: () 2024-09-19T13:54:17.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 zonegroup default 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.303+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.304+0000 7fc71200d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.304+0000 7fc71200d800 20 started sync module instance, tier type = 2024-09-19T13:54:17.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.304+0000 7fc71200d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:17.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=0 2024-09-19T13:54:17.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=1 2024-09-19T13:54:17.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=2 2024-09-19T13:54:17.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=3 2024-09-19T13:54:17.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=4 2024-09-19T13:54:17.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=5 2024-09-19T13:54:17.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.312+0000 7fc71200d800 20 add_watcher() i=6 2024-09-19T13:54:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.313+0000 7fc71200d800 20 add_watcher() i=7 2024-09-19T13:54:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.313+0000 7fc71200d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.314+0000 7fc5c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 5 note: GC not initialized 2024-09-19T13:54:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc5c4fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 20 Filter name: none 2024-09-19T13:54:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc53e7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T13:54:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.315+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T13:54:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 : miss 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 info.flags=0x17 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 to cache LRU end 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.316+0000 7fc71200d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.317+0000 7fc71200d800 -1 Injecting error=-95 at location=init_index 2024-09-19T13:54:17.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.317+0000 7fc71200d800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 info.flags=0x17 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 to cache LRU end 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21, ofs0, ns] 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc5eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595108 cookie 94398435152128 notifier 6017 bl.length()=995 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc5eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 info.flags=0x17 2024-09-19T13:54:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc5eeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 to cache LRU end 2024-09-19T13:54:17.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc5eeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:17.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): orig_sources= new_sources= 2024-09-19T13:54:17.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): potential sources added=[] removed=[] 2024-09-19T13:54:17.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): orig_dests= new_dests= 2024-09-19T13:54:17.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.321+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): potential dests added=[] removed=[] 2024-09-19T13:54:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.0 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.0 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.1 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.1 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.2 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.2 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.3 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.3 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.4 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.4 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.5 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.5 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.6 2024-09-19T13:54:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.6 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.7 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.7 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.8 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.8 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.9 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.9 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.10 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.10 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.11 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1.11 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.0 2024-09-19T13:54:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.1 2024-09-19T13:54:17.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.324+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.2 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.325+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.3 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.325+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.4 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.326+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.5 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.326+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.6 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.327+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.7 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.327+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.8 2024-09-19T13:54:17.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.327+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.9 2024-09-19T13:54:17.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.328+0000 7fc71200d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21.10 2024-09-19T13:54:17.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.330+0000 7fc71200d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:17.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.330+0000 7fc71200d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 2024-09-19T13:54:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 info.flags=0x17 2024-09-19T13:54:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 to cache LRU end 2024-09-19T13:54:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21, ofs0, ns] 2024-09-19T13:54:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc5eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595109 cookie 94398435152128 notifier 6017 bl.length()=963 2024-09-19T13:54:17.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc5eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 info.flags=0x17 2024-09-19T13:54:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc5eeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 to cache LRU end 2024-09-19T13:54:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc5eeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): orig_sources= new_sources= 2024-09-19T13:54:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): potential sources added=[] removed=[] 2024-09-19T13:54:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): orig_dests= new_dests= 2024-09-19T13:54:17.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.332+0000 7fc71200d800 20 handle_bi_update(): bucket=:error-at-init-index[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21]): potential dests added=[] removed=[] 2024-09-19T13:54:17.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.334+0000 7fc71200d800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-19T13:54:17.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.336+0000 7fc5c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:17.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.339+0000 7fc71200d800 20 remove_watcher() i=0 2024-09-19T13:54:17.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.339+0000 7fc71200d800 2 removed watcher, disabling cache 2024-09-19T13:54:17.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.340+0000 7fc71200d800 20 remove_watcher() i=1 2024-09-19T13:54:17.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.341+0000 7fc71200d800 20 remove_watcher() i=2 2024-09-19T13:54:17.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.342+0000 7fc71200d800 20 remove_watcher() i=3 2024-09-19T13:54:17.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.343+0000 7fc71200d800 20 remove_watcher() i=4 2024-09-19T13:54:17.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.344+0000 7fc71200d800 20 remove_watcher() i=5 2024-09-19T13:54:17.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.345+0000 7fc71200d800 20 remove_watcher() i=6 2024-09-19T13:54:17.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.346+0000 7fc71200d800 20 remove_watcher() i=7 2024-09-19T13:54:17.359 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T13:54:17.390 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:17.390 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:17.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.424+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 realm 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.426+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.427+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.427+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.427+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.427+0000 7f9a4782d800 20 searching for the correct realm 2024-09-19T13:54:17.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.431+0000 7f9a45b18640 0 -- 172.21.15.94:0/2905347322 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x5621b6207920 msgr2=0x5621b6209d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:17.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.434+0000 7f9a45317640 0 -- 172.21.15.94:0/2905347322 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9a3c02d960 msgr2=0x7f9a3c03d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.437+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 zone default found 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 4 Realm: () 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 zonegroup default 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.438+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.439+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.439+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.439+0000 7f9a4782d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.439+0000 7f9a4782d800 20 started sync module instance, tier type = 2024-09-19T13:54:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.439+0000 7f9a4782d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=0 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=1 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=2 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=3 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=4 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=5 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.447+0000 7f9a4782d800 20 add_watcher() i=6 2024-09-19T13:54:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.448+0000 7f9a4782d800 20 add_watcher() i=7 2024-09-19T13:54:17.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.448+0000 7f9a4782d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:17.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.450+0000 7f98fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:17.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.450+0000 7f9a4782d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:17.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.450+0000 7f9a4782d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:17.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.450+0000 7f9a4782d800 5 note: GC not initialized 2024-09-19T13:54:17.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.450+0000 7f98fa7e4640 20 reqs_thread_entry: start 2024-09-19T13:54:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.451+0000 7f9a4782d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.451+0000 7f9a4782d800 20 Filter name: none 2024-09-19T13:54:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.451+0000 7f986bfff640 20 reqs_thread_entry: start 2024-09-19T13:54:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.451+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.451+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.451+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:54:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:54:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.452+0000 7f9a4782d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.454+0000 7f98fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.456+0000 7f9a4782d800 20 remove_watcher() i=0 2024-09-19T13:54:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.456+0000 7f9a4782d800 2 removed watcher, disabling cache 2024-09-19T13:54:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.457+0000 7f9a4782d800 20 remove_watcher() i=1 2024-09-19T13:54:17.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.458+0000 7f9a4782d800 20 remove_watcher() i=2 2024-09-19T13:54:17.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.458+0000 7f9a4782d800 20 remove_watcher() i=3 2024-09-19T13:54:17.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.459+0000 7f9a4782d800 20 remove_watcher() i=4 2024-09-19T13:54:17.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.460+0000 7f9a4782d800 20 remove_watcher() i=5 2024-09-19T13:54:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.461+0000 7f9a4782d800 20 remove_watcher() i=6 2024-09-19T13:54:17.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.462+0000 7f9a4782d800 20 remove_watcher() i=7 2024-09-19T13:54:17.474 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:17.474 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:17.474 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-init-index id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T13:54:17.474 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:17.549 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at init_index 2024-09-19T13:54:17.549 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:17.724 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T13:54:17.752 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:17.752 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:17.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.991+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.993+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.993+0000 7f5956f40800 20 realm 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.993+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.993+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.993+0000 7f5956f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.993+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.994+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.994+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.994+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:17.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.994+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:17.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.995+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:17.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.995+0000 7f5956f40800 20 searching for the correct realm 2024-09-19T13:54:17.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:17.997+0000 7f594a485640 0 -- 172.21.15.94:0/1947519072 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f594407e060 msgr2=0x7f59440aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.203+0000 7f5952c86640 0 -- 172.21.15.94:0/1947519072 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f593c090650 msgr2=0x7f593c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:18.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:18.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:18.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.410+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:18.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 zone default found 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 4 Realm: () 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 zonegroup default 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.411+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.412+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.412+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.412+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.412+0000 7f5956f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.412+0000 7f5956f40800 20 started sync module instance, tier type = 2024-09-19T13:54:18.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.412+0000 7f5956f40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=0 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=1 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=2 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=3 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=4 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=5 2024-09-19T13:54:18.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.421+0000 7f5956f40800 20 add_watcher() i=6 2024-09-19T13:54:18.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.422+0000 7f5956f40800 20 add_watcher() i=7 2024-09-19T13:54:18.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.422+0000 7f5956f40800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:18.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.423+0000 7f58097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:18.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5956f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:18.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5956f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:18.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5956f40800 5 note: GC not initialized 2024-09-19T13:54:18.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5783fff640 20 reqs_thread_entry: start 2024-09-19T13:54:18.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5956f40800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:18.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5956f40800 20 Filter name: none 2024-09-19T13:54:18.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5781ffb640 20 reqs_thread_entry: start 2024-09-19T13:54:18.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.424+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.425+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.425+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.425+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.425+0000 7f5956f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.425+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.426+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:18.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.426+0000 7f5956f40800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.426+0000 7f5956f40800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:18.428 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.426+0000 7f5956f40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:18.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.428+0000 7f58097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:18.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.430+0000 7f5956f40800 20 remove_watcher() i=0 2024-09-19T13:54:18.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.430+0000 7f5956f40800 2 removed watcher, disabling cache 2024-09-19T13:54:18.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.431+0000 7f5956f40800 20 remove_watcher() i=1 2024-09-19T13:54:18.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.432+0000 7f5956f40800 20 remove_watcher() i=2 2024-09-19T13:54:18.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.433+0000 7f5956f40800 20 remove_watcher() i=3 2024-09-19T13:54:18.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.434+0000 7f5956f40800 20 remove_watcher() i=4 2024-09-19T13:54:18.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.435+0000 7f5956f40800 20 remove_watcher() i=5 2024-09-19T13:54:18.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.436+0000 7f5956f40800 20 remove_watcher() i=6 2024-09-19T13:54:18.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.437+0000 7f5956f40800 20 remove_watcher() i=7 2024-09-19T13:54:18.449 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.449 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:18.449 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:18.449 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.450 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-19T13:54:18.485 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.520+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 realm 2024-09-19T13:54:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:18.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.523+0000 7f49d4616800 20 searching for the correct realm 2024-09-19T13:54:18.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.527+0000 7f49d05e8640 0 -- 172.21.15.94:0/928469912 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f49b802d070 msgr2=0x7f49b8044950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.530+0000 7f49cfde7640 0 -- 172.21.15.94:0/928469912 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f49b8054930 msgr2=0x7f49b80433e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 zone default found 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 4 Realm: () 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 zonegroup default 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.739+0000 7f49d4616800 20 started sync module instance, tier type = 2024-09-19T13:54:18.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.739+0000 7f49d4616800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=0 2024-09-19T13:54:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=1 2024-09-19T13:54:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=2 2024-09-19T13:54:18.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=3 2024-09-19T13:54:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=4 2024-09-19T13:54:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=5 2024-09-19T13:54:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=6 2024-09-19T13:54:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.749+0000 7f49d4616800 20 add_watcher() i=7 2024-09-19T13:54:18.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.749+0000 7f49d4616800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:18.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f4885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:18.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f49d4616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:18.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f49d4616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:18.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f49d4616800 5 note: GC not initialized 2024-09-19T13:54:18.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f4884fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:18.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f49d4616800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:18.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f49d4616800 20 Filter name: none 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.751+0000 7f47fe7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : miss 2024-09-19T13:54:18.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:18.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.752+0000 7f49d4616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:18.756 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49d4616800 time 2024-09-19T13:54:18.754657+0000 2024-09-19T13:54:18.756 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49d578c76a] 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:18.774 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f49d4616800 thread_name:radosgw-admin 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.755+0000 7f49d4616800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49d4616800 time 2024-09-19T13:54:18.754657+0000 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49d578c76a] 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.775 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49d443e6f0] 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49d448b99c] 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:18.776 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49d578c7c4] 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:18.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.755+0000 7f49d4616800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f49d4616800 thread_name:radosgw-admin 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49d443e6f0] 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49d448b99c] 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49d578c7c4] 2024-09-19T13:54:18.780 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:54:18.503+0000 7f49d05e8640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.781 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:54:18.503+0000 7f49d05e8640 1 monclient: found mon.noname-c 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:54:18.503+0000 7f49d05e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: dump: 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.782 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:54:18.504+0000 7f49d4616800 5 monclient: authenticate success, global_id 6056 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:54:18.504+0000 7f49d4616800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:54:18.504+0000 7f49d4616800 4 set_mon_vals no callback set 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: dump: 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.783 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:54:18.504+0000 7f49d4616800 10 monclient: shutdown 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:54:18.504+0000 7f49d4616800 5 asok(0x55659aef9410) unregister_commands rotate-key 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.784 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding auth protocol: cephx 2024-09-19T13:54:18.785 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding auth protocol: cephx 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding auth protocol: cephx 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.786 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:54:18.505+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: starting msgr at 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: starting objecter 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 asok(0x55659aef9410) register_command objecter_requests hook 0x55659b1491d0 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: setting wanted keys 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: calling monclient init 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding auth protocol: cephx 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding auth protocol: cephx 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding auth protocol: cephx 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.787 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:54:18.505+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:54:18.505+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key hook 0x55659b11a838 2024-09-19T13:54:18.788 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b05ced0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b063160 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b063ac0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.161967s 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b05ced0 auth_method 0 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.789 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): get_auth_request con 0x55659b063ac0 auth_method 0 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.790 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b063160 auth_method 0 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_done global_id 6342 payload 824 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.791 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:54:18.506+0000 7f49cfde7640 1 monclient: found mon.noname-a 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: dump: 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: dump: 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:54:18.506+0000 7f49d4616800 5 monclient: authenticate success, global_id 6342 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:54:18.506+0000 7f48bde0b640 4 set_mon_vals no callback set 2024-09-19T13:54:18.794 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:54:18.506+0000 7f49d4616800 1 librados: init done 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:54:18.508+0000 7f48b7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:54:18.508+0000 7f48b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:54:18.508+0000 7f48b7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:54:18.508+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f48b8077570 auth_method 0 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:54:18.508+0000 7f49d05e8640 10 monclient: get_auth_request con 0x55659b163be0 auth_method 0 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:54:18.509+0000 7f49cfde7640 10 monclient: get_auth_request con 0x55659b166dc0 auth_method 0 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:54:18.511+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x55659b16be50 auth_method 0 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:54:18.511+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:54:18.511+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.795 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:54:18.511+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.796 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding auth protocol: cephx 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding auth protocol: cephx 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding auth protocol: cephx 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.797 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:54:18.512+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 asok(0x55659aef9410) register_command objecter_requests cmddesc objecter_requests hook 0x55659b173320 EEXIST 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:54:18.512+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding auth protocol: cephx 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding auth protocol: cephx 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding auth protocol: cephx 2024-09-19T13:54:18.798 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.799 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:54:18.512+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:54:18.512+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:54:18.513+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key cmddesc rotate-key hook 0x55659b16ee20 EEXIST 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b197640 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b197a20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b196350 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.169088s 2024-09-19T13:54:18.800 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b197640 auth_method 0 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b197a20 auth_method 0 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.801 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_done global_id 6345 payload 824 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:54:18.513+0000 7f49cfde7640 1 monclient: found mon.noname-a 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: dump: 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: dump: 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:54:18.513+0000 7f49d4616800 5 monclient: authenticate success, global_id 6345 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.804 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:54:18.513+0000 7f49d0de9640 4 set_mon_vals no callback set 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:54:18.515+0000 7f48b57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:54:18.515+0000 7f48b57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:54:18.515+0000 7f48b57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:54:18.515+0000 7f49d4616800 10 monclient: get_monmap_and_config 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:54:18.515+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:54:18.515+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:54:18.515+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding auth protocol: cephx 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding auth protocol: cephx 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding auth protocol: cephx 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.806 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:54:18.515+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f48a8077480 auth_method 0 2024-09-19T13:54:18.807 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:54:18.515+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding auth protocol: cephx 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding auth protocol: cephx 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding auth protocol: cephx 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.808 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:54:18.516+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:54:18.516+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key cmddesc rotate-key hook 0x7fffa68aefb8 EEXIST 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b1bb2b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b1eba80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b1e7120 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.809 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.172528s 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b1eba80 auth_method 0 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b1bb2b0 auth_method 0 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.810 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): get_auth_request con 0x55659b1e7120 auth_method 0 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.811 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_done global_id 6065 payload 274 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 1 monclient: found mon.noname-c 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: dump: 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 monclient: authenticate success, global_id 6065 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:54:18.517+0000 7f49d4616800 4 set_mon_vals no callback set 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: dump: 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.813 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: shutdown 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:54:18.517+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding auth protocol: cephx 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding auth protocol: cephx 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding auth protocol: cephx 2024-09-19T13:54:18.815 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.816 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:54:18.518+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: starting msgr at 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: starting objecter 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 asok(0x55659aef9410) register_command objecter_requests cmddesc objecter_requests hook 0x55659b1e5d30 EEXIST 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: setting wanted keys 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: calling monclient init 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding auth protocol: cephx 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding auth protocol: cephx 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding auth protocol: cephx 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.817 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:54:18.518+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:54:18.518+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key cmddesc rotate-key hook 0x55659b1ac048 EEXIST 2024-09-19T13:54:18.818 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b1bb2b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b1e7120 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b1eba80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.174772s 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b1bb2b0 auth_method 0 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.819 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): get_auth_request con 0x55659b1eba80 auth_method 0 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b1e7120 auth_method 0 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.820 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:54:18.519+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:54:18.519+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:54:18.519+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:54:18.519+0000 7f49cfde7640 10 monclient(hunting): handle_auth_done global_id 6351 payload 824 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:54:18.519+0000 7f49cfde7640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:54:18.519+0000 7f49cfde7640 1 monclient: found mon.noname-a 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:54:18.519+0000 7f49cfde7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: dump: 2024-09-19T13:54:18.821 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.822 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: dump: 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.823 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:54:18.519+0000 7f49d4616800 5 monclient: authenticate success, global_id 6351 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:54:18.519+0000 7f48aeffd640 4 set_mon_vals no callback set 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:54:18.519+0000 7f49d4616800 1 librados: init done 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:54:18.519+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cr dump hook 0x55659b1ee7b8 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:54:18.520+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:54:18.521+0000 7f48ad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:54:18.521+0000 7f48ad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:54:18.521+0000 7f48ad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.824 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:54:18.521+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f4898077570 auth_method 0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:54:18.521+0000 7f49d05e8640 10 monclient: get_auth_request con 0x55659b205140 auth_method 0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 realm 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:54:18.522+0000 7f49d4616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:54:18.522+0000 7f49cfde7640 10 monclient: get_auth_request con 0x55659b2094d0 auth_method 0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 searching for the correct realm 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:54:18.523+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x55659b20e600 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:54:18.524+0000 7f49d05e8640 10 monclient: get_auth_request con 0x7f49b802d070 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:54:18.525+0000 7f49cfde7640 10 monclient: get_auth_request con 0x7f49c8017020 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:54:18.526+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f49c006d060 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:54:18.527+0000 7f49d05e8640 0 -- 172.21.15.94:0/928469912 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f49b802d070 msgr2=0x7f49b8044950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:54:18.527+0000 7f48ad7fa640 1 client.6351.objecter ms_handle_reset 0x7f49b802d070 session 0x7f49b804a040 osd.7 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:54:18.527+0000 7f48ad7fa640 10 monclient: _renew_subs 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:54:18.527+0000 7f48ad7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:54:18.527+0000 7f49d05e8640 10 monclient: get_auth_request con 0x7f4898087390 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:54:18.528+0000 7f49d05e8640 10 monclient: get_auth_request con 0x7f49b8054040 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:54:18.530+0000 7f49cfde7640 10 monclient: get_auth_request con 0x7f49b8054930 auth_method 0 2024-09-19T13:54:18.826 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:54:18.530+0000 7f49cfde7640 0 -- 172.21.15.94:0/928469912 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f49b8054930 msgr2=0x7f49b80433e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:54:18.732+0000 7f49cfde7640 10 monclient: get_auth_request con 0x7f49b8054930 auth_method 0 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.827 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 zone default found 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:54:18.738+0000 7f49d4616800 4 Realm: () 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:54:18.738+0000 7f49d4616800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:54:18.738+0000 7f49d4616800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:54:18.738+0000 7f49d4616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 zonegroup default 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.828 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 started sync module instance, tier type = 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=0 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=1 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=2 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=3 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=4 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=5 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=6 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:54:18.749+0000 7f49d4616800 20 add_watcher() i=7 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:54:18.749+0000 7f49d4616800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding auth protocol: cephx 2024-09-19T13:54:18.829 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding auth protocol: cephx 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding auth protocol: cephx 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.830 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:54:18.751+0000 7f4885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:54:18.751+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache list hook 0x55659b1dcf10 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache inspect hook 0x55659b1dcf10 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache erase hook 0x55659b1dcf10 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache zap hook 0x55659b1dcf10 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 note: GC not initialized 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:54:18.751+0000 7f4884fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace show hook 0x7f49b8017d00 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace history hook 0x7f49b8017d00 2024-09-19T13:54:18.831 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace active hook 0x7f49b8017d00 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace active_short hook 0x7f49b8017d00 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 Filter name: none 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:54:18.751+0000 7f47fe7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T13:54:18.832 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : miss 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:54:18.755+0000 7f49d4616800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49d4616800 time 2024-09-19T13:54:18.754657+0000 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.833 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49d578c76a] 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:54:18.755+0000 7f49d4616800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:54:18.834 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f49d4616800 thread_name:radosgw-admin 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49d443e6f0] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49d448b99c] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49d578c7c4] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:18.835 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:54:18.836 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:54:18.837 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:54:18.838 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:54:18.839 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:54:18.840 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:54:18.841 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:54:18.842 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:54:18.843 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f47fe7fc640 / http_manager 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4884fe1640 / http_manager 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4885fe3640 / rgw_dt_lg_renew 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48ad7fa640 / ms_dispatch 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48aeffd640 / io_context_pool 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48b57fa640 / ms_dispatch 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48b7fff640 / ms_dispatch 2024-09-19T13:54:18.844 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48bde0b640 / io_context_pool 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49cf5e6640 / msgr-worker-2 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49cfde7640 / msgr-worker-1 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49d05e8640 / msgr-worker-0 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49d0de9640 / io_context_pool 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49d4616800 / radosgw-admin 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.90239.log 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:54:18.503+0000 7f49d05e8640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:54:18.503+0000 7f49d05e8640 1 monclient: found mon.noname-c 2024-09-19T13:54:18.845 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:54:18.503+0000 7f49d05e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: dump: 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.846 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:54:18.504+0000 7f49d4616800 5 monclient: authenticate success, global_id 6056 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:54:18.504+0000 7f49d4616800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:54:18.504+0000 7f49d4616800 4 set_mon_vals no callback set 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:54:18.504+0000 7f48bde0b640 10 monclient: dump: 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.847 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:54:18.504+0000 7f49d4616800 10 monclient: shutdown 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:54:18.504+0000 7f49d4616800 5 asok(0x55659aef9410) unregister_commands rotate-key 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.848 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.849 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding auth protocol: cephx 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding auth protocol: cephx 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding auth protocol: cephx 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.850 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: crc 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11c4c0) adding con mode: secure 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:54:18.505+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: starting msgr at 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: starting objecter 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 asok(0x55659aef9410) register_command objecter_requests hook 0x55659b1491d0 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: setting wanted keys 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:54:18.505+0000 7f49d4616800 1 librados: calling monclient init 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding auth protocol: cephx 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding auth protocol: cephx 2024-09-19T13:54:18.851 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding auth protocol: cephx 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.852 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: crc 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 AuthRegistry(0x55659b11a6f0) adding con mode: secure 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:54:18.505+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:54:18.505+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:54:18.505+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key hook 0x55659b11a838 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b05ced0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b063160 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.853 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b063ac0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:54:18.505+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.161967s 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b05ced0 auth_method 0 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): get_auth_request con 0x55659b063ac0 auth_method 0 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.854 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:54:18.506+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b063160 auth_method 0 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.855 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:54:18.506+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient(hunting): handle_auth_done global_id 6342 payload 824 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:54:18.506+0000 7f49cfde7640 1 monclient: found mon.noname-a 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:54:18.506+0000 7f49cfde7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: dump: 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.856 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:18.857 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:54:18.506+0000 7f48b7fff640 10 monclient: dump: 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.858 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:54:18.506+0000 7f49d4616800 5 monclient: authenticate success, global_id 6342 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:54:18.506+0000 7f48bde0b640 4 set_mon_vals no callback set 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:54:18.506+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:54:18.506+0000 7f49d4616800 1 librados: init done 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:54:18.508+0000 7f48b7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:54:18.508+0000 7f48b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:54:18.508+0000 7f48b7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:54:18.508+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f48b8077570 auth_method 0 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:54:18.508+0000 7f49d05e8640 10 monclient: get_auth_request con 0x55659b163be0 auth_method 0 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:54:18.509+0000 7f49cfde7640 10 monclient: get_auth_request con 0x55659b166dc0 auth_method 0 2024-09-19T13:54:18.859 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:54:18.511+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x55659b16be50 auth_method 0 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:54:18.511+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:54:18.511+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:54:18.511+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.860 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding auth protocol: cephx 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding auth protocol: cephx 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding auth protocol: cephx 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.861 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: crc 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16fe30) adding con mode: secure 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:54:18.512+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 asok(0x55659aef9410) register_command objecter_requests cmddesc objecter_requests hook 0x55659b173320 EEXIST 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:54:18.512+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.862 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding auth protocol: cephx 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding auth protocol: cephx 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding auth protocol: cephx 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.863 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: crc 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:54:18.512+0000 7f49d4616800 5 AuthRegistry(0x55659b16ecd8) adding con mode: secure 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:54:18.512+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.864 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:54:18.512+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:54:18.513+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key cmddesc rotate-key hook 0x55659b16ee20 EEXIST 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b197640 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b197a20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b196350 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.865 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.169088s 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b197640 auth_method 0 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b197a20 auth_method 0 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.866 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:54:18.513+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient(hunting): handle_auth_done global_id 6345 payload 824 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:54:18.513+0000 7f49cfde7640 1 monclient: found mon.noname-a 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:54:18.513+0000 7f49cfde7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.867 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: dump: 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.868 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:54:18.513+0000 7f48b57fa640 10 monclient: dump: 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.869 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:54:18.513+0000 7f49d4616800 5 monclient: authenticate success, global_id 6345 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:54:18.513+0000 7f49d0de9640 4 set_mon_vals no callback set 2024-09-19T13:54:18.870 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:54:18.513+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:54:18.515+0000 7f48b57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:54:18.515+0000 7f48b57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:54:18.515+0000 7f48b57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:54:18.515+0000 7f49d4616800 10 monclient: get_monmap_and_config 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:54:18.515+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:54:18.515+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:54:18.515+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.871 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding auth protocol: cephx 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding auth protocol: cephx 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding auth protocol: cephx 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.872 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: crc 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:54:18.515+0000 7f49d4616800 5 AuthRegistry(0x55659b1b71b0) adding con mode: secure 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:54:18.515+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f48a8077480 auth_method 0 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:54:18.515+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding auth protocol: cephx 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding auth protocol: cephx 2024-09-19T13:54:18.873 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding auth protocol: cephx 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: crc 2024-09-19T13:54:18.874 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 AuthRegistry(0x7fffa68aee70) adding con mode: secure 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:54:18.516+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:54:18.516+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:54:18.516+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key cmddesc rotate-key hook 0x7fffa68aefb8 EEXIST 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b1bb2b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b1eba80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b1e7120 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.875 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:54:18.516+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.172528s 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b1eba80 auth_method 0 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b1bb2b0 auth_method 0 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): get_auth_request con 0x55659b1e7120 auth_method 0 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.876 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:54:18.516+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.877 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:54:18.516+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_done global_id 6065 payload 274 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 1 monclient: found mon.noname-c 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:54:18.516+0000 7f49cf5e6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:54:18.878 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: dump: 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.879 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 monclient: authenticate success, global_id 6065 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:18.880 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:54:18.517+0000 7f49d4616800 4 set_mon_vals no callback set 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:54:18.517+0000 7f48aeffd640 10 monclient: dump: 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.881 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.882 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: shutdown 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: build_initial_monmap 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:54:18.517+0000 7f49d4616800 1 build_initial for_mkfs: 0 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:54:18.517+0000 7f49d4616800 10 monclient: monmap: 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:18.883 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding auth protocol: cephx 2024-09-19T13:54:18.884 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding auth protocol: cephx 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding auth protocol: cephx 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.885 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: crc 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:54:18.517+0000 7f49d4616800 5 AuthRegistry(0x55659b1dde20) adding con mode: secure 2024-09-19T13:54:18.886 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:54:18.518+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: starting msgr at 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: starting objecter 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 asok(0x55659aef9410) register_command objecter_requests cmddesc objecter_requests hook 0x55659b1e5d30 EEXIST 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: setting wanted keys 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:54:18.518+0000 7f49d4616800 1 librados: calling monclient init 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient: init 2024-09-19T13:54:18.887 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding auth protocol: cephx 2024-09-19T13:54:18.888 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding auth protocol: cephx 2024-09-19T13:54:18.888 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding auth protocol: cephx 2024-09-19T13:54:18.888 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.888 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.889 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: crc 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 AuthRegistry(0x55659b1abf00) adding con mode: secure 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:54:18.518+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:54:18.518+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:54:18.518+0000 7f49d4616800 5 asok(0x55659aef9410) register_command rotate-key cmddesc rotate-key hook 0x55659b1ac048 EEXIST 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-a con 0x55659b1bb2b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-b con 0x55659b1e7120 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): picked mon.noname-c con 0x55659b1eba80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.890 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:54:18.518+0000 7f49d4616800 10 monclient(hunting): authenticate will time out at 1872.174772s 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): get_auth_request con 0x55659b1bb2b0 auth_method 0 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): get_auth_request con 0x55659b1eba80 auth_method 0 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.891 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:54:18.518+0000 7f49cfde7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:54:18.518+0000 7f49d05e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request con 0x55659b1e7120 auth_method 0 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:54:18.518+0000 7f49cf5e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:54:18.519+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:54:18.519+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:54:18.519+0000 7f49cf5e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:18.892 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:54:18.519+0000 7f49cfde7640 10 monclient(hunting): handle_auth_done global_id 6351 payload 824 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:54:18.519+0000 7f49cfde7640 10 monclient: _finish_hunting 0 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:54:18.519+0000 7f49cfde7640 1 monclient: found mon.noname-a 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:54:18.519+0000 7f49cfde7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: dump: 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.893 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: _finish_auth 0 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: _check_auth_tickets 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:54:18.519+0000 7f48ad7fa640 10 monclient: dump: 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:18.894 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:54:18.519+0000 7f49d4616800 5 monclient: authenticate success, global_id 6351 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:54:18.519+0000 7f48aeffd640 4 set_mon_vals no callback set 2024-09-19T13:54:18.895 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _renew_subs 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:54:18.519+0000 7f49d4616800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:54:18.519+0000 7f49d4616800 1 librados: init done 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:54:18.519+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cr dump hook 0x55659b1ee7b8 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:54:18.520+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:54:18.521+0000 7f48ad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:54:18.521+0000 7f48ad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:54:18.521+0000 7f48ad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:54:18.521+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f4898077570 auth_method 0 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:54:18.521+0000 7f49d05e8640 10 monclient: get_auth_request con 0x55659b205140 auth_method 0 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.896 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 realm 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:54:18.522+0000 7f49d4616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:54:18.522+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:54:18.522+0000 7f49cfde7640 10 monclient: get_auth_request con 0x55659b2094d0 auth_method 0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:54:18.523+0000 7f49d4616800 20 searching for the correct realm 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:54:18.523+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x55659b20e600 auth_method 0 2024-09-19T13:54:18.897 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:54:18.524+0000 7f49d05e8640 10 monclient: get_auth_request con 0x7f49b802d070 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:54:18.525+0000 7f49cfde7640 10 monclient: get_auth_request con 0x7f49c8017020 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:54:18.526+0000 7f49cf5e6640 10 monclient: get_auth_request con 0x7f49c006d060 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:54:18.527+0000 7f49d05e8640 0 -- 172.21.15.94:0/928469912 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f49b802d070 msgr2=0x7f49b8044950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:54:18.527+0000 7f48ad7fa640 1 client.6351.objecter ms_handle_reset 0x7f49b802d070 session 0x7f49b804a040 osd.7 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:54:18.527+0000 7f48ad7fa640 10 monclient: _renew_subs 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:54:18.527+0000 7f48ad7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:54:18.527+0000 7f49d05e8640 10 monclient: get_auth_request con 0x7f4898087390 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:54:18.528+0000 7f49d05e8640 10 monclient: get_auth_request con 0x7f49b8054040 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:54:18.530+0000 7f49cfde7640 10 monclient: get_auth_request con 0x7f49b8054930 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:54:18.530+0000 7f49cfde7640 0 -- 172.21.15.94:0/928469912 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f49b8054930 msgr2=0x7f49b80433e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:54:18.732+0000 7f49cfde7640 10 monclient: get_auth_request con 0x7f49b8054930 auth_method 0 2024-09-19T13:54:18.898 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:54:18.737+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 zone default found 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:54:18.738+0000 7f49d4616800 4 Realm: () 2024-09-19T13:54:18.899 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:54:18.738+0000 7f49d4616800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:54:18.738+0000 7f49d4616800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:54:18.738+0000 7f49d4616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 zonegroup default 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:54:18.738+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 started sync module instance, tier type = 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:54:18.739+0000 7f49d4616800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=0 2024-09-19T13:54:18.900 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=1 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=2 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=3 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=4 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=5 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:54:18.748+0000 7f49d4616800 20 add_watcher() i=6 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:54:18.749+0000 7f49d4616800 20 add_watcher() i=7 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:54:18.749+0000 7f49d4616800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding auth protocol: cephx 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding auth protocol: cephx 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding auth protocol: cephx 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.901 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: crc 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 AuthRegistry(0x7fffa68af340) adding con mode: secure 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:54:18.751+0000 7f4885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:54:18.751+0000 7f49d4616800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache list hook 0x55659b1dcf10 2024-09-19T13:54:18.902 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache inspect hook 0x55659b1dcf10 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache erase hook 0x55659b1dcf10 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command cache zap hook 0x55659b1dcf10 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 note: GC not initialized 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:54:18.751+0000 7f4884fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace show hook 0x7f49b8017d00 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace history hook 0x7f49b8017d00 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace active hook 0x7f49b8017d00 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:54:18.751+0000 7f49d4616800 5 asok(0x55659aef9410) register_command sync trace active_short hook 0x7f49b8017d00 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:54:18.751+0000 7f49d4616800 20 Filter name: none 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:54:18.751+0000 7f47fe7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T13:54:18.903 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : miss 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:54:18.752+0000 7f49d4616800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:54:18.752+0000 7f49d4616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:54:18.755+0000 7f49d4616800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f49d4616800 time 2024-09-19T13:54:18.754657+0000 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:18.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f49d578c76a] 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:54:18.755+0000 7f49d4616800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:54:18.905 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f49d4616800 thread_name:radosgw-admin 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f49d443e6f0] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f49d448b99c] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f49d578c7c4] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f49d578c928] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55659a3a0791] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd73f64) [0x55659a8adf64] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55659a3b043d] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f49d4429590] 2024-09-19T13:54:18.906 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:54:18.907 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:54:18.908 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:54:18.909 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:54:18.910 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:54:18.911 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:54:18.912 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:54:18.913 INFO:tasks.workunit.client.0.smithi094.stderr: 7f47fe7fc640 / http_manager 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4884fe1640 / http_manager 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4885fe3640 / rgw_dt_lg_renew 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48ad7fa640 / ms_dispatch 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48aeffd640 / io_context_pool 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48b57fa640 / ms_dispatch 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48b7fff640 / ms_dispatch 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48bde0b640 / io_context_pool 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49cf5e6640 / msgr-worker-2 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49cfde7640 / msgr-worker-1 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49d05e8640 / msgr-worker-0 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49d0de9640 / io_context_pool 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: 7f49d4616800 / radosgw-admin 2024-09-19T13:54:18.914 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:54:18.915 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:54:18.915 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:54:18.756264Z_58b2a1f6-1fcd-47c4-98df-761b7d635c9d/log 2024-09-19T13:54:18.915 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:54:18.915 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T13:54:18.916 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.830+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 realm 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.832+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.833+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:18.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.833+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:18.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.833+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:18.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.833+0000 7ffb2921d800 20 searching for the correct realm 2024-09-19T13:54:18.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.836+0000 7ffb241f1640 0 -- 172.21.15.94:0/2496748102 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7ffb14021020 msgr2=0x7ffb1408a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:18.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:18.839+0000 7ffb249f2640 0 -- 172.21.15.94:0/2496748102 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ffb18069a80 msgr2=0x7ffb1806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.046+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:19.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 zone default found 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 4 Realm: () 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 zonegroup default 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.047+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 started sync module instance, tier type = 2024-09-19T13:54:19.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.048+0000 7ffb2921d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=0 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=1 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=2 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=3 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=4 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=5 2024-09-19T13:54:19.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.058+0000 7ffb2921d800 20 add_watcher() i=6 2024-09-19T13:54:19.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.059+0000 7ffb2921d800 20 add_watcher() i=7 2024-09-19T13:54:19.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.059+0000 7ffb2921d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:19.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.060+0000 7ff9dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:19.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:19.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 5 note: GC not initialized 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ff9d9fe3640 20 reqs_thread_entry: start 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 Filter name: none 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ff94b7fe640 20 reqs_thread_entry: start 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:19.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.061+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.062+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.062+0000 7ffb2921d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.062+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.062+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.062+0000 7ffb2921d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.063+0000 7ffb2921d800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:19.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.063+0000 7ffb2921d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:19.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.065+0000 7ff9dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:19.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.067+0000 7ffb2921d800 20 remove_watcher() i=0 2024-09-19T13:54:19.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.067+0000 7ffb2921d800 2 removed watcher, disabling cache 2024-09-19T13:54:19.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.068+0000 7ffb2921d800 20 remove_watcher() i=1 2024-09-19T13:54:19.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.069+0000 7ffb2921d800 20 remove_watcher() i=2 2024-09-19T13:54:19.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.070+0000 7ffb2921d800 20 remove_watcher() i=3 2024-09-19T13:54:19.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.071+0000 7ffb2921d800 20 remove_watcher() i=4 2024-09-19T13:54:19.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.072+0000 7ffb2921d800 20 remove_watcher() i=5 2024-09-19T13:54:19.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.073+0000 7ffb2921d800 20 remove_watcher() i=6 2024-09-19T13:54:19.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.074+0000 7ffb2921d800 20 remove_watcher() i=7 2024-09-19T13:54:19.085 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:19.085 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:19.085 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:19.085 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:19.136 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:54:19.166 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:19.166 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:19.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.201+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 realm 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.203+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.204+0000 7f7962894800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:19.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.204+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.205+0000 7f7962894800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:19.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.205+0000 7f7962894800 20 searching for the correct realm 2024-09-19T13:54:19.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.208+0000 7f7960b7f640 0 -- 172.21.15.94:0/3939847249 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55be2207e710 msgr2=0x55be22080b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:19.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.212+0000 7f796037e640 0 -- 172.21.15.94:0/3939847249 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f7954045020 msgr2=0x7f7954075040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:19.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:19.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:19.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:19.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:19.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.216+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 zone default found 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 4 Realm: () 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 zonegroup default 2024-09-19T13:54:19.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.217+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.218+0000 7f7962894800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:19.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.218+0000 7f7962894800 20 started sync module instance, tier type = 2024-09-19T13:54:19.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.218+0000 7f7962894800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=0 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=1 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=2 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=3 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=4 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=5 2024-09-19T13:54:19.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.226+0000 7f7962894800 20 add_watcher() i=6 2024-09-19T13:54:19.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.227+0000 7f7962894800 20 add_watcher() i=7 2024-09-19T13:54:19.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.227+0000 7f7962894800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:19.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.228+0000 7f7816fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:19.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:19.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:19.230 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 5 note: GC not initialized 2024-09-19T13:54:19.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7815fdb640 20 reqs_thread_entry: start 2024-09-19T13:54:19.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:19.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 20 Filter name: none 2024-09-19T13:54:19.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f77877fe640 20 reqs_thread_entry: start 2024-09-19T13:54:19.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T13:54:19.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.229+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.230+0000 7f7962894800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.230+0000 7f7962894800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.230+0000 7f7962894800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.230+0000 7f7962894800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : miss 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.230+0000 7f7962894800 20 rados->read ofs=0 len=0 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.231+0000 7f7962894800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.231+0000 7f7962894800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.231+0000 7f7962894800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.231+0000 7f7962894800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.231+0000 7f7962894800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:19.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.231+0000 7f7962894800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:19.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.232+0000 7f7962894800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to be held by another RGW process; skipping for now 2024-09-19T13:54:19.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.232+0000 7f7816fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:19.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.235+0000 7f7962894800 20 remove_watcher() i=0 2024-09-19T13:54:19.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.235+0000 7f7962894800 2 removed watcher, disabling cache 2024-09-19T13:54:19.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.236+0000 7f7962894800 20 remove_watcher() i=1 2024-09-19T13:54:19.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.237+0000 7f7962894800 20 remove_watcher() i=2 2024-09-19T13:54:19.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.238+0000 7f7962894800 20 remove_watcher() i=3 2024-09-19T13:54:19.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.239+0000 7f7962894800 20 remove_watcher() i=4 2024-09-19T13:54:19.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.240+0000 7f7962894800 20 remove_watcher() i=5 2024-09-19T13:54:19.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.240+0000 7f7962894800 20 remove_watcher() i=6 2024-09-19T13:54:19.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:19.241+0000 7f7962894800 20 remove_watcher() i=7 2024-09-19T13:54:19.253 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:54:49.286 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:54:49.321 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:49.321 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:49.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.362+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.363+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.363+0000 7f87e8e94800 20 realm 2024-09-19T13:54:49.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.363+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.364+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.364+0000 7f87e8e94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:49.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.364+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.364+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.364+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.365+0000 7f87e8e94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:49.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.365+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.365+0000 7f87e8e94800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:49.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.365+0000 7f87e8e94800 20 searching for the correct realm 2024-09-19T13:54:49.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.369+0000 7f87e717f640 0 -- 172.21.15.94:0/1920199118 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x56525eec22c0 msgr2=0x56525eec46b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:49.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.373+0000 7f87de17d640 0 -- 172.21.15.94:0/1920199118 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f87d8055c40 msgr2=0x7f87d80c3140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.377+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 zone default found 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 4 Realm: () 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 zonegroup default 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.378+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.379+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.379+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.379+0000 7f87e8e94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.379+0000 7f87e8e94800 20 started sync module instance, tier type = 2024-09-19T13:54:49.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.379+0000 7f87e8e94800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=0 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=1 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=2 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=3 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=4 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=5 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.389+0000 7f87e8e94800 20 add_watcher() i=6 2024-09-19T13:54:49.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.390+0000 7f87e8e94800 20 add_watcher() i=7 2024-09-19T13:54:49.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.390+0000 7f87e8e94800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:49.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.391+0000 7f869d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:49.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f87e8e94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:49.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f87e8e94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f87e8e94800 5 note: GC not initialized 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f8617fff640 20 reqs_thread_entry: start 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f87e8e94800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f87e8e94800 20 Filter name: none 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.392+0000 7f8615ffb640 20 reqs_thread_entry: start 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T13:54:49.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : miss 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:49.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.393+0000 7f87e8e94800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:49.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.398+0000 7f87e8e94800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.398+0000 7f87e8e94800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.398+0000 7f87e8e94800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f87e8e94800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22, ofs0, ns] 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f86ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595112 cookie 94911779903600 notifier 6119 bl.length()=997 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f86ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f86ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f86ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): orig_sources= new_sources= 2024-09-19T13:54:49.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): potential sources added=[] removed=[] 2024-09-19T13:54:49.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): orig_dests= new_dests= 2024-09-19T13:54:49.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.399+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): potential dests added=[] removed=[] 2024-09-19T13:54:49.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.0 2024-09-19T13:54:49.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.0 2024-09-19T13:54:49.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.1 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.1 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.2 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.2 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.3 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.3 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.4 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.4 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.5 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.5 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.6 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.6 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.7 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.7 2024-09-19T13:54:49.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.8 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.8 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.9 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.9 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.10 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.10 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.11 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1.11 2024-09-19T13:54:49.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.404+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.0 2024-09-19T13:54:49.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.405+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1 2024-09-19T13:54:49.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.405+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.2 2024-09-19T13:54:49.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.406+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.3 2024-09-19T13:54:49.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.406+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.4 2024-09-19T13:54:49.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.407+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.5 2024-09-19T13:54:49.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.408+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.6 2024-09-19T13:54:49.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.408+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.7 2024-09-19T13:54:49.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.409+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.8 2024-09-19T13:54:49.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.410+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.9 2024-09-19T13:54:49.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.410+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.10 2024-09-19T13:54:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.413+0000 7f87e8e94800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:49.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.413+0000 7f87e8e94800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22, ofs0, ns] 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f86c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94911779903600 notifier 6119 bl.length()=997 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f86c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f86c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f86c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): orig_sources= new_sources= 2024-09-19T13:54:49.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): potential sources added=[] removed=[] 2024-09-19T13:54:49.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): orig_dests= new_dests= 2024-09-19T13:54:49.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.415+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): potential dests added=[] removed=[] 2024-09-19T13:54:49.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.418+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.0 2024-09-19T13:54:49.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.418+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.1 2024-09-19T13:54:49.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.418+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.2 2024-09-19T13:54:49.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.419+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.3 2024-09-19T13:54:49.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.419+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.4 2024-09-19T13:54:49.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.419+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.5 2024-09-19T13:54:49.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.420+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.6 2024-09-19T13:54:49.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.420+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.7 2024-09-19T13:54:49.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.421+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.8 2024-09-19T13:54:49.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.421+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.9 2024-09-19T13:54:49.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.421+0000 7f87e8e94800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22.10 2024-09-19T13:54:49.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.421+0000 7f87e8e94800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:49.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.421+0000 7f87e8e94800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.422+0000 7f87e8e94800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22, ofs0, ns] 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f86c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94911779903600 notifier 6119 bl.length()=965 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f86c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 info.flags=0x17 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f86c9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 to cache LRU end 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f86c9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:49.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): orig_sources= new_sources= 2024-09-19T13:54:49.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): potential sources added=[] removed=[] 2024-09-19T13:54:49.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): orig_dests= new_dests= 2024-09-19T13:54:49.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.423+0000 7f87e8e94800 20 handle_bi_update(): bucket=:abort-at-init-indext[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22]): potential dests added=[] removed=[] 2024-09-19T13:54:49.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.428+0000 7f87e8e94800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-19T13:54:49.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.430+0000 7f869d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:49.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.432+0000 7f87e8e94800 20 remove_watcher() i=0 2024-09-19T13:54:49.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.432+0000 7f87e8e94800 2 removed watcher, disabling cache 2024-09-19T13:54:49.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.433+0000 7f87e8e94800 20 remove_watcher() i=1 2024-09-19T13:54:49.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.434+0000 7f87e8e94800 20 remove_watcher() i=2 2024-09-19T13:54:49.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.435+0000 7f87e8e94800 20 remove_watcher() i=3 2024-09-19T13:54:49.438 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.436+0000 7f87e8e94800 20 remove_watcher() i=4 2024-09-19T13:54:49.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.437+0000 7f87e8e94800 20 remove_watcher() i=5 2024-09-19T13:54:49.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.438+0000 7f87e8e94800 20 remove_watcher() i=6 2024-09-19T13:54:49.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.439+0000 7f87e8e94800 20 remove_watcher() i=7 2024-09-19T13:54:49.453 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T13:54:49.482 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:49.482 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:49.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.517+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 realm 2024-09-19T13:54:49.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:49.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.519+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.520+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:49.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.520+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.520+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:49.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.520+0000 7fee4fc87800 20 searching for the correct realm 2024-09-19T13:54:49.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.522+0000 7fee4d771640 0 -- 172.21.15.94:0/4047597779 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x5559286604e0 msgr2=0x7fee480a3c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:49.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.726+0000 7fee4df72640 0 -- 172.21.15.94:0/4047597779 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fee380724f0 msgr2=0x7fee38067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:49.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.732+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:49.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 zone default found 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 4 Realm: () 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 zonegroup default 2024-09-19T13:54:49.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.733+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.734+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.734+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.734+0000 7fee4fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.734+0000 7fee4fc87800 20 started sync module instance, tier type = 2024-09-19T13:54:49.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.734+0000 7fee4fc87800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:49.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=0 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=1 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=2 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=3 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=4 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=5 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.743+0000 7fee4fc87800 20 add_watcher() i=6 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.745+0000 7fee4fc87800 20 add_watcher() i=7 2024-09-19T13:54:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.745+0000 7fee4fc87800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.746+0000 7fed037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.746+0000 7fee4fc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.746+0000 7fee4fc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.746+0000 7fee4fc87800 5 note: GC not initialized 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fed027e4640 20 reqs_thread_entry: start 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fee4fc87800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fee4fc87800 20 Filter name: none 2024-09-19T13:54:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fec73fff640 20 reqs_thread_entry: start 2024-09-19T13:54:49.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.747+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.748+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.748+0000 7fee4fc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.748+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.748+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.748+0000 7fee4fc87800 20 rados->read ofs=0 len=0 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.749+0000 7fee4fc87800 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T13:54:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.749+0000 7fee4fc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:49.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.750+0000 7fed037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:49.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.752+0000 7fee4fc87800 20 remove_watcher() i=0 2024-09-19T13:54:49.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.752+0000 7fee4fc87800 2 removed watcher, disabling cache 2024-09-19T13:54:49.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.753+0000 7fee4fc87800 20 remove_watcher() i=1 2024-09-19T13:54:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.755+0000 7fee4fc87800 20 remove_watcher() i=2 2024-09-19T13:54:49.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.756+0000 7fee4fc87800 20 remove_watcher() i=3 2024-09-19T13:54:49.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.757+0000 7fee4fc87800 20 remove_watcher() i=4 2024-09-19T13:54:49.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.758+0000 7fee4fc87800 20 remove_watcher() i=5 2024-09-19T13:54:49.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.759+0000 7fee4fc87800 20 remove_watcher() i=6 2024-09-19T13:54:49.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:49.760+0000 7fee4fc87800 20 remove_watcher() i=7 2024-09-19T13:54:49.772 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:49.772 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:49.772 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-init-indext id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:54:49.772 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:49.846 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-19T13:54:49.846 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:50.024 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T13:54:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:50.052 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:50.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.086+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 realm 2024-09-19T13:54:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.088+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.089+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:50.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.089+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.090+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:50.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.090+0000 7fa24ea14800 20 searching for the correct realm 2024-09-19T13:54:50.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.092+0000 7fa24a0cb640 0 -- 172.21.15.94:0/841413569 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7fa244061020 msgr2=0x7fa244055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:50.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.296+0000 7fa24a8cc640 0 -- 172.21.15.94:0/841413569 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fa240037060 msgr2=0x7fa240031b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.301+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:50.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 zone default found 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 4 Realm: () 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 zonegroup default 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.302+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.303+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.303+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.303+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.303+0000 7fa24ea14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.303+0000 7fa24ea14800 20 started sync module instance, tier type = 2024-09-19T13:54:50.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.303+0000 7fa24ea14800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=0 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=1 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=2 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=3 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=4 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=5 2024-09-19T13:54:50.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.312+0000 7fa24ea14800 20 add_watcher() i=6 2024-09-19T13:54:50.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.313+0000 7fa24ea14800 20 add_watcher() i=7 2024-09-19T13:54:50.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.313+0000 7fa24ea14800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:50.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.314+0000 7fa100fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:50.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:50.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 5 note: GC not initialized 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa07b7fe640 20 reqs_thread_entry: start 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 Filter name: none 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa0797fa640 20 reqs_thread_entry: start 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:50.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.315+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.316+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:50.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.316+0000 7fa24ea14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:50.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.316+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.316+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:50.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.316+0000 7fa24ea14800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.317+0000 7fa24ea14800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:50.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.317+0000 7fa24ea14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:50.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.319+0000 7fa100fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:50.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.320+0000 7fa24ea14800 20 remove_watcher() i=0 2024-09-19T13:54:50.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.320+0000 7fa24ea14800 2 removed watcher, disabling cache 2024-09-19T13:54:50.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.321+0000 7fa24ea14800 20 remove_watcher() i=1 2024-09-19T13:54:50.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.322+0000 7fa24ea14800 20 remove_watcher() i=2 2024-09-19T13:54:50.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.323+0000 7fa24ea14800 20 remove_watcher() i=3 2024-09-19T13:54:50.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.324+0000 7fa24ea14800 20 remove_watcher() i=4 2024-09-19T13:54:50.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.325+0000 7fa24ea14800 20 remove_watcher() i=5 2024-09-19T13:54:50.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.326+0000 7fa24ea14800 20 remove_watcher() i=6 2024-09-19T13:54:50.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.327+0000 7fa24ea14800 20 remove_watcher() i=7 2024-09-19T13:54:50.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:50.339 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:50.339 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:50.340 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-19T13:54:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:50.374 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:50.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.408+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 realm 2024-09-19T13:54:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.410+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.411+0000 7f083092a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:50.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.411+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.411+0000 7f083092a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:50.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.411+0000 7f083092a800 20 searching for the correct realm 2024-09-19T13:54:50.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.414+0000 7f082be16640 0 -- 172.21.15.94:0/3286332801 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f081c07c070 msgr2=0x7f081c08b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:50.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.418+0000 7f082c617640 0 -- 172.21.15.94:0/3286332801 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f082006e090 msgr2=0x7f082007d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:50.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.623+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 zone default found 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 4 Realm: () 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:50.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 zonegroup default 2024-09-19T13:54:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.624+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.625+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.625+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.625+0000 7f083092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.625+0000 7f083092a800 20 started sync module instance, tier type = 2024-09-19T13:54:50.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.625+0000 7f083092a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:50.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=0 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=1 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=2 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=3 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=4 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=5 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.633+0000 7f083092a800 20 add_watcher() i=6 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.634+0000 7f083092a800 20 add_watcher() i=7 2024-09-19T13:54:50.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.634+0000 7f083092a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.636+0000 7f06e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.636+0000 7f083092a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.636+0000 7f083092a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.636+0000 7f083092a800 5 note: GC not initialized 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.636+0000 7f06e1fdb640 20 reqs_thread_entry: start 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 20 Filter name: none 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f06537fe640 20 reqs_thread_entry: start 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T13:54:50.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:50.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T13:54:50.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T13:54:50.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 : miss 2024-09-19T13:54:50.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:50.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:50.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:50.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:50.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:50.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.637+0000 7f083092a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 2024-09-19T13:54:50.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.641+0000 7f083092a800 -1 Injecting error=-5 at location=set_target_layout 2024-09-19T13:54:50.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.641+0000 7f083092a800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-19T13:54:50.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.645+0000 7f06e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:50.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.648+0000 7f083092a800 20 remove_watcher() i=0 2024-09-19T13:54:50.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.648+0000 7f083092a800 2 removed watcher, disabling cache 2024-09-19T13:54:50.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.649+0000 7f083092a800 20 remove_watcher() i=1 2024-09-19T13:54:50.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.649+0000 7f083092a800 20 remove_watcher() i=2 2024-09-19T13:54:50.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.650+0000 7f083092a800 20 remove_watcher() i=3 2024-09-19T13:54:50.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.651+0000 7f083092a800 20 remove_watcher() i=4 2024-09-19T13:54:50.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.652+0000 7f083092a800 20 remove_watcher() i=5 2024-09-19T13:54:50.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.653+0000 7f083092a800 20 remove_watcher() i=6 2024-09-19T13:54:50.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.654+0000 7f083092a800 20 remove_watcher() i=7 2024-09-19T13:54:50.668 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T13:54:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:50.697 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:50.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.731+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.732+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.732+0000 7fd4caa0e800 20 realm 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.732+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.733+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.733+0000 7fd4caa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.733+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.733+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.733+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.734+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:50.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.734+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.734+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:50.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.734+0000 7fd4caa0e800 20 searching for the correct realm 2024-09-19T13:54:50.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.737+0000 7fd4bd8ca640 0 -- 172.21.15.94:0/2420795874 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd4b806f390 msgr2=0x7fd4b806d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:50.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.740+0000 7fd4c60cb640 0 -- 172.21.15.94:0/2420795874 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd4b002e740 msgr2=0x7fd4b0061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:50.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:50.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:50.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:50.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:50.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:50.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:50.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.945+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:50.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 zone default found 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 4 Realm: () 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 zonegroup default 2024-09-19T13:54:50.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.946+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 started sync module instance, tier type = 2024-09-19T13:54:50.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.947+0000 7fd4caa0e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:50.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=0 2024-09-19T13:54:50.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=1 2024-09-19T13:54:50.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=2 2024-09-19T13:54:50.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=3 2024-09-19T13:54:50.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=4 2024-09-19T13:54:50.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=5 2024-09-19T13:54:50.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.956+0000 7fd4caa0e800 20 add_watcher() i=6 2024-09-19T13:54:50.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.957+0000 7fd4caa0e800 20 add_watcher() i=7 2024-09-19T13:54:50.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.957+0000 7fd4caa0e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:50.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.958+0000 7fd37cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:50.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:50.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:50.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 5 note: GC not initialized 2024-09-19T13:54:50.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd2f77fe640 20 reqs_thread_entry: start 2024-09-19T13:54:50.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 Filter name: none 2024-09-19T13:54:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd2f57fa640 20 reqs_thread_entry: start 2024-09-19T13:54:50.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.959+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.960+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.960+0000 7fd4caa0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.960+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.960+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.960+0000 7fd4caa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.961+0000 7fd4caa0e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:50.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.961+0000 7fd4caa0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:50.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.962+0000 7fd37cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:50.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.964+0000 7fd4caa0e800 20 remove_watcher() i=0 2024-09-19T13:54:50.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.964+0000 7fd4caa0e800 2 removed watcher, disabling cache 2024-09-19T13:54:50.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.965+0000 7fd4caa0e800 20 remove_watcher() i=1 2024-09-19T13:54:50.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.966+0000 7fd4caa0e800 20 remove_watcher() i=2 2024-09-19T13:54:50.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.967+0000 7fd4caa0e800 20 remove_watcher() i=3 2024-09-19T13:54:50.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.968+0000 7fd4caa0e800 20 remove_watcher() i=4 2024-09-19T13:54:50.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.969+0000 7fd4caa0e800 20 remove_watcher() i=5 2024-09-19T13:54:50.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.970+0000 7fd4caa0e800 20 remove_watcher() i=6 2024-09-19T13:54:50.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:50.971+0000 7fd4caa0e800 20 remove_watcher() i=7 2024-09-19T13:54:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:50.983 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:50.983 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:51.033 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:54:51.066 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:51.066 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:51.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.100+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 realm 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.102+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.103+0000 7f2e0ab75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.103+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.103+0000 7f2e0ab75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:51.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.103+0000 7f2e0ab75800 20 searching for the correct realm 2024-09-19T13:54:51.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.106+0000 7f2e08e67640 0 -- 172.21.15.94:0/597783132 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f2df00b5dd0 msgr2=0x7f2df00b57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:51.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.109+0000 7f2e08666640 0 -- 172.21.15.94:0/597783132 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f2df00aad50 msgr2=0x7f2df00b46a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:51.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.114+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 zone default found 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 4 Realm: () 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 zonegroup default 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 started sync module instance, tier type = 2024-09-19T13:54:51.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.115+0000 7f2e0ab75800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=0 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=1 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=2 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=3 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=4 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=5 2024-09-19T13:54:51.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=6 2024-09-19T13:54:51.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 20 add_watcher() i=7 2024-09-19T13:54:51.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.124+0000 7f2e0ab75800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.126+0000 7f2cbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.126+0000 7f2e0ab75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.126+0000 7f2e0ab75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.126+0000 7f2e0ab75800 5 note: GC not initialized 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.126+0000 7f2cbdfdb640 20 reqs_thread_entry: start 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.126+0000 7f2e0ab75800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 20 Filter name: none 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2c2f7fe640 20 reqs_thread_entry: start 2024-09-19T13:54:51.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 : miss 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:51.130 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.127+0000 7f2e0ab75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23, ofs0, ns] 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2cdf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94576176019920 notifier 6492 bl.length()=1009 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2cdf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2cdf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2cdf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): orig_sources= new_sources= 2024-09-19T13:54:51.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): potential sources added=[] removed=[] 2024-09-19T13:54:51.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): orig_dests= new_dests= 2024-09-19T13:54:51.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.132+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): potential dests added=[] removed=[] 2024-09-19T13:54:51.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.0 2024-09-19T13:54:51.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.0 2024-09-19T13:54:51.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.1 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.1 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.2 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.2 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.3 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.3 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.4 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.4 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.5 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.5 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.6 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.6 2024-09-19T13:54:51.140 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.7 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.7 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.8 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.8 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.9 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.9 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.10 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.10 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.11 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1.11 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.0 2024-09-19T13:54:51.141 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.137+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1 2024-09-19T13:54:51.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.138+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.2 2024-09-19T13:54:51.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.139+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.3 2024-09-19T13:54:51.142 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.139+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.4 2024-09-19T13:54:51.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.139+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.5 2024-09-19T13:54:51.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.140+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.6 2024-09-19T13:54:51.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.140+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.7 2024-09-19T13:54:51.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.141+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.8 2024-09-19T13:54:51.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.141+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.9 2024-09-19T13:54:51.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.142+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.10 2024-09-19T13:54:51.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.145+0000 7f2e0ab75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:51.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.145+0000 7f2e0ab75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 2024-09-19T13:54:51.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2e0ab75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2e0ab75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2e0ab75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2e0ab75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23, ofs0, ns] 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2cdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94576176019920 notifier 6492 bl.length()=1009 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2cdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2cdeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.146+0000 7f2cdeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.147+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): orig_sources= new_sources= 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.147+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): potential sources added=[] removed=[] 2024-09-19T13:54:51.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.147+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): orig_dests= new_dests= 2024-09-19T13:54:51.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.147+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): potential dests added=[] removed=[] 2024-09-19T13:54:51.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.149+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.0 2024-09-19T13:54:51.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.149+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.1 2024-09-19T13:54:51.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.149+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.2 2024-09-19T13:54:51.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.150+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.3 2024-09-19T13:54:51.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.150+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.4 2024-09-19T13:54:51.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.150+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.5 2024-09-19T13:54:51.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.150+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.6 2024-09-19T13:54:51.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.151+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.7 2024-09-19T13:54:51.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.151+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.8 2024-09-19T13:54:51.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.151+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.9 2024-09-19T13:54:51.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.152+0000 7f2e0ab75800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23.10 2024-09-19T13:54:51.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.152+0000 7f2e0ab75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:51.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.152+0000 7f2e0ab75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.153+0000 7f2e0ab75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.153+0000 7f2e0ab75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.153+0000 7f2e0ab75800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.153+0000 7f2e0ab75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23, ofs0, ns] 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2cdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595116 cookie 94576176019920 notifier 6492 bl.length()=977 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2cdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 info.flags=0x17 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2cdeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 to cache LRU end 2024-09-19T13:54:51.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2cdeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:51.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): orig_sources= new_sources= 2024-09-19T13:54:51.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): potential sources added=[] removed=[] 2024-09-19T13:54:51.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): orig_dests= new_dests= 2024-09-19T13:54:51.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.154+0000 7f2e0ab75800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23]): potential dests added=[] removed=[] 2024-09-19T13:54:51.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.156+0000 7f2e0ab75800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T13:54:51.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.158+0000 7f2cbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:51.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.160+0000 7f2e0ab75800 20 remove_watcher() i=0 2024-09-19T13:54:51.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.160+0000 7f2e0ab75800 2 removed watcher, disabling cache 2024-09-19T13:54:51.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.161+0000 7f2e0ab75800 20 remove_watcher() i=1 2024-09-19T13:54:51.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.162+0000 7f2e0ab75800 20 remove_watcher() i=2 2024-09-19T13:54:51.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.163+0000 7f2e0ab75800 20 remove_watcher() i=3 2024-09-19T13:54:51.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.164+0000 7f2e0ab75800 20 remove_watcher() i=4 2024-09-19T13:54:51.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.165+0000 7f2e0ab75800 20 remove_watcher() i=5 2024-09-19T13:54:51.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.166+0000 7f2e0ab75800 20 remove_watcher() i=6 2024-09-19T13:54:51.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.167+0000 7f2e0ab75800 20 remove_watcher() i=7 2024-09-19T13:54:51.181 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T13:54:51.210 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:51.210 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:51.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.243+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 realm 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.245+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.246+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:51.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.246+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.246+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:51.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.246+0000 7f19ca131800 20 searching for the correct realm 2024-09-19T13:54:51.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.249+0000 7f19c5675640 0 -- 172.21.15.94:0/3559235683 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55e5e1096460 msgr2=0x55e5e10988b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:51.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.253+0000 7f19c5e76640 0 -- 172.21.15.94:0/3559235683 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f19bc060120 msgr2=0x7f19bc049690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:51.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:51.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:51.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:51.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:51.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:51.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.458+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 zone default found 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 4 Realm: () 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 zonegroup default 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 started sync module instance, tier type = 2024-09-19T13:54:51.463 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.459+0000 7f19ca131800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=0 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=1 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=2 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=3 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=4 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=5 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=6 2024-09-19T13:54:51.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 20 add_watcher() i=7 2024-09-19T13:54:51.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.468+0000 7f19ca131800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:51.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.470+0000 7f18777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.470+0000 7f19ca131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.470+0000 7f19ca131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.470+0000 7f19ca131800 5 note: GC not initialized 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f18767fc640 20 reqs_thread_entry: start 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f19ca131800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f19ca131800 20 Filter name: none 2024-09-19T13:54:51.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f17e7fff640 20 reqs_thread_entry: start 2024-09-19T13:54:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.471+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:51.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:51.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:51.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:51.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.472+0000 7f19ca131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:51.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.474+0000 7f18777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.476+0000 7f19ca131800 20 remove_watcher() i=0 2024-09-19T13:54:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.476+0000 7f19ca131800 2 removed watcher, disabling cache 2024-09-19T13:54:51.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.477+0000 7f19ca131800 20 remove_watcher() i=1 2024-09-19T13:54:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.478+0000 7f19ca131800 20 remove_watcher() i=2 2024-09-19T13:54:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.479+0000 7f19ca131800 20 remove_watcher() i=3 2024-09-19T13:54:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.480+0000 7f19ca131800 20 remove_watcher() i=4 2024-09-19T13:54:51.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.481+0000 7f19ca131800 20 remove_watcher() i=5 2024-09-19T13:54:51.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.481+0000 7f19ca131800 20 remove_watcher() i=6 2024-09-19T13:54:51.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.482+0000 7f19ca131800 20 remove_watcher() i=7 2024-09-19T13:54:51.495 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:51.495 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:51.495 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:54:51.495 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:51.568 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-19T13:54:51.568 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:51.733 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T13:54:51.763 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:51.763 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:51.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.797+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 realm 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:51.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.799+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.800+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:51.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.800+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:51.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.800+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:51.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:51.800+0000 7f403691f800 20 searching for the correct realm 2024-09-19T13:54:52.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.003+0000 7f4031d8a640 0 -- 172.21.15.94:0/4215099739 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f402c0b8070 msgr2=0x7f402c0b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:52.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.408+0000 7f403258b640 0 -- 172.21.15.94:0/4215099739 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f401c054410 msgr2=0x7f401c054850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:52.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:52.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:52.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:52.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:52.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:52.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:52.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:52.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.615+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:52.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 zone default found 2024-09-19T13:54:52.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 4 Realm: () 2024-09-19T13:54:52.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 zonegroup default 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.616+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.617+0000 7f403691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.617+0000 7f403691f800 20 started sync module instance, tier type = 2024-09-19T13:54:52.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.617+0000 7f403691f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=0 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=1 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=2 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=3 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=4 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=5 2024-09-19T13:54:52.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.627+0000 7f403691f800 20 add_watcher() i=6 2024-09-19T13:54:52.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.628+0000 7f403691f800 20 add_watcher() i=7 2024-09-19T13:54:52.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.628+0000 7f403691f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:52.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.630+0000 7f3ee8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.630+0000 7f403691f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.630+0000 7f403691f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.630+0000 7f403691f800 5 note: GC not initialized 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.630+0000 7f3e637fe640 20 reqs_thread_entry: start 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.630+0000 7f403691f800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.631+0000 7f403691f800 20 Filter name: none 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.631+0000 7f3e617fa640 20 reqs_thread_entry: start 2024-09-19T13:54:52.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.631+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.631+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:52.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.631+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:52.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.632+0000 7f403691f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:52.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.634+0000 7f3ee8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:52.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.637+0000 7f403691f800 20 remove_watcher() i=0 2024-09-19T13:54:52.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.637+0000 7f403691f800 2 removed watcher, disabling cache 2024-09-19T13:54:52.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.638+0000 7f403691f800 20 remove_watcher() i=1 2024-09-19T13:54:52.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.639+0000 7f403691f800 20 remove_watcher() i=2 2024-09-19T13:54:52.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.640+0000 7f403691f800 20 remove_watcher() i=3 2024-09-19T13:54:52.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.641+0000 7f403691f800 20 remove_watcher() i=4 2024-09-19T13:54:52.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.642+0000 7f403691f800 20 remove_watcher() i=5 2024-09-19T13:54:52.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.643+0000 7f403691f800 20 remove_watcher() i=6 2024-09-19T13:54:52.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.644+0000 7f403691f800 20 remove_watcher() i=7 2024-09-19T13:54:52.657 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:52.657 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:52.658 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:52.658 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:52.659 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-19T13:54:52.697 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:52.697 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:52.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.733+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.734+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.734+0000 7fc7d7614800 20 realm 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.734+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.734+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.734+0000 7fc7d7614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.734+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.735+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.735+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.736+0000 7fc7d7614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:52.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.736+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.736+0000 7fc7d7614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:52.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.736+0000 7fc7d7614800 20 searching for the correct realm 2024-09-19T13:54:52.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.740+0000 7fc7ca4ca640 0 -- 172.21.15.94:0/1151291622 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fc7c40a9040 msgr2=0x7fc7c4037ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:52.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.743+0000 7fc7d34cc640 0 -- 172.21.15.94:0/1151291622 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fc7bc05fb70 msgr2=0x7fc7bc068040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:52.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:52.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:52.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:52.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:52.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:52.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:52.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.747+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:52.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:52.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 zone default found 2024-09-19T13:54:52.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 4 Realm: () 2024-09-19T13:54:52.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 zonegroup default 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.748+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.749+0000 7fc7d7614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.749+0000 7fc7d7614800 20 started sync module instance, tier type = 2024-09-19T13:54:52.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.749+0000 7fc7d7614800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:52.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=0 2024-09-19T13:54:52.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=1 2024-09-19T13:54:52.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=2 2024-09-19T13:54:52.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=3 2024-09-19T13:54:52.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=4 2024-09-19T13:54:52.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=5 2024-09-19T13:54:52.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.757+0000 7fc7d7614800 20 add_watcher() i=6 2024-09-19T13:54:52.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.758+0000 7fc7d7614800 20 add_watcher() i=7 2024-09-19T13:54:52.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.758+0000 7fc7d7614800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:52.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc6897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 5 note: GC not initialized 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc603fff640 20 reqs_thread_entry: start 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 20 Filter name: none 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc601ffb640 20 reqs_thread_entry: start 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.760+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:52.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T13:54:52.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T13:54:52.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 : miss 2024-09-19T13:54:52.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:52.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:52.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.761+0000 7fc7d7614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 2024-09-19T13:54:52.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.765+0000 7fc7d7614800 -1 Injecting error=-125 at location=set_target_layout 2024-09-19T13:54:52.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc7d7614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc7d7614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc7d7614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc7d7614800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24, ofs0, ns] 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc6b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595119 cookie 94636403718368 notifier 6543 bl.length()=1009 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc6b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc6b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.766+0000 7fc6b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.767+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): orig_sources= new_sources= 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.767+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): potential sources added=[] removed=[] 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.767+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): orig_dests= new_dests= 2024-09-19T13:54:52.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.767+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): potential dests added=[] removed=[] 2024-09-19T13:54:52.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.0 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.0 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.1 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.1 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.2 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.2 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.3 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.3 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.4 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.4 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.5 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.5 2024-09-19T13:54:52.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.6 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.6 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.7 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.7 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.8 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.8 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.9 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.9 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.10 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.10 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.11 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1.11 2024-09-19T13:54:52.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.774+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.0 2024-09-19T13:54:52.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.775+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1 2024-09-19T13:54:52.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.776+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.2 2024-09-19T13:54:52.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.776+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.3 2024-09-19T13:54:52.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.777+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.4 2024-09-19T13:54:52.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.778+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.5 2024-09-19T13:54:52.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.778+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.6 2024-09-19T13:54:52.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.779+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.7 2024-09-19T13:54:52.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.779+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.8 2024-09-19T13:54:52.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.780+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.9 2024-09-19T13:54:52.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.780+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.10 2024-09-19T13:54:52.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.784+0000 7fc7d7614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:52.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.784+0000 7fc7d7614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 2024-09-19T13:54:52.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc7d7614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc7d7614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc7d7614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc7d7614800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24, ofs0, ns] 2024-09-19T13:54:52.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc6b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595120 cookie 94636403718368 notifier 6543 bl.length()=1009 2024-09-19T13:54:52.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc6b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc6b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.785+0000 7fc6b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.786+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): orig_sources= new_sources= 2024-09-19T13:54:52.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.786+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): potential sources added=[] removed=[] 2024-09-19T13:54:52.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.786+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): orig_dests= new_dests= 2024-09-19T13:54:52.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.786+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): potential dests added=[] removed=[] 2024-09-19T13:54:52.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.788+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.0 2024-09-19T13:54:52.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.789+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.1 2024-09-19T13:54:52.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.789+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.2 2024-09-19T13:54:52.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.789+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.3 2024-09-19T13:54:52.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.790+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.4 2024-09-19T13:54:52.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.790+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.5 2024-09-19T13:54:52.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.791+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.6 2024-09-19T13:54:52.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.791+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.7 2024-09-19T13:54:52.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.791+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.8 2024-09-19T13:54:52.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.791+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.9 2024-09-19T13:54:52.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.792+0000 7fc7d7614800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24.10 2024-09-19T13:54:52.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.792+0000 7fc7d7614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 : hit (requested=0x17, cached=0x17) 2024-09-19T13:54:52.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.792+0000 7fc7d7614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.793+0000 7fc7d7614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.793+0000 7fc7d7614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.793+0000 7fc7d7614800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.793+0000 7fc7d7614800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24, ofs0, ns] 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc6b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595121 cookie 94636403718368 notifier 6543 bl.length()=977 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc6b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 info.flags=0x17 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc6b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 to cache LRU end 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc6b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:52.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): orig_sources= new_sources= 2024-09-19T13:54:52.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): potential sources added=[] removed=[] 2024-09-19T13:54:52.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): orig_dests= new_dests= 2024-09-19T13:54:52.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.794+0000 7fc7d7614800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24]): potential dests added=[] removed=[] 2024-09-19T13:54:52.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.797+0000 7fc7d7614800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T13:54:52.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.798+0000 7fc6897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:52.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.800+0000 7fc7d7614800 20 remove_watcher() i=0 2024-09-19T13:54:52.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.800+0000 7fc7d7614800 2 removed watcher, disabling cache 2024-09-19T13:54:52.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.801+0000 7fc7d7614800 20 remove_watcher() i=1 2024-09-19T13:54:52.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.802+0000 7fc7d7614800 20 remove_watcher() i=2 2024-09-19T13:54:52.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.803+0000 7fc7d7614800 20 remove_watcher() i=3 2024-09-19T13:54:52.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.804+0000 7fc7d7614800 20 remove_watcher() i=4 2024-09-19T13:54:52.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.805+0000 7fc7d7614800 20 remove_watcher() i=5 2024-09-19T13:54:52.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.806+0000 7fc7d7614800 20 remove_watcher() i=6 2024-09-19T13:54:52.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.807+0000 7fc7d7614800 20 remove_watcher() i=7 2024-09-19T13:54:52.820 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T13:54:52.849 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:52.849 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:52.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.883+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 realm 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:52.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.885+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.886+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:52.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.886+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:52.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.887+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:52.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.887+0000 7fa9c772c800 20 searching for the correct realm 2024-09-19T13:54:52.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.890+0000 7fa9c2c4e640 0 -- 172.21.15.94:0/3886175766 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fa9b4045b30 msgr2=0x7fa9b40976c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:52.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:52.893+0000 7fa9c344f640 0 -- 172.21.15.94:0/3886175766 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa9b80a66b0 msgr2=0x7fa9b80406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.098+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:53.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 zone default found 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 4 Realm: () 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 zonegroup default 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.099+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.100+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.100+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.100+0000 7fa9c772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.100+0000 7fa9c772c800 20 started sync module instance, tier type = 2024-09-19T13:54:53.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.100+0000 7fa9c772c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=0 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=1 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=2 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=3 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=4 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=5 2024-09-19T13:54:53.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.109+0000 7fa9c772c800 20 add_watcher() i=6 2024-09-19T13:54:53.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.110+0000 7fa9c772c800 20 add_watcher() i=7 2024-09-19T13:54:53.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.110+0000 7fa9c772c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:53.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa879fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa9c772c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:53.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa9c772c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa9c772c800 5 note: GC not initialized 2024-09-19T13:54:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa878fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa9c772c800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa9c772c800 20 Filter name: none 2024-09-19T13:54:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa7f27fc640 20 reqs_thread_entry: start 2024-09-19T13:54:53.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.112+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.113+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.113+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.113+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.113+0000 7fa9c772c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.113+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.114+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.114+0000 7fa9c772c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.114+0000 7fa9c772c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.114+0000 7fa9c772c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:53.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.116+0000 7fa879fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.118+0000 7fa9c772c800 20 remove_watcher() i=0 2024-09-19T13:54:53.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.118+0000 7fa9c772c800 2 removed watcher, disabling cache 2024-09-19T13:54:53.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.119+0000 7fa9c772c800 20 remove_watcher() i=1 2024-09-19T13:54:53.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.119+0000 7fa9c772c800 20 remove_watcher() i=2 2024-09-19T13:54:53.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.121+0000 7fa9c772c800 20 remove_watcher() i=3 2024-09-19T13:54:53.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.121+0000 7fa9c772c800 20 remove_watcher() i=4 2024-09-19T13:54:53.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.122+0000 7fa9c772c800 20 remove_watcher() i=5 2024-09-19T13:54:53.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.123+0000 7fa9c772c800 20 remove_watcher() i=6 2024-09-19T13:54:53.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.124+0000 7fa9c772c800 20 remove_watcher() i=7 2024-09-19T13:54:53.136 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.136 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:53.136 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T13:54:53.136 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.211 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-19T13:54:53.211 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.392 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T13:54:53.420 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:53.420 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:53.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.454+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.455+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.455+0000 7f57ee125800 20 realm 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.455+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.456+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.456+0000 7f57ee125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.456+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.456+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.456+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.457+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.457+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.457+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:53.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.457+0000 7f57ee125800 20 searching for the correct realm 2024-09-19T13:54:53.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.460+0000 7f57e1532640 0 -- 172.21.15.94:0/3268874622 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x556a77c34350 msgr2=0x556a77c36740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.463+0000 7f57e9d33640 0 -- 172.21.15.94:0/3268874622 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f57d4041320 msgr2=0x7f57d4075ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.467+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 zone default found 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 4 Realm: () 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 zonegroup default 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.468+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.469+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.469+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.469+0000 7f57ee125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.469+0000 7f57ee125800 20 started sync module instance, tier type = 2024-09-19T13:54:53.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.469+0000 7f57ee125800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=0 2024-09-19T13:54:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=1 2024-09-19T13:54:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=2 2024-09-19T13:54:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=3 2024-09-19T13:54:53.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=4 2024-09-19T13:54:53.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=5 2024-09-19T13:54:53.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.477+0000 7f57ee125800 20 add_watcher() i=6 2024-09-19T13:54:53.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.478+0000 7f57ee125800 20 add_watcher() i=7 2024-09-19T13:54:53.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.478+0000 7f57ee125800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:53.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.479+0000 7f569b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f57ee125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f57ee125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f57ee125800 5 note: GC not initialized 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f569a7fc640 20 reqs_thread_entry: start 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f57ee125800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f57ee125800 20 Filter name: none 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f560bfff640 20 reqs_thread_entry: start 2024-09-19T13:54:53.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.480+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.481+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.481+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.481+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.481+0000 7f57ee125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.481+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.482+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.482+0000 7f57ee125800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.482+0000 7f57ee125800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.482+0000 7f57ee125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:53.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.484+0000 7f569b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.485+0000 7f57ee125800 20 remove_watcher() i=0 2024-09-19T13:54:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.485+0000 7f57ee125800 2 removed watcher, disabling cache 2024-09-19T13:54:53.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.486+0000 7f57ee125800 20 remove_watcher() i=1 2024-09-19T13:54:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.488+0000 7f57ee125800 20 remove_watcher() i=2 2024-09-19T13:54:53.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.489+0000 7f57ee125800 20 remove_watcher() i=3 2024-09-19T13:54:53.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.489+0000 7f57ee125800 20 remove_watcher() i=4 2024-09-19T13:54:53.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.490+0000 7f57ee125800 20 remove_watcher() i=5 2024-09-19T13:54:53.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.491+0000 7f57ee125800 20 remove_watcher() i=6 2024-09-19T13:54:53.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.492+0000 7f57ee125800 20 remove_watcher() i=7 2024-09-19T13:54:53.504 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.504 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:53.505 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:53.505 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.506 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-19T13:54:53.540 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:53.540 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:53.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.575+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 realm 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:53.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.578+0000 7fce0a61d800 20 searching for the correct realm 2024-09-19T13:54:53.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.580+0000 7fce05deb640 0 -- 172.21.15.94:0/1713781091 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7fce00029040 msgr2=0x7fce0001a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:53.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.784+0000 7fce065ec640 0 -- 172.21.15.94:0/1713781091 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fcdf8056030 msgr2=0x7fcdf80a41d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 zone default found 2024-09-19T13:54:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 4 Realm: () 2024-09-19T13:54:53.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 zonegroup default 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 started sync module instance, tier type = 2024-09-19T13:54:53.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.791+0000 7fce0a61d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=0 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=1 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=2 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=3 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=4 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=5 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=6 2024-09-19T13:54:53.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=7 2024-09-19T13:54:53.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.800+0000 7fce0a61d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:53.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.802+0000 7fccbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.802+0000 7fce0a61d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.802+0000 7fce0a61d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.802+0000 7fce0a61d800 5 note: GC not initialized 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.803+0000 7fccbafe5640 20 reqs_thread_entry: start 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.803+0000 7fce0a61d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.803+0000 7fce0a61d800 20 Filter name: none 2024-09-19T13:54:53.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.803+0000 7fccb8fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:53.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.803+0000 7fce0a61d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T13:54:53.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.803+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : miss 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:53.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.804+0000 7fce0a61d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:54:53.809 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fce0a61d800 time 2024-09-19T13:54:53.809168+0000 2024-09-19T13:54:53.809 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:53.810 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.810 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce0b78c76a] 2024-09-19T13:54:53.810 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.810 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.808+0000 7fce0a61d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fce0a61d800 time 2024-09-19T13:54:53.809168+0000 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce0b78c76a] 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.811 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:54:53.812 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fce0a61d800 thread_name:radosgw-admin 2024-09-19T13:54:53.829 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fce0a43e6f0] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fce0a48b99c] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce0b78c7c4] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:53.830 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.809+0000 7fce0a61d800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fce0a61d800 thread_name:radosgw-admin 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fce0a43e6f0] 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fce0a48b99c] 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce0b78c7c4] 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.831 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:54:53.558+0000 7fccf3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:54:53.558+0000 7fccf3e07640 10 monclient: dump: 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.832 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6588 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.833 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: dump: 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:54:53.559+0000 7fce0a61d800 4 set_mon_vals no callback set 2024-09-19T13:54:53.834 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: shutdown 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 asok(0x5561be995410) unregister_commands rotate-key 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:54:53.559+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.835 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding auth protocol: cephx 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding auth protocol: cephx 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding auth protocol: cephx 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.836 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:54:53.560+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: starting msgr at 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: starting objecter 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 asok(0x5561be995410) register_command objecter_requests hook 0x5561bebbdc50 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: setting wanted keys 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: calling monclient init 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding auth protocol: cephx 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding auth protocol: cephx 2024-09-19T13:54:53.837 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding auth protocol: cephx 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.838 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:54:53.560+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:54:53.560+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key hook 0x5561bebb7758 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bebbdf70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bebe0f30 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x7fcdf40030f0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.217801s 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bebbdf70 auth_method 0 2024-09-19T13:54:53.839 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bebe0f30 auth_method 0 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.840 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x7fcdf40030f0 auth_method 0 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:54:53.561+0000 7fce055ea640 10 monclient(hunting): handle_auth_done global_id 6591 payload 824 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:54:53.561+0000 7fce055ea640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:54:53.561+0000 7fce055ea640 1 monclient: found mon.noname-a 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:54:53.561+0000 7fce055ea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: dump: 2024-09-19T13:54:53.841 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.842 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: dump: 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:54:53.561+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6591 2024-09-19T13:54:53.843 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:54:53.561+0000 7fccf3e07640 4 set_mon_vals no callback set 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:54:53.561+0000 7fce0a61d800 1 librados: init done 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:54:53.563+0000 7fccf2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:54:53.563+0000 7fccf2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:54:53.563+0000 7fccf2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:54:53.563+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fccec0775a0 auth_method 0 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:54:53.563+0000 7fce065ec640 10 monclient: get_auth_request con 0x5561bebe37c0 auth_method 0 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:54:53.564+0000 7fce05deb640 10 monclient: get_auth_request con 0x5561bec03530 auth_method 0 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:54:53.565+0000 7fce055ea640 10 monclient: get_auth_request con 0x5561bec085f0 auth_method 0 2024-09-19T13:54:53.844 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:54:53.566+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:54:53.566+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:54:53.566+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.845 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding auth protocol: cephx 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding auth protocol: cephx 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding auth protocol: cephx 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.846 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:54:53.566+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 asok(0x5561be995410) register_command objecter_requests cmddesc objecter_requests hook 0x5561bec0fb90 EEXIST 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:54:53.566+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding auth protocol: cephx 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding auth protocol: cephx 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding auth protocol: cephx 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.847 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:54:53.567+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:54:53.567+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:54:53.567+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key cmddesc rotate-key hook 0x5561bec0b7c0 EEXIST 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bec33eb0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x5561bec34290 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.848 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bec32bc0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.224445s 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bec33eb0 auth_method 0 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x5561bec32bc0 auth_method 0 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.849 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bec34290 auth_method 0 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.850 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_done global_id 6594 payload 824 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:54:53.567+0000 7fce05deb640 1 monclient: found mon.noname-a 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: dump: 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.851 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.852 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.852 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.852 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.852 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.852 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.852 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: dump: 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.853 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:54:53.568+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6594 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:54:53.568+0000 7fce06ded640 4 set_mon_vals no callback set 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:54:53.570+0000 7fcceb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:54:53.570+0000 7fcceb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:54:53.570+0000 7fcceb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:54:53.570+0000 7fce055ea640 10 monclient: get_auth_request con 0x7fcce0077480 auth_method 0 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: get_monmap_and_config 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.854 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:54:53.570+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding auth protocol: cephx 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding auth protocol: cephx 2024-09-19T13:54:53.855 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding auth protocol: cephx 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.856 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:54:53.570+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding auth protocol: cephx 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding auth protocol: cephx 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding auth protocol: cephx 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.857 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:54:53.571+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:54:53.571+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:54:53.571+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key cmddesc rotate-key hook 0x7ffc878b7ab8 EEXIST 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bec88380 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bec78cd0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x5561bec837b0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.858 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.228443s 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bec88380 auth_method 0 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bec78cd0 auth_method 0 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.859 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x5561bec837b0 auth_method 0 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.860 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_done global_id 6290 payload 274 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:54:53.571+0000 7fce05deb640 1 monclient: found mon.noname-c 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:54:53.571+0000 7fcce97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:54:53.571+0000 7fcce97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:54:53.571+0000 7fcce97fa640 10 monclient: dump: 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: dump: 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6290 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:54:53.572+0000 7fce0a61d800 4 set_mon_vals no callback set 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: shutdown 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.863 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:54:53.572+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding auth protocol: cephx 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding auth protocol: cephx 2024-09-19T13:54:53.864 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding auth protocol: cephx 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:54:53.572+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:54:53.572+0000 7fce0a61d800 1 librados: starting msgr at 2024-09-19T13:54:53.865 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:54:53.572+0000 7fce0a61d800 1 librados: starting objecter 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 asok(0x5561be995410) register_command objecter_requests cmddesc objecter_requests hook 0x5561bec83b90 EEXIST 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:54:53.573+0000 7fce0a61d800 1 librados: setting wanted keys 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:54:53.573+0000 7fce0a61d800 1 librados: calling monclient init 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding auth protocol: cephx 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding auth protocol: cephx 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding auth protocol: cephx 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.866 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:54:53.573+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:54:53.573+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key cmddesc rotate-key hook 0x5561bec488b8 EEXIST 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x5561bec78cd0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bec837b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bec88380 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.867 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.230632s 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bec837b0 auth_method 0 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x5561bec88380 auth_method 0 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bec78cd0 auth_method 0 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.868 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_done global_id 6600 payload 824 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:54:53.573+0000 7fce055ea640 1 monclient: found mon.noname-a 2024-09-19T13:54:53.869 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: dump: 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.870 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: dump: 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:54:53.574+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6600 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:54:53.574+0000 7fcce97fa640 4 set_mon_vals no callback set 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:54:53.574+0000 7fce0a61d800 1 librados: init done 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:54:53.574+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cr dump hook 0x5561bec7b4d8 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:54:53.575+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:54:53.576+0000 7fccd77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:54:53.576+0000 7fccd77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.872 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:54:53.576+0000 7fccd77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:54:53.576+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fccd00775a0 auth_method 0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:54:53.576+0000 7fce065ec640 10 monclient: get_auth_request con 0x5561beca22a0 auth_method 0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 realm 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:54:53.577+0000 7fce0a61d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:54:53.577+0000 7fce05deb640 10 monclient: get_auth_request con 0x5561beca64b0 auth_method 0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.873 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 searching for the correct realm 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:54:53.578+0000 7fce055ea640 10 monclient: get_auth_request con 0x5561becab730 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:54:53.579+0000 7fce065ec640 10 monclient: get_auth_request con 0x7fcdf8056030 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:54:53.579+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fce00029040 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:54:53.580+0000 7fce05deb640 0 -- 172.21.15.94:0/1713781091 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7fce00029040 msgr2=0x7fce0001a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:54:53.781+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fce00029040 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:54:53.781+0000 7fce055ea640 10 monclient: get_auth_request con 0x7fcdf0070150 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:54:53.783+0000 7fce065ec640 10 monclient: get_auth_request con 0x7fcdf80c8630 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:54:53.784+0000 7fce065ec640 0 -- 172.21.15.94:0/1713781091 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fcdf8056030 msgr2=0x7fcdf80a41d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:54:53.784+0000 7fccd77fe640 1 client.6600.objecter ms_handle_reset 0x7fcdf8056030 session 0x7fcdf80c3070 osd.7 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:54:53.784+0000 7fccd77fe640 10 monclient: _renew_subs 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:54:53.784+0000 7fccd77fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:54:53.785+0000 7fce065ec640 10 monclient: get_auth_request con 0x7fccd00873c0 auth_method 0 2024-09-19T13:54:53.874 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:54:53.785+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fcdf8069ba0 auth_method 0 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 zone default found 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:54:53.791+0000 7fce0a61d800 4 Realm: () 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:54:53.791+0000 7fce0a61d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:53.875 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:54:53.791+0000 7fce0a61d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:54:53.791+0000 7fce0a61d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 zonegroup default 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 started sync module instance, tier type = 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=0 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=1 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=2 2024-09-19T13:54:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=3 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=4 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=5 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=6 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=7 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:54:53.800+0000 7fce0a61d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding auth protocol: cephx 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding auth protocol: cephx 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding auth protocol: cephx 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:54:53.802+0000 7fccbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:54:53.802+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:54:53.802+0000 7fce0a61d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:54:53.802+0000 7fce0a61d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache list hook 0x5561bec7dc70 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache inspect hook 0x5561bec7dc70 2024-09-19T13:54:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache erase hook 0x5561bec7dc70 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache zap hook 0x5561bec7dc70 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 note: GC not initialized 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:54:53.803+0000 7fccbafe5640 20 reqs_thread_entry: start 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace show hook 0x7fcdf0047020 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace history hook 0x7fcdf0047020 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace active hook 0x7fcdf0047020 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace active_short hook 0x7fcdf0047020 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:54:53.803+0000 7fce0a61d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:54:53.803+0000 7fce0a61d800 20 Filter name: none 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:54:53.803+0000 7fccb8fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:54:53.803+0000 7fce0a61d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:54:53.803+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.879 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : miss 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:54:53.808+0000 7fce0a61d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fce0a61d800 time 2024-09-19T13:54:53.809168+0000 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:53.880 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce0b78c76a] 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:54:53.809+0000 7fce0a61d800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:54:53.881 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fce0a61d800 thread_name:radosgw-admin 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fce0a43e6f0] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fce0a48b99c] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce0b78c7c4] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:53.882 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:54:53.883 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:54:53.884 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:54:53.885 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:54:53.886 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:54:53.887 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:54:53.888 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:54:53.889 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccb8fe1640 / http_manager 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccbafe5640 / http_manager 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccbbfe7640 / rgw_dt_lg_renew 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccd77fe640 / ms_dispatch 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 7fcce97fa640 / io_context_pool 2024-09-19T13:54:53.890 INFO:tasks.workunit.client.0.smithi094.stderr: 7fcceb7fe640 / ms_dispatch 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccf2604640 / ms_dispatch 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccf3e07640 / io_context_pool 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce055ea640 / msgr-worker-2 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce05deb640 / msgr-worker-1 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce065ec640 / msgr-worker-0 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce06ded640 / io_context_pool 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce0a61d800 / radosgw-admin 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:54:53.891 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.98485.log 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:54:53.558+0000 7fccf3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:54:53.558+0000 7fccf3e07640 10 monclient: dump: 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.892 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6588 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:54:53.559+0000 7fccf3e07640 10 monclient: dump: 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.893 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:54:53.559+0000 7fce0a61d800 4 set_mon_vals no callback set 2024-09-19T13:54:53.894 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: shutdown 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 asok(0x5561be995410) unregister_commands rotate-key 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:54:53.559+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:54:53.559+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.895 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding auth protocol: cephx 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding auth protocol: cephx 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding auth protocol: cephx 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.896 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: crc 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:54:53.559+0000 7fce0a61d800 5 AuthRegistry(0x5561bebbce70) adding con mode: secure 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:54:53.560+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: starting msgr at 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: starting objecter 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 asok(0x5561be995410) register_command objecter_requests hook 0x5561bebbdc50 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: setting wanted keys 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:54:53.560+0000 7fce0a61d800 1 librados: calling monclient init 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding auth protocol: cephx 2024-09-19T13:54:53.897 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding auth protocol: cephx 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding auth protocol: cephx 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: crc 2024-09-19T13:54:53.898 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 AuthRegistry(0x5561bebb7610) adding con mode: secure 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:54:53.560+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:54:53.560+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:54:53.560+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key hook 0x5561bebb7758 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bebbdf70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bebe0f30 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x7fcdf40030f0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:54:53.560+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.217801s 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bebbdf70 auth_method 0 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bebe0f30 auth_method 0 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:54:53.560+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:54:53.560+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x7fcdf40030f0 auth_method 0 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:54:53.561+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:54:53.561+0000 7fce055ea640 10 monclient(hunting): handle_auth_done global_id 6591 payload 824 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:54:53.561+0000 7fce055ea640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:54:53.561+0000 7fce055ea640 1 monclient: found mon.noname-a 2024-09-19T13:54:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:54:53.561+0000 7fce055ea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: dump: 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:54:53.561+0000 7fccf2604640 10 monclient: dump: 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:54:53.561+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6591 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:54:53.561+0000 7fccf3e07640 4 set_mon_vals no callback set 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:54:53.561+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:54:53.561+0000 7fce0a61d800 1 librados: init done 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:54:53.563+0000 7fccf2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:54:53.563+0000 7fccf2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:54:53.563+0000 7fccf2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:54:53.563+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fccec0775a0 auth_method 0 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:54:53.563+0000 7fce065ec640 10 monclient: get_auth_request con 0x5561bebe37c0 auth_method 0 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:54:53.564+0000 7fce05deb640 10 monclient: get_auth_request con 0x5561bec03530 auth_method 0 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:54:53.565+0000 7fce055ea640 10 monclient: get_auth_request con 0x5561bec085f0 auth_method 0 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:54:53.566+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:54:53.566+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:54:53.566+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.905 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding auth protocol: cephx 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding auth protocol: cephx 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding auth protocol: cephx 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: crc 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0c6c0) adding con mode: secure 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:54:53.566+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 asok(0x5561be995410) register_command objecter_requests cmddesc objecter_requests hook 0x5561bec0fb90 EEXIST 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:54:53.566+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding auth protocol: cephx 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding auth protocol: cephx 2024-09-19T13:54:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding auth protocol: cephx 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: crc 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:54:53.566+0000 7fce0a61d800 5 AuthRegistry(0x5561bec0b678) adding con mode: secure 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:54:53.567+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:54:53.567+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:54:53.567+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key cmddesc rotate-key hook 0x5561bec0b7c0 EEXIST 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bec33eb0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x5561bec34290 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bec32bc0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:54:53.567+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.224445s 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bec33eb0 auth_method 0 2024-09-19T13:54:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x5561bec32bc0 auth_method 0 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bec34290 auth_method 0 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:54:53.567+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:54:53.567+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient(hunting): handle_auth_done global_id 6594 payload 824 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:54:53.567+0000 7fce05deb640 1 monclient: found mon.noname-a 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:54:53.567+0000 7fce05deb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: dump: 2024-09-19T13:54:53.911 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:54:53.568+0000 7fcceb7fe640 10 monclient: dump: 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:54:53.568+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6594 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:54:53.568+0000 7fce06ded640 4 set_mon_vals no callback set 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:54:53.568+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:54:53.570+0000 7fcceb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:54:53.570+0000 7fcceb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:54:53.570+0000 7fcceb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:54:53.570+0000 7fce055ea640 10 monclient: get_auth_request con 0x7fcce0077480 auth_method 0 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: get_monmap_and_config 2024-09-19T13:54:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:54:53.570+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding auth protocol: cephx 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding auth protocol: cephx 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding auth protocol: cephx 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: crc 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x5561bec53d60) adding con mode: secure 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:54:53.570+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:54:53.570+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding auth protocol: cephx 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding auth protocol: cephx 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding auth protocol: cephx 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: crc 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:54:53.570+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7970) adding con mode: secure 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:54:53.571+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:54:53.571+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:54:53.571+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key cmddesc rotate-key hook 0x7ffc878b7ab8 EEXIST 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bec88380 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bec78cd0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x5561bec837b0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:54:53.571+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.228443s 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bec88380 auth_method 0 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bec78cd0 auth_method 0 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x5561bec837b0 auth_method 0 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:54:53.571+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:54:53.571+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient(hunting): handle_auth_done global_id 6290 payload 274 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:54:53.571+0000 7fce05deb640 1 monclient: found mon.noname-c 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:54:53.571+0000 7fce05deb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:54:53.571+0000 7fcce97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:54:53.571+0000 7fcce97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:54:53.571+0000 7fcce97fa640 10 monclient: dump: 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:54:53.572+0000 7fcce97fa640 10 monclient: dump: 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.922 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6290 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: get_monmap_and_config success 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:54:53.572+0000 7fce0a61d800 4 set_mon_vals no callback set 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: shutdown 2024-09-19T13:54:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: build_initial_monmap 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:54:53.572+0000 7fce0a61d800 1 build_initial for_mkfs: 0 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:54:53.572+0000 7fce0a61d800 10 monclient: monmap: 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding auth protocol: cephx 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding auth protocol: cephx 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding auth protocol: cephx 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: crc 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:54:53.572+0000 7fce0a61d800 5 AuthRegistry(0x5561bec578e0) adding con mode: secure 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:54:53.572+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:54:53.572+0000 7fce0a61d800 1 librados: starting msgr at 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:54:53.572+0000 7fce0a61d800 1 librados: starting objecter 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 asok(0x5561be995410) register_command objecter_requests cmddesc objecter_requests hook 0x5561bec83b90 EEXIST 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:54:53.573+0000 7fce0a61d800 1 librados: setting wanted keys 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:54:53.573+0000 7fce0a61d800 1 librados: calling monclient init 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient: init 2024-09-19T13:54:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding auth protocol: cephx 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding auth protocol: cephx 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding auth protocol: cephx 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: crc 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 AuthRegistry(0x5561bec48770) adding con mode: secure 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:54:53.573+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:54:53.573+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:54:53.573+0000 7fce0a61d800 5 asok(0x5561be995410) register_command rotate-key cmddesc rotate-key hook 0x5561bec488b8 EEXIST 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient: _reopen_session rank -1 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-b con 0x5561bec78cd0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-a con 0x5561bec837b0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): picked mon.noname-c con 0x5561bec88380 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:54:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): _renew_subs 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:54:53.573+0000 7fce0a61d800 10 monclient(hunting): authenticate will time out at 1907.230632s 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): get_auth_request con 0x5561bec837b0 auth_method 0 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): get_auth_request con 0x5561bec88380 auth_method 0 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): get_auth_request con 0x5561bec78cd0 auth_method 0 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:54:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:54:53.573+0000 7fce065ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:54:53.573+0000 7fce05deb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient(hunting): handle_auth_done global_id 6600 payload 824 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient: _finish_hunting 0 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:54:53.573+0000 7fce055ea640 1 monclient: found mon.noname-a 2024-09-19T13:54:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:54:53.573+0000 7fce055ea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: dump: 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: _finish_auth 0 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: _check_auth_tickets 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:54:53.574+0000 7fccd77fe640 10 monclient: dump: 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:54:53.932 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:54:53.574+0000 7fce0a61d800 5 monclient: authenticate success, global_id 6600 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:54:53.574+0000 7fcce97fa640 4 set_mon_vals no callback set 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _renew_subs 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:54:53.574+0000 7fce0a61d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:54:53.574+0000 7fce0a61d800 1 librados: init done 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:54:53.574+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cr dump hook 0x5561bec7b4d8 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:54:53.575+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:54:53.576+0000 7fccd77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:54:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:54:53.576+0000 7fccd77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:54:53.576+0000 7fccd77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:54:53.576+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fccd00775a0 auth_method 0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:54:53.576+0000 7fce065ec640 10 monclient: get_auth_request con 0x5561beca22a0 auth_method 0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 realm 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:54:53.577+0000 7fce0a61d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:54:53.577+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:54:53.577+0000 7fce05deb640 10 monclient: get_auth_request con 0x5561beca64b0 auth_method 0 2024-09-19T13:54:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:54:53.578+0000 7fce0a61d800 20 searching for the correct realm 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:54:53.578+0000 7fce055ea640 10 monclient: get_auth_request con 0x5561becab730 auth_method 0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:54:53.579+0000 7fce065ec640 10 monclient: get_auth_request con 0x7fcdf8056030 auth_method 0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:54:53.579+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fce00029040 auth_method 0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:54:53.580+0000 7fce05deb640 0 -- 172.21.15.94:0/1713781091 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7fce00029040 msgr2=0x7fce0001a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:54:53.781+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fce00029040 auth_method 0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:54:53.781+0000 7fce055ea640 10 monclient: get_auth_request con 0x7fcdf0070150 auth_method 0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:54:53.783+0000 7fce065ec640 10 monclient: get_auth_request con 0x7fcdf80c8630 auth_method 0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:54:53.784+0000 7fce065ec640 0 -- 172.21.15.94:0/1713781091 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fcdf8056030 msgr2=0x7fcdf80a41d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:54:53.784+0000 7fccd77fe640 1 client.6600.objecter ms_handle_reset 0x7fcdf8056030 session 0x7fcdf80c3070 osd.7 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:54:53.784+0000 7fccd77fe640 10 monclient: _renew_subs 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:54:53.784+0000 7fccd77fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:54:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:54:53.785+0000 7fce065ec640 10 monclient: get_auth_request con 0x7fccd00873c0 auth_method 0 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:54:53.785+0000 7fce05deb640 10 monclient: get_auth_request con 0x7fcdf8069ba0 auth_method 0 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:54:53.790+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 zone default found 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:54:53.791+0000 7fce0a61d800 4 Realm: () 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:54:53.791+0000 7fce0a61d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:54:53.791+0000 7fce0a61d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:54:53.791+0000 7fce0a61d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 zonegroup default 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 started sync module instance, tier type = 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:54:53.791+0000 7fce0a61d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=0 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=1 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=2 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=3 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=4 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=5 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=6 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:54:53.800+0000 7fce0a61d800 20 add_watcher() i=7 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:54:53.800+0000 7fce0a61d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding auth protocol: cephx 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding auth protocol: cephx 2024-09-19T13:54:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding auth protocol: cephx 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:54:53.802+0000 7fccbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: crc 2024-09-19T13:54:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 AuthRegistry(0x7ffc878b7e40) adding con mode: secure 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:54:53.802+0000 7fce0a61d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:54:53.802+0000 7fce0a61d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:54:53.802+0000 7fce0a61d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache list hook 0x5561bec7dc70 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache inspect hook 0x5561bec7dc70 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache erase hook 0x5561bec7dc70 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 asok(0x5561be995410) register_command cache zap hook 0x5561bec7dc70 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:54:53.802+0000 7fce0a61d800 5 note: GC not initialized 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:54:53.803+0000 7fccbafe5640 20 reqs_thread_entry: start 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace show hook 0x7fcdf0047020 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace history hook 0x7fcdf0047020 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace active hook 0x7fcdf0047020 2024-09-19T13:54:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:54:53.803+0000 7fce0a61d800 5 asok(0x5561be995410) register_command sync trace active_short hook 0x7fcdf0047020 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:54:53.803+0000 7fce0a61d800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:54:53.803+0000 7fce0a61d800 20 Filter name: none 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:54:53.803+0000 7fccb8fe1640 20 reqs_thread_entry: start 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:54:53.803+0000 7fce0a61d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:54:53.803+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : miss 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:54:53.804+0000 7fce0a61d800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:54:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:54:53.804+0000 7fce0a61d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:54:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:54:53.808+0000 7fce0a61d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fce0a61d800 time 2024-09-19T13:54:53.809168+0000 2024-09-19T13:54:53.942 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:54:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fce0b78c76a] 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:54:53.809+0000 7fce0a61d800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fce0a61d800 thread_name:radosgw-admin 2024-09-19T13:54:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fce0a43e6f0] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fce0a48b99c] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fce0b78c7c4] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fce0b78c928] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561bcd3e791] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd740a8) [0x5561bd24c0a8] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5561bcd4e43d] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fce0a429590] 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:54:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:54:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:54:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:54:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:54:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:54:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:54:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:54:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccb8fe1640 / http_manager 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccbafe5640 / http_manager 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccbbfe7640 / rgw_dt_lg_renew 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccd77fe640 / ms_dispatch 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fcce97fa640 / io_context_pool 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fcceb7fe640 / ms_dispatch 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccf2604640 / ms_dispatch 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fccf3e07640 / io_context_pool 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce055ea640 / msgr-worker-2 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce05deb640 / msgr-worker-1 2024-09-19T13:54:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce065ec640 / msgr-worker-0 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce06ded640 / io_context_pool 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 7fce0a61d800 / radosgw-admin 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:54:53.810825Z_1a35b0c2-37ee-4462-9c76-0112df3c0742/log 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:54:53.954 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.883+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 realm 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.885+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.886+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.886+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.886+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.886+0000 7fb3f6b2c800 20 searching for the correct realm 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.889+0000 7fb3ea04e640 0 -- 172.21.15.94:0/977709737 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x561776ea4970 msgr2=0x561776ea6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.893+0000 7fb3f284f640 0 -- 172.21.15.94:0/977709737 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fb3dc0720b0 msgr2=0x7fb3dc086780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:53.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.896+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 zone default found 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 4 Realm: () 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:53.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 zonegroup default 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.897+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.898+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.898+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.898+0000 7fb3f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.898+0000 7fb3f6b2c800 20 started sync module instance, tier type = 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.898+0000 7fb3f6b2c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=0 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=1 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=2 2024-09-19T13:54:53.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=3 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=4 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=5 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=6 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 20 add_watcher() i=7 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.907+0000 7fb3f6b2c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.909+0000 7fb2a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.909+0000 7fb3f6b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.909+0000 7fb3f6b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.909+0000 7fb3f6b2c800 5 note: GC not initialized 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.909+0000 7fb223fff640 20 reqs_thread_entry: start 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.910+0000 7fb3f6b2c800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.910+0000 7fb3f6b2c800 20 Filter name: none 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.910+0000 7fb221ffb640 20 reqs_thread_entry: start 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.910+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.910+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.910+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.911+0000 7fb3f6b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.913+0000 7fb2a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.915+0000 7fb3f6b2c800 20 remove_watcher() i=0 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.915+0000 7fb3f6b2c800 2 removed watcher, disabling cache 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.916+0000 7fb3f6b2c800 20 remove_watcher() i=1 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.917+0000 7fb3f6b2c800 20 remove_watcher() i=2 2024-09-19T13:54:53.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.918+0000 7fb3f6b2c800 20 remove_watcher() i=3 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.919+0000 7fb3f6b2c800 20 remove_watcher() i=4 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.920+0000 7fb3f6b2c800 20 remove_watcher() i=5 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.921+0000 7fb3f6b2c800 20 remove_watcher() i=6 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:53.922+0000 7fb3f6b2c800 20 remove_watcher() i=7 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:54:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:54:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:54:54.017 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:54.017 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:54.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.051+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.052+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.052+0000 7fe514a16800 20 realm 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.052+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.053+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.053+0000 7fe514a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.053+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.053+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.053+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.054+0000 7fe514a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:54.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.054+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.054+0000 7fe514a16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:54:54.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.054+0000 7fe514a16800 20 searching for the correct realm 2024-09-19T13:54:54.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.057+0000 7fe5109e8640 0 -- 172.21.15.94:0/2557715102 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fe4f804d040 msgr2=0x7fe4f8026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:54.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.060+0000 7fe5101e7640 0 -- 172.21.15.94:0/2557715102 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe4f8027040 msgr2=0x7fe4f804c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.266+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 zone default found 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 4 Realm: () 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 zonegroup default 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.267+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.268+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.268+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.268+0000 7fe514a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:54:54.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.268+0000 7fe514a16800 20 started sync module instance, tier type = 2024-09-19T13:54:54.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.268+0000 7fe514a16800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:54:54.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=0 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=1 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=2 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=3 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=4 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=5 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.277+0000 7fe514a16800 20 add_watcher() i=6 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.278+0000 7fe514a16800 20 add_watcher() i=7 2024-09-19T13:54:54.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.278+0000 7fe514a16800 2 all 8 watchers are set, enabling cache 2024-09-19T13:54:54.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe3c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:54.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe514a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:54:54.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe514a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:54:54.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe514a16800 5 note: GC not initialized 2024-09-19T13:54:54.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe3c5fdb640 20 reqs_thread_entry: start 2024-09-19T13:54:54.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe514a16800 20 init_complete bucket index max shards: 11 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.280+0000 7fe514a16800 20 Filter name: none 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe3377fe640 20 reqs_thread_entry: start 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : miss 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 20 rados->read ofs=0 len=0 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:54:54.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:54:54.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.281+0000 7fe514a16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:54:54.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.283+0000 7fe514a16800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to be held by another RGW process; skipping for now 2024-09-19T13:54:54.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.283+0000 7fe3c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:54:54.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.285+0000 7fe514a16800 20 remove_watcher() i=0 2024-09-19T13:54:54.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.285+0000 7fe514a16800 2 removed watcher, disabling cache 2024-09-19T13:54:54.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.286+0000 7fe514a16800 20 remove_watcher() i=1 2024-09-19T13:54:54.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.287+0000 7fe514a16800 20 remove_watcher() i=2 2024-09-19T13:54:54.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.288+0000 7fe514a16800 20 remove_watcher() i=3 2024-09-19T13:54:54.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.289+0000 7fe514a16800 20 remove_watcher() i=4 2024-09-19T13:54:54.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.290+0000 7fe514a16800 20 remove_watcher() i=5 2024-09-19T13:54:54.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.291+0000 7fe514a16800 20 remove_watcher() i=6 2024-09-19T13:54:54.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:54:54.292+0000 7fe514a16800 20 remove_watcher() i=7 2024-09-19T13:54:54.304 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:55:24.319 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:55:24.355 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:24.355 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:24.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.395+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 realm 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.397+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.398+0000 7fc62da63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:24.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.398+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.398+0000 7fc62da63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:24.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.398+0000 7fc62da63800 20 searching for the correct realm 2024-09-19T13:55:24.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.400+0000 7fc62b554640 0 -- 172.21.15.94:0/1752414115 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x55aeeee35b00 msgr2=0x7fc624060920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:24.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.606+0000 7fc62bd55640 0 -- 172.21.15.94:0/1752414115 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fc61406f0e0 msgr2=0x7fc6140670c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:24.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:24.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:24.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.612+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 zone default found 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 4 Realm: () 2024-09-19T13:55:24.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:24.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:24.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:24.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 zonegroup default 2024-09-19T13:55:24.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.613+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 started sync module instance, tier type = 2024-09-19T13:55:24.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.614+0000 7fc62da63800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=0 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=1 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=2 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=3 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=4 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=5 2024-09-19T13:55:24.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.624+0000 7fc62da63800 20 add_watcher() i=6 2024-09-19T13:55:24.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.625+0000 7fc62da63800 20 add_watcher() i=7 2024-09-19T13:55:24.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.625+0000 7fc62da63800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.627+0000 7fc4e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.627+0000 7fc62da63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.627+0000 7fc62da63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.627+0000 7fc62da63800 5 note: GC not initialized 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.628+0000 7fc4e0fe1640 20 reqs_thread_entry: start 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.628+0000 7fc62da63800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.628+0000 7fc62da63800 20 Filter name: none 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.628+0000 7fc45a7fc640 20 reqs_thread_entry: start 2024-09-19T13:55:24.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.628+0000 7fc62da63800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T13:55:24.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.628+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : miss 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.629+0000 7fc62da63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:55:24.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.634+0000 7fc62da63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.634+0000 7fc62da63800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.634+0000 7fc62da63800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.634+0000 7fc62da63800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25, ofs0, ns] 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.634+0000 7fc50e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595145 cookie 94209822959232 notifier 6341 bl.length()=1009 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc50e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc50e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc50e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): orig_sources= new_sources= 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): potential sources added=[] removed=[] 2024-09-19T13:55:24.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): orig_dests= new_dests= 2024-09-19T13:55:24.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.635+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): potential dests added=[] removed=[] 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.639+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.0 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.0 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.1 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.1 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.2 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.2 2024-09-19T13:55:24.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.3 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.3 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.4 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.4 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.5 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.5 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.6 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.6 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.7 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.7 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.8 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.8 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.9 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.9 2024-09-19T13:55:24.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.10 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.10 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.11 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1.11 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.0 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.640+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.641+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.2 2024-09-19T13:55:24.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.641+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.3 2024-09-19T13:55:24.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.643+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.4 2024-09-19T13:55:24.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.643+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.5 2024-09-19T13:55:24.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.644+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.6 2024-09-19T13:55:24.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.644+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.7 2024-09-19T13:55:24.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.645+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.8 2024-09-19T13:55:24.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.645+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.9 2024-09-19T13:55:24.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.646+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.10 2024-09-19T13:55:24.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.649+0000 7fc62da63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:24.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.649+0000 7fc62da63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:55:24.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc62da63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc62da63800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc62da63800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc62da63800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25, ofs0, ns] 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc50e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595146 cookie 94209822959232 notifier 6341 bl.length()=1009 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc50e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc50e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.650+0000 7fc50e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.651+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): orig_sources= new_sources= 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.651+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): potential sources added=[] removed=[] 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.651+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): orig_dests= new_dests= 2024-09-19T13:55:24.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.651+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): potential dests added=[] removed=[] 2024-09-19T13:55:24.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.653+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.0 2024-09-19T13:55:24.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.653+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.1 2024-09-19T13:55:24.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.654+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.2 2024-09-19T13:55:24.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.654+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.3 2024-09-19T13:55:24.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.654+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.4 2024-09-19T13:55:24.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.655+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.5 2024-09-19T13:55:24.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.655+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.6 2024-09-19T13:55:24.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.655+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.7 2024-09-19T13:55:24.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.655+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.8 2024-09-19T13:55:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.656+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.9 2024-09-19T13:55:24.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.656+0000 7fc62da63800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25.10 2024-09-19T13:55:24.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.657+0000 7fc62da63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:24.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.657+0000 7fc62da63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 2024-09-19T13:55:24.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc62da63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc62da63800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc62da63800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc62da63800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25, ofs0, ns] 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc50e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595147 cookie 94209822959232 notifier 6341 bl.length()=977 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc50e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 info.flags=0x17 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc50e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 to cache LRU end 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.658+0000 7fc50e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.659+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): orig_sources= new_sources= 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.659+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): potential sources added=[] removed=[] 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.659+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): orig_dests= new_dests= 2024-09-19T13:55:24.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.659+0000 7fc62da63800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25]): potential dests added=[] removed=[] 2024-09-19T13:55:24.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.661+0000 7fc62da63800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T13:55:24.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.662+0000 7fc4e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:24.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.665+0000 7fc62da63800 20 remove_watcher() i=0 2024-09-19T13:55:24.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.665+0000 7fc62da63800 2 removed watcher, disabling cache 2024-09-19T13:55:24.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.666+0000 7fc62da63800 20 remove_watcher() i=1 2024-09-19T13:55:24.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.667+0000 7fc62da63800 20 remove_watcher() i=2 2024-09-19T13:55:24.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.668+0000 7fc62da63800 20 remove_watcher() i=3 2024-09-19T13:55:24.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.669+0000 7fc62da63800 20 remove_watcher() i=4 2024-09-19T13:55:24.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.670+0000 7fc62da63800 20 remove_watcher() i=5 2024-09-19T13:55:24.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.671+0000 7fc62da63800 20 remove_watcher() i=6 2024-09-19T13:55:24.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.672+0000 7fc62da63800 20 remove_watcher() i=7 2024-09-19T13:55:24.686 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T13:55:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:24.715 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:24.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.749+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 realm 2024-09-19T13:55:24.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:24.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.751+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.752+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:24.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.752+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.752+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:24.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.752+0000 7efd5a739800 20 searching for the correct realm 2024-09-19T13:55:24.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.755+0000 7efd4dbc6640 0 -- 172.21.15.94:0/2928501700 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7efd4807f040 msgr2=0x7efd4806ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:24.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.759+0000 7efd563c7640 0 -- 172.21.15.94:0/2928501700 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7efd4001d400 msgr2=0x7efd4001d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:24.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:24.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:24.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:24.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:24.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:24.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:24.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:24.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.965+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:24.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 zone default found 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 4 Realm: () 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 zonegroup default 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.966+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.967+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.967+0000 7efd5a739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.967+0000 7efd5a739800 20 started sync module instance, tier type = 2024-09-19T13:55:24.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.967+0000 7efd5a739800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=0 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=1 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=2 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=3 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=4 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=5 2024-09-19T13:55:24.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.976+0000 7efd5a739800 20 add_watcher() i=6 2024-09-19T13:55:24.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.977+0000 7efd5a739800 20 add_watcher() i=7 2024-09-19T13:55:24.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.977+0000 7efd5a739800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:24.980 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.978+0000 7efc0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:24.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efd5a739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:24.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efd5a739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:24.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efd5a739800 5 note: GC not initialized 2024-09-19T13:55:24.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efc077fe640 20 reqs_thread_entry: start 2024-09-19T13:55:24.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efd5a739800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:24.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efd5a739800 20 Filter name: none 2024-09-19T13:55:24.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efc057fa640 20 reqs_thread_entry: start 2024-09-19T13:55:24.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.979+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.980+0000 7efd5a739800 20 rados->read ofs=0 len=0 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.981+0000 7efd5a739800 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T13:55:24.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.981+0000 7efd5a739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:24.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.982+0000 7efc0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:24.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.985+0000 7efd5a739800 20 remove_watcher() i=0 2024-09-19T13:55:24.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.985+0000 7efd5a739800 2 removed watcher, disabling cache 2024-09-19T13:55:24.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.986+0000 7efd5a739800 20 remove_watcher() i=1 2024-09-19T13:55:24.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.987+0000 7efd5a739800 20 remove_watcher() i=2 2024-09-19T13:55:24.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.988+0000 7efd5a739800 20 remove_watcher() i=3 2024-09-19T13:55:24.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.989+0000 7efd5a739800 20 remove_watcher() i=4 2024-09-19T13:55:24.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.990+0000 7efd5a739800 20 remove_watcher() i=5 2024-09-19T13:55:24.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.990+0000 7efd5a739800 20 remove_watcher() i=6 2024-09-19T13:55:24.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:24.991+0000 7efd5a739800 20 remove_watcher() i=7 2024-09-19T13:55:25.004 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.004 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:25.004 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-set-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:55:25.004 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.081 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-19T13:55:25.081 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.257 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T13:55:25.286 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:25.286 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:25.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.320+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 realm 2024-09-19T13:55:25.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:25.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.322+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.323+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.323+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.323+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:25.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.323+0000 7f5b1653d800 20 searching for the correct realm 2024-09-19T13:55:25.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.326+0000 7f5b12a2b640 0 -- 172.21.15.94:0/3910433165 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x562650f31e90 msgr2=0x562650f34280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.330+0000 7f5b11a29640 0 -- 172.21.15.94:0/3910433165 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f5b0404e070 msgr2=0x7f5b0404ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.333+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 zone default found 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 4 Realm: () 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 zonegroup default 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.334+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.335+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.335+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.335+0000 7f5b1653d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.335+0000 7f5b1653d800 20 started sync module instance, tier type = 2024-09-19T13:55:25.339 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.335+0000 7f5b1653d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=0 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=1 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=2 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=3 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=4 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=5 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.344+0000 7f5b1653d800 20 add_watcher() i=6 2024-09-19T13:55:25.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.345+0000 7f5b1653d800 20 add_watcher() i=7 2024-09-19T13:55:25.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.345+0000 7f5b1653d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:25.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.346+0000 7f59c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.346+0000 7f5b1653d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.346+0000 7f5b1653d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.347+0000 7f5b1653d800 5 note: GC not initialized 2024-09-19T13:55:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.347+0000 7f59437fe640 20 reqs_thread_entry: start 2024-09-19T13:55:25.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.347+0000 7f5b1653d800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:25.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.347+0000 7f5b1653d800 20 Filter name: none 2024-09-19T13:55:25.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.347+0000 7f59417fa640 20 reqs_thread_entry: start 2024-09-19T13:55:25.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.347+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.348+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.348+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.348+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.348+0000 7f5b1653d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.348+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.349+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.349+0000 7f5b1653d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.349+0000 7f5b1653d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:25.352 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.349+0000 7f5b1653d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:25.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.351+0000 7f59c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.353+0000 7f5b1653d800 20 remove_watcher() i=0 2024-09-19T13:55:25.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.353+0000 7f5b1653d800 2 removed watcher, disabling cache 2024-09-19T13:55:25.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.354+0000 7f5b1653d800 20 remove_watcher() i=1 2024-09-19T13:55:25.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.355+0000 7f5b1653d800 20 remove_watcher() i=2 2024-09-19T13:55:25.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.356+0000 7f5b1653d800 20 remove_watcher() i=3 2024-09-19T13:55:25.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.357+0000 7f5b1653d800 20 remove_watcher() i=4 2024-09-19T13:55:25.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.358+0000 7f5b1653d800 20 remove_watcher() i=5 2024-09-19T13:55:25.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.359+0000 7f5b1653d800 20 remove_watcher() i=6 2024-09-19T13:55:25.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.360+0000 7f5b1653d800 20 remove_watcher() i=7 2024-09-19T13:55:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.372 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:25.372 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:25.372 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.374 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-19T13:55:25.409 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:25.409 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:25.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.442+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 realm 2024-09-19T13:55:25.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:25.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.444+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.445+0000 7fa600e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.445+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.445+0000 7fa600e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:25.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.445+0000 7fa600e20800 20 searching for the correct realm 2024-09-19T13:55:25.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.448+0000 7fa5ff10b640 0 -- 172.21.15.94:0/3203248821 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x563a7cf59070 msgr2=0x563a7cf5b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.451+0000 7fa5fe90a640 0 -- 172.21.15.94:0/3203248821 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa5e80203e0 msgr2=0x7fa5e8020860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:25.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:25.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:25.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:25.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:25.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:25.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.455+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:25.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 zone default found 2024-09-19T13:55:25.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 4 Realm: () 2024-09-19T13:55:25.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 zonegroup default 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.456+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.457+0000 7fa600e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.457+0000 7fa600e20800 20 started sync module instance, tier type = 2024-09-19T13:55:25.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.457+0000 7fa600e20800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=0 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=1 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=2 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=3 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=4 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=5 2024-09-19T13:55:25.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=6 2024-09-19T13:55:25.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 20 add_watcher() i=7 2024-09-19T13:55:25.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.465+0000 7fa600e20800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:25.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.467+0000 7fa4b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.467+0000 7fa600e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.467+0000 7fa600e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.467+0000 7fa600e20800 5 note: GC not initialized 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.467+0000 7fa42ffff640 20 reqs_thread_entry: start 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 20 Filter name: none 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa42dffb640 20 reqs_thread_entry: start 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T13:55:25.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:25.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:25.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:25.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 : miss 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.468+0000 7fa600e20800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.469+0000 7fa600e20800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.469+0000 7fa600e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.469+0000 7fa600e20800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.469+0000 7fa600e20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.469+0000 7fa600e20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.469+0000 7fa600e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.473+0000 7fa600e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.473+0000 7fa600e20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.473+0000 7fa600e20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.473+0000 7fa600e20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26, ofs0, ns] 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa4e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595101 cookie 94809204612096 notifier 6389 bl.length()=1023 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa4e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa4e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa4e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa600e20800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_sources= new_sources= 2024-09-19T13:55:25.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa600e20800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential sources added=[] removed=[] 2024-09-19T13:55:25.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa600e20800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_dests= new_dests= 2024-09-19T13:55:25.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa600e20800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential dests added=[] removed=[] 2024-09-19T13:55:25.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa600e20800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-19T13:55:25.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.474+0000 7fa600e20800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-19T13:55:25.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.476+0000 7fa4b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.478+0000 7fa600e20800 20 remove_watcher() i=0 2024-09-19T13:55:25.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.478+0000 7fa600e20800 2 removed watcher, disabling cache 2024-09-19T13:55:25.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.479+0000 7fa600e20800 20 remove_watcher() i=1 2024-09-19T13:55:25.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.480+0000 7fa600e20800 20 remove_watcher() i=2 2024-09-19T13:55:25.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.481+0000 7fa600e20800 20 remove_watcher() i=3 2024-09-19T13:55:25.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.482+0000 7fa600e20800 20 remove_watcher() i=4 2024-09-19T13:55:25.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.483+0000 7fa600e20800 20 remove_watcher() i=5 2024-09-19T13:55:25.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.484+0000 7fa600e20800 20 remove_watcher() i=6 2024-09-19T13:55:25.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.485+0000 7fa600e20800 20 remove_watcher() i=7 2024-09-19T13:55:25.498 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T13:55:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:25.527 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:25.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.561+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 realm 2024-09-19T13:55:25.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:25.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.563+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.564+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.564+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.564+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:25.567 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.564+0000 7f604292e800 20 searching for the correct realm 2024-09-19T13:55:25.570 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.568+0000 7f603eede640 0 -- 172.21.15.94:0/2404069755 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f602806ab40 msgr2=0x7f6028060310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.571+0000 7f603e6dd640 0 -- 172.21.15.94:0/2404069755 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6028015760 msgr2=0x7f602805fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.777+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 zone default found 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 4 Realm: () 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 zonegroup default 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.778+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.779+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.779+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.779+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.779+0000 7f604292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.779+0000 7f604292e800 20 started sync module instance, tier type = 2024-09-19T13:55:25.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.779+0000 7f604292e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=0 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=1 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=2 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=3 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=4 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=5 2024-09-19T13:55:25.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=6 2024-09-19T13:55:25.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.788+0000 7f604292e800 20 add_watcher() i=7 2024-09-19T13:55:25.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.789+0000 7f604292e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:25.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.790+0000 7f5ef4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.790+0000 7f604292e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:25.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.790+0000 7f604292e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.790+0000 7f604292e800 5 note: GC not initialized 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.790+0000 7f5e6f7fe640 20 reqs_thread_entry: start 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.791+0000 7f604292e800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.791+0000 7f604292e800 20 Filter name: none 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.791+0000 7f5e6d7fa640 20 reqs_thread_entry: start 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.791+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.791+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:25.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.791+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.792+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.792+0000 7f604292e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.792+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.792+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.792+0000 7f604292e800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.792+0000 7f604292e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:25.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.793+0000 7f604292e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:25.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.794+0000 7f5ef4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.796+0000 7f604292e800 20 remove_watcher() i=0 2024-09-19T13:55:25.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.796+0000 7f604292e800 2 removed watcher, disabling cache 2024-09-19T13:55:25.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.797+0000 7f604292e800 20 remove_watcher() i=1 2024-09-19T13:55:25.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.798+0000 7f604292e800 20 remove_watcher() i=2 2024-09-19T13:55:25.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.799+0000 7f604292e800 20 remove_watcher() i=3 2024-09-19T13:55:25.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.800+0000 7f604292e800 20 remove_watcher() i=4 2024-09-19T13:55:25.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.801+0000 7f604292e800 20 remove_watcher() i=5 2024-09-19T13:55:25.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.802+0000 7f604292e800 20 remove_watcher() i=6 2024-09-19T13:55:25.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.803+0000 7f604292e800 20 remove_watcher() i=7 2024-09-19T13:55:25.815 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.815 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:25.815 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:25.815 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:25.866 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:55:25.897 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:25.897 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:25.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.931+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 realm 2024-09-19T13:55:25.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:25.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.933+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.934+0000 7fa8c59a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.934+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.935+0000 7fa8c59a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:25.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.935+0000 7fa8c59a9800 20 searching for the correct realm 2024-09-19T13:55:25.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.938+0000 7fa8bac92640 0 -- 172.21.15.94:0/3075264682 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x562210cfdf80 msgr2=0x562210d00440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.941+0000 7fa8c3493640 0 -- 172.21.15.94:0/3075264682 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa8ac0a5650 msgr2=0x7fa8ac0a5a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:25.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:25.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.945+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 zone default found 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 4 Realm: () 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 zonegroup default 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.946+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.947+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.947+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.947+0000 7fa8c59a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:25.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.947+0000 7fa8c59a9800 20 started sync module instance, tier type = 2024-09-19T13:55:25.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.947+0000 7fa8c59a9800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=0 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=1 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=2 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=3 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=4 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=5 2024-09-19T13:55:25.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.955+0000 7fa8c59a9800 20 add_watcher() i=6 2024-09-19T13:55:25.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.956+0000 7fa8c59a9800 20 add_watcher() i=7 2024-09-19T13:55:25.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.956+0000 7fa8c59a9800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:25.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.957+0000 7fa779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:25.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 5 note: GC not initialized 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa778fe1640 20 reqs_thread_entry: start 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 20 Filter name: none 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa6f27fc640 20 reqs_thread_entry: start 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T13:55:25.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.958+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.959+0000 7fa8c59a9800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.959+0000 7fa8c59a9800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.959+0000 7fa8c59a9800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.959+0000 7fa8c59a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 : miss 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.959+0000 7fa8c59a9800 20 rados->read ofs=0 len=0 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.960+0000 7fa8c59a9800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:25.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.960+0000 7fa8c59a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.960+0000 7fa8c59a9800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.960+0000 7fa8c59a9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:25.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.960+0000 7fa8c59a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.960+0000 7fa8c59a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 2024-09-19T13:55:25.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.961+0000 7fa8c59a9800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:55:25.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26, ofs0, ns] 2024-09-19T13:55:25.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa7a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595102 cookie 94704310949120 notifier 6744 bl.length()=1023 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa7a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa7a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa7a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_sources= new_sources= 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential sources added=[] removed=[] 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_dests= new_dests= 2024-09-19T13:55:25.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.967+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential dests added=[] removed=[] 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.0 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.0 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.1 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.1 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.2 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.2 2024-09-19T13:55:25.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.3 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.3 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.4 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.4 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.5 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.5 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.6 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.6 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.7 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.7 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.8 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.8 2024-09-19T13:55:25.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.9 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.9 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.10 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.10 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.11 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2.11 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.0 2024-09-19T13:55:25.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.972+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.1 2024-09-19T13:55:25.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.973+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2 2024-09-19T13:55:25.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.973+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.3 2024-09-19T13:55:25.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.974+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.4 2024-09-19T13:55:25.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.974+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.5 2024-09-19T13:55:25.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.975+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.6 2024-09-19T13:55:25.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.975+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.7 2024-09-19T13:55:25.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.976+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.8 2024-09-19T13:55:25.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.976+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.9 2024-09-19T13:55:25.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.976+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.10 2024-09-19T13:55:25.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.980+0000 7fa8c59a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:25.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.980+0000 7fa8c59a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 2024-09-19T13:55:25.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa8c59a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa8c59a9800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa8c59a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa8c59a9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26, ofs0, ns] 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa7a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595103 cookie 94704310949120 notifier 6744 bl.length()=1023 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa7a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa7a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.981+0000 7fa7a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.982+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_sources= new_sources= 2024-09-19T13:55:25.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.982+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential sources added=[] removed=[] 2024-09-19T13:55:25.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.982+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_dests= new_dests= 2024-09-19T13:55:25.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.982+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential dests added=[] removed=[] 2024-09-19T13:55:25.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.984+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.0 2024-09-19T13:55:25.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.985+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.1 2024-09-19T13:55:25.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.985+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.2 2024-09-19T13:55:25.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.985+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.3 2024-09-19T13:55:25.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.986+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.4 2024-09-19T13:55:25.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.986+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.5 2024-09-19T13:55:25.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.986+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.6 2024-09-19T13:55:25.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.987+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.7 2024-09-19T13:55:25.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.987+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.8 2024-09-19T13:55:25.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.988+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.9 2024-09-19T13:55:25.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.988+0000 7fa8c59a9800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26.10 2024-09-19T13:55:25.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.988+0000 7fa8c59a9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:25.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.988+0000 7fa8c59a9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.989+0000 7fa8c59a9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.989+0000 7fa8c59a9800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.989+0000 7fa8c59a9800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.989+0000 7fa8c59a9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26, ofs0, ns] 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa7a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94704310949120 notifier 6744 bl.length()=991 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa7a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 info.flags=0x17 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa7a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 to cache LRU end 2024-09-19T13:55:25.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa7a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:25.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_sources= new_sources= 2024-09-19T13:55:25.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential sources added=[] removed=[] 2024-09-19T13:55:25.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): orig_dests= new_dests= 2024-09-19T13:55:25.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.990+0000 7fa8c59a9800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26]): potential dests added=[] removed=[] 2024-09-19T13:55:25.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.992+0000 7fa8c59a9800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-19T13:55:25.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.994+0000 7fa779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:25.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.996+0000 7fa8c59a9800 20 remove_watcher() i=0 2024-09-19T13:55:25.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.996+0000 7fa8c59a9800 2 removed watcher, disabling cache 2024-09-19T13:55:25.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.997+0000 7fa8c59a9800 20 remove_watcher() i=1 2024-09-19T13:55:25.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.998+0000 7fa8c59a9800 20 remove_watcher() i=2 2024-09-19T13:55:26.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:25.999+0000 7fa8c59a9800 20 remove_watcher() i=3 2024-09-19T13:55:26.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.000+0000 7fa8c59a9800 20 remove_watcher() i=4 2024-09-19T13:55:26.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.000+0000 7fa8c59a9800 20 remove_watcher() i=5 2024-09-19T13:55:26.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.001+0000 7fa8c59a9800 20 remove_watcher() i=6 2024-09-19T13:55:26.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.002+0000 7fa8c59a9800 20 remove_watcher() i=7 2024-09-19T13:55:26.016 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T13:55:26.045 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:26.045 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:26.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.079+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 realm 2024-09-19T13:55:26.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:26.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.081+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.082+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.082+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.082+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:26.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.082+0000 7fcaa3d33800 20 searching for the correct realm 2024-09-19T13:55:26.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.085+0000 7fcaa019a640 0 -- 172.21.15.94:0/2875304150 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fca880b1030 msgr2=0x7fca880038e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:26.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.088+0000 7fca9f999640 0 -- 172.21.15.94:0/2875304150 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fca880bfc40 msgr2=0x7fca88009dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:26.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:26.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:26.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:26.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:26.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:26.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:26.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:26.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 zone default found 2024-09-19T13:55:26.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 4 Realm: () 2024-09-19T13:55:26.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:26.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 zonegroup default 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.093+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 started sync module instance, tier type = 2024-09-19T13:55:26.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.094+0000 7fcaa3d33800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=0 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=1 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=2 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=3 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=4 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=5 2024-09-19T13:55:26.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.103+0000 7fcaa3d33800 20 add_watcher() i=6 2024-09-19T13:55:26.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.104+0000 7fcaa3d33800 20 add_watcher() i=7 2024-09-19T13:55:26.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.104+0000 7fcaa3d33800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:26.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.105+0000 7fc955fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fcaa3d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fcaa3d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fcaa3d33800 5 note: GC not initialized 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fc954fe1640 20 reqs_thread_entry: start 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fcaa3d33800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fcaa3d33800 20 Filter name: none 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fc8ce7fc640 20 reqs_thread_entry: start 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.106+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:26.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.107+0000 7fcaa3d33800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.108+0000 7fcaa3d33800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.108+0000 7fcaa3d33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:26.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.109+0000 7fc955fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.111+0000 7fcaa3d33800 20 remove_watcher() i=0 2024-09-19T13:55:26.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.111+0000 7fcaa3d33800 2 removed watcher, disabling cache 2024-09-19T13:55:26.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.113+0000 7fcaa3d33800 20 remove_watcher() i=1 2024-09-19T13:55:26.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.113+0000 7fcaa3d33800 20 remove_watcher() i=2 2024-09-19T13:55:26.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.115+0000 7fcaa3d33800 20 remove_watcher() i=3 2024-09-19T13:55:26.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.116+0000 7fcaa3d33800 20 remove_watcher() i=4 2024-09-19T13:55:26.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.117+0000 7fcaa3d33800 20 remove_watcher() i=5 2024-09-19T13:55:26.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.118+0000 7fcaa3d33800 20 remove_watcher() i=6 2024-09-19T13:55:26.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.119+0000 7fcaa3d33800 20 remove_watcher() i=7 2024-09-19T13:55:26.131 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.131 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:26.131 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:55:26.131 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.205 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-19T13:55:26.205 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.403 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T13:55:26.431 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:26.431 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:26.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.465+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 realm 2024-09-19T13:55:26.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:26.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.467+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.468+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.468+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.468+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:26.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.468+0000 7f6da6015800 20 searching for the correct realm 2024-09-19T13:55:26.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.472+0000 7f6da0f91640 0 -- 172.21.15.94:0/1770001722 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6d9403c030 msgr2=0x7f6d94008d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:26.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.476+0000 7f6da0f91640 0 -- 172.21.15.94:0/1770001722 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6c6c087390 msgr2=0x7f6c6c0897c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:26.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.479+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 zone default found 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 4 Realm: () 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 zonegroup default 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.480+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.481+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.481+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.481+0000 7f6da6015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.481+0000 7f6da6015800 20 started sync module instance, tier type = 2024-09-19T13:55:26.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.481+0000 7f6da6015800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:26.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=0 2024-09-19T13:55:26.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=1 2024-09-19T13:55:26.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=2 2024-09-19T13:55:26.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=3 2024-09-19T13:55:26.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=4 2024-09-19T13:55:26.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=5 2024-09-19T13:55:26.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.489+0000 7f6da6015800 20 add_watcher() i=6 2024-09-19T13:55:26.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.490+0000 7f6da6015800 20 add_watcher() i=7 2024-09-19T13:55:26.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.490+0000 7f6da6015800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:26.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6c577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6da6015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:26.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6da6015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:26.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6da6015800 5 note: GC not initialized 2024-09-19T13:55:26.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6c567e4640 20 reqs_thread_entry: start 2024-09-19T13:55:26.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6da6015800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:26.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6da6015800 20 Filter name: none 2024-09-19T13:55:26.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6bc7fff640 20 reqs_thread_entry: start 2024-09-19T13:55:26.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.492+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.493+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.493+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:26.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.494+0000 7f6da6015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:26.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.496+0000 7f6c577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.498+0000 7f6da6015800 20 remove_watcher() i=0 2024-09-19T13:55:26.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.498+0000 7f6da6015800 2 removed watcher, disabling cache 2024-09-19T13:55:26.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.499+0000 7f6da6015800 20 remove_watcher() i=1 2024-09-19T13:55:26.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.500+0000 7f6da6015800 20 remove_watcher() i=2 2024-09-19T13:55:26.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.501+0000 7f6da6015800 20 remove_watcher() i=3 2024-09-19T13:55:26.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.502+0000 7f6da6015800 20 remove_watcher() i=4 2024-09-19T13:55:26.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.503+0000 7f6da6015800 20 remove_watcher() i=5 2024-09-19T13:55:26.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.504+0000 7f6da6015800 20 remove_watcher() i=6 2024-09-19T13:55:26.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.505+0000 7f6da6015800 20 remove_watcher() i=7 2024-09-19T13:55:26.517 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.517 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:26.517 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:26.517 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.519 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-19T13:55:26.555 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:26.555 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:26.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.589+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 realm 2024-09-19T13:55:26.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:26.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.591+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.592+0000 7fd960d30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.592+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.592+0000 7fd960d30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:26.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.592+0000 7fd960d30800 20 searching for the correct realm 2024-09-19T13:55:26.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.595+0000 7fd957fff640 0 -- 172.21.15.94:0/619859070 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x557be58d7df0 msgr2=0x557be58da1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:26.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.599+0000 7fd95c9bc640 0 -- 172.21.15.94:0/619859070 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd948027b30 msgr2=0x7fd948099120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:26.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:26.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:26.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 zone default found 2024-09-19T13:55:26.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 4 Realm: () 2024-09-19T13:55:26.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:26.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 zonegroup default 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.603+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 started sync module instance, tier type = 2024-09-19T13:55:26.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.604+0000 7fd960d30800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=0 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=1 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=2 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=3 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=4 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=5 2024-09-19T13:55:26.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.613+0000 7fd960d30800 20 add_watcher() i=6 2024-09-19T13:55:26.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.614+0000 7fd960d30800 20 add_watcher() i=7 2024-09-19T13:55:26.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.614+0000 7fd960d30800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:26.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.615+0000 7fd812fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 5 note: GC not initialized 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd811fe3640 20 reqs_thread_entry: start 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 20 Filter name: none 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd7837fe640 20 reqs_thread_entry: start 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.616+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 : miss 2024-09-19T13:55:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 info.flags=0x17 2024-09-19T13:55:26.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 to cache LRU end 2024-09-19T13:55:26.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:26.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:26.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.617+0000 7fd960d30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 2024-09-19T13:55:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd960d30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 info.flags=0x17 2024-09-19T13:55:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd960d30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 to cache LRU end 2024-09-19T13:55:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd960d30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:26.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd960d30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27, ofs0, ns] 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd8337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 93990620611904 notifier 6473 bl.length()=1023 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd8337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 info.flags=0x17 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd8337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 to cache LRU end 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.622+0000 7fd8337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.623+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): orig_sources= new_sources= 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.623+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): potential sources added=[] removed=[] 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.623+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): orig_dests= new_dests= 2024-09-19T13:55:26.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.623+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): potential dests added=[] removed=[] 2024-09-19T13:55:26.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.623+0000 7fd960d30800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-19T13:55:26.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.623+0000 7fd960d30800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-19T13:55:26.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.0 2024-09-19T13:55:26.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.0 2024-09-19T13:55:26.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.1 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.1 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.2 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.2 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.3 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.3 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.4 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.4 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.5 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.5 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.6 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.6 2024-09-19T13:55:26.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.7 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.7 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.8 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.8 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.9 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.9 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.10 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.10 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.11 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1.11 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.0 2024-09-19T13:55:26.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.625+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.1 2024-09-19T13:55:26.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.626+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.2 2024-09-19T13:55:26.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.626+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.3 2024-09-19T13:55:26.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.627+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.4 2024-09-19T13:55:26.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.627+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.5 2024-09-19T13:55:26.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.628+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.6 2024-09-19T13:55:26.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.628+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.7 2024-09-19T13:55:26.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.628+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.8 2024-09-19T13:55:26.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.629+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.9 2024-09-19T13:55:26.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.629+0000 7fd960d30800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27.10 2024-09-19T13:55:26.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.634+0000 7fd960d30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:26.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.634+0000 7fd960d30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 2024-09-19T13:55:26.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.635+0000 7fd960d30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 info.flags=0x17 2024-09-19T13:55:26.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.635+0000 7fd960d30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 to cache LRU end 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.635+0000 7fd960d30800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.635+0000 7fd960d30800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27, ofs0, ns] 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd8337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595108 cookie 93990620611904 notifier 6473 bl.length()=991 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd8337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 info.flags=0x17 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd8337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 to cache LRU end 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd8337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): orig_sources= new_sources= 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): potential sources added=[] removed=[] 2024-09-19T13:55:26.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): orig_dests= new_dests= 2024-09-19T13:55:26.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.636+0000 7fd960d30800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27]): potential dests added=[] removed=[] 2024-09-19T13:55:26.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.642+0000 7fd960d30800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-19T13:55:26.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.646+0000 7fd812fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.648+0000 7fd960d30800 20 remove_watcher() i=0 2024-09-19T13:55:26.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.648+0000 7fd960d30800 2 removed watcher, disabling cache 2024-09-19T13:55:26.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.649+0000 7fd960d30800 20 remove_watcher() i=1 2024-09-19T13:55:26.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.650+0000 7fd960d30800 20 remove_watcher() i=2 2024-09-19T13:55:26.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.651+0000 7fd960d30800 20 remove_watcher() i=3 2024-09-19T13:55:26.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.652+0000 7fd960d30800 20 remove_watcher() i=4 2024-09-19T13:55:26.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.653+0000 7fd960d30800 20 remove_watcher() i=5 2024-09-19T13:55:26.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.654+0000 7fd960d30800 20 remove_watcher() i=6 2024-09-19T13:55:26.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.655+0000 7fd960d30800 20 remove_watcher() i=7 2024-09-19T13:55:26.668 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T13:55:26.698 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:26.698 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:26.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.732+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.733+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.733+0000 7f9f62519800 20 realm 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.733+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.733+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.733+0000 7f9f62519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.733+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.734+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.734+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.734+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.734+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.735+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:26.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.735+0000 7f9f62519800 20 searching for the correct realm 2024-09-19T13:55:26.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.738+0000 7f9f57fff640 0 -- 172.21.15.94:0/970766129 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x559a59977bb0 msgr2=0x559a5997a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:26.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.741+0000 7f9f6000a640 0 -- 172.21.15.94:0/970766129 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9f4801f040 msgr2=0x7f9f48043930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:26.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:26.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 zone default found 2024-09-19T13:55:26.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 4 Realm: () 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 zonegroup default 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.746+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.747+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.747+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.747+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.747+0000 7f9f62519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.747+0000 7f9f62519800 20 started sync module instance, tier type = 2024-09-19T13:55:26.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.747+0000 7f9f62519800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=0 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=1 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=2 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=3 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=4 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=5 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.756+0000 7f9f62519800 20 add_watcher() i=6 2024-09-19T13:55:26.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.757+0000 7f9f62519800 20 add_watcher() i=7 2024-09-19T13:55:26.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.757+0000 7f9f62519800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:26.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.758+0000 7f9e167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9f62519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:26.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9f62519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:26.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9f62519800 5 note: GC not initialized 2024-09-19T13:55:26.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9e157e2640 20 reqs_thread_entry: start 2024-09-19T13:55:26.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9f62519800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:26.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9f62519800 20 Filter name: none 2024-09-19T13:55:26.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9d86ffd640 20 reqs_thread_entry: start 2024-09-19T13:55:26.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.759+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.760+0000 7f9f62519800 20 rados->read ofs=0 len=0 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.761+0000 7f9f62519800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:26.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.761+0000 7f9f62519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:26.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.762+0000 7f9e167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:26.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.764+0000 7f9f62519800 20 remove_watcher() i=0 2024-09-19T13:55:26.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.764+0000 7f9f62519800 2 removed watcher, disabling cache 2024-09-19T13:55:26.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.765+0000 7f9f62519800 20 remove_watcher() i=1 2024-09-19T13:55:26.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.766+0000 7f9f62519800 20 remove_watcher() i=2 2024-09-19T13:55:26.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.767+0000 7f9f62519800 20 remove_watcher() i=3 2024-09-19T13:55:26.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.768+0000 7f9f62519800 20 remove_watcher() i=4 2024-09-19T13:55:26.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.769+0000 7f9f62519800 20 remove_watcher() i=5 2024-09-19T13:55:26.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.770+0000 7f9f62519800 20 remove_watcher() i=6 2024-09-19T13:55:26.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:26.770+0000 7f9f62519800 20 remove_watcher() i=7 2024-09-19T13:55:26.783 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.783 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:26.783 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T13:55:26.783 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:26.857 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-19T13:55:26.857 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.033 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T13:55:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:27.060 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:27.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.094+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 realm 2024-09-19T13:55:27.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:27.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.096+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.097+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.097+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.097+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:27.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.097+0000 7f230ad2c800 20 searching for the correct realm 2024-09-19T13:55:27.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.100+0000 7f23072db640 0 -- 172.21.15.94:0/4272776311 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f22f0035060 msgr2=0x7f22f0068130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.103+0000 7f2306ada640 0 -- 172.21.15.94:0/4272776311 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f22f00696c0 msgr2=0x7f22f00831b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.308+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 zone default found 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 4 Realm: () 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 zonegroup default 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.309+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 started sync module instance, tier type = 2024-09-19T13:55:27.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.310+0000 7f230ad2c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=0 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=1 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=2 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=3 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=4 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=5 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.319+0000 7f230ad2c800 20 add_watcher() i=6 2024-09-19T13:55:27.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.320+0000 7f230ad2c800 20 add_watcher() i=7 2024-09-19T13:55:27.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.320+0000 7f230ad2c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:27.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.322+0000 7f21bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.322+0000 7f230ad2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.322+0000 7f230ad2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.322+0000 7f230ad2c800 5 note: GC not initialized 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.322+0000 7f2137fff640 20 reqs_thread_entry: start 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.323+0000 7f230ad2c800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.323+0000 7f230ad2c800 20 Filter name: none 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.323+0000 7f2135ffb640 20 reqs_thread_entry: start 2024-09-19T13:55:27.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.323+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.324+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.324+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.324+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:27.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.324+0000 7f230ad2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:27.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.324+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.325+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.325+0000 7f230ad2c800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.325+0000 7f230ad2c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:27.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.325+0000 7f230ad2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:27.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.327+0000 7f21bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.329+0000 7f230ad2c800 20 remove_watcher() i=0 2024-09-19T13:55:27.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.329+0000 7f230ad2c800 2 removed watcher, disabling cache 2024-09-19T13:55:27.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.330+0000 7f230ad2c800 20 remove_watcher() i=1 2024-09-19T13:55:27.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.331+0000 7f230ad2c800 20 remove_watcher() i=2 2024-09-19T13:55:27.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.332+0000 7f230ad2c800 20 remove_watcher() i=3 2024-09-19T13:55:27.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.333+0000 7f230ad2c800 20 remove_watcher() i=4 2024-09-19T13:55:27.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.334+0000 7f230ad2c800 20 remove_watcher() i=5 2024-09-19T13:55:27.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.335+0000 7f230ad2c800 20 remove_watcher() i=6 2024-09-19T13:55:27.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.336+0000 7f230ad2c800 20 remove_watcher() i=7 2024-09-19T13:55:27.348 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.348 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:27.348 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:27.348 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.350 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-19T13:55:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:27.384 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:27.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.419+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.420+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.420+0000 7f2845a1d800 20 realm 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.420+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.421+0000 7f2845a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.423 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:27.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.422+0000 7f2845a1d800 20 searching for the correct realm 2024-09-19T13:55:27.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.425+0000 7f28409ea640 0 -- 172.21.15.94:0/1039259748 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f283c0be040 msgr2=0x7f283c0c9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.428+0000 7f28411eb640 0 -- 172.21.15.94:0/1039259748 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f283407eb60 msgr2=0x7f28340a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:27.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:27.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:27.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 zone default found 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 4 Realm: () 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:27.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 zonegroup default 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 started sync module instance, tier type = 2024-09-19T13:55:27.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.635+0000 7f2845a1d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=0 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=1 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=2 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=3 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=4 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=5 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=6 2024-09-19T13:55:27.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.646+0000 7f2845a1d800 20 add_watcher() i=7 2024-09-19T13:55:27.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.646+0000 7f2845a1d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:27.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.647+0000 7f26f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:27.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:27.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 5 note: GC not initialized 2024-09-19T13:55:27.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f26f6fe5640 20 reqs_thread_entry: start 2024-09-19T13:55:27.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:27.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 20 Filter name: none 2024-09-19T13:55:27.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f26f4fe1640 20 reqs_thread_entry: start 2024-09-19T13:55:27.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T13:55:27.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : miss 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.649+0000 7f2845a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:27.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.654+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.654+0000 7f2845a1d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.654+0000 7f2845a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.654+0000 7f2845a1d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28, ofs0, ns] 2024-09-19T13:55:27.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595150 cookie 94758694535616 notifier 6524 bl.length()=1023 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_sources= new_sources= 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential sources added=[] removed=[] 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_dests= new_dests= 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential dests added=[] removed=[] 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2845a1d800 time 2024-09-19T13:55:27.657035+0000 2024-09-19T13:55:27.658 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2846b8c76a] 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:55:27.677 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.656+0000 7f2845a1d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2845a1d800 time 2024-09-19T13:55:27.657035+0000 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2846b8c76a] 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.678 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2845a1d800 thread_name:radosgw-admin 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f284583e6f0] 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f284588b99c] 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2846b8c7c4] 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.679 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.657+0000 7f2845a1d800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2845a1d800 thread_name:radosgw-admin 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f284583e6f0] 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f284588b99c] 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:55:27.680 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2846b8c7c4] 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:55:27.402+0000 7f2845a1d800 10 monclient: get_monmap_and_config success 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:55:27.402+0000 7f2845a1d800 4 set_mon_vals no callback set 2024-09-19T13:55:27.681 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:55:27.403+0000 7f2845a1d800 10 monclient: shutdown 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 asok(0x562eba222410) unregister_commands rotate-key 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:55:27.403+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:55:27.403+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:55:27.403+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.682 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding auth protocol: cephx 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding auth protocol: cephx 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding auth protocol: cephx 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.683 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:55:27.404+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: starting msgr at 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: starting objecter 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 asok(0x562eba222410) register_command objecter_requests hook 0x562eba4499f0 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: setting wanted keys 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: calling monclient init 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding auth protocol: cephx 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding auth protocol: cephx 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding auth protocol: cephx 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.684 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:55:27.404+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:55:27.404+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key hook 0x562eba444ad8 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:55:27.685 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba2b88d0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba386d10 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba389ca0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.061762s 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba2b88d0 auth_method 0 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba386d10 auth_method 0 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.686 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba389ca0 auth_method 0 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:55:27.405+0000 7f28411eb640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:55:27.405+0000 7f28411eb640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.687 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:55:27.405+0000 7f28411eb640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:55:27.405+0000 7f28411eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: dump: 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.688 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: dump: 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.689 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:55:27.405+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6515 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:55:27.405+0000 7f272f606640 4 set_mon_vals no callback set 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:55:27.405+0000 7f2845a1d800 1 librados: init done 2024-09-19T13:55:27.690 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:55:27.407+0000 7f272de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:55:27.407+0000 7f272de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:55:27.407+0000 7f272de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:55:27.407+0000 7f28409ea640 10 monclient: get_auth_request con 0x7f2728077570 auth_method 0 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:55:27.407+0000 7f28419ec640 10 monclient: get_auth_request con 0x562eba46b210 auth_method 0 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:55:27.408+0000 7f28411eb640 10 monclient: get_auth_request con 0x562eba48f8a0 auth_method 0 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:55:27.409+0000 7f28409ea640 10 monclient: get_auth_request con 0x562eba494e70 auth_method 0 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:55:27.410+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:55:27.410+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:55:27.410+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.691 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding auth protocol: cephx 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding auth protocol: cephx 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding auth protocol: cephx 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.692 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:55:27.410+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 asok(0x562eba222410) register_command objecter_requests cmddesc objecter_requests hook 0x562eba49c210 EEXIST 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:55:27.410+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding auth protocol: cephx 2024-09-19T13:55:27.693 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding auth protocol: cephx 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding auth protocol: cephx 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.694 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:55:27.411+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:55:27.411+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:55:27.411+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key cmddesc rotate-key hook 0x562eba497d70 EEXIST 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba4c0530 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba4c0910 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba4bf240 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.068340s 2024-09-19T13:55:27.695 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba4c0910 auth_method 0 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba4c0530 auth_method 0 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.696 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba4bf240 auth_method 0 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:55:27.411+0000 7f28409ea640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:55:27.411+0000 7f2726ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:55:27.411+0000 7f2726ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.697 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:55:27.411+0000 7f2726ffd640 10 monclient: dump: 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.698 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: dump: 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.699 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:55:27.412+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6518 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:55:27.412+0000 7f28421ed640 4 set_mon_vals no callback set 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:55:27.413+0000 7f2726ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:55:27.413+0000 7f2726ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:55:27.413+0000 7f2726ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:55:27.414+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f271c077540 auth_method 0 2024-09-19T13:55:27.700 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: get_monmap_and_config 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:55:27.414+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.701 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding auth protocol: cephx 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding auth protocol: cephx 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding auth protocol: cephx 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.702 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:55:27.414+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding auth protocol: cephx 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding auth protocol: cephx 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding auth protocol: cephx 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.703 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:55:27.414+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:55:27.415+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:55:27.415+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key cmddesc rotate-key hook 0x7ffc29da1988 EEXIST 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba50ece0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.704 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba50ff10 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba5063f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.072221s 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba50ece0 auth_method 0 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba5063f0 auth_method 0 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.705 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba50ff10 auth_method 0 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.706 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_done global_id 6521 payload 274 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:55:27.415+0000 7f28411eb640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: dump: 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.707 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: dump: 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.708 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:55:27.415+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6521 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient: get_monmap_and_config success 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:55:27.415+0000 7f2845a1d800 4 set_mon_vals no callback set 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: shutdown 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.709 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding auth protocol: cephx 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding auth protocol: cephx 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding auth protocol: cephx 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.710 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:55:27.416+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: starting msgr at 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: starting objecter 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 asok(0x562eba222410) register_command objecter_requests cmddesc objecter_requests hook 0x562eba50ea00 EEXIST 2024-09-19T13:55:27.711 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: setting wanted keys 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: calling monclient init 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding auth protocol: cephx 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding auth protocol: cephx 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding auth protocol: cephx 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.712 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:55:27.417+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:55:27.417+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:55:27.417+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key cmddesc rotate-key hook 0x562eba4d4f38 EEXIST 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba5063f0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba50ece0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba50ff10 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.713 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.074387s 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba50ece0 auth_method 0 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba50ff10 auth_method 0 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.714 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba5063f0 auth_method 0 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.715 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:55:27.417+0000 7f28409ea640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: dump: 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.716 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: dump: 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.717 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:55:27.417+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6524 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.718 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:55:27.417+0000 7f2724ff9640 4 set_mon_vals no callback set 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:55:27.418+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:55:27.418+0000 7f2845a1d800 1 librados: init done 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:55:27.418+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cr dump hook 0x562eba4e2518 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:55:27.419+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:55:27.419+0000 7f2712ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:55:27.419+0000 7f2712ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:55:27.419+0000 7f2712ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:55:27.420+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f270c077570 auth_method 0 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:55:27.420+0000 7f28419ec640 10 monclient: get_auth_request con 0x562eba52ea70 auth_method 0 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:55:27.420+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:55:27.420+0000 7f2845a1d800 20 realm 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:55:27.420+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.719 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:55:27.421+0000 7f2845a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:55:27.421+0000 7f28411eb640 10 monclient: get_auth_request con 0x562eba532e30 auth_method 0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 searching for the correct realm 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:55:27.422+0000 7f28409ea640 10 monclient: get_auth_request con 0x562eba537fb0 auth_method 0 2024-09-19T13:55:27.720 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:55:27.423+0000 7f28419ec640 10 monclient: get_auth_request con 0x7f2834081280 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:55:27.423+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f283801f040 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:55:27.424+0000 7f28409ea640 10 monclient: get_auth_request con 0x7f283c0be040 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:55:27.425+0000 7f28409ea640 0 -- 172.21.15.94:0/1039259748 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f283c0be040 msgr2=0x7f283c0c9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:55:27.425+0000 7f2712ffd640 1 client.6524.objecter ms_handle_reset 0x7f283c0be040 session 0x7f283c005040 osd.4 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:55:27.425+0000 7f2712ffd640 10 monclient: _renew_subs 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:55:27.425+0000 7f2712ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:55:27.425+0000 7f28409ea640 10 monclient: get_auth_request con 0x7f270c087390 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:55:27.426+0000 7f28419ec640 10 monclient: get_auth_request con 0x7f283407c470 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:55:27.428+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f283407eb60 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:55:27.428+0000 7f28411eb640 0 -- 172.21.15.94:0/1039259748 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f283407eb60 msgr2=0x7f28340a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:55:27.629+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f283407eb60 auth_method 0 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:27.721 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 zone default found 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:55:27.634+0000 7f2845a1d800 4 Realm: () 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:55:27.634+0000 7f2845a1d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:27.722 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:55:27.634+0000 7f2845a1d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:55:27.634+0000 7f2845a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 zonegroup default 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 started sync module instance, tier type = 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=0 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=1 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=2 2024-09-19T13:55:27.723 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=3 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=4 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=5 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=6 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:55:27.646+0000 7f2845a1d800 20 add_watcher() i=7 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:55:27.646+0000 7f2845a1d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding auth protocol: cephx 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding auth protocol: cephx 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding auth protocol: cephx 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.724 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:55:27.647+0000 7f26f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:55:27.648+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache list hook 0x562eba503de0 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache inspect hook 0x562eba503de0 2024-09-19T13:55:27.725 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache erase hook 0x562eba503de0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache zap hook 0x562eba503de0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 note: GC not initialized 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:55:27.648+0000 7f26f6fe5640 20 reqs_thread_entry: start 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace show hook 0x7f28340049a0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace history hook 0x7f28340049a0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace active hook 0x7f28340049a0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace active_short hook 0x7f28340049a0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 Filter name: none 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:55:27.648+0000 7f26f4fe1640 20 reqs_thread_entry: start 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:55:27.648+0000 7f2845a1d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.726 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : miss 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.727 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28, ofs0, ns] 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595150 cookie 94758694535616 notifier 6524 bl.length()=1023 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_sources= new_sources= 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential sources added=[] removed=[] 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_dests= new_dests= 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential dests added=[] removed=[] 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:55:27.656+0000 7f2845a1d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2845a1d800 time 2024-09-19T13:55:27.657035+0000 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2846b8c76a] 2024-09-19T13:55:27.728 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:55:27.657+0000 7f2845a1d800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2845a1d800 thread_name:radosgw-admin 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.729 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f284583e6f0] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f284588b99c] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2846b8c7c4] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:55:27.730 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:55:27.731 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:55:27.732 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:55:27.733 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:55:27.734 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:55:27.735 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:55:27.736 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:55:27.737 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f26f4fe1640 / http_manager 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f26f6fe5640 / http_manager 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f26f7fe7640 / rgw_dt_lg_renew 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2712ffd640 / ms_dispatch 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2724ff9640 / io_context_pool 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2726ffd640 / ms_dispatch 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f272de03640 / ms_dispatch 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f272f606640 / io_context_pool 2024-09-19T13:55:27.738 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28409ea640 / msgr-worker-2 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28411eb640 / msgr-worker-1 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28419ec640 / msgr-worker-0 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28421ed640 / io_context_pool 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2845a1d800 / radosgw-admin 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.106731.log 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:55:27.402+0000 7f2845a1d800 10 monclient: get_monmap_and_config success 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:55:27.402+0000 7f2845a1d800 4 set_mon_vals no callback set 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:55:27.403+0000 7f2845a1d800 10 monclient: shutdown 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 asok(0x562eba222410) unregister_commands rotate-key 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:55:27.403+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.739 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:55:27.403+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:55:27.403+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding auth protocol: cephx 2024-09-19T13:55:27.740 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding auth protocol: cephx 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding auth protocol: cephx 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: crc 2024-09-19T13:55:27.741 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:55:27.403+0000 7f2845a1d800 5 AuthRegistry(0x562eba44a100) adding con mode: secure 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:55:27.404+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: starting msgr at 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: starting objecter 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 asok(0x562eba222410) register_command objecter_requests hook 0x562eba4499f0 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: setting wanted keys 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:55:27.404+0000 7f2845a1d800 1 librados: calling monclient init 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding auth protocol: cephx 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding auth protocol: cephx 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding auth protocol: cephx 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.742 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: crc 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 AuthRegistry(0x562eba444990) adding con mode: secure 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:55:27.404+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:55:27.404+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:55:27.404+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key hook 0x562eba444ad8 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.743 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba2b88d0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba386d10 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba389ca0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:55:27.404+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.061762s 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba2b88d0 auth_method 0 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba386d10 auth_method 0 2024-09-19T13:55:27.744 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:55:27.404+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:55:27.404+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba389ca0 auth_method 0 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:55:27.404+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.745 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:55:27.405+0000 7f28411eb640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:55:27.405+0000 7f28411eb640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:55:27.405+0000 7f28411eb640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:55:27.405+0000 7f28411eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: dump: 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.746 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:55:27.405+0000 7f272de03640 10 monclient: dump: 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.747 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:55:27.405+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6515 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:55:27.405+0000 7f272f606640 4 set_mon_vals no callback set 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:55:27.405+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.748 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:55:27.405+0000 7f2845a1d800 1 librados: init done 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:55:27.407+0000 7f272de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:55:27.407+0000 7f272de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:55:27.407+0000 7f272de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:55:27.407+0000 7f28409ea640 10 monclient: get_auth_request con 0x7f2728077570 auth_method 0 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:55:27.407+0000 7f28419ec640 10 monclient: get_auth_request con 0x562eba46b210 auth_method 0 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:55:27.408+0000 7f28411eb640 10 monclient: get_auth_request con 0x562eba48f8a0 auth_method 0 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:55:27.409+0000 7f28409ea640 10 monclient: get_auth_request con 0x562eba494e70 auth_method 0 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:55:27.410+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:55:27.410+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.749 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:55:27.410+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding auth protocol: cephx 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding auth protocol: cephx 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding auth protocol: cephx 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.750 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: crc 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba498dd0) adding con mode: secure 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:55:27.410+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 asok(0x562eba222410) register_command objecter_requests cmddesc objecter_requests hook 0x562eba49c210 EEXIST 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:55:27.410+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.751 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding auth protocol: cephx 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding auth protocol: cephx 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding auth protocol: cephx 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.752 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: crc 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:55:27.410+0000 7f2845a1d800 5 AuthRegistry(0x562eba497c28) adding con mode: secure 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:55:27.411+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:55:27.411+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:55:27.411+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key cmddesc rotate-key hook 0x562eba497d70 EEXIST 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba4c0530 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba4c0910 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba4bf240 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.753 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:55:27.411+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.068340s 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba4c0910 auth_method 0 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba4c0530 auth_method 0 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.754 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:55:27.411+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba4bf240 auth_method 0 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:55:27.411+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:55:27.411+0000 7f28409ea640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:55:27.411+0000 7f28409ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:55:27.411+0000 7f2726ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:55:27.411+0000 7f2726ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:55:27.411+0000 7f2726ffd640 10 monclient: dump: 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.755 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.756 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:55:27.412+0000 7f2726ffd640 10 monclient: dump: 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.757 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:55:27.412+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6518 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:55:27.412+0000 7f28421ed640 4 set_mon_vals no callback set 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:55:27.412+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:55:27.413+0000 7f2726ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:55:27.413+0000 7f2726ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:55:27.413+0000 7f2726ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:55:27.414+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f271c077540 auth_method 0 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: get_monmap_and_config 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.758 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:55:27.414+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding auth protocol: cephx 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding auth protocol: cephx 2024-09-19T13:55:27.759 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding auth protocol: cephx 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.760 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: crc 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e0350) adding con mode: secure 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:55:27.414+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:55:27.414+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding auth protocol: cephx 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding auth protocol: cephx 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding auth protocol: cephx 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.761 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: crc 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:55:27.414+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1840) adding con mode: secure 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:55:27.414+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:55:27.415+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:55:27.415+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key cmddesc rotate-key hook 0x7ffc29da1988 EEXIST 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.762 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba50ece0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba50ff10 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba5063f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.072221s 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba50ece0 auth_method 0 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.763 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba5063f0 auth_method 0 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba50ff10 auth_method 0 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.764 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:55:27.415+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:55:27.415+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient(hunting): handle_auth_done global_id 6521 payload 274 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:55:27.415+0000 7f28411eb640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:55:27.415+0000 7f28411eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: dump: 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.765 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.766 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:55:27.415+0000 7f2724ff9640 10 monclient: dump: 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:55:27.415+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6521 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:55:27.415+0000 7f2845a1d800 10 monclient: get_monmap_and_config success 2024-09-19T13:55:27.767 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:55:27.415+0000 7f2845a1d800 4 set_mon_vals no callback set 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: shutdown 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: build_initial_monmap 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 build_initial for_mkfs: 0 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: monmap: 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:55:27.768 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding auth protocol: cephx 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding auth protocol: cephx 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding auth protocol: cephx 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.769 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: crc 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4e3ed0) adding con mode: secure 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:55:27.416+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: starting msgr at 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: starting objecter 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 asok(0x562eba222410) register_command objecter_requests cmddesc objecter_requests hook 0x562eba50ea00 EEXIST 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: setting wanted keys 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:55:27.416+0000 7f2845a1d800 1 librados: calling monclient init 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:55:27.416+0000 7f2845a1d800 10 monclient: init 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding auth protocol: cephx 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding auth protocol: cephx 2024-09-19T13:55:27.770 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding auth protocol: cephx 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: crc 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:55:27.416+0000 7f2845a1d800 5 AuthRegistry(0x562eba4d4df0) adding con mode: secure 2024-09-19T13:55:27.771 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:55:27.417+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:55:27.417+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:55:27.417+0000 7f2845a1d800 5 asok(0x562eba222410) register_command rotate-key cmddesc rotate-key hook 0x562eba4d4f38 EEXIST 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _reopen_session rank -1 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-b con 0x562eba5063f0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-c con 0x562eba50ece0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): picked mon.noname-a con 0x562eba50ff10 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): start opening mon connection 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): _renew_subs 2024-09-19T13:55:27.772 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient(hunting): authenticate will time out at 1941.074387s 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): get_auth_request con 0x562eba50ece0 auth_method 0 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): get_auth_request con 0x562eba50ff10 auth_method 0 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): get_auth_request con 0x562eba5063f0 auth_method 0 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:55:27.773 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:55:27.417+0000 7f28419ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:55:27.417+0000 7f28411eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient(hunting): handle_auth_done global_id 6524 payload 824 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient: _finish_hunting 0 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:55:27.417+0000 7f28409ea640 1 monclient: found mon.noname-c 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:55:27.417+0000 7f28409ea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.774 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: dump: 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: _finish_auth 0 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:55:27.775 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:55:27.417+0000 7f2712ffd640 10 monclient: dump: 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:55:27.776 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:55:27.417+0000 7f2845a1d800 5 monclient: authenticate success, global_id 6524 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:55:27.417+0000 7f2724ff9640 4 set_mon_vals no callback set 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:55:27.417+0000 7f2845a1d800 10 monclient: _renew_subs 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:55:27.418+0000 7f2845a1d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:55:27.418+0000 7f2845a1d800 1 librados: init done 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:55:27.418+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cr dump hook 0x562eba4e2518 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:55:27.419+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:55:27.419+0000 7f2712ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:55:27.419+0000 7f2712ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:55:27.419+0000 7f2712ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:55:27.777 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:55:27.420+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f270c077570 auth_method 0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:55:27.420+0000 7f28419ec640 10 monclient: get_auth_request con 0x562eba52ea70 auth_method 0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:55:27.420+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:55:27.420+0000 7f2845a1d800 20 realm 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:55:27.420+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:55:27.421+0000 7f2845a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:55:27.421+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:55:27.421+0000 7f28411eb640 10 monclient: get_auth_request con 0x562eba532e30 auth_method 0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:27.778 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:55:27.422+0000 7f2845a1d800 20 searching for the correct realm 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:55:27.422+0000 7f28409ea640 10 monclient: get_auth_request con 0x562eba537fb0 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:55:27.423+0000 7f28419ec640 10 monclient: get_auth_request con 0x7f2834081280 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:55:27.423+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f283801f040 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:55:27.424+0000 7f28409ea640 10 monclient: get_auth_request con 0x7f283c0be040 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:55:27.425+0000 7f28409ea640 0 -- 172.21.15.94:0/1039259748 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f283c0be040 msgr2=0x7f283c0c9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:55:27.425+0000 7f2712ffd640 1 client.6524.objecter ms_handle_reset 0x7f283c0be040 session 0x7f283c005040 osd.4 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:55:27.425+0000 7f2712ffd640 10 monclient: _renew_subs 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:55:27.425+0000 7f2712ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:55:27.425+0000 7f28409ea640 10 monclient: get_auth_request con 0x7f270c087390 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:55:27.426+0000 7f28419ec640 10 monclient: get_auth_request con 0x7f283407c470 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:55:27.428+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f283407eb60 auth_method 0 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:55:27.428+0000 7f28411eb640 0 -- 172.21.15.94:0/1039259748 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f283407eb60 msgr2=0x7f28340a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.779 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:55:27.629+0000 7f28411eb640 10 monclient: get_auth_request con 0x7f283407eb60 auth_method 0 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 zone default found 2024-09-19T13:55:27.780 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:55:27.634+0000 7f2845a1d800 4 Realm: () 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:55:27.634+0000 7f2845a1d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:55:27.634+0000 7f2845a1d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:55:27.634+0000 7f2845a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 zonegroup default 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:55:27.634+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 started sync module instance, tier type = 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:55:27.635+0000 7f2845a1d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:27.781 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=0 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=1 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=2 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=3 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=4 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=5 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:55:27.645+0000 7f2845a1d800 20 add_watcher() i=6 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:55:27.646+0000 7f2845a1d800 20 add_watcher() i=7 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:55:27.646+0000 7f2845a1d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding auth protocol: cephx 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding auth protocol: cephx 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding auth protocol: cephx 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.782 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: crc 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:55:27.647+0000 7f2845a1d800 5 AuthRegistry(0x7ffc29da1d10) adding con mode: secure 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:55:27.647+0000 7f26f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:55:27.648+0000 7f2845a1d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:27.783 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache list hook 0x562eba503de0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache inspect hook 0x562eba503de0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache erase hook 0x562eba503de0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command cache zap hook 0x562eba503de0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 note: GC not initialized 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:55:27.648+0000 7f26f6fe5640 20 reqs_thread_entry: start 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace show hook 0x7f28340049a0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace history hook 0x7f28340049a0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace active hook 0x7f28340049a0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:55:27.648+0000 7f2845a1d800 5 asok(0x562eba222410) register_command sync trace active_short hook 0x7f28340049a0 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 Filter name: none 2024-09-19T13:55:27.784 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:55:27.648+0000 7f26f4fe1640 20 reqs_thread_entry: start 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:55:27.648+0000 7f2845a1d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:55:27.648+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : miss 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:55:27.649+0000 7f2845a1d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.785 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:55:27.649+0000 7f2845a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:55:27.654+0000 7f2845a1d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28, ofs0, ns] 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595150 cookie 94758694535616 notifier 6524 bl.length()=1023 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:55:27.655+0000 7f2724ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_sources= new_sources= 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential sources added=[] removed=[] 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_dests= new_dests= 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:55:27.655+0000 7f2845a1d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential dests added=[] removed=[] 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:55:27.656+0000 7f2845a1d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2845a1d800 time 2024-09-19T13:55:27.657035+0000 2024-09-19T13:55:27.786 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2846b8c76a] 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:55:27.657+0000 7f2845a1d800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f2845a1d800 thread_name:radosgw-admin 2024-09-19T13:55:27.787 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f284583e6f0] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f284588b99c] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2846b8c7c4] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2846b8c928] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562eb94f4791] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74c9e) [0x562eb9a02c9e] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562eb950443d] 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:55:27.788 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2845829590] 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:55:27.789 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:55:27.790 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:55:27.791 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:55:27.792 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:55:27.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:55:27.794 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:55:27.795 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f26f4fe1640 / http_manager 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f26f6fe5640 / http_manager 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f26f7fe7640 / rgw_dt_lg_renew 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2712ffd640 / ms_dispatch 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2724ff9640 / io_context_pool 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2726ffd640 / ms_dispatch 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f272de03640 / ms_dispatch 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f272f606640 / io_context_pool 2024-09-19T13:55:27.796 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28409ea640 / msgr-worker-2 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28411eb640 / msgr-worker-1 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28419ec640 / msgr-worker-0 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: 7f28421ed640 / io_context_pool 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: 7f2845a1d800 / radosgw-admin 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:55:27.658716Z_7774a3d7-9462-40ae-b30e-e7f89000920b/log 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:55:27.797 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T13:55:27.802 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.730+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 realm 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.732+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.733+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.733+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.734+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:27.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.734+0000 7f083a735800 20 searching for the correct realm 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.737+0000 7f082dc20640 0 -- 172.21.15.94:0/407981893 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55d695aa7de0 msgr2=0x55d695aaa1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.740+0000 7f0836421640 0 -- 172.21.15.94:0/407981893 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f08200910b0 msgr2=0x7f08200931e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.744+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 zone default found 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 4 Realm: () 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 zonegroup default 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.745+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.746+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.746+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.746+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.746+0000 7f083a735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.746+0000 7f083a735800 20 started sync module instance, tier type = 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.746+0000 7f083a735800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.755+0000 7f083a735800 20 add_watcher() i=0 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.755+0000 7f083a735800 20 add_watcher() i=1 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.755+0000 7f083a735800 20 add_watcher() i=2 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.755+0000 7f083a735800 20 add_watcher() i=3 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.755+0000 7f083a735800 20 add_watcher() i=4 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.755+0000 7f083a735800 20 add_watcher() i=5 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.756+0000 7f083a735800 20 add_watcher() i=6 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.756+0000 7f083a735800 20 add_watcher() i=7 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.756+0000 7f083a735800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.758+0000 7f06ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.758+0000 7f083a735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:27.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.758+0000 7f083a735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.758+0000 7f083a735800 5 note: GC not initialized 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f06677fe640 20 reqs_thread_entry: start 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f083a735800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f083a735800 20 Filter name: none 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f06657fa640 20 reqs_thread_entry: start 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.759+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.760+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.760+0000 7f083a735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.760+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.760+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.760+0000 7f083a735800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.761+0000 7f083a735800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.761+0000 7f083a735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.762+0000 7f06ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.765+0000 7f083a735800 20 remove_watcher() i=0 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.765+0000 7f083a735800 2 removed watcher, disabling cache 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.766+0000 7f083a735800 20 remove_watcher() i=1 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.767+0000 7f083a735800 20 remove_watcher() i=2 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.768+0000 7f083a735800 20 remove_watcher() i=3 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.770+0000 7f083a735800 20 remove_watcher() i=4 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.771+0000 7f083a735800 20 remove_watcher() i=5 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.771+0000 7f083a735800 20 remove_watcher() i=6 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.772+0000 7f083a735800 20 remove_watcher() i=7 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.808 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:27.809 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:27.809 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:27.835 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:55:27.867 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:27.867 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:27.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.901+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.902+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.902+0000 7fce2e340800 20 realm 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.902+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.903+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.904+0000 7fce2e340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:27.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.904+0000 7fce2e340800 20 searching for the correct realm 2024-09-19T13:55:27.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.907+0000 7fce2a8c1640 0 -- 172.21.15.94:0/3072804495 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x56434aa0b6a0 msgr2=0x56434aa0da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.912 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.910+0000 7fce2a0c0640 0 -- 172.21.15.94:0/3072804495 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fce140a6b40 msgr2=0x7fce14017990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:27.916 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.914+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:27.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 zone default found 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 4 Realm: () 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 zonegroup default 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.915+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.916+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.916+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.916+0000 7fce2e340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:27.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.916+0000 7fce2e340800 20 started sync module instance, tier type = 2024-09-19T13:55:27.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.916+0000 7fce2e340800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=0 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=1 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=2 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=3 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=4 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=5 2024-09-19T13:55:27.928 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.926+0000 7fce2e340800 20 add_watcher() i=6 2024-09-19T13:55:27.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.927+0000 7fce2e340800 20 add_watcher() i=7 2024-09-19T13:55:27.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.927+0000 7fce2e340800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:27.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.928+0000 7fcce0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.928+0000 7fce2e340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:27.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.928+0000 7fce2e340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:27.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 5 note: GC not initialized 2024-09-19T13:55:27.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fcc5b7fe640 20 reqs_thread_entry: start 2024-09-19T13:55:27.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:27.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 20 Filter name: none 2024-09-19T13:55:27.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fcc597fa640 20 reqs_thread_entry: start 2024-09-19T13:55:27.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : miss 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.929+0000 7fce2e340800 20 rados->read ofs=0 len=0 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.930+0000 7fce2e340800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.930+0000 7fce2e340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.930+0000 7fce2e340800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.930+0000 7fce2e340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.930+0000 7fce2e340800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:27.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.930+0000 7fce2e340800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:27.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.931+0000 7fce2e340800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to be held by another RGW process; skipping for now 2024-09-19T13:55:27.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.932+0000 7fcce0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:27.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.934+0000 7fce2e340800 20 remove_watcher() i=0 2024-09-19T13:55:27.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.934+0000 7fce2e340800 2 removed watcher, disabling cache 2024-09-19T13:55:27.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.935+0000 7fce2e340800 20 remove_watcher() i=1 2024-09-19T13:55:27.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.936+0000 7fce2e340800 20 remove_watcher() i=2 2024-09-19T13:55:27.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.938+0000 7fce2e340800 20 remove_watcher() i=3 2024-09-19T13:55:27.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.939+0000 7fce2e340800 20 remove_watcher() i=4 2024-09-19T13:55:27.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.940+0000 7fce2e340800 20 remove_watcher() i=5 2024-09-19T13:55:27.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.941+0000 7fce2e340800 20 remove_watcher() i=6 2024-09-19T13:55:27.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:27.942+0000 7fce2e340800 20 remove_watcher() i=7 2024-09-19T13:55:27.954 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:55:57.964 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:55:57.999 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:57.999 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:58.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.038+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 realm 2024-09-19T13:55:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:58.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.040+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.041+0000 7fa7cb410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.041+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.041+0000 7fa7cb410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:58.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.041+0000 7fa7cb410800 20 searching for the correct realm 2024-09-19T13:55:58.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.046+0000 7fa7c62ca640 0 -- 172.21.15.94:0/3787818904 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fa7b8036060 msgr2=0x7fa7b80672b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:58.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.049+0000 7fa7c72cc640 0 -- 172.21.15.94:0/3787818904 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fa7bc0c2b00 msgr2=0x7fa7bc0c39f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.053+0000 7fa7cb410800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.053+0000 7fa7cb410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.053+0000 7fa7cb410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.054+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 zone default found 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 4 Realm: () 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 zonegroup default 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 started sync module instance, tier type = 2024-09-19T13:55:58.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.055+0000 7fa7cb410800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:58.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=0 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=1 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=2 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=3 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=4 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=5 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.065+0000 7fa7cb410800 20 add_watcher() i=6 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.066+0000 7fa7cb410800 20 add_watcher() i=7 2024-09-19T13:55:58.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.066+0000 7fa7cb410800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:58.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.067+0000 7fa67d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:58.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 5 note: GC not initialized 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa5f7fff640 20 reqs_thread_entry: start 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 20 Filter name: none 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa5f5ffb640 20 reqs_thread_entry: start 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T13:55:58.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.068+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T13:55:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T13:55:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : miss 2024-09-19T13:55:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T13:55:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.069+0000 7fa7cb410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:58.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.071+0000 7fa7cb410800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:55:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28, ofs0, ns] 2024-09-19T13:55:58.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa6aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595151 cookie 94786896792400 notifier 6572 bl.length()=1023 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa6aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa6aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa6aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_sources= new_sources= 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential sources added=[] removed=[] 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_dests= new_dests= 2024-09-19T13:55:58.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.077+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential dests added=[] removed=[] 2024-09-19T13:55:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.0 2024-09-19T13:55:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.0 2024-09-19T13:55:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.1 2024-09-19T13:55:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.1 2024-09-19T13:55:58.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.2 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.2 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.3 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.3 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.4 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.4 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.5 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.5 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.6 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.6 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.7 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.7 2024-09-19T13:55:58.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.8 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.8 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.9 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.9 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.10 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.10 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.11 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2.11 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.0 2024-09-19T13:55:58.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.1 2024-09-19T13:55:58.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.083+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2 2024-09-19T13:55:58.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.084+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.3 2024-09-19T13:55:58.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.084+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.4 2024-09-19T13:55:58.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.085+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.5 2024-09-19T13:55:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.085+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.6 2024-09-19T13:55:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.086+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.7 2024-09-19T13:55:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.086+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.8 2024-09-19T13:55:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.087+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.9 2024-09-19T13:55:58.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.087+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.10 2024-09-19T13:55:58.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.092+0000 7fa7cb410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:58.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.092+0000 7fa7cb410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.093+0000 7fa7cb410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.093+0000 7fa7cb410800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.093+0000 7fa7cb410800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.093+0000 7fa7cb410800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28, ofs0, ns] 2024-09-19T13:55:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa6aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595152 cookie 94786896792400 notifier 6572 bl.length()=1023 2024-09-19T13:55:58.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa6aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa6aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa6aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_sources= new_sources= 2024-09-19T13:55:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential sources added=[] removed=[] 2024-09-19T13:55:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_dests= new_dests= 2024-09-19T13:55:58.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.094+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential dests added=[] removed=[] 2024-09-19T13:55:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.096+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.0 2024-09-19T13:55:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.097+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.1 2024-09-19T13:55:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.097+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.2 2024-09-19T13:55:58.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.097+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.3 2024-09-19T13:55:58.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.098+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.4 2024-09-19T13:55:58.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.098+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.5 2024-09-19T13:55:58.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.098+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.6 2024-09-19T13:55:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.099+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.7 2024-09-19T13:55:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.099+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.8 2024-09-19T13:55:58.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.099+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.9 2024-09-19T13:55:58.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.100+0000 7fa7cb410800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28.10 2024-09-19T13:55:58.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.100+0000 7fa7cb410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:58.102 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.100+0000 7fa7cb410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28, ofs0, ns] 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa6aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595153 cookie 94786896792400 notifier 6572 bl.length()=991 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa6aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 info.flags=0x17 2024-09-19T13:55:58.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa6aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 to cache LRU end 2024-09-19T13:55:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa6aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_sources= new_sources= 2024-09-19T13:55:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential sources added=[] removed=[] 2024-09-19T13:55:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): orig_dests= new_dests= 2024-09-19T13:55:58.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.103+0000 7fa7cb410800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28]): potential dests added=[] removed=[] 2024-09-19T13:55:58.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.105+0000 7fa7cb410800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-19T13:55:58.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.106+0000 7fa67d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:58.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.110+0000 7fa7cb410800 20 remove_watcher() i=0 2024-09-19T13:55:58.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.110+0000 7fa7cb410800 2 removed watcher, disabling cache 2024-09-19T13:55:58.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.110+0000 7fa7cb410800 20 remove_watcher() i=1 2024-09-19T13:55:58.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.111+0000 7fa7cb410800 20 remove_watcher() i=2 2024-09-19T13:55:58.114 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.113+0000 7fa7cb410800 20 remove_watcher() i=3 2024-09-19T13:55:58.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.114+0000 7fa7cb410800 20 remove_watcher() i=4 2024-09-19T13:55:58.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.115+0000 7fa7cb410800 20 remove_watcher() i=5 2024-09-19T13:55:58.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.116+0000 7fa7cb410800 20 remove_watcher() i=6 2024-09-19T13:55:58.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.117+0000 7fa7cb410800 20 remove_watcher() i=7 2024-09-19T13:55:58.131 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T13:55:58.159 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:58.159 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:58.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.193+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 realm 2024-09-19T13:55:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:58.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.195+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.196+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.196+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.196+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:58.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.196+0000 7fe510b40800 20 searching for the correct realm 2024-09-19T13:55:58.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.400+0000 7fe5040ec640 0 -- 172.21.15.94:0/1774840076 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe4fc06d070 msgr2=0x7fe4fc0a1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:58.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.404+0000 7fe50c8ed640 0 -- 172.21.15.94:0/1774840076 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe4f407f3e0 msgr2=0x7fe4f407f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.611+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 zone default found 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 4 Realm: () 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 zonegroup default 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.615 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 started sync module instance, tier type = 2024-09-19T13:55:58.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.612+0000 7fe510b40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=0 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=1 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=2 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=3 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=4 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=5 2024-09-19T13:55:58.624 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.622+0000 7fe510b40800 20 add_watcher() i=6 2024-09-19T13:55:58.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.623+0000 7fe510b40800 20 add_watcher() i=7 2024-09-19T13:55:58.625 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.623+0000 7fe510b40800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:58.626 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.624+0000 7fe3c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe510b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe510b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe510b40800 5 note: GC not initialized 2024-09-19T13:55:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe3c1fe3640 20 reqs_thread_entry: start 2024-09-19T13:55:58.627 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe510b40800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe510b40800 20 Filter name: none 2024-09-19T13:55:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe3337fe640 20 reqs_thread_entry: start 2024-09-19T13:55:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.625+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.626+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:58.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.626+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T13:55:58.629 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T13:55:58.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.627+0000 7fe510b40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:58.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.629+0000 7fe3c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:58.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.631+0000 7fe510b40800 20 remove_watcher() i=0 2024-09-19T13:55:58.633 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.631+0000 7fe510b40800 2 removed watcher, disabling cache 2024-09-19T13:55:58.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.632+0000 7fe510b40800 20 remove_watcher() i=1 2024-09-19T13:55:58.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.633+0000 7fe510b40800 20 remove_watcher() i=2 2024-09-19T13:55:58.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.634+0000 7fe510b40800 20 remove_watcher() i=3 2024-09-19T13:55:58.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.635+0000 7fe510b40800 20 remove_watcher() i=4 2024-09-19T13:55:58.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.636+0000 7fe510b40800 20 remove_watcher() i=5 2024-09-19T13:55:58.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.637+0000 7fe510b40800 20 remove_watcher() i=6 2024-09-19T13:55:58.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.638+0000 7fe510b40800 20 remove_watcher() i=7 2024-09-19T13:55:58.650 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:58.650 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:58.650 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-trim-reshard-log-entries id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:55:58.650 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:58.729 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-19T13:55:58.729 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:58.905 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T13:55:58.933 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:58.933 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:58.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.967+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.968+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.968+0000 7fca0cc87800 20 realm 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.968+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.968+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.968+0000 7fca0cc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.968+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.969+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:58.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.969+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.969+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.969+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.970+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:58.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.970+0000 7fca0cc87800 20 searching for the correct realm 2024-09-19T13:55:58.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:58.974+0000 7fca0af72640 0 -- 172.21.15.94:0/1269720780 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fc9f403f040 msgr2=0x7fc9f402f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:59.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.180+0000 7fca0a771640 0 -- 172.21.15.94:0/1269720780 >> [v2:172.21.15.149:6810/155328186,v1:172.21.15.149:6811/155328186] conn(0x5580a2d6ce90 msgr2=0x5580a2d6f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:59.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:59.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.182+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 zone default found 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 4 Realm: () 2024-09-19T13:55:59.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 zonegroup default 2024-09-19T13:55:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.183+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.184+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.184+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.184+0000 7fca0cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.184+0000 7fca0cc87800 20 started sync module instance, tier type = 2024-09-19T13:55:59.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.184+0000 7fca0cc87800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:59.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=0 2024-09-19T13:55:59.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=1 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=2 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=3 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=4 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=5 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.192+0000 7fca0cc87800 20 add_watcher() i=6 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.193+0000 7fca0cc87800 20 add_watcher() i=7 2024-09-19T13:55:59.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.193+0000 7fca0cc87800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:59.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fc8c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:59.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fca0cc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:59.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fca0cc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:59.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fca0cc87800 5 note: GC not initialized 2024-09-19T13:55:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fc83b7fe640 20 reqs_thread_entry: start 2024-09-19T13:55:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fca0cc87800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fca0cc87800 20 Filter name: none 2024-09-19T13:55:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fc8397fa640 20 reqs_thread_entry: start 2024-09-19T13:55:59.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.195+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.196+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.196+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.196+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.196+0000 7fca0cc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.196+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.197+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.197+0000 7fca0cc87800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.197+0000 7fca0cc87800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:55:59.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.197+0000 7fca0cc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:59.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.199+0000 7fc8c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:59.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.201+0000 7fca0cc87800 20 remove_watcher() i=0 2024-09-19T13:55:59.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.201+0000 7fca0cc87800 2 removed watcher, disabling cache 2024-09-19T13:55:59.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.201+0000 7fca0cc87800 20 remove_watcher() i=1 2024-09-19T13:55:59.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.202+0000 7fca0cc87800 20 remove_watcher() i=2 2024-09-19T13:55:59.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.203+0000 7fca0cc87800 20 remove_watcher() i=3 2024-09-19T13:55:59.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.204+0000 7fca0cc87800 20 remove_watcher() i=4 2024-09-19T13:55:59.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.205+0000 7fca0cc87800 20 remove_watcher() i=5 2024-09-19T13:55:59.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.206+0000 7fca0cc87800 20 remove_watcher() i=6 2024-09-19T13:55:59.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.207+0000 7fca0cc87800 20 remove_watcher() i=7 2024-09-19T13:55:59.219 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:59.219 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:59.219 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:59.220 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:59.221 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-19T13:55:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:59.254 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:59.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.289+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 realm 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.290+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.291+0000 7f1ecaf25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.291+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.291+0000 7f1ecaf25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:59.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.291+0000 7f1ecaf25800 20 searching for the correct realm 2024-09-19T13:55:59.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.293+0000 7f1ec63ad640 0 -- 172.21.15.94:0/1847694038 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f1eb8027040 msgr2=0x7f1eb8019a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:55:59.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.298+0000 7f1ec6bae640 0 -- 172.21.15.94:0/1847694038 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f1ebc05cb60 msgr2=0x7f1ebc069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:59.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:59.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.503+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 zone default found 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 4 Realm: () 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 zonegroup default 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.504+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.505+0000 7f1ecaf25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.505+0000 7f1ecaf25800 20 started sync module instance, tier type = 2024-09-19T13:55:59.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.505+0000 7f1ecaf25800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=0 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=1 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=2 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=3 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=4 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=5 2024-09-19T13:55:59.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.513+0000 7f1ecaf25800 20 add_watcher() i=6 2024-09-19T13:55:59.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.514+0000 7f1ecaf25800 20 add_watcher() i=7 2024-09-19T13:55:59.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.514+0000 7f1ecaf25800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:59.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1d7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:59.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 5 note: GC not initialized 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1cf7fff640 20 reqs_thread_entry: start 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 20 Filter name: none 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1cf5ffb640 20 reqs_thread_entry: start 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-19T13:55:59.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.516+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:55:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-19T13:55:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-19T13:55:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 : miss 2024-09-19T13:55:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:55:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:55:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.517+0000 7f1ecaf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 2024-09-19T13:55:59.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.522+0000 7f1ecaf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.522+0000 7f1ecaf25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.522+0000 7f1ecaf25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.522+0000 7f1ecaf25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29, ofs0, ns] 2024-09-19T13:55:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1da9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595111 cookie 94345823255008 notifier 6963 bl.length()=999 2024-09-19T13:55:59.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1da9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1da9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1da9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_sources= new_sources= 2024-09-19T13:55:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential sources added=[] removed=[] 2024-09-19T13:55:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_dests= new_dests= 2024-09-19T13:55:59.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.523+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential dests added=[] removed=[] 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.0 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.0 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.1 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.1 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.2 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.2 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.3 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.3 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.4 2024-09-19T13:55:59.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.4 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.5 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.5 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.6 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.6 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.7 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.7 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.8 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.8 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.9 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.9 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.10 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.10 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.11 2024-09-19T13:55:59.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.11 2024-09-19T13:55:59.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.527+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.0 2024-09-19T13:55:59.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.528+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1 2024-09-19T13:55:59.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.528+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.2 2024-09-19T13:55:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.529+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.3 2024-09-19T13:55:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.530+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.4 2024-09-19T13:55:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.530+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.5 2024-09-19T13:55:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.530+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.6 2024-09-19T13:55:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.532+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.7 2024-09-19T13:55:59.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.532+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.8 2024-09-19T13:55:59.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.532+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.9 2024-09-19T13:55:59.534 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.533+0000 7f1ecaf25800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.10 2024-09-19T13:55:59.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.535+0000 7f1ecaf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:59.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.535+0000 7f1ecaf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29, ofs0, ns] 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1daa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595112 cookie 94345823255008 notifier 6963 bl.length()=999 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1daa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1daa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1daa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_sources= new_sources= 2024-09-19T13:55:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential sources added=[] removed=[] 2024-09-19T13:55:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_dests= new_dests= 2024-09-19T13:55:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential dests added=[] removed=[] 2024-09-19T13:55:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 -1 Injecting error=-5 at location=block_writes 2024-09-19T13:55:59.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.537+0000 7f1ecaf25800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-19T13:55:59.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.541+0000 7f1ecaf25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-19T13:55:59.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.541+0000 7f1ecaf25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 2024-09-19T13:55:59.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29, ofs0, ns] 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1daa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94345823255008 notifier 6963 bl.length()=967 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1daa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1daa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1daa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:55:59.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_sources= new_sources= 2024-09-19T13:55:59.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential sources added=[] removed=[] 2024-09-19T13:55:59.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_dests= new_dests= 2024-09-19T13:55:59.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.543+0000 7f1ecaf25800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential dests added=[] removed=[] 2024-09-19T13:55:59.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.545+0000 7f1ecaf25800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-19T13:55:59.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.547+0000 7f1d7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:59.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.550+0000 7f1ecaf25800 20 remove_watcher() i=0 2024-09-19T13:55:59.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.550+0000 7f1ecaf25800 2 removed watcher, disabling cache 2024-09-19T13:55:59.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.551+0000 7f1ecaf25800 20 remove_watcher() i=1 2024-09-19T13:55:59.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.551+0000 7f1ecaf25800 20 remove_watcher() i=2 2024-09-19T13:55:59.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.553+0000 7f1ecaf25800 20 remove_watcher() i=3 2024-09-19T13:55:59.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.553+0000 7f1ecaf25800 20 remove_watcher() i=4 2024-09-19T13:55:59.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.555+0000 7f1ecaf25800 20 remove_watcher() i=5 2024-09-19T13:55:59.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.555+0000 7f1ecaf25800 20 remove_watcher() i=6 2024-09-19T13:55:59.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.555+0000 7f1ecaf25800 20 remove_watcher() i=7 2024-09-19T13:55:59.569 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T13:55:59.600 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:59.600 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:59.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.633+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 realm 2024-09-19T13:55:59.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.635+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.637 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.636+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:59.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.636+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.636+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:59.638 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.636+0000 7f62ac52a800 20 searching for the correct realm 2024-09-19T13:55:59.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.640+0000 7f62a8a18640 0 -- 172.21.15.94:0/3122414293 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55ce65e9cd20 msgr2=0x55ce65e9f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:59.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.642+0000 7f62a8217640 0 -- 172.21.15.94:0/3122414293 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f62900148d0 msgr2=0x7f629002d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:55:59.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:55:59.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:55:59.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:55:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:55:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:55:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:55:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.646+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:55:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 zone default found 2024-09-19T13:55:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 4 Realm: () 2024-09-19T13:55:59.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 zonegroup default 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.647+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.648+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.648+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.648+0000 7f62ac52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.648+0000 7f62ac52a800 20 started sync module instance, tier type = 2024-09-19T13:55:59.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.648+0000 7f62ac52a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=0 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=1 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=2 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=3 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=4 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=5 2024-09-19T13:55:59.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.656+0000 7f62ac52a800 20 add_watcher() i=6 2024-09-19T13:55:59.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.657+0000 7f62ac52a800 20 add_watcher() i=7 2024-09-19T13:55:59.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.657+0000 7f62ac52a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.659+0000 7f615efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.659+0000 7f62ac52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.659+0000 7f62ac52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.659+0000 7f62ac52a800 5 note: GC not initialized 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.660+0000 7f615dfdb640 20 reqs_thread_entry: start 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.660+0000 7f62ac52a800 20 init_complete bucket index max shards: 11 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.660+0000 7f62ac52a800 20 Filter name: none 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.660+0000 7f60cf7fe640 20 reqs_thread_entry: start 2024-09-19T13:55:59.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.660+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.661+0000 7f62ac52a800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.662+0000 7f62ac52a800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:55:59.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.662+0000 7f62ac52a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:55:59.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.663+0000 7f615efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:55:59.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.665+0000 7f62ac52a800 20 remove_watcher() i=0 2024-09-19T13:55:59.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.665+0000 7f62ac52a800 2 removed watcher, disabling cache 2024-09-19T13:55:59.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.666+0000 7f62ac52a800 20 remove_watcher() i=1 2024-09-19T13:55:59.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.667+0000 7f62ac52a800 20 remove_watcher() i=2 2024-09-19T13:55:59.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.668+0000 7f62ac52a800 20 remove_watcher() i=3 2024-09-19T13:55:59.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.669+0000 7f62ac52a800 20 remove_watcher() i=4 2024-09-19T13:55:59.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.670+0000 7f62ac52a800 20 remove_watcher() i=5 2024-09-19T13:55:59.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.671+0000 7f62ac52a800 20 remove_watcher() i=6 2024-09-19T13:55:59.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.672+0000 7f62ac52a800 20 remove_watcher() i=7 2024-09-19T13:55:59.683 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:59.683 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:55:59.683 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:55:59.683 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:55:59.734 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:55:59.767 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:59.767 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:59.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.802+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 realm 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:55:59.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.803+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.804+0000 7f98f6016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:55:59.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.804+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:55:59.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.805+0000 7f98f6016800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:55:59.806 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.805+0000 7f98f6016800 20 searching for the correct realm 2024-09-19T13:55:59.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:55:59.807+0000 7f98f0fe6640 0 -- 172.21.15.94:0/415457974 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f98e406a3d0 msgr2=0x7f98e407b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:00.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.013+0000 7f98f17e7640 0 -- 172.21.15.94:0/415457974 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f98dc03f400 msgr2=0x7f98dc03f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:00.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.220+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:00.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 zone default found 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 4 Realm: () 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 zonegroup default 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.221+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.222+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.222+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.222+0000 7f98f6016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.222+0000 7f98f6016800 20 started sync module instance, tier type = 2024-09-19T13:56:00.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.222+0000 7f98f6016800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:00.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=0 2024-09-19T13:56:00.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=1 2024-09-19T13:56:00.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=2 2024-09-19T13:56:00.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=3 2024-09-19T13:56:00.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=4 2024-09-19T13:56:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=5 2024-09-19T13:56:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.231+0000 7f98f6016800 20 add_watcher() i=6 2024-09-19T13:56:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.232+0000 7f98f6016800 20 add_watcher() i=7 2024-09-19T13:56:00.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.232+0000 7f98f6016800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:00.234 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f97a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:00.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f98f6016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f98f6016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f98f6016800 5 note: GC not initialized 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f97a67e4640 20 reqs_thread_entry: start 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f98f6016800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f98f6016800 20 Filter name: none 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.234+0000 7f9717fff640 20 reqs_thread_entry: start 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-19T13:56:00.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-19T13:56:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-19T13:56:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 : miss 2024-09-19T13:56:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.235+0000 7f98f6016800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.236+0000 7f98f6016800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.236+0000 7f98f6016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.236+0000 7f98f6016800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.236+0000 7f98f6016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.236+0000 7f98f6016800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.236+0000 7f98f6016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 2024-09-19T13:56:00.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.240+0000 7f98f6016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.240+0000 7f98f6016800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.240+0000 7f98f6016800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.240+0000 7f98f6016800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29, ofs0, ns] 2024-09-19T13:56:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f97d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94527447494464 notifier 6653 bl.length()=999 2024-09-19T13:56:00.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f97d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f97d4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f97d4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_sources= new_sources= 2024-09-19T13:56:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential sources added=[] removed=[] 2024-09-19T13:56:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_dests= new_dests= 2024-09-19T13:56:00.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.241+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential dests added=[] removed=[] 2024-09-19T13:56:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.0 2024-09-19T13:56:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.0 2024-09-19T13:56:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.1 2024-09-19T13:56:00.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.1 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.2 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.2 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.3 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.3 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.4 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.4 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.5 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.5 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.6 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.6 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.7 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.7 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.8 2024-09-19T13:56:00.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.8 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.9 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.9 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.10 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.10 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.11 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1.11 2024-09-19T13:56:00.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.246+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.0 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.247+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.247+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.2 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.247+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.3 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.248+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.4 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.248+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.5 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.249+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.6 2024-09-19T13:56:00.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.249+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.7 2024-09-19T13:56:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.250+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.8 2024-09-19T13:56:00.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.250+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.9 2024-09-19T13:56:00.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.251+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.10 2024-09-19T13:56:00.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.253+0000 7f98f6016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:00.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.253+0000 7f98f6016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 2024-09-19T13:56:00.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.254+0000 7f98f6016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.254+0000 7f98f6016800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.254+0000 7f98f6016800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f98f6016800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29, ofs0, ns] 2024-09-19T13:56:00.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f97d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94527447494464 notifier 6653 bl.length()=999 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f97d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f97d4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f97d4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_sources= new_sources= 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential sources added=[] removed=[] 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_dests= new_dests= 2024-09-19T13:56:00.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.255+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential dests added=[] removed=[] 2024-09-19T13:56:00.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.258+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.0 2024-09-19T13:56:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.259+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.1 2024-09-19T13:56:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.259+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.2 2024-09-19T13:56:00.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.259+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.3 2024-09-19T13:56:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.260+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.4 2024-09-19T13:56:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.260+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.5 2024-09-19T13:56:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.260+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.6 2024-09-19T13:56:00.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.260+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.7 2024-09-19T13:56:00.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.261+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.8 2024-09-19T13:56:00.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.261+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.9 2024-09-19T13:56:00.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.261+0000 7f98f6016800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29.10 2024-09-19T13:56:00.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.262+0000 7f98f6016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:00.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.262+0000 7f98f6016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 2024-09-19T13:56:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f98f6016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f98f6016800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f98f6016800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f98f6016800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29, ofs0, ns] 2024-09-19T13:56:00.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f97d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595116 cookie 94527447494464 notifier 6653 bl.length()=967 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f97d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 info.flags=0x17 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f97d4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 to cache LRU end 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.263+0000 7f97d4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.264+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_sources= new_sources= 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.264+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential sources added=[] removed=[] 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.264+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): orig_dests= new_dests= 2024-09-19T13:56:00.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.264+0000 7f98f6016800 20 handle_bi_update(): bucket=:error-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29]): potential dests added=[] removed=[] 2024-09-19T13:56:00.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.266+0000 7f98f6016800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-19T13:56:00.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.267+0000 7f97a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:00.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.269+0000 7f98f6016800 20 remove_watcher() i=0 2024-09-19T13:56:00.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.269+0000 7f98f6016800 2 removed watcher, disabling cache 2024-09-19T13:56:00.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.270+0000 7f98f6016800 20 remove_watcher() i=1 2024-09-19T13:56:00.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.271+0000 7f98f6016800 20 remove_watcher() i=2 2024-09-19T13:56:00.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.272+0000 7f98f6016800 20 remove_watcher() i=3 2024-09-19T13:56:00.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.273+0000 7f98f6016800 20 remove_watcher() i=4 2024-09-19T13:56:00.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.274+0000 7f98f6016800 20 remove_watcher() i=5 2024-09-19T13:56:00.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.275+0000 7f98f6016800 20 remove_watcher() i=6 2024-09-19T13:56:00.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.276+0000 7f98f6016800 20 remove_watcher() i=7 2024-09-19T13:56:00.288 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T13:56:00.317 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:00.317 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:00.353 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.352+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 realm 2024-09-19T13:56:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:00.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.354+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.355+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.355+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.355+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:00.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.355+0000 7fe8cd525800 20 searching for the correct realm 2024-09-19T13:56:00.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.358+0000 7fe8c8aa1640 0 -- 172.21.15.94:0/226140487 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x560c5b750260 msgr2=0x560c5b7526b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:00.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.361+0000 7fe8c92a2640 0 -- 172.21.15.94:0/226140487 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe8c0050bd0 msgr2=0x7fe8c007d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:00.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 zone default found 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 4 Realm: () 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 zonegroup default 2024-09-19T13:56:00.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.366+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 started sync module instance, tier type = 2024-09-19T13:56:00.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.367+0000 7fe8cd525800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=0 2024-09-19T13:56:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=1 2024-09-19T13:56:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=2 2024-09-19T13:56:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=3 2024-09-19T13:56:00.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=4 2024-09-19T13:56:00.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=5 2024-09-19T13:56:00.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.376+0000 7fe8cd525800 20 add_watcher() i=6 2024-09-19T13:56:00.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.377+0000 7fe8cd525800 20 add_watcher() i=7 2024-09-19T13:56:00.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.377+0000 7fe8cd525800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:00.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.378+0000 7fe77ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.378+0000 7fe8cd525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.378+0000 7fe8cd525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.378+0000 7fe8cd525800 5 note: GC not initialized 2024-09-19T13:56:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe77efe5640 20 reqs_thread_entry: start 2024-09-19T13:56:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe8cd525800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:00.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe8cd525800 20 Filter name: none 2024-09-19T13:56:00.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe77cfe1640 20 reqs_thread_entry: start 2024-09-19T13:56:00.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.379+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:00.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.380+0000 7fe8cd525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:00.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.382+0000 7fe77ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:00.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.384+0000 7fe8cd525800 20 remove_watcher() i=0 2024-09-19T13:56:00.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.384+0000 7fe8cd525800 2 removed watcher, disabling cache 2024-09-19T13:56:00.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.385+0000 7fe8cd525800 20 remove_watcher() i=1 2024-09-19T13:56:00.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.386+0000 7fe8cd525800 20 remove_watcher() i=2 2024-09-19T13:56:00.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.387+0000 7fe8cd525800 20 remove_watcher() i=3 2024-09-19T13:56:00.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.388+0000 7fe8cd525800 20 remove_watcher() i=4 2024-09-19T13:56:00.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.389+0000 7fe8cd525800 20 remove_watcher() i=5 2024-09-19T13:56:00.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.389+0000 7fe8cd525800 20 remove_watcher() i=6 2024-09-19T13:56:00.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.390+0000 7fe8cd525800 20 remove_watcher() i=7 2024-09-19T13:56:00.401 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:00.401 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:00.402 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-block-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:56:00.402 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:00.475 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at block_writes 2024-09-19T13:56:00.475 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:00.652 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T13:56:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:00.680 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:00.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.715+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 realm 2024-09-19T13:56:00.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.717+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.718+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.718+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.718+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:00.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.718+0000 7fc810546800 20 searching for the correct realm 2024-09-19T13:56:00.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.721+0000 7fc807fff640 0 -- 172.21.15.94:0/471292787 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x56469d53be50 msgr2=0x56469d53e240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:00.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.724+0000 7fc80e030640 0 -- 172.21.15.94:0/471292787 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc7f802fb70 msgr2=0x7fc7f804c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.728+0000 7fc810546800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.728+0000 7fc810546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.728+0000 7fc810546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.728+0000 7fc810546800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.728+0000 7fc810546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.728+0000 7fc810546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:00.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 zone default found 2024-09-19T13:56:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 4 Realm: () 2024-09-19T13:56:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:00.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 zonegroup default 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.729+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 started sync module instance, tier type = 2024-09-19T13:56:00.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.730+0000 7fc810546800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:00.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=0 2024-09-19T13:56:00.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=1 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=2 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=3 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=4 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=5 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.738+0000 7fc810546800 20 add_watcher() i=6 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.739+0000 7fc810546800 20 add_watcher() i=7 2024-09-19T13:56:00.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.739+0000 7fc810546800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.741+0000 7fc6c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.741+0000 7fc810546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.741+0000 7fc810546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc810546800 5 note: GC not initialized 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc63f7fe640 20 reqs_thread_entry: start 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc810546800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:00.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc810546800 20 Filter name: none 2024-09-19T13:56:00.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc63d7fa640 20 reqs_thread_entry: start 2024-09-19T13:56:00.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.742+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.743+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.743+0000 7fc810546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.743+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.743+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.743+0000 7fc810546800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.744+0000 7fc810546800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:00.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.744+0000 7fc810546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:00.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.745+0000 7fc6c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:00.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.747+0000 7fc810546800 20 remove_watcher() i=0 2024-09-19T13:56:00.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.747+0000 7fc810546800 2 removed watcher, disabling cache 2024-09-19T13:56:00.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.748+0000 7fc810546800 20 remove_watcher() i=1 2024-09-19T13:56:00.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.749+0000 7fc810546800 20 remove_watcher() i=2 2024-09-19T13:56:00.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.750+0000 7fc810546800 20 remove_watcher() i=3 2024-09-19T13:56:00.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.751+0000 7fc810546800 20 remove_watcher() i=4 2024-09-19T13:56:00.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.752+0000 7fc810546800 20 remove_watcher() i=5 2024-09-19T13:56:00.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.753+0000 7fc810546800 20 remove_watcher() i=6 2024-09-19T13:56:00.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.754+0000 7fc810546800 20 remove_watcher() i=7 2024-09-19T13:56:00.765 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:00.765 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:00.765 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:00.765 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:00.766 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-19T13:56:00.800 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:00.800 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:00.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.835+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 realm 2024-09-19T13:56:00.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:00.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:00.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:00.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.837+0000 7f907a60e800 20 searching for the correct realm 2024-09-19T13:56:00.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:00.840+0000 7f9075458640 0 -- 172.21.15.94:0/1603354054 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f907007c070 msgr2=0x7f907007e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.046+0000 7f9075c59640 0 -- 172.21.15.94:0/1603354054 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9060040940 msgr2=0x7f9060041440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:01.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 zone default found 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 4 Realm: () 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:01.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 zonegroup default 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.255+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.255+0000 7f907a60e800 20 started sync module instance, tier type = 2024-09-19T13:56:01.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.255+0000 7f907a60e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=0 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=1 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=2 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=3 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=4 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=5 2024-09-19T13:56:01.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=6 2024-09-19T13:56:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.265+0000 7f907a60e800 20 add_watcher() i=7 2024-09-19T13:56:01.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.265+0000 7f907a60e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:01.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f8f2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f907a60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f907a60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f907a60e800 5 note: GC not initialized 2024-09-19T13:56:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f8f2afe5640 20 reqs_thread_entry: start 2024-09-19T13:56:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f907a60e800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:01.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.267+0000 7f907a60e800 20 Filter name: none 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f8f28fe1640 20 reqs_thread_entry: start 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : miss 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.269+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.269+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.269+0000 7f907a60e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.269+0000 7f907a60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.269+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.269+0000 7f907a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595156 cookie 94592427244544 notifier 7056 bl.length()=999 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:01.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.279+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.0 2024-09-19T13:56:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.279+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.0 2024-09-19T13:56:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.279+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.1 2024-09-19T13:56:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.279+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.1 2024-09-19T13:56:01.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.2 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.2 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.3 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.3 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.4 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.4 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.5 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.5 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.6 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.6 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.7 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.7 2024-09-19T13:56:01.282 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.8 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.8 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.9 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.9 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.10 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.10 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.11 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.11 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.0 2024-09-19T13:56:01.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1 2024-09-19T13:56:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.281+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2 2024-09-19T13:56:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.281+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.3 2024-09-19T13:56:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.282+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.4 2024-09-19T13:56:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.282+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.5 2024-09-19T13:56:01.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.283+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.6 2024-09-19T13:56:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.284+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.7 2024-09-19T13:56:01.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.284+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.8 2024-09-19T13:56:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.285+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.9 2024-09-19T13:56:01.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.286+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.10 2024-09-19T13:56:01.289 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.289+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:01.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.289+0000 7f907a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595157 cookie 94592427244544 notifier 7056 bl.length()=999 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:01.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f907a60e800 time 2024-09-19T13:56:01.292096+0000 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f907b78c76a] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:56:01.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.292+0000 7f907a60e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f907a60e800 time 2024-09-19T13:56:01.292096+0000 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f907b78c76a] 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.295 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:56:01.296 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f907a60e800 thread_name:radosgw-admin 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f907a43e6f0] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f907a48b99c] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f907b78c7c4] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.312 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.293+0000 7f907a60e800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f907a60e800 thread_name:radosgw-admin 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f907a43e6f0] 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f907a48b99c] 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f907b78c7c4] 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.313 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:56:00.820+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.476476s 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x560803eaced0 auth_method 0 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x560803eb84e0 auth_method 0 2024-09-19T13:56:01.314 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x560803eb3160 auth_method 0 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.315 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 6695 payload 824 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:56:00.820+0000 7f907645a640 1 monclient: found mon.noname-c 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: dump: 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.316 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: dump: 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.317 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:56:00.821+0000 7f907a60e800 5 monclient: authenticate success, global_id 6695 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:56:00.821+0000 7f8f63e07640 4 set_mon_vals no callback set 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:56:00.821+0000 7f907a60e800 1 librados: init done 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:56:00.823+0000 7f8f62604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:01.318 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:56:00.823+0000 7f8f62604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:56:00.823+0000 7f8f62604640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:56:00.823+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f8f5c077570 auth_method 0 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:56:00.823+0000 7f9075458640 10 monclient: get_auth_request con 0x560803f94230 auth_method 0 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:56:00.824+0000 7f9075c59640 10 monclient: get_auth_request con 0x560803fb6f70 auth_method 0 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:56:00.825+0000 7f9075458640 10 monclient: get_auth_request con 0x560803fbc000 auth_method 0 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:56:00.826+0000 7f907a60e800 10 monclient: build_initial_monmap 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:56:00.826+0000 7f907a60e800 1 build_initial for_mkfs: 0 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:56:00.826+0000 7f907a60e800 10 monclient: monmap: 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:01.319 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding auth protocol: cephx 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding auth protocol: cephx 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding auth protocol: cephx 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.320 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:56:00.826+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 asok(0x560803d49410) register_command objecter_requests cmddesc objecter_requests hook 0x560803fc34c0 EEXIST 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:56:00.826+0000 7f907a60e800 10 monclient: init 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding auth protocol: cephx 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding auth protocol: cephx 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding auth protocol: cephx 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.321 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:56:00.826+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:56:00.826+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:56:00.827+0000 7f907a60e800 5 asok(0x560803d49410) register_command rotate-key cmddesc rotate-key hook 0x560803fbf0f0 EEXIST 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-b con 0x560803fe77e0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-a con 0x560803fe7bc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:01.322 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-c con 0x560803fe64f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.483097s 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x560803fe64f0 auth_method 0 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x560803fe7bc0 auth_method 0 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.323 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x560803fe77e0 auth_method 0 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.324 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:56:00.827+0000 7f907645a640 1 monclient: found mon.noname-c 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: dump: 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.325 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: dump: 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.326 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:56:00.827+0000 7f907a60e800 5 monclient: authenticate success, global_id 6698 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:56:00.827+0000 7f9076c5b640 4 set_mon_vals no callback set 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.327 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:56:00.829+0000 7f8f5b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:56:00.829+0000 7f8f5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:56:00.829+0000 7f8f5b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:56:00.829+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f8f50077480 auth_method 0 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:56:00.829+0000 7f907a60e800 10 monclient: get_monmap_and_config 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:56:00.829+0000 7f907a60e800 10 monclient: build_initial_monmap 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:56:00.829+0000 7f907a60e800 1 build_initial for_mkfs: 0 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:56:00.829+0000 7f907a60e800 10 monclient: monmap: 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:01.328 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding auth protocol: cephx 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding auth protocol: cephx 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding auth protocol: cephx 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.329 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:56:00.830+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient: init 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding auth protocol: cephx 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding auth protocol: cephx 2024-09-19T13:56:01.330 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding auth protocol: cephx 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:56:00.830+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:56:00.830+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 asok(0x560803d49410) register_command rotate-key cmddesc rotate-key hook 0x7ffcc7bf0a68 EEXIST 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-c con 0x56080403bb40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-b con 0x56080400b950 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-a con 0x560804036f00 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.486785s 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x56080403bb40 auth_method 0 2024-09-19T13:56:01.332 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x560804036f00 auth_method 0 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x56080400b950 auth_method 0 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.333 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:56:00.831+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:56:00.831+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:56:00.831+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:56:00.831+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 7053 payload 274 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:56:00.831+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:56:00.831+0000 7f907645a640 1 monclient: found mon.noname-a 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:56:00.831+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:01.334 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: dump: 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.335 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: dump: 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 monclient: authenticate success, global_id 7053 2024-09-19T13:56:01.336 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: get_monmap_and_config success 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:56:00.831+0000 7f907a60e800 4 set_mon_vals no callback set 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: shutdown 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: build_initial_monmap 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:56:00.831+0000 7f907a60e800 1 build_initial for_mkfs: 0 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: monmap: 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:01.337 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding auth protocol: cephx 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding auth protocol: cephx 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding auth protocol: cephx 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.338 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:56:00.832+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: starting msgr at 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: starting objecter 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 asok(0x560803d49410) register_command objecter_requests cmddesc objecter_requests hook 0x560804036290 EEXIST 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: setting wanted keys 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: calling monclient init 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient: init 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding auth protocol: cephx 2024-09-19T13:56:01.339 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding auth protocol: cephx 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding auth protocol: cephx 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.340 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:56:00.832+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:56:00.832+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 asok(0x560803d49410) register_command rotate-key cmddesc rotate-key hook 0x560803ffc1e8 EEXIST 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-c con 0x56080400b950 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-b con 0x560804036f00 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-a con 0x56080403bb40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.341 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.488945s 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x56080403bb40 auth_method 0 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x56080400b950 auth_method 0 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x560804036f00 auth_method 0 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.342 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:56:00.833+0000 7f907645a640 1 monclient: found mon.noname-a 2024-09-19T13:56:01.343 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: dump: 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.344 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: dump: 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.345 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:56:00.833+0000 7f907a60e800 5 monclient: authenticate success, global_id 7056 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:56:00.833+0000 7f8f597fa640 4 set_mon_vals no callback set 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:56:00.833+0000 7f907a60e800 1 librados: init done 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:56:00.833+0000 7f907a60e800 5 asok(0x560803d49410) register_command cr dump hook 0x560804032af8 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:56:00.835+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:56:00.835+0000 7f8f477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:56:00.835+0000 7f8f477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.346 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:56:00.835+0000 7f8f477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:56:00.835+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f8f40077570 auth_method 0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:56:00.835+0000 7f9075458640 10 monclient: get_auth_request con 0x560804055530 auth_method 0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 realm 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:56:00.836+0000 7f907a60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:56:00.836+0000 7f9075c59640 10 monclient: get_auth_request con 0x560804059750 auth_method 0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.347 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 searching for the correct realm 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:56:00.838+0000 7f9075458640 10 monclient: get_auth_request con 0x56080405e9f0 auth_method 0 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:56:00.838+0000 7f907645a640 10 monclient: get_auth_request con 0x7f906002e440 auth_method 0 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:56:00.839+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f906809dbb0 auth_method 0 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:56:00.840+0000 7f9075458640 10 monclient: get_auth_request con 0x7f907007c070 auth_method 0 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:56:00.840+0000 7f9075458640 0 -- 172.21.15.94:0/1603354054 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f907007c070 msgr2=0x7f907007e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:56:01.042+0000 7f9075458640 10 monclient: get_auth_request con 0x7f907007c070 auth_method 0 2024-09-19T13:56:01.348 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:56:01.044+0000 7f907645a640 10 monclient: get_auth_request con 0x7f906003f040 auth_method 0 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:56:01.046+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f9060040940 auth_method 0 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:56:01.046+0000 7f9075c59640 0 -- 172.21.15.94:0/1603354054 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9060040940 msgr2=0x7f9060041440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:56:01.247+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f9060040940 auth_method 0 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:56:01.248+0000 7f8f477fe640 1 client.7056.objecter ms_handle_reset 0x7f907007c070 session 0x7f907009d040 osd.4 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:56:01.248+0000 7f8f477fe640 10 monclient: _renew_subs 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:56:01.248+0000 7f8f477fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:56:01.248+0000 7f9075458640 10 monclient: get_auth_request con 0x7f8f400873f0 auth_method 0 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:01.349 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 zone default found 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:56:01.254+0000 7f907a60e800 4 Realm: () 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:56:01.254+0000 7f907a60e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:56:01.254+0000 7f907a60e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:56:01.254+0000 7f907a60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 zonegroup default 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.350 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:56:01.255+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:56:01.255+0000 7f907a60e800 20 started sync module instance, tier type = 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:56:01.255+0000 7f907a60e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=0 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=1 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=2 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=3 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=4 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=5 2024-09-19T13:56:01.351 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=6 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:56:01.265+0000 7f907a60e800 20 add_watcher() i=7 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:56:01.265+0000 7f907a60e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding auth protocol: cephx 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding auth protocol: cephx 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding auth protocol: cephx 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.352 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:56:01.267+0000 7f8f2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:56:01.267+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache list hook 0x5608040291f0 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache inspect hook 0x5608040291f0 2024-09-19T13:56:01.353 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache erase hook 0x5608040291f0 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache zap hook 0x5608040291f0 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 note: GC not initialized 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:56:01.267+0000 7f8f2afe5640 20 reqs_thread_entry: start 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace show hook 0x7f9068005390 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace history hook 0x7f9068005390 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace active hook 0x7f9068005390 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace active_short hook 0x7f9068005390 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 Filter name: none 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:56:01.268+0000 7f8f28fe1640 20 reqs_thread_entry: start 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.354 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : miss 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:56:01.269+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.355 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595156 cookie 94592427244544 notifier 7056 bl.length()=999 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:56:01.279+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.0 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:56:01.279+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.0 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:56:01.279+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.1 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:56:01.279+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.1 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.2 2024-09-19T13:56:01.356 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.2 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.3 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.3 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.4 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.4 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.5 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.5 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.6 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.6 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.7 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.7 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.8 2024-09-19T13:56:01.357 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.8 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.9 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.9 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.10 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.10 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.11 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.11 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.0 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:56:01.281+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:56:01.281+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.3 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:56:01.282+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.4 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:56:01.282+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.5 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:56:01.283+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.6 2024-09-19T13:56:01.358 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:56:01.284+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.7 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:56:01.284+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.8 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:56:01.285+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.9 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:56:01.286+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.10 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:56:01.289+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:56:01.289+0000 7f907a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.359 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595157 cookie 94592427244544 notifier 7056 bl.length()=999 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:56:01.292+0000 7f907a60e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f907a60e800 time 2024-09-19T13:56:01.292096+0000 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.360 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f907b78c76a] 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:56:01.293+0000 7f907a60e800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f907a60e800 thread_name:radosgw-admin 2024-09-19T13:56:01.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f907a43e6f0] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f907a48b99c] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f907b78c7c4] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:56:01.362 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:56:01.363 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:56:01.364 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:56:01.365 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:56:01.366 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:56:01.367 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:56:01.368 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f28fe1640 / http_manager 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f2afe5640 / http_manager 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f2bfe7640 / rgw_dt_lg_renew 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f477fe640 / ms_dispatch 2024-09-19T13:56:01.369 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f58ff9640 / io_context_pool 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f597fa640 / io_context_pool 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f5b7fe640 / ms_dispatch 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f62604640 / ms_dispatch 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f63e07640 / io_context_pool 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f9075458640 / msgr-worker-2 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f9075c59640 / msgr-worker-1 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f907645a640 / msgr-worker-0 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f9076c5b640 / io_context_pool 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7f907a60e800 / radosgw-admin 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.113211.log 2024-09-19T13:56:01.370 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:56:00.820+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.476476s 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x560803eaced0 auth_method 0 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x560803eb84e0 auth_method 0 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.371 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x560803eb3160 auth_method 0 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:56:00.820+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:56:00.820+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 6695 payload 824 2024-09-19T13:56:01.372 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:56:00.820+0000 7f907645a640 1 monclient: found mon.noname-c 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:56:00.820+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: dump: 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.373 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:56:00.821+0000 7f8f62604640 10 monclient: dump: 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.374 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:56:00.821+0000 7f907a60e800 5 monclient: authenticate success, global_id 6695 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:56:00.821+0000 7f8f63e07640 4 set_mon_vals no callback set 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:56:00.821+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:56:00.821+0000 7f907a60e800 1 librados: init done 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:56:00.823+0000 7f8f62604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:01.375 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:56:00.823+0000 7f8f62604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:56:00.823+0000 7f8f62604640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:56:00.823+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f8f5c077570 auth_method 0 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:56:00.823+0000 7f9075458640 10 monclient: get_auth_request con 0x560803f94230 auth_method 0 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:56:00.824+0000 7f9075c59640 10 monclient: get_auth_request con 0x560803fb6f70 auth_method 0 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:56:00.825+0000 7f9075458640 10 monclient: get_auth_request con 0x560803fbc000 auth_method 0 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:56:00.826+0000 7f907a60e800 10 monclient: build_initial_monmap 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:56:00.826+0000 7f907a60e800 1 build_initial for_mkfs: 0 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:56:00.826+0000 7f907a60e800 10 monclient: monmap: 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:01.376 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding auth protocol: cephx 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding auth protocol: cephx 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding auth protocol: cephx 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.377 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: crc 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbfff0) adding con mode: secure 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:56:00.826+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 asok(0x560803d49410) register_command objecter_requests cmddesc objecter_requests hook 0x560803fc34c0 EEXIST 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:56:00.826+0000 7f907a60e800 10 monclient: init 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding auth protocol: cephx 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding auth protocol: cephx 2024-09-19T13:56:01.378 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding auth protocol: cephx 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: crc 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:56:00.826+0000 7f907a60e800 5 AuthRegistry(0x560803fbefa8) adding con mode: secure 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:56:00.826+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.379 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:56:00.826+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:56:00.827+0000 7f907a60e800 5 asok(0x560803d49410) register_command rotate-key cmddesc rotate-key hook 0x560803fbf0f0 EEXIST 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-b con 0x560803fe77e0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-a con 0x560803fe7bc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-c con 0x560803fe64f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.483097s 2024-09-19T13:56:01.380 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x560803fe64f0 auth_method 0 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x560803fe7bc0 auth_method 0 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.381 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x560803fe77e0 auth_method 0 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:56:00.827+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:56:00.827+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.382 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:56:00.827+0000 7f907645a640 1 monclient: found mon.noname-c 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:56:00.827+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: dump: 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.383 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:56:00.827+0000 7f8f5b7fe640 10 monclient: dump: 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.384 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:56:00.827+0000 7f907a60e800 5 monclient: authenticate success, global_id 6698 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:56:00.827+0000 7f9076c5b640 4 set_mon_vals no callback set 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:56:00.827+0000 7f907a60e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:56:00.829+0000 7f8f5b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:56:00.829+0000 7f8f5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:56:00.829+0000 7f8f5b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:56:00.829+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f8f50077480 auth_method 0 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:56:00.829+0000 7f907a60e800 10 monclient: get_monmap_and_config 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:56:00.829+0000 7f907a60e800 10 monclient: build_initial_monmap 2024-09-19T13:56:01.385 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:56:00.829+0000 7f907a60e800 1 build_initial for_mkfs: 0 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:56:00.829+0000 7f907a60e800 10 monclient: monmap: 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding auth protocol: cephx 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding auth protocol: cephx 2024-09-19T13:56:01.386 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding auth protocol: cephx 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.387 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: crc 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:56:00.829+0000 7f907a60e800 5 AuthRegistry(0x5608040074c0) adding con mode: secure 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:56:00.830+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient: init 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding auth protocol: cephx 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding auth protocol: cephx 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding auth protocol: cephx 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.388 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: crc 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0920) adding con mode: secure 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:56:00.830+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:56:00.830+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:56:00.830+0000 7f907a60e800 5 asok(0x560803d49410) register_command rotate-key cmddesc rotate-key hook 0x7ffcc7bf0a68 EEXIST 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:56:01.389 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-c con 0x56080403bb40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-b con 0x56080400b950 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-a con 0x560804036f00 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:56:00.830+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.486785s 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x56080403bb40 auth_method 0 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x560804036f00 auth_method 0 2024-09-19T13:56:01.390 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x56080400b950 auth_method 0 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:56:00.830+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:56:00.830+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:56:00.830+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:56:00.831+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.391 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:56:00.831+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:56:00.831+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:56:00.831+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 7053 payload 274 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:56:00.831+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:56:00.831+0000 7f907645a640 1 monclient: found mon.noname-a 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:56:00.831+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: dump: 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.392 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:56:00.831+0000 7f8f597fa640 10 monclient: dump: 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.393 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 monclient: authenticate success, global_id 7053 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: get_monmap_and_config success 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:56:00.831+0000 7f907a60e800 4 set_mon_vals no callback set 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: shutdown 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: build_initial_monmap 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:56:00.831+0000 7f907a60e800 1 build_initial for_mkfs: 0 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:56:00.831+0000 7f907a60e800 10 monclient: monmap: 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:01.394 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding auth protocol: cephx 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding auth protocol: cephx 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding auth protocol: cephx 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.395 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:56:00.831+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: crc 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x56080402ddd0) adding con mode: secure 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:56:00.832+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: starting msgr at 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: starting objecter 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 asok(0x560803d49410) register_command objecter_requests cmddesc objecter_requests hook 0x560804036290 EEXIST 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: setting wanted keys 2024-09-19T13:56:01.396 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:56:00.832+0000 7f907a60e800 1 librados: calling monclient init 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient: init 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding auth protocol: cephx 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding auth protocol: cephx 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding auth protocol: cephx 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.397 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: crc 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 AuthRegistry(0x560803ffc0a0) adding con mode: secure 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:56:00.832+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:56:00.832+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:56:00.832+0000 7f907a60e800 5 asok(0x560803d49410) register_command rotate-key cmddesc rotate-key hook 0x560803ffc1e8 EEXIST 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-c con 0x56080400b950 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-b con 0x560804036f00 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): picked mon.noname-a con 0x56080403bb40 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:01.398 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:56:00.832+0000 7f907a60e800 10 monclient(hunting): authenticate will time out at 1974.488945s 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): get_auth_request con 0x56080403bb40 auth_method 0 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): get_auth_request con 0x56080400b950 auth_method 0 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): get_auth_request con 0x560804036f00 auth_method 0 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:01.399 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:56:00.833+0000 7f9075c59640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:56:00.833+0000 7f9075458640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient: _finish_hunting 0 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:56:00.833+0000 7f907645a640 1 monclient: found mon.noname-a 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:56:00.833+0000 7f907645a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.400 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: dump: 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: _finish_auth 0 2024-09-19T13:56:01.401 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: _check_auth_tickets 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:56:00.833+0000 7f8f477fe640 10 monclient: dump: 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:01.402 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:56:00.833+0000 7f907a60e800 5 monclient: authenticate success, global_id 7056 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:56:00.833+0000 7f8f597fa640 4 set_mon_vals no callback set 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _renew_subs 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:56:00.833+0000 7f907a60e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:56:00.833+0000 7f907a60e800 1 librados: init done 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:56:00.833+0000 7f907a60e800 5 asok(0x560803d49410) register_command cr dump hook 0x560804032af8 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:56:00.835+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:56:00.835+0000 7f8f477fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:56:00.835+0000 7f8f477fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:56:00.835+0000 7f8f477fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:01.403 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:56:00.835+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f8f40077570 auth_method 0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:56:00.835+0000 7f9075458640 10 monclient: get_auth_request con 0x560804055530 auth_method 0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 realm 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:56:00.836+0000 7f907a60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:56:00.836+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:56:00.836+0000 7f9075c59640 10 monclient: get_auth_request con 0x560804059750 auth_method 0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.404 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:56:00.837+0000 7f907a60e800 20 searching for the correct realm 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:56:00.838+0000 7f9075458640 10 monclient: get_auth_request con 0x56080405e9f0 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:56:00.838+0000 7f907645a640 10 monclient: get_auth_request con 0x7f906002e440 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:56:00.839+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f906809dbb0 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:56:00.840+0000 7f9075458640 10 monclient: get_auth_request con 0x7f907007c070 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:56:00.840+0000 7f9075458640 0 -- 172.21.15.94:0/1603354054 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f907007c070 msgr2=0x7f907007e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:56:01.042+0000 7f9075458640 10 monclient: get_auth_request con 0x7f907007c070 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:56:01.044+0000 7f907645a640 10 monclient: get_auth_request con 0x7f906003f040 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:56:01.046+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f9060040940 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:56:01.046+0000 7f9075c59640 0 -- 172.21.15.94:0/1603354054 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9060040940 msgr2=0x7f9060041440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:56:01.247+0000 7f9075c59640 10 monclient: get_auth_request con 0x7f9060040940 auth_method 0 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:56:01.248+0000 7f8f477fe640 1 client.7056.objecter ms_handle_reset 0x7f907007c070 session 0x7f907009d040 osd.4 2024-09-19T13:56:01.405 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:56:01.248+0000 7f8f477fe640 10 monclient: _renew_subs 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:56:01.248+0000 7f8f477fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:56:01.248+0000 7f9075458640 10 monclient: get_auth_request con 0x7f8f400873f0 auth_method 0 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.406 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:56:01.253+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 zone default found 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:56:01.254+0000 7f907a60e800 4 Realm: () 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:56:01.254+0000 7f907a60e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:56:01.254+0000 7f907a60e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:56:01.254+0000 7f907a60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 zonegroup default 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:56:01.254+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.407 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:56:01.255+0000 7f907a60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:56:01.255+0000 7f907a60e800 20 started sync module instance, tier type = 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:56:01.255+0000 7f907a60e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=0 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=1 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=2 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=3 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=4 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=5 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:56:01.264+0000 7f907a60e800 20 add_watcher() i=6 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:56:01.265+0000 7f907a60e800 20 add_watcher() i=7 2024-09-19T13:56:01.408 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:56:01.265+0000 7f907a60e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding auth protocol: cephx 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding auth protocol: cephx 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding auth protocol: cephx 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:56:01.267+0000 7f8f2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: crc 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 AuthRegistry(0x7ffcc7bf0df0) adding con mode: secure 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:56:01.267+0000 7f907a60e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache list hook 0x5608040291f0 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache inspect hook 0x5608040291f0 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache erase hook 0x5608040291f0 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command cache zap hook 0x5608040291f0 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 note: GC not initialized 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:56:01.267+0000 7f8f2afe5640 20 reqs_thread_entry: start 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace show hook 0x7f9068005390 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace history hook 0x7f9068005390 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace active hook 0x7f9068005390 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:56:01.267+0000 7f907a60e800 5 asok(0x560803d49410) register_command sync trace active_short hook 0x7f9068005390 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:56:01.267+0000 7f907a60e800 20 Filter name: none 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:56:01.268+0000 7f8f28fe1640 20 reqs_thread_entry: start 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T13:56:01.411 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:56:01.268+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : miss 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:56:01.268+0000 7f907a60e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:56:01.269+0000 7f907a60e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:56:01.269+0000 7f907a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:56:01.274+0000 7f907a60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595156 cookie 94592427244544 notifier 7056 bl.length()=999 2024-09-19T13:56:01.412 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:56:01.274+0000 7f8f597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:56:01.274+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:56:01.279+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.0 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:56:01.279+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.0 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:56:01.279+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.1 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:56:01.279+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.1 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.2 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.2 2024-09-19T13:56:01.413 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.3 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.3 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.4 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.4 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.5 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.5 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.6 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.6 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.7 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.7 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.8 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.8 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.9 2024-09-19T13:56:01.414 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.9 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.10 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.10 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:56:01.280+0000 7f907a60e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.11 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1.11 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.0 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:56:01.280+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:56:01.281+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:56:01.281+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.3 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:56:01.282+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.4 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:56:01.282+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.5 2024-09-19T13:56:01.415 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:56:01.283+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.6 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:56:01.284+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.7 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:56:01.284+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.8 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:56:01.285+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.9 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:56:01.286+0000 7f907a60e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.10 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:56:01.289+0000 7f907a60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:56:01.289+0000 7f907a60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:56:01.291+0000 7f907a60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595157 cookie 94592427244544 notifier 7056 bl.length()=999 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:01.416 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:56:01.291+0000 7f8f58ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:56:01.291+0000 7f907a60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:56:01.292+0000 7f907a60e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f907a60e800 time 2024-09-19T13:56:01.292096+0000 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f907b78c76a] 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.417 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:56:01.293+0000 7f907a60e800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f907a60e800 thread_name:radosgw-admin 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f907a43e6f0] 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f907a48b99c] 2024-09-19T13:56:01.418 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f907b78c7c4] 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f907b78c928] 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080201e791] 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x56080202d6ce] 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56080202e504] 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f907a429590] 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:56:01.419 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:56:01.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:56:01.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:56:01.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:56:01.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:56:01.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:56:01.425 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:56:01.426 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f28fe1640 / http_manager 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f2afe5640 / http_manager 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f2bfe7640 / rgw_dt_lg_renew 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f477fe640 / ms_dispatch 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f58ff9640 / io_context_pool 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f597fa640 / io_context_pool 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f5b7fe640 / ms_dispatch 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f62604640 / ms_dispatch 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f63e07640 / io_context_pool 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f9075458640 / msgr-worker-2 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f9075c59640 / msgr-worker-1 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f907645a640 / msgr-worker-0 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f9076c5b640 / io_context_pool 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: 7f907a60e800 / radosgw-admin 2024-09-19T13:56:01.427 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:56:01.428 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:56:01.428 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:56:01.293733Z_48ab4937-738b-4f76-9249-449bd0df98a6/log 2024-09-19T13:56:01.428 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:56:01.428 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T13:56:01.429 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:01.429 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:01.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.370+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 realm 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.372+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.373+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.373+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.374+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.374+0000 7f5a05010800 20 searching for the correct realm 2024-09-19T13:56:01.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.376+0000 7f59ffeca640 0 -- 172.21.15.94:0/4066024805 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f59f0068040 msgr2=0x7f59f00a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:01.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.582+0000 7f5a006cb640 0 -- 172.21.15.94:0/4066024805 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f59f40163c0 msgr2=0x7f59f4016840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:01.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:01.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.788+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:01.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 zone default found 2024-09-19T13:56:01.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 4 Realm: () 2024-09-19T13:56:01.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 zonegroup default 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 started sync module instance, tier type = 2024-09-19T13:56:01.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.789+0000 7f5a05010800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:01.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=0 2024-09-19T13:56:01.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=1 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=2 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=3 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=4 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=5 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.798+0000 7f5a05010800 20 add_watcher() i=6 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.799+0000 7f5a05010800 20 add_watcher() i=7 2024-09-19T13:56:01.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.799+0000 7f5a05010800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:01.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.800+0000 7f58b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f5a05010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f5a05010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f5a05010800 5 note: GC not initialized 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f58b5fdb640 20 reqs_thread_entry: start 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f5a05010800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f5a05010800 20 Filter name: none 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f58277fe640 20 reqs_thread_entry: start 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.801+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.802+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:01.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.802+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.802+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T13:56:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.802+0000 7f5a05010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.802+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.803+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.803+0000 7f5a05010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.803+0000 7f5a05010800 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T13:56:01.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.803+0000 7f5a05010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:01.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.805+0000 7f58b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.807+0000 7f5a05010800 20 remove_watcher() i=0 2024-09-19T13:56:01.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.807+0000 7f5a05010800 2 removed watcher, disabling cache 2024-09-19T13:56:01.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.807+0000 7f5a05010800 20 remove_watcher() i=1 2024-09-19T13:56:01.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.808+0000 7f5a05010800 20 remove_watcher() i=2 2024-09-19T13:56:01.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.809+0000 7f5a05010800 20 remove_watcher() i=3 2024-09-19T13:56:01.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.810+0000 7f5a05010800 20 remove_watcher() i=4 2024-09-19T13:56:01.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.811+0000 7f5a05010800 20 remove_watcher() i=5 2024-09-19T13:56:01.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.812+0000 7f5a05010800 20 remove_watcher() i=6 2024-09-19T13:56:01.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.813+0000 7f5a05010800 20 remove_watcher() i=7 2024-09-19T13:56:01.824 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.824 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:01.824 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:01.824 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:01.876 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:56:01.907 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:01.908 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:01.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.943+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 realm 2024-09-19T13:56:01.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.944+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.945+0000 7f44e272c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.945+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.945+0000 7f44e272c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:01.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.945+0000 7f44e272c800 20 searching for the correct realm 2024-09-19T13:56:01.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:01.949+0000 7f44deb62640 0 -- 172.21.15.94:0/350453919 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7f44c800b040 msgr2=0x7f44c8069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:02.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.155+0000 7f44deb62640 0 -- 172.21.15.94:0/350453919 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7f44c800b040 msgr2=0x7f44c8069fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.159+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:02.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 zone default found 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 4 Realm: () 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:02.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 zonegroup default 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.160+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 started sync module instance, tier type = 2024-09-19T13:56:02.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.161+0000 7f44e272c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=0 2024-09-19T13:56:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=1 2024-09-19T13:56:02.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=2 2024-09-19T13:56:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=3 2024-09-19T13:56:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=4 2024-09-19T13:56:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=5 2024-09-19T13:56:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.170+0000 7f44e272c800 20 add_watcher() i=6 2024-09-19T13:56:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.171+0000 7f44e272c800 20 add_watcher() i=7 2024-09-19T13:56:02.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.171+0000 7f44e272c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:02.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.172+0000 7f4394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:02.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 5 note: GC not initialized 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f430f7fe640 20 reqs_thread_entry: start 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 20 Filter name: none 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f430d7fa640 20 reqs_thread_entry: start 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.173+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : miss 2024-09-19T13:56:02.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 20 rados->read ofs=0 len=0 2024-09-19T13:56:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T13:56:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:02.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.174+0000 7f44e272c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.175+0000 7f44e272c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to be held by another RGW process; skipping for now 2024-09-19T13:56:02.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.176+0000 7f4394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.178+0000 7f44e272c800 20 remove_watcher() i=0 2024-09-19T13:56:02.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.178+0000 7f44e272c800 2 removed watcher, disabling cache 2024-09-19T13:56:02.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.179+0000 7f44e272c800 20 remove_watcher() i=1 2024-09-19T13:56:02.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.180+0000 7f44e272c800 20 remove_watcher() i=2 2024-09-19T13:56:02.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.181+0000 7f44e272c800 20 remove_watcher() i=3 2024-09-19T13:56:02.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.182+0000 7f44e272c800 20 remove_watcher() i=4 2024-09-19T13:56:02.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.183+0000 7f44e272c800 20 remove_watcher() i=5 2024-09-19T13:56:02.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.184+0000 7f44e272c800 20 remove_watcher() i=6 2024-09-19T13:56:02.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:02.185+0000 7f44e272c800 20 remove_watcher() i=7 2024-09-19T13:56:02.195 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:56:32.220 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:56:32.254 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:32.255 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:32.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.294+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.295+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.295+0000 7fbad972e800 20 realm 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.295+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.295+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.295+0000 7fbad972e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.295+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.296+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.296+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.297+0000 7fbad972e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:32.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.297+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.297+0000 7fbad972e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:32.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.297+0000 7fbad972e800 20 searching for the correct realm 2024-09-19T13:56:32.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.300+0000 7fbacffff640 0 -- 172.21.15.94:0/1674104306 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fbac8081070 msgr2=0x7fbac807b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:32.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.507+0000 7fbad5364640 0 -- 172.21.15.94:0/1674104306 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fbac00dcc40 msgr2=0x7fbac00ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:32.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:32.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:32.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:32.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:32.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:32.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:32.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.715+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 20 zone default found 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 4 Realm: () 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:32.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 20 zonegroup default 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.716+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.717+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.717+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.717+0000 7fbad972e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.717+0000 7fbad972e800 20 started sync module instance, tier type = 2024-09-19T13:56:32.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.717+0000 7fbad972e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=0 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=1 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=2 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=3 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=4 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=5 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.727+0000 7fbad972e800 20 add_watcher() i=6 2024-09-19T13:56:32.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.729+0000 7fbad972e800 20 add_watcher() i=7 2024-09-19T13:56:32.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.729+0000 7fbad972e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:32.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fb98bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fbad972e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fbad972e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fbad972e800 5 note: GC not initialized 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fb98afe5640 20 reqs_thread_entry: start 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fbad972e800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.731+0000 7fbad972e800 20 Filter name: none 2024-09-19T13:56:32.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fb988fe1640 20 reqs_thread_entry: start 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : miss 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.732+0000 7fbad972e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.733+0000 7fbad972e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.733+0000 7fbad972e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.733+0000 7fbad972e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.733+0000 7fbad972e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.733+0000 7fbad972e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.733+0000 7fbad972e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:32.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.734+0000 7fbad972e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:56:32.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fbad972e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fbad972e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fbad972e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fbad972e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fb9b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595158 cookie 93914634107664 notifier 6755 bl.length()=999 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fb9b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fb9b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.743+0000 7fb9b8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.744+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.744+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.744+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:32.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.744+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:32.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.0 2024-09-19T13:56:32.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.0 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.1 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.1 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.2 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.2 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.3 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.3 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.4 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.4 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.5 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.5 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.6 2024-09-19T13:56:32.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.6 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.7 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.7 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.8 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.8 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.9 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.9 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.10 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.10 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.11 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2.11 2024-09-19T13:56:32.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.750+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.0 2024-09-19T13:56:32.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.751+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1 2024-09-19T13:56:32.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.751+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2 2024-09-19T13:56:32.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.752+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.3 2024-09-19T13:56:32.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.752+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.4 2024-09-19T13:56:32.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.753+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.5 2024-09-19T13:56:32.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.754+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.6 2024-09-19T13:56:32.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.754+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.7 2024-09-19T13:56:32.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.755+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.8 2024-09-19T13:56:32.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.756+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.9 2024-09-19T13:56:32.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.757+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.10 2024-09-19T13:56:32.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.760+0000 7fbad972e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:32.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.760+0000 7fbad972e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:32.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fbad972e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fbad972e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fbad972e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fbad972e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fb9abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595159 cookie 93914634107664 notifier 6755 bl.length()=999 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fb9abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fb9abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.761+0000 7fb9abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.762+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.762+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.762+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:32.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.762+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:32.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.764+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.0 2024-09-19T13:56:32.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.765+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.1 2024-09-19T13:56:32.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.765+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.2 2024-09-19T13:56:32.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.765+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.3 2024-09-19T13:56:32.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.766+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.4 2024-09-19T13:56:32.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.766+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.5 2024-09-19T13:56:32.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.766+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.6 2024-09-19T13:56:32.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.767+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.7 2024-09-19T13:56:32.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.767+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.8 2024-09-19T13:56:32.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.767+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.9 2024-09-19T13:56:32.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.768+0000 7fbad972e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30.10 2024-09-19T13:56:32.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.768+0000 7fbad972e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:32.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.768+0000 7fbad972e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.769+0000 7fbad972e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.769+0000 7fbad972e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.769+0000 7fbad972e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.769+0000 7fbad972e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30, ofs0, ns] 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fb9b8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595160 cookie 93914634107664 notifier 6755 bl.length()=967 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fb9b8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 info.flags=0x17 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fb9b8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 to cache LRU end 2024-09-19T13:56:32.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fb9b8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:32.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_sources= new_sources= 2024-09-19T13:56:32.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential sources added=[] removed=[] 2024-09-19T13:56:32.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): orig_dests= new_dests= 2024-09-19T13:56:32.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.770+0000 7fbad972e800 20 handle_bi_update(): bucket=:abort-at-block-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30]): potential dests added=[] removed=[] 2024-09-19T13:56:32.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.772+0000 7fbad972e800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-19T13:56:32.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.774+0000 7fb98bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:32.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.777+0000 7fbad972e800 20 remove_watcher() i=0 2024-09-19T13:56:32.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.777+0000 7fbad972e800 2 removed watcher, disabling cache 2024-09-19T13:56:32.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.778+0000 7fbad972e800 20 remove_watcher() i=1 2024-09-19T13:56:32.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.779+0000 7fbad972e800 20 remove_watcher() i=2 2024-09-19T13:56:32.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.780+0000 7fbad972e800 20 remove_watcher() i=3 2024-09-19T13:56:32.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.781+0000 7fbad972e800 20 remove_watcher() i=4 2024-09-19T13:56:32.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.782+0000 7fbad972e800 20 remove_watcher() i=5 2024-09-19T13:56:32.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.783+0000 7fbad972e800 20 remove_watcher() i=6 2024-09-19T13:56:32.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:32.784+0000 7fbad972e800 20 remove_watcher() i=7 2024-09-19T13:56:32.799 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T13:56:32.829 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:32.829 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:33.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.057+0000 7f83ff96c640 0 --2- 172.21.15.94:0/3188205645 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x5642ccadb020 0x5642ccade5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-19T13:56:33.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.065+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 realm 2024-09-19T13:56:33.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:33.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.067+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.068+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:33.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.068+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.069+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:33.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.069+0000 7f8403a0e800 20 searching for the correct realm 2024-09-19T13:56:33.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.071+0000 7f83fe96a640 0 -- 172.21.15.94:0/2240661505 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f83f001d040 msgr2=0x7f83f0066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:33.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.278+0000 7f83ff16b640 0 -- 172.21.15.94:0/2240661505 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f83f40760c0 msgr2=0x7f83f40787b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:33.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.485+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 zone default found 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 4 Realm: () 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 zonegroup default 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.486+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.487+0000 7f8403a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.487+0000 7f8403a0e800 20 started sync module instance, tier type = 2024-09-19T13:56:33.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.487+0000 7f8403a0e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=0 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=1 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=2 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=3 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=4 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=5 2024-09-19T13:56:33.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.497+0000 7f8403a0e800 20 add_watcher() i=6 2024-09-19T13:56:33.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.498+0000 7f8403a0e800 20 add_watcher() i=7 2024-09-19T13:56:33.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.498+0000 7f8403a0e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:33.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.499+0000 7f82b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:33.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f8403a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:33.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f8403a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:33.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f8403a0e800 5 note: GC not initialized 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f82b4fe1640 20 reqs_thread_entry: start 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f8403a0e800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f8403a0e800 20 Filter name: none 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.500+0000 7f822e7fc640 20 reqs_thread_entry: start 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.501+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.501+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:33.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.501+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:33.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:33.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T13:56:33.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T13:56:33.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.502+0000 7f8403a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:33.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.504+0000 7f82b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:33.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.507+0000 7f8403a0e800 20 remove_watcher() i=0 2024-09-19T13:56:33.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.507+0000 7f8403a0e800 2 removed watcher, disabling cache 2024-09-19T13:56:33.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.508+0000 7f8403a0e800 20 remove_watcher() i=1 2024-09-19T13:56:33.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.509+0000 7f8403a0e800 20 remove_watcher() i=2 2024-09-19T13:56:33.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.510+0000 7f8403a0e800 20 remove_watcher() i=3 2024-09-19T13:56:33.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.511+0000 7f8403a0e800 20 remove_watcher() i=4 2024-09-19T13:56:33.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.512+0000 7f8403a0e800 20 remove_watcher() i=5 2024-09-19T13:56:33.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.513+0000 7f8403a0e800 20 remove_watcher() i=6 2024-09-19T13:56:33.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.514+0000 7f8403a0e800 20 remove_watcher() i=7 2024-09-19T13:56:33.528 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:33.528 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:33.528 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-block-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:56:33.528 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:33.605 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-19T13:56:33.606 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:33.786 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T13:56:33.813 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:33.814 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:33.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.848+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.849+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 20 realm 2024-09-19T13:56:33.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:33.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:33.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.850+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.851+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:33.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.851+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:33.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.851+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:33.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.851+0000 7efcacf2f800 20 searching for the correct realm 2024-09-19T13:56:33.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.853+0000 7efca0475640 0 -- 172.21.15.94:0/2096045733 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7efc9803e030 msgr2=0x7efc9803e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:33.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:33.858+0000 7efca8c76640 0 -- 172.21.15.94:0/2096045733 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7efc9007b2f0 msgr2=0x7efc900e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:34.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:34.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:34.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.064+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 zone default found 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 4 Realm: () 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:34.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:34.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:34.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 zonegroup default 2024-09-19T13:56:34.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.065+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.066+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.066+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.066+0000 7efcacf2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.066+0000 7efcacf2f800 20 started sync module instance, tier type = 2024-09-19T13:56:34.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.066+0000 7efcacf2f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=0 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=1 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=2 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=3 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=4 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=5 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.075+0000 7efcacf2f800 20 add_watcher() i=6 2024-09-19T13:56:34.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.076+0000 7efcacf2f800 20 add_watcher() i=7 2024-09-19T13:56:34.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.076+0000 7efcacf2f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:34.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.077+0000 7efb5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:34.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efcacf2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:34.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efcacf2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:34.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efcacf2f800 5 note: GC not initialized 2024-09-19T13:56:34.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efb5dfe3640 20 reqs_thread_entry: start 2024-09-19T13:56:34.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efcacf2f800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:34.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efcacf2f800 20 Filter name: none 2024-09-19T13:56:34.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efacf7fe640 20 reqs_thread_entry: start 2024-09-19T13:56:34.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.078+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.079+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:34.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.079+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:34.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.080+0000 7efcacf2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:34.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.082+0000 7efb5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:34.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.084+0000 7efcacf2f800 20 remove_watcher() i=0 2024-09-19T13:56:34.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.084+0000 7efcacf2f800 2 removed watcher, disabling cache 2024-09-19T13:56:34.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.085+0000 7efcacf2f800 20 remove_watcher() i=1 2024-09-19T13:56:34.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.086+0000 7efcacf2f800 20 remove_watcher() i=2 2024-09-19T13:56:34.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.087+0000 7efcacf2f800 20 remove_watcher() i=3 2024-09-19T13:56:34.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.088+0000 7efcacf2f800 20 remove_watcher() i=4 2024-09-19T13:56:34.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.089+0000 7efcacf2f800 20 remove_watcher() i=5 2024-09-19T13:56:34.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.090+0000 7efcacf2f800 20 remove_watcher() i=6 2024-09-19T13:56:34.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.091+0000 7efcacf2f800 20 remove_watcher() i=7 2024-09-19T13:56:34.103 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:34.103 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:34.103 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:34.104 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:34.105 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-19T13:56:34.138 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:34.139 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:34.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.374+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 realm 2024-09-19T13:56:34.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:34.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.376+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.377+0000 7ff19ce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:34.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.377+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.377+0000 7ff19ce98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:34.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.377+0000 7ff19ce98800 20 searching for the correct realm 2024-09-19T13:56:34.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.380+0000 7ff192181640 0 -- 172.21.15.94:0/1503697545 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7ff18c032050 msgr2=0x7ff18c041920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:34.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.586+0000 7ff19a982640 0 -- 172.21.15.94:0/1503697545 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff184073470 msgr2=0x7ff1840683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:34.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.793+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:34.797 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:34.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 zone default found 2024-09-19T13:56:34.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 4 Realm: () 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 zonegroup default 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.794+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.795+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.795+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.795+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.795+0000 7ff19ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.795+0000 7ff19ce98800 20 started sync module instance, tier type = 2024-09-19T13:56:34.799 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.795+0000 7ff19ce98800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=0 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=1 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=2 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=3 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=4 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=5 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.805+0000 7ff19ce98800 20 add_watcher() i=6 2024-09-19T13:56:34.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.806+0000 7ff19ce98800 20 add_watcher() i=7 2024-09-19T13:56:34.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.806+0000 7ff19ce98800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:34.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7ff0517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7ff19ce98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7ff19ce98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7ff19ce98800 5 note: GC not initialized 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7fefcbfff640 20 reqs_thread_entry: start 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7ff19ce98800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7ff19ce98800 20 Filter name: none 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.808+0000 7fefc9ffb640 20 reqs_thread_entry: start 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T13:56:34.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 : miss 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.809+0000 7ff19ce98800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.810+0000 7ff19ce98800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:34.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.810+0000 7ff19ce98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:34.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.810+0000 7ff19ce98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:34.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.810+0000 7ff19ce98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:34.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.810+0000 7ff19ce98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:34.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.810+0000 7ff19ce98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 2024-09-19T13:56:34.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff19ce98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:34.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff19ce98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:34.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff19ce98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:34.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff19ce98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31, ofs0, ns] 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff07dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595117 cookie 94895107073760 notifier 7161 bl.length()=1015 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff07dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff07dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.815+0000 7ff07dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.816+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_sources= new_sources= 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.816+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential sources added=[] removed=[] 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.816+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_dests= new_dests= 2024-09-19T13:56:34.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.816+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential dests added=[] removed=[] 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.0 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.0 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.1 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.1 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.2 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.2 2024-09-19T13:56:34.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.3 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.3 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.4 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.4 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.5 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.5 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.6 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.6 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.7 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.7 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.8 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.8 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.9 2024-09-19T13:56:34.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.9 2024-09-19T13:56:34.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.10 2024-09-19T13:56:34.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.10 2024-09-19T13:56:34.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.11 2024-09-19T13:56:34.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1.11 2024-09-19T13:56:34.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.0 2024-09-19T13:56:34.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.821+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1 2024-09-19T13:56:34.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.822+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2 2024-09-19T13:56:34.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.822+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.3 2024-09-19T13:56:34.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.823+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.4 2024-09-19T13:56:34.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.824+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.5 2024-09-19T13:56:34.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.824+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.6 2024-09-19T13:56:34.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.825+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.7 2024-09-19T13:56:34.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.826+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.8 2024-09-19T13:56:34.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.826+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.9 2024-09-19T13:56:34.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.826+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.10 2024-09-19T13:56:34.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.830+0000 7ff19ce98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:34.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.830+0000 7ff19ce98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 2024-09-19T13:56:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31, ofs0, ns] 2024-09-19T13:56:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff07e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595118 cookie 94895107073760 notifier 7161 bl.length()=1015 2024-09-19T13:56:34.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff07e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:34.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff07e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:34.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff07e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:34.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_sources= new_sources= 2024-09-19T13:56:34.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential sources added=[] removed=[] 2024-09-19T13:56:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_dests= new_dests= 2024-09-19T13:56:34.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.831+0000 7ff19ce98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential dests added=[] removed=[] 2024-09-19T13:56:34.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.834+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.0 2024-09-19T13:56:34.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.834+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1 2024-09-19T13:56:34.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.835+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2 2024-09-19T13:56:34.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.835+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.3 2024-09-19T13:56:34.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.835+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.4 2024-09-19T13:56:34.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.836+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.5 2024-09-19T13:56:34.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.836+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.6 2024-09-19T13:56:34.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.837+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.7 2024-09-19T13:56:34.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.837+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.8 2024-09-19T13:56:34.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.838+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.9 2024-09-19T13:56:34.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.838+0000 7ff19ce98800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.10 2024-09-19T13:56:34.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.838+0000 7ff19ce98800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-19T13:56:34.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.838+0000 7ff19ce98800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-19T13:56:34.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.842+0000 7ff0517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.844+0000 7ff19ce98800 20 remove_watcher() i=0 2024-09-19T13:56:34.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.844+0000 7ff19ce98800 2 removed watcher, disabling cache 2024-09-19T13:56:34.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.845+0000 7ff19ce98800 20 remove_watcher() i=1 2024-09-19T13:56:34.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.846+0000 7ff19ce98800 20 remove_watcher() i=2 2024-09-19T13:56:34.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.847+0000 7ff19ce98800 20 remove_watcher() i=3 2024-09-19T13:56:34.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.848+0000 7ff19ce98800 20 remove_watcher() i=4 2024-09-19T13:56:34.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.849+0000 7ff19ce98800 20 remove_watcher() i=5 2024-09-19T13:56:34.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.850+0000 7ff19ce98800 20 remove_watcher() i=6 2024-09-19T13:56:34.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.851+0000 7ff19ce98800 20 remove_watcher() i=7 2024-09-19T13:56:34.866 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T13:56:34.895 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:34.895 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:34.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.929+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.930+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.930+0000 7fa973130800 20 realm 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.930+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.931+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.931+0000 7fa973130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.931+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.931+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.931+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.932+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:34.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.932+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.932+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:34.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.932+0000 7fa973130800 20 searching for the correct realm 2024-09-19T13:56:34.937 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.935+0000 7fa9666af640 0 -- 172.21.15.94:0/3509962513 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55d461104f00 msgr2=0x55d4611072f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:34.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.939+0000 7fa96eeb0640 0 -- 172.21.15.94:0/3509962513 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa95804c960 msgr2=0x7fa9580837e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:34.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.943+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:34.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 zone default found 2024-09-19T13:56:34.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 4 Realm: () 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 zonegroup default 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.944+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.945+0000 7fa973130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.945+0000 7fa973130800 20 started sync module instance, tier type = 2024-09-19T13:56:34.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.945+0000 7fa973130800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:34.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=0 2024-09-19T13:56:34.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=1 2024-09-19T13:56:34.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=2 2024-09-19T13:56:34.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=3 2024-09-19T13:56:34.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=4 2024-09-19T13:56:34.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=5 2024-09-19T13:56:34.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.953+0000 7fa973130800 20 add_watcher() i=6 2024-09-19T13:56:34.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.954+0000 7fa973130800 20 add_watcher() i=7 2024-09-19T13:56:34.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.954+0000 7fa973130800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:34.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.955+0000 7fa8257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:34.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa973130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:34.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa973130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:34.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa973130800 5 note: GC not initialized 2024-09-19T13:56:34.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa79ffff640 20 reqs_thread_entry: start 2024-09-19T13:56:34.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa973130800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:34.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa973130800 20 Filter name: none 2024-09-19T13:56:34.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa79dffb640 20 reqs_thread_entry: start 2024-09-19T13:56:34.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.956+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.957+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.957+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.957+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.957+0000 7fa973130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.957+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.958+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:34.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.958+0000 7fa973130800 20 rados->read ofs=0 len=0 2024-09-19T13:56:34.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.958+0000 7fa973130800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:56:34.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.958+0000 7fa973130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:34.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.960+0000 7fa8257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:34.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.962+0000 7fa973130800 20 remove_watcher() i=0 2024-09-19T13:56:34.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.962+0000 7fa973130800 2 removed watcher, disabling cache 2024-09-19T13:56:34.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.963+0000 7fa973130800 20 remove_watcher() i=1 2024-09-19T13:56:34.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.964+0000 7fa973130800 20 remove_watcher() i=2 2024-09-19T13:56:34.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.965+0000 7fa973130800 20 remove_watcher() i=3 2024-09-19T13:56:34.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.966+0000 7fa973130800 20 remove_watcher() i=4 2024-09-19T13:56:34.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.967+0000 7fa973130800 20 remove_watcher() i=5 2024-09-19T13:56:34.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.968+0000 7fa973130800 20 remove_watcher() i=6 2024-09-19T13:56:34.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:34.969+0000 7fa973130800 20 remove_watcher() i=7 2024-09-19T13:56:34.981 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:34.981 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:34.981 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:35.033 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:56:35.066 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:35.066 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:35.103 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.101+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.102+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.102+0000 7fd13c531800 20 realm 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.102+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.102+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.102+0000 7fd13c531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.102+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.103+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.105 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.103+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.103+0000 7fd13c531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.103+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.104+0000 7fd13c531800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:35.106 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.104+0000 7fd13c531800 20 searching for the correct realm 2024-09-19T13:56:35.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.107+0000 7fd12fa75640 0 -- 172.21.15.94:0/2043670571 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd12807d070 msgr2=0x7fd128094450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:35.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.110+0000 7fd138276640 0 -- 172.21.15.94:0/2043670571 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd120047460 msgr2=0x7fd12006c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.319 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.316+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:35.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 zone default found 2024-09-19T13:56:35.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 4 Realm: () 2024-09-19T13:56:35.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:35.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 zonegroup default 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.317+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.318+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.318+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.318+0000 7fd13c531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.318+0000 7fd13c531800 20 started sync module instance, tier type = 2024-09-19T13:56:35.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.318+0000 7fd13c531800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:35.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=0 2024-09-19T13:56:35.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=1 2024-09-19T13:56:35.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=2 2024-09-19T13:56:35.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=3 2024-09-19T13:56:35.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=4 2024-09-19T13:56:35.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=5 2024-09-19T13:56:35.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.327+0000 7fd13c531800 20 add_watcher() i=6 2024-09-19T13:56:35.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.328+0000 7fd13c531800 20 add_watcher() i=7 2024-09-19T13:56:35.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.328+0000 7fd13c531800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:35.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.330+0000 7fcfeefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:35.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.330+0000 7fd13c531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:35.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.330+0000 7fd13c531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:35.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.330+0000 7fd13c531800 5 note: GC not initialized 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.330+0000 7fcfedfdb640 20 reqs_thread_entry: start 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.330+0000 7fd13c531800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 20 Filter name: none 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fcf5f7fe640 20 reqs_thread_entry: start 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 : miss 2024-09-19T13:56:35.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.331+0000 7fd13c531800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.332+0000 7fd13c531800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:56:35.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.332+0000 7fd13c531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.332+0000 7fd13c531800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.332+0000 7fd13c531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:35.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.332+0000 7fd13c531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.332+0000 7fd13c531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 2024-09-19T13:56:35.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.333+0000 7fd13c531800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:56:35.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd13c531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd13c531800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd13c531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd13c531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31, ofs0, ns] 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd00effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595119 cookie 94872722886288 notifier 7200 bl.length()=1015 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd00effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd00effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.339+0000 7fd00effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.340+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_sources= new_sources= 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.340+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential sources added=[] removed=[] 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.340+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_dests= new_dests= 2024-09-19T13:56:35.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.340+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential dests added=[] removed=[] 2024-09-19T13:56:35.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.0 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.0 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.1 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.1 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.2 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.2 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.3 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.3 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.4 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.4 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.5 2024-09-19T13:56:35.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.5 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.6 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.6 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.7 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.7 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.8 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.8 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.9 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.9 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.10 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.10 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.11 2024-09-19T13:56:35.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2.11 2024-09-19T13:56:35.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.344+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.0 2024-09-19T13:56:35.349 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.345+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1 2024-09-19T13:56:35.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.345+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2 2024-09-19T13:56:35.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.346+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.3 2024-09-19T13:56:35.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.346+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.4 2024-09-19T13:56:35.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.347+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.5 2024-09-19T13:56:35.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.347+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.6 2024-09-19T13:56:35.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.347+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.7 2024-09-19T13:56:35.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.348+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.8 2024-09-19T13:56:35.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.348+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.9 2024-09-19T13:56:35.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.349+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.10 2024-09-19T13:56:35.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.352+0000 7fd13c531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:35.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.352+0000 7fd13c531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 2024-09-19T13:56:35.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd13c531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd13c531800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd13c531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd13c531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31, ofs0, ns] 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd00f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595120 cookie 94872722886288 notifier 7200 bl.length()=1015 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd00f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd00f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.353+0000 7fd00f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.354+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_sources= new_sources= 2024-09-19T13:56:35.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.354+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential sources added=[] removed=[] 2024-09-19T13:56:35.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.354+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_dests= new_dests= 2024-09-19T13:56:35.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.354+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential dests added=[] removed=[] 2024-09-19T13:56:35.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.356+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.0 2024-09-19T13:56:35.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.356+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.1 2024-09-19T13:56:35.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.357+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.2 2024-09-19T13:56:35.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.357+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.3 2024-09-19T13:56:35.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.357+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.4 2024-09-19T13:56:35.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.358+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.5 2024-09-19T13:56:35.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.358+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.6 2024-09-19T13:56:35.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.358+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.7 2024-09-19T13:56:35.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.359+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.8 2024-09-19T13:56:35.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.359+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.9 2024-09-19T13:56:35.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.359+0000 7fd13c531800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31.10 2024-09-19T13:56:35.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.360+0000 7fd13c531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:35.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.360+0000 7fd13c531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 2024-09-19T13:56:35.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd13c531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd13c531800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd13c531800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd13c531800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31, ofs0, ns] 2024-09-19T13:56:35.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd00f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595121 cookie 94872722886288 notifier 7200 bl.length()=983 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd00f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 info.flags=0x17 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd00f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 to cache LRU end 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.361+0000 7fd00f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.362+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_sources= new_sources= 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.362+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential sources added=[] removed=[] 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.362+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): orig_dests= new_dests= 2024-09-19T13:56:35.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.362+0000 7fd13c531800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31]): potential dests added=[] removed=[] 2024-09-19T13:56:35.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.364+0000 7fd13c531800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T13:56:35.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.366+0000 7fcfeefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:35.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.369+0000 7fd13c531800 20 remove_watcher() i=0 2024-09-19T13:56:35.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.369+0000 7fd13c531800 2 removed watcher, disabling cache 2024-09-19T13:56:35.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.369+0000 7fd13c531800 20 remove_watcher() i=1 2024-09-19T13:56:35.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.370+0000 7fd13c531800 20 remove_watcher() i=2 2024-09-19T13:56:35.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.371+0000 7fd13c531800 20 remove_watcher() i=3 2024-09-19T13:56:35.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.372+0000 7fd13c531800 20 remove_watcher() i=4 2024-09-19T13:56:35.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.373+0000 7fd13c531800 20 remove_watcher() i=5 2024-09-19T13:56:35.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.374+0000 7fd13c531800 20 remove_watcher() i=6 2024-09-19T13:56:35.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.375+0000 7fd13c531800 20 remove_watcher() i=7 2024-09-19T13:56:35.390 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T13:56:35.418 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:35.418 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:35.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.452+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 realm 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.454+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.455+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.455+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.455+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:35.458 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.455+0000 7fcfb4b22800 20 searching for the correct realm 2024-09-19T13:56:35.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.459+0000 7fcfaffd1640 0 -- 172.21.15.94:0/176765942 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fcfa000b040 msgr2=0x7fcfa003d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:35.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.462+0000 7fcfaffd1640 0 -- 172.21.15.94:0/176765942 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fce780873f0 msgr2=0x7fce78089820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.465+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 zone default found 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 4 Realm: () 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 zonegroup default 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.466+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.467+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.467+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.467+0000 7fcfb4b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.467+0000 7fcfb4b22800 20 started sync module instance, tier type = 2024-09-19T13:56:35.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.467+0000 7fcfb4b22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=0 2024-09-19T13:56:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=1 2024-09-19T13:56:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=2 2024-09-19T13:56:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=3 2024-09-19T13:56:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=4 2024-09-19T13:56:35.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=5 2024-09-19T13:56:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.476+0000 7fcfb4b22800 20 add_watcher() i=6 2024-09-19T13:56:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.477+0000 7fcfb4b22800 20 add_watcher() i=7 2024-09-19T13:56:35.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.477+0000 7fcfb4b22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:35.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fce66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:35.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcfb4b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcfb4b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcfb4b22800 5 note: GC not initialized 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fce65fdb640 20 reqs_thread_entry: start 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcfb4b22800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcfb4b22800 20 Filter name: none 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcdd77fe640 20 reqs_thread_entry: start 2024-09-19T13:56:35.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.479+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.480+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:35.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.480+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.483+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:35.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.483+0000 7fcfb4b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:35.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.483+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.484+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:35.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.484+0000 7fcfb4b22800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.484+0000 7fcfb4b22800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:35.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.484+0000 7fcfb4b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:35.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.486+0000 7fce66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.488+0000 7fcfb4b22800 20 remove_watcher() i=0 2024-09-19T13:56:35.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.488+0000 7fcfb4b22800 2 removed watcher, disabling cache 2024-09-19T13:56:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.489+0000 7fcfb4b22800 20 remove_watcher() i=1 2024-09-19T13:56:35.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.490+0000 7fcfb4b22800 20 remove_watcher() i=2 2024-09-19T13:56:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.491+0000 7fcfb4b22800 20 remove_watcher() i=3 2024-09-19T13:56:35.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.492+0000 7fcfb4b22800 20 remove_watcher() i=4 2024-09-19T13:56:35.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.493+0000 7fcfb4b22800 20 remove_watcher() i=5 2024-09-19T13:56:35.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.493+0000 7fcfb4b22800 20 remove_watcher() i=6 2024-09-19T13:56:35.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.494+0000 7fcfb4b22800 20 remove_watcher() i=7 2024-09-19T13:56:35.507 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:35.507 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:56:35.507 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:35.581 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-19T13:56:35.582 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:35.752 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T13:56:35.780 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:35.780 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:35.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.814+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.815+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.815+0000 7fc6fc263800 20 realm 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.815+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.815+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.815+0000 7fc6fc263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.815+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.816+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.816+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.816+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.816+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.817+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:35.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.817+0000 7fc6fc263800 20 searching for the correct realm 2024-09-19T13:56:35.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.820+0000 7fc6f1553640 0 -- 172.21.15.94:0/1987875853 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x559ddff761c0 msgr2=0x559ddff78610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:35.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.824+0000 7fc6f9d54640 0 -- 172.21.15.94:0/1987875853 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc6e4052920 msgr2=0x7fc6e400d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 zone default found 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 4 Realm: () 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:35.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 zonegroup default 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.828+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 started sync module instance, tier type = 2024-09-19T13:56:35.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.829+0000 7fc6fc263800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=0 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=1 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=2 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=3 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=4 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=5 2024-09-19T13:56:35.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.838+0000 7fc6fc263800 20 add_watcher() i=6 2024-09-19T13:56:35.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.839+0000 7fc6fc263800 20 add_watcher() i=7 2024-09-19T13:56:35.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.839+0000 7fc6fc263800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:35.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.840+0000 7fc5ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:35.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc6fc263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:35.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc6fc263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:35.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc6fc263800 5 note: GC not initialized 2024-09-19T13:56:35.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc5aa7fc640 20 reqs_thread_entry: start 2024-09-19T13:56:35.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc6fc263800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:35.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc6fc263800 20 Filter name: none 2024-09-19T13:56:35.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc51bfff640 20 reqs_thread_entry: start 2024-09-19T13:56:35.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.841+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.842+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.842+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.842+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.842+0000 7fc6fc263800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.842+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.843+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:35.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.843+0000 7fc6fc263800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.843+0000 7fc6fc263800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:35.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.843+0000 7fc6fc263800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:35.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.845+0000 7fc5ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:35.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.847+0000 7fc6fc263800 20 remove_watcher() i=0 2024-09-19T13:56:35.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.847+0000 7fc6fc263800 2 removed watcher, disabling cache 2024-09-19T13:56:35.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.847+0000 7fc6fc263800 20 remove_watcher() i=1 2024-09-19T13:56:35.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.848+0000 7fc6fc263800 20 remove_watcher() i=2 2024-09-19T13:56:35.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.849+0000 7fc6fc263800 20 remove_watcher() i=3 2024-09-19T13:56:35.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.850+0000 7fc6fc263800 20 remove_watcher() i=4 2024-09-19T13:56:35.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.851+0000 7fc6fc263800 20 remove_watcher() i=5 2024-09-19T13:56:35.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.852+0000 7fc6fc263800 20 remove_watcher() i=6 2024-09-19T13:56:35.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.853+0000 7fc6fc263800 20 remove_watcher() i=7 2024-09-19T13:56:35.865 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:35.865 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:35.865 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:35.865 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:35.867 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-19T13:56:35.902 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:35.902 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:35.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.937+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 realm 2024-09-19T13:56:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:35.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:35.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.939+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.940+0000 7f6afe40d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:35.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.940+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:35.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.940+0000 7f6afe40d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:35.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.940+0000 7f6afe40d800 20 searching for the correct realm 2024-09-19T13:56:35.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:35.942+0000 7f6af36f6640 0 -- 172.21.15.94:0/3478464353 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6aec0ae260 msgr2=0x7f6aec0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:36.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.148+0000 7f6afbef7640 0 -- 172.21.15.94:0/3478464353 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6ae401d430 msgr2=0x7f6ae401d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:36.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:36.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:36.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:36.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.355+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:36.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 zone default found 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 4 Realm: () 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 zonegroup default 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.356+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.357+0000 7f6afe40d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.357+0000 7f6afe40d800 20 started sync module instance, tier type = 2024-09-19T13:56:36.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.357+0000 7f6afe40d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:36.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=0 2024-09-19T13:56:36.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=1 2024-09-19T13:56:36.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=2 2024-09-19T13:56:36.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=3 2024-09-19T13:56:36.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=4 2024-09-19T13:56:36.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=5 2024-09-19T13:56:36.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.365+0000 7f6afe40d800 20 add_watcher() i=6 2024-09-19T13:56:36.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.366+0000 7f6afe40d800 20 add_watcher() i=7 2024-09-19T13:56:36.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.366+0000 7f6afe40d800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:36.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.368+0000 7f69b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:36.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:36.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 5 note: GC not initialized 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f69b0fe1640 20 reqs_thread_entry: start 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 20 Filter name: none 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f692a7fc640 20 reqs_thread_entry: start 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T13:56:36.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.369+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:36.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T13:56:36.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T13:56:36.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 : miss 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.370+0000 7f6afe40d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 2024-09-19T13:56:36.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f6afe40d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f6afe40d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f6afe40d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f6afe40d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32, ofs0, ns] 2024-09-19T13:56:36.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f69daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595124 cookie 93861537112176 notifier 6890 bl.length()=1015 2024-09-19T13:56:36.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f69daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f69daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.377+0000 7f69daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.378+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): orig_sources= new_sources= 2024-09-19T13:56:36.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.378+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): potential sources added=[] removed=[] 2024-09-19T13:56:36.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.378+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): orig_dests= new_dests= 2024-09-19T13:56:36.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.378+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): potential dests added=[] removed=[] 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.382+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.0 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.0 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.1 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.1 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.2 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.2 2024-09-19T13:56:36.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.3 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.3 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.4 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.4 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.5 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.5 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.6 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.6 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.7 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.7 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.8 2024-09-19T13:56:36.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.8 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.9 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.9 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.10 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.10 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.11 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1.11 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.0 2024-09-19T13:56:36.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1 2024-09-19T13:56:36.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.383+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.2 2024-09-19T13:56:36.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.384+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.3 2024-09-19T13:56:36.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.384+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.4 2024-09-19T13:56:36.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.385+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.5 2024-09-19T13:56:36.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.385+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.6 2024-09-19T13:56:36.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.386+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.7 2024-09-19T13:56:36.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.386+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.8 2024-09-19T13:56:36.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.387+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.9 2024-09-19T13:56:36.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.387+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.10 2024-09-19T13:56:36.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.390+0000 7f6afe40d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:36.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.390+0000 7f6afe40d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.391+0000 7f6afe40d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.391+0000 7f6afe40d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.391+0000 7f6afe40d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.391+0000 7f6afe40d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32, ofs0, ns] 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f69daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595125 cookie 93861537112176 notifier 6890 bl.length()=1015 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f69daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f69daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f69daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): orig_sources= new_sources= 2024-09-19T13:56:36.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): potential sources added=[] removed=[] 2024-09-19T13:56:36.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): orig_dests= new_dests= 2024-09-19T13:56:36.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.392+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): potential dests added=[] removed=[] 2024-09-19T13:56:36.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.395+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.0 2024-09-19T13:56:36.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.395+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.1 2024-09-19T13:56:36.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.395+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.2 2024-09-19T13:56:36.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.395+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.3 2024-09-19T13:56:36.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.396+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.4 2024-09-19T13:56:36.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.396+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.5 2024-09-19T13:56:36.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.396+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.6 2024-09-19T13:56:36.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.397+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.7 2024-09-19T13:56:36.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.397+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.8 2024-09-19T13:56:36.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.397+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.9 2024-09-19T13:56:36.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.398+0000 7f6afe40d800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32.10 2024-09-19T13:56:36.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.398+0000 7f6afe40d800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-19T13:56:36.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.398+0000 7f6afe40d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:36.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.398+0000 7f6afe40d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.399+0000 7f6afe40d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.399+0000 7f6afe40d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.399+0000 7f6afe40d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.399+0000 7f6afe40d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32, ofs0, ns] 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f69da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595126 cookie 93861537112176 notifier 6890 bl.length()=983 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f69da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 info.flags=0x17 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f69da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 to cache LRU end 2024-09-19T13:56:36.402 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f69da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:36.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): orig_sources= new_sources= 2024-09-19T13:56:36.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): potential sources added=[] removed=[] 2024-09-19T13:56:36.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): orig_dests= new_dests= 2024-09-19T13:56:36.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.400+0000 7f6afe40d800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32]): potential dests added=[] removed=[] 2024-09-19T13:56:36.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.402+0000 7f6afe40d800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T13:56:36.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.404+0000 7f69b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:36.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.406+0000 7f6afe40d800 20 remove_watcher() i=0 2024-09-19T13:56:36.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.406+0000 7f6afe40d800 2 removed watcher, disabling cache 2024-09-19T13:56:36.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.407+0000 7f6afe40d800 20 remove_watcher() i=1 2024-09-19T13:56:36.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.408+0000 7f6afe40d800 20 remove_watcher() i=2 2024-09-19T13:56:36.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.409+0000 7f6afe40d800 20 remove_watcher() i=3 2024-09-19T13:56:36.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.410+0000 7f6afe40d800 20 remove_watcher() i=4 2024-09-19T13:56:36.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.411+0000 7f6afe40d800 20 remove_watcher() i=5 2024-09-19T13:56:36.414 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.412+0000 7f6afe40d800 20 remove_watcher() i=6 2024-09-19T13:56:36.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.413+0000 7f6afe40d800 20 remove_watcher() i=7 2024-09-19T13:56:36.428 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T13:56:36.456 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:36.456 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:36.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.489+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 realm 2024-09-19T13:56:36.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:36.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.491+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.492+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:36.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.492+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.492+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:36.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.492+0000 7f0d868b9800 20 searching for the correct realm 2024-09-19T13:56:36.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.496+0000 7f0d84ba4640 0 -- 172.21.15.94:0/3350779168 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55e8191b9c80 msgr2=0x55e8191bc0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:36.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.499+0000 7f0d843a3640 0 -- 172.21.15.94:0/3350779168 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f0d780671f0 msgr2=0x7f0d780a1050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:36.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:36.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:36.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:36.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:36.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:36.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.503+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 zone default found 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 4 Realm: () 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:36.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 zonegroup default 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 started sync module instance, tier type = 2024-09-19T13:56:36.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.504+0000 7f0d868b9800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:36.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.512+0000 7f0d868b9800 20 add_watcher() i=0 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=1 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=2 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=3 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=4 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=5 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=6 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 20 add_watcher() i=7 2024-09-19T13:56:36.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.513+0000 7f0d868b9800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:36.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.515+0000 7f0c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.515+0000 7f0d868b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.515+0000 7f0d868b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.515+0000 7f0d868b9800 5 note: GC not initialized 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.515+0000 7f0c397e2640 20 reqs_thread_entry: start 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.516+0000 7f0d868b9800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.516+0000 7f0d868b9800 20 Filter name: none 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.516+0000 7f0baaffd640 20 reqs_thread_entry: start 2024-09-19T13:56:36.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.516+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.516+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.516+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:36.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.517+0000 7f0d868b9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:36.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.519+0000 7f0c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:36.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.522+0000 7f0d868b9800 20 remove_watcher() i=0 2024-09-19T13:56:36.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.522+0000 7f0d868b9800 2 removed watcher, disabling cache 2024-09-19T13:56:36.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.523+0000 7f0d868b9800 20 remove_watcher() i=1 2024-09-19T13:56:36.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.523+0000 7f0d868b9800 20 remove_watcher() i=2 2024-09-19T13:56:36.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.524+0000 7f0d868b9800 20 remove_watcher() i=3 2024-09-19T13:56:36.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.525+0000 7f0d868b9800 20 remove_watcher() i=4 2024-09-19T13:56:36.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.526+0000 7f0d868b9800 20 remove_watcher() i=5 2024-09-19T13:56:36.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.527+0000 7f0d868b9800 20 remove_watcher() i=6 2024-09-19T13:56:36.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.528+0000 7f0d868b9800 20 remove_watcher() i=7 2024-09-19T13:56:36.541 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:36.541 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:36.541 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T13:56:36.541 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:36.615 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-19T13:56:36.615 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:36.788 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T13:56:36.816 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:36.816 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:36.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.849+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 20 realm 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.851+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.852+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.852+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:36.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.852+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.852+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:36.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.853+0000 7fc5f8526800 20 searching for the correct realm 2024-09-19T13:56:36.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.856+0000 7fc5f39d8640 0 -- 172.21.15.94:0/2709862492 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55a0b0a21e00 msgr2=0x55a0b0a24230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:36.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.859+0000 7fc5f41d9640 0 -- 172.21.15.94:0/2709862492 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc5e80493f0 msgr2=0x7fc5e8049870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:36.865 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.862+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:36.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 zone default found 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 4 Realm: () 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 zonegroup default 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.863+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.864+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.864+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.864+0000 7fc5f8526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.864+0000 7fc5f8526800 20 started sync module instance, tier type = 2024-09-19T13:56:36.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.864+0000 7fc5f8526800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:36.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=0 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=1 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=2 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=3 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=4 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=5 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.872+0000 7fc5f8526800 20 add_watcher() i=6 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.873+0000 7fc5f8526800 20 add_watcher() i=7 2024-09-19T13:56:36.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.873+0000 7fc5f8526800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:36.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc4aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc5f8526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc5f8526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc5f8526800 5 note: GC not initialized 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc4a9fdb640 20 reqs_thread_entry: start 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc5f8526800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc5f8526800 20 Filter name: none 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc41b7fe640 20 reqs_thread_entry: start 2024-09-19T13:56:36.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.875+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.876+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.876+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.876+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.876+0000 7fc5f8526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.876+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.877+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.877+0000 7fc5f8526800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.877+0000 7fc5f8526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:36.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.877+0000 7fc5f8526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:36.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.878+0000 7fc4aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:36.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.880+0000 7fc5f8526800 20 remove_watcher() i=0 2024-09-19T13:56:36.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.880+0000 7fc5f8526800 2 removed watcher, disabling cache 2024-09-19T13:56:36.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.882+0000 7fc5f8526800 20 remove_watcher() i=1 2024-09-19T13:56:36.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.882+0000 7fc5f8526800 20 remove_watcher() i=2 2024-09-19T13:56:36.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.883+0000 7fc5f8526800 20 remove_watcher() i=3 2024-09-19T13:56:36.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.884+0000 7fc5f8526800 20 remove_watcher() i=4 2024-09-19T13:56:36.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.885+0000 7fc5f8526800 20 remove_watcher() i=5 2024-09-19T13:56:36.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.886+0000 7fc5f8526800 20 remove_watcher() i=6 2024-09-19T13:56:36.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.887+0000 7fc5f8526800 20 remove_watcher() i=7 2024-09-19T13:56:36.899 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:36.900 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:36.900 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:36.900 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:36.901 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-19T13:56:36.935 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:36.935 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:36.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.969+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.970+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.970+0000 7f3a67010800 20 realm 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.970+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.971+0000 7f3a67010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:36.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:36.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:36.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:36.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.972+0000 7f3a67010800 20 searching for the correct realm 2024-09-19T13:56:36.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.974+0000 7f3a61fdf640 0 -- 172.21.15.94:0/2665990953 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f3a540cc040 msgr2=0x7f3a540ac530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:36.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:36.979+0000 7f3a627e0640 0 -- 172.21.15.94:0/2665990953 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3a5805b400 msgr2=0x7f3a5805b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:37.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:37.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:37.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:37.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:37.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 zone default found 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 4 Realm: () 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 zonegroup default 2024-09-19T13:56:37.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.187+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.187+0000 7f3a67010800 20 started sync module instance, tier type = 2024-09-19T13:56:37.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.187+0000 7f3a67010800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:37.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=0 2024-09-19T13:56:37.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=1 2024-09-19T13:56:37.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=2 2024-09-19T13:56:37.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=3 2024-09-19T13:56:37.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=4 2024-09-19T13:56:37.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=5 2024-09-19T13:56:37.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=6 2024-09-19T13:56:37.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.196+0000 7f3a67010800 20 add_watcher() i=7 2024-09-19T13:56:37.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.196+0000 7f3a67010800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:37.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f3918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:37.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f3a67010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:37.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f3a67010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:37.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f3a67010800 5 note: GC not initialized 2024-09-19T13:56:37.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f38937fe640 20 reqs_thread_entry: start 2024-09-19T13:56:37.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f3a67010800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:37.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f3a67010800 20 Filter name: none 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.198+0000 7f38917fa640 20 reqs_thread_entry: start 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : miss 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.199+0000 7f3a67010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:56:37.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3a67010800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3a67010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595132 cookie 94285956246608 notifier 6941 bl.length()=1015 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:56:37.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:56:37.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:56:37.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:56:37.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:56:37.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:56:37.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:56:37.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:56:37.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:56:37.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.210+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:56:37.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.210+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:56:37.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.211+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:56:37.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.211+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:56:37.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.212+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:56:37.214 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.212+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:56:37.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.213+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:56:37.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.213+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:56:37.216 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.214+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:56:37.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.217+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:37.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.217+0000 7f3a67010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:56:37.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3a67010800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.220 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3a67010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595133 cookie 94285956246608 notifier 6941 bl.length()=1015 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:56:37.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:56:37.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:56:37.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:56:37.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:56:37.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:56:37.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:56:37.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:56:37.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:56:37.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:56:37.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:56:37.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:56:37.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.224+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:56:37.226 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a67010800 time 2024-09-19T13:56:37.225709+0000 2024-09-19T13:56:37.226 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a6818c76a] 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.225+0000 7f3a67010800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a67010800 time 2024-09-19T13:56:37.225709+0000 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:37.227 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a6818c76a] 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:56:37.228 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3a67010800 thread_name:radosgw-admin 2024-09-19T13:56:37.246 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.246 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a66e3e6f0] 2024-09-19T13:56:37.246 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a66e8b99c] 2024-09-19T13:56:37.246 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a6818c7c4] 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.225+0000 7f3a67010800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3a67010800 thread_name:radosgw-admin 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.247 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a66e3e6f0] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a66e8b99c] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a6818c7c4] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:56:37.248 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:56:36.954+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:56:36.954+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:56:36.954+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8d2c160 auth_method 0 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.249 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:56:36.955+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 7302 payload 824 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:56:36.955+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:56:36.955+0000 7f3a627e0640 1 monclient: found mon.noname-a 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:56:36.955+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: dump: 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.250 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.252 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: dump: 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:56:36.955+0000 7f3a67010800 5 monclient: authenticate success, global_id 7302 2024-09-19T13:56:37.253 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:56:36.955+0000 7f3950608640 4 set_mon_vals no callback set 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:56:36.955+0000 7f3a67010800 1 librados: init done 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:56:36.957+0000 7f394ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:56:36.957+0000 7f394ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:56:36.957+0000 7f394ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:56:36.957+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f3948077570 auth_method 0 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:56:36.957+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x55c0a8e0d360 auth_method 0 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:56:36.958+0000 7f3a627e0640 10 monclient: get_auth_request con 0x55c0a8e2fe90 auth_method 0 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:56:36.959+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x55c0a8e336f0 auth_method 0 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:56:36.960+0000 7f3a67010800 10 monclient: build_initial_monmap 2024-09-19T13:56:37.254 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:56:36.960+0000 7f3a67010800 1 build_initial for_mkfs: 0 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:56:36.960+0000 7f3a67010800 10 monclient: monmap: 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding auth protocol: cephx 2024-09-19T13:56:37.255 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding auth protocol: cephx 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding auth protocol: cephx 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.256 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:56:36.960+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command objecter_requests cmddesc objecter_requests hook 0x55c0a8e3c580 EEXIST 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:56:36.960+0000 7f3a67010800 10 monclient: init 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding auth protocol: cephx 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding auth protocol: cephx 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding auth protocol: cephx 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.257 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:56:36.961+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:56:36.961+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:56:36.961+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command rotate-key cmddesc rotate-key hook 0x55c0a8e380a0 EEXIST 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-a con 0x55c0a8e608a0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-b con 0x55c0a8e60c80 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-c con 0x55c0a8e5f5b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.258 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): authenticate will time out at 2010.618445s 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): get_auth_request con 0x55c0a8e608a0 auth_method 0 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request con 0x55c0a8e5f5b0 auth_method 0 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.259 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8e60c80 auth_method 0 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 7305 payload 824 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.260 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:56:36.961+0000 7f3a627e0640 1 monclient: found mon.noname-a 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: dump: 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.261 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: dump: 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.262 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:56:36.962+0000 7f3a67010800 5 monclient: authenticate success, global_id 7305 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:56:36.962+0000 7f3a637e2640 4 set_mon_vals no callback set 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:56:36.963+0000 7f3947fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:56:36.963+0000 7f3947fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:56:36.963+0000 7f3947fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.263 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:56:36.963+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f393c077480 auth_method 0 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:56:36.963+0000 7f3a67010800 10 monclient: get_monmap_and_config 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:56:36.963+0000 7f3a67010800 10 monclient: build_initial_monmap 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:56:36.963+0000 7f3a67010800 1 build_initial for_mkfs: 0 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:56:36.963+0000 7f3a67010800 10 monclient: monmap: 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:37.264 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding auth protocol: cephx 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding auth protocol: cephx 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding auth protocol: cephx 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.265 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:56:36.964+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient: init 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding auth protocol: cephx 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding auth protocol: cephx 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding auth protocol: cephx 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.266 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:56:36.964+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:56:36.964+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command rotate-key cmddesc rotate-key hook 0x7ffde3ab2bd8 EEXIST 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-c con 0x55c0a8eb48d0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-a con 0x55c0a8ea5220 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:37.267 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-b con 0x55c0a8eafd00 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): authenticate will time out at 2010.621922s 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): get_auth_request con 0x55c0a8eb48d0 auth_method 0 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8ea5220 auth_method 0 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.268 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request con 0x55c0a8eafd00 auth_method 0 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.269 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 6938 payload 274 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:56:36.965+0000 7f3a627e0640 1 monclient: found mon.noname-c 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: dump: 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.270 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: dump: 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.271 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:56:36.965+0000 7f3a67010800 5 monclient: authenticate success, global_id 6938 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:56:36.965+0000 7f3a67010800 10 monclient: get_monmap_and_config success 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:56:36.965+0000 7f3a67010800 4 set_mon_vals no callback set 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:56:36.965+0000 7f3a67010800 10 monclient: shutdown 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:56:36.966+0000 7f3a67010800 10 monclient: build_initial_monmap 2024-09-19T13:56:37.272 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 build_initial for_mkfs: 0 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:56:36.966+0000 7f3a67010800 10 monclient: monmap: 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding auth protocol: cephx 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding auth protocol: cephx 2024-09-19T13:56:37.273 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding auth protocol: cephx 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:56:36.966+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.274 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: starting msgr at 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: starting objecter 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command objecter_requests cmddesc objecter_requests hook 0x55c0a8e86300 EEXIST 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: setting wanted keys 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: calling monclient init 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:56:36.966+0000 7f3a67010800 10 monclient: init 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding auth protocol: cephx 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding auth protocol: cephx 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding auth protocol: cephx 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.275 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:56:36.966+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:56:36.966+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:56:36.967+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command rotate-key cmddesc rotate-key hook 0x55c0a8e752a8 EEXIST 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-c con 0x55c0a8ea5220 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-b con 0x55c0a8eafd00 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:37.276 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-a con 0x55c0a8eb48d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): authenticate will time out at 2010.624089s 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): get_auth_request con 0x55c0a8ea5220 auth_method 0 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request con 0x55c0a8eb48d0 auth_method 0 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.277 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8eafd00 auth_method 0 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-19T13:56:37.278 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:56:36.967+0000 7f3a627e0640 1 monclient: found mon.noname-c 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: dump: 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.279 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: dump: 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.280 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:56:36.967+0000 7f3a67010800 5 monclient: authenticate success, global_id 6941 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:56:36.967+0000 7f3945ffb640 4 set_mon_vals no callback set 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:56:36.967+0000 7f3a67010800 1 librados: init done 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:56:36.967+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cr dump hook 0x55c0a8ead388 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:56:36.969+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:56:36.969+0000 7f3933fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:37.281 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:56:36.969+0000 7f3933fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:56:36.969+0000 7f3933fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:56:36.970+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f392c077570 auth_method 0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:56:36.970+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x55c0a8ecdf00 auth_method 0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:56:36.970+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:56:36.970+0000 7f3a67010800 20 realm 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:56:36.970+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:56:36.971+0000 7f3a67010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:56:36.971+0000 7f3a627e0640 10 monclient: get_auth_request con 0x55c0a8ed2290 auth_method 0 2024-09-19T13:56:37.282 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 searching for the correct realm 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:56:36.972+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x55c0a8ed7390 auth_method 0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:56:36.973+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x7f3a5802b410 auth_method 0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:56:36.973+0000 7f3a627e0640 10 monclient: get_auth_request con 0x7f3a5c00e070 auth_method 0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:56:36.974+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f3a540cc040 auth_method 0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:56:36.974+0000 7f3a61fdf640 0 -- 172.21.15.94:0/2665990953 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f3a540cc040 msgr2=0x7f3a540ac530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:56:36.974+0000 7f3933fff640 1 client.6941.objecter ms_handle_reset 0x7f3a540cc040 session 0x7f3a54005040 osd.4 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:56:36.974+0000 7f3933fff640 10 monclient: _renew_subs 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:56:36.974+0000 7f3933fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:56:36.975+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f392c087390 auth_method 0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:56:36.976+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x7f3a5804b040 auth_method 0 2024-09-19T13:56:37.283 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:56:36.979+0000 7f3a627e0640 10 monclient: get_auth_request con 0x7f3a5805b400 auth_method 0 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:56:36.979+0000 7f3a627e0640 0 -- 172.21.15.94:0/2665990953 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3a5805b400 msgr2=0x7f3a5805b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:56:37.180+0000 7f3a627e0640 10 monclient: get_auth_request con 0x7f3a5805b400 auth_method 0 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.284 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 zone default found 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:56:37.186+0000 7f3a67010800 4 Realm: () 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:56:37.186+0000 7f3a67010800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:56:37.186+0000 7f3a67010800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:56:37.186+0000 7f3a67010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 zonegroup default 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:56:37.187+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.285 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:56:37.187+0000 7f3a67010800 20 started sync module instance, tier type = 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:56:37.187+0000 7f3a67010800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=0 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=1 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=2 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=3 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=4 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=5 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=6 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:56:37.196+0000 7f3a67010800 20 add_watcher() i=7 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:56:37.196+0000 7f3a67010800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding auth protocol: cephx 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding auth protocol: cephx 2024-09-19T13:56:37.286 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding auth protocol: cephx 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:56:37.198+0000 7f3918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.287 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:56:37.198+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache list hook 0x55c0a8ead5f0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache inspect hook 0x55c0a8ead5f0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache erase hook 0x55c0a8ead5f0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache zap hook 0x55c0a8ead5f0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 note: GC not initialized 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:56:37.198+0000 7f38937fe640 20 reqs_thread_entry: start 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace show hook 0x7f3a5800b7d0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace history hook 0x7f3a5800b7d0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace active hook 0x7f3a5800b7d0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace active_short hook 0x7f3a5800b7d0 2024-09-19T13:56:37.288 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 Filter name: none 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:56:37.198+0000 7f38917fa640 20 reqs_thread_entry: start 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : miss 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.289 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595132 cookie 94285956246608 notifier 6941 bl.length()=1015 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:56:37.290 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:56:37.291 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:56:37.292 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:56:37.210+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:56:37.210+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:56:37.211+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:56:37.211+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:56:37.212+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:56:37.212+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:56:37.213+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:56:37.213+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:56:37.214+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:56:37.217+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:56:37.217+0000 7f3a67010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.293 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595133 cookie 94285956246608 notifier 6941 bl.length()=1015 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:56:37.294 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:56:37.224+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:56:37.225+0000 7f3a67010800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a67010800 time 2024-09-19T13:56:37.225709+0000 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a6818c76a] 2024-09-19T13:56:37.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:56:37.225+0000 7f3a67010800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3a67010800 thread_name:radosgw-admin 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a66e3e6f0] 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a66e8b99c] 2024-09-19T13:56:37.296 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a6818c7c4] 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:56:37.297 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:56:37.298 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:56:37.299 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:56:37.300 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:56:37.301 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:56:37.302 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:56:37.303 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38917fa640 / http_manager 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38937fe640 / http_manager 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3918fe1640 / rgw_dt_lg_renew 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3933fff640 / ms_dispatch 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3945ffb640 / io_context_pool 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3947fff640 / ms_dispatch 2024-09-19T13:56:37.304 INFO:tasks.workunit.client.0.smithi094.stderr: 7f394ee05640 / ms_dispatch 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3950608640 / io_context_pool 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a61fdf640 / msgr-worker-2 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a627e0640 / msgr-worker-1 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a62fe1640 / msgr-worker-0 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a637e2640 / io_context_pool 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a67010800 / radosgw-admin 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.121457.log 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.305 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:56:36.954+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:56:36.954+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:56:36.954+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:56:36.954+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8d2c160 auth_method 0 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:56:36.955+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:56:36.955+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 7302 payload 824 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:56:36.955+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:56:36.955+0000 7f3a627e0640 1 monclient: found mon.noname-a 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:56:36.955+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.306 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: dump: 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.307 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:56:36.955+0000 7f394ee05640 10 monclient: dump: 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.308 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:56:36.955+0000 7f3a67010800 5 monclient: authenticate success, global_id 7302 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:56:36.955+0000 7f3950608640 4 set_mon_vals no callback set 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:56:36.955+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:56:36.955+0000 7f3a67010800 1 librados: init done 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:56:36.957+0000 7f394ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:56:36.957+0000 7f394ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:56:36.957+0000 7f394ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:56:36.957+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f3948077570 auth_method 0 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:56:36.957+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x55c0a8e0d360 auth_method 0 2024-09-19T13:56:37.309 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:56:36.958+0000 7f3a627e0640 10 monclient: get_auth_request con 0x55c0a8e2fe90 auth_method 0 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:56:36.959+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x55c0a8e336f0 auth_method 0 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:56:36.960+0000 7f3a67010800 10 monclient: build_initial_monmap 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:56:36.960+0000 7f3a67010800 1 build_initial for_mkfs: 0 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:56:36.960+0000 7f3a67010800 10 monclient: monmap: 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:37.310 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding auth protocol: cephx 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding auth protocol: cephx 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding auth protocol: cephx 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.311 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: crc 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e390b0) adding con mode: secure 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:56:36.960+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command objecter_requests cmddesc objecter_requests hook 0x55c0a8e3c580 EEXIST 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:56:36.960+0000 7f3a67010800 10 monclient: init 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding auth protocol: cephx 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding auth protocol: cephx 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding auth protocol: cephx 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.312 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: crc 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:56:36.960+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e37f58) adding con mode: secure 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:56:36.961+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:56:36.961+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:56:36.961+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command rotate-key cmddesc rotate-key hook 0x55c0a8e380a0 EEXIST 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-a con 0x55c0a8e608a0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-b con 0x55c0a8e60c80 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:37.313 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-c con 0x55c0a8e5f5b0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:56:36.961+0000 7f3a67010800 10 monclient(hunting): authenticate will time out at 2010.618445s 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): get_auth_request con 0x55c0a8e608a0 auth_method 0 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request con 0x55c0a8e5f5b0 auth_method 0 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.314 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:56:36.961+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8e60c80 auth_method 0 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:56:36.961+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 7305 payload 824 2024-09-19T13:56:37.315 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:56:36.961+0000 7f3a627e0640 1 monclient: found mon.noname-a 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:56:36.961+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: dump: 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.316 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:56:36.962+0000 7f3947fff640 10 monclient: dump: 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.317 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:56:36.962+0000 7f3a67010800 5 monclient: authenticate success, global_id 7305 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:56:36.962+0000 7f3a637e2640 4 set_mon_vals no callback set 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:56:36.962+0000 7f3a67010800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:56:36.963+0000 7f3947fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:56:36.963+0000 7f3947fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:56:36.963+0000 7f3947fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.318 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:56:36.963+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f393c077480 auth_method 0 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:56:36.963+0000 7f3a67010800 10 monclient: get_monmap_and_config 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:56:36.963+0000 7f3a67010800 10 monclient: build_initial_monmap 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:56:36.963+0000 7f3a67010800 1 build_initial for_mkfs: 0 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:56:36.963+0000 7f3a67010800 10 monclient: monmap: 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.319 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding auth protocol: cephx 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding auth protocol: cephx 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding auth protocol: cephx 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: crc 2024-09-19T13:56:37.320 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e80300) adding con mode: secure 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:56:36.964+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient: init 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding auth protocol: cephx 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding auth protocol: cephx 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding auth protocol: cephx 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.321 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: crc 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2a90) adding con mode: secure 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:56:36.964+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:56:36.964+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:56:36.964+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command rotate-key cmddesc rotate-key hook 0x7ffde3ab2bd8 EEXIST 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-c con 0x55c0a8eb48d0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-a con 0x55c0a8ea5220 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-b con 0x55c0a8eafd00 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.322 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:56:36.964+0000 7f3a67010800 10 monclient(hunting): authenticate will time out at 2010.621922s 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): get_auth_request con 0x55c0a8eb48d0 auth_method 0 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8ea5220 auth_method 0 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request con 0x55c0a8eafd00 auth_method 0 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.323 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:56:36.965+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:56:36.965+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 6938 payload 274 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:56:36.965+0000 7f3a627e0640 1 monclient: found mon.noname-c 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:56:36.965+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.324 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: dump: 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.325 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:56:36.965+0000 7f3945ffb640 10 monclient: dump: 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:56:36.965+0000 7f3a67010800 5 monclient: authenticate success, global_id 6938 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:56:36.965+0000 7f3a67010800 10 monclient: get_monmap_and_config success 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:56:36.965+0000 7f3a67010800 4 set_mon_vals no callback set 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:56:36.965+0000 7f3a67010800 10 monclient: shutdown 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:56:36.966+0000 7f3a67010800 10 monclient: build_initial_monmap 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 build_initial for_mkfs: 0 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:56:36.966+0000 7f3a67010800 10 monclient: monmap: 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:56:37.327 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding auth protocol: cephx 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding auth protocol: cephx 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding auth protocol: cephx 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.328 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: crc 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e83e30) adding con mode: secure 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:56:36.966+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: starting msgr at 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: starting objecter 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command objecter_requests cmddesc objecter_requests hook 0x55c0a8e86300 EEXIST 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: setting wanted keys 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:56:36.966+0000 7f3a67010800 1 librados: calling monclient init 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:56:36.966+0000 7f3a67010800 10 monclient: init 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding auth protocol: cephx 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding auth protocol: cephx 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding auth protocol: cephx 2024-09-19T13:56:37.329 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: crc 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:56:36.966+0000 7f3a67010800 5 AuthRegistry(0x55c0a8e75160) adding con mode: secure 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:56:36.966+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.330 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:56:36.966+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:56:36.967+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command rotate-key cmddesc rotate-key hook 0x55c0a8e752a8 EEXIST 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _reopen_session rank -1 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-c con 0x55c0a8ea5220 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-b con 0x55c0a8eafd00 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): picked mon.noname-a con 0x55c0a8eb48d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): start opening mon connection 2024-09-19T13:56:37.331 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): _renew_subs 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient(hunting): authenticate will time out at 2010.624089s 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): get_auth_request con 0x55c0a8ea5220 auth_method 0 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request con 0x55c0a8eb48d0 auth_method 0 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.332 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:56:36.967+0000 7f3a62fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request con 0x55c0a8eafd00 auth_method 0 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:56:36.967+0000 7f3a61fdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient: _finish_hunting 0 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:56:36.967+0000 7f3a627e0640 1 monclient: found mon.noname-c 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:56:36.967+0000 7f3a627e0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.333 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: dump: 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: _finish_auth 0 2024-09-19T13:56:37.334 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: _check_auth_tickets 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:56:36.967+0000 7f3933fff640 10 monclient: dump: 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:56:37.335 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:56:36.967+0000 7f3a67010800 5 monclient: authenticate success, global_id 6941 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:56:36.967+0000 7f3945ffb640 4 set_mon_vals no callback set 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _renew_subs 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:56:36.967+0000 7f3a67010800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:56:36.967+0000 7f3a67010800 1 librados: init done 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:56:36.967+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cr dump hook 0x55c0a8ead388 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:56:36.969+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:56:36.969+0000 7f3933fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:56:36.969+0000 7f3933fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:56:36.969+0000 7f3933fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:56:37.336 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:56:36.970+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f392c077570 auth_method 0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:56:36.970+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x55c0a8ecdf00 auth_method 0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:56:36.970+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:56:36.970+0000 7f3a67010800 20 realm 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:56:36.970+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:56:36.971+0000 7f3a67010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:56:36.971+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:56:36.971+0000 7f3a627e0640 10 monclient: get_auth_request con 0x55c0a8ed2290 auth_method 0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.337 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:56:36.972+0000 7f3a67010800 20 searching for the correct realm 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:56:36.972+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x55c0a8ed7390 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:56:36.973+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x7f3a5802b410 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:56:36.973+0000 7f3a627e0640 10 monclient: get_auth_request con 0x7f3a5c00e070 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:56:36.974+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f3a540cc040 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:56:36.974+0000 7f3a61fdf640 0 -- 172.21.15.94:0/2665990953 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f3a540cc040 msgr2=0x7f3a540ac530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:56:36.974+0000 7f3933fff640 1 client.6941.objecter ms_handle_reset 0x7f3a540cc040 session 0x7f3a54005040 osd.4 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:56:36.974+0000 7f3933fff640 10 monclient: _renew_subs 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:56:36.974+0000 7f3933fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:56:36.975+0000 7f3a61fdf640 10 monclient: get_auth_request con 0x7f392c087390 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:56:36.976+0000 7f3a62fe1640 10 monclient: get_auth_request con 0x7f3a5804b040 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:56:36.979+0000 7f3a627e0640 10 monclient: get_auth_request con 0x7f3a5805b400 auth_method 0 2024-09-19T13:56:37.338 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:56:36.979+0000 7f3a627e0640 0 -- 172.21.15.94:0/2665990953 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3a5805b400 msgr2=0x7f3a5805b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:56:37.180+0000 7f3a627e0640 10 monclient: get_auth_request con 0x7f3a5805b400 auth_method 0 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:56:37.185+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:37.339 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 zone default found 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:56:37.186+0000 7f3a67010800 4 Realm: () 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:56:37.186+0000 7f3a67010800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:56:37.186+0000 7f3a67010800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:56:37.186+0000 7f3a67010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 zonegroup default 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:56:37.186+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:56:37.187+0000 7f3a67010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:56:37.187+0000 7f3a67010800 20 started sync module instance, tier type = 2024-09-19T13:56:37.340 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:56:37.187+0000 7f3a67010800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=0 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=1 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=2 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=3 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=4 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=5 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:56:37.195+0000 7f3a67010800 20 add_watcher() i=6 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:56:37.196+0000 7f3a67010800 20 add_watcher() i=7 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:56:37.196+0000 7f3a67010800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding auth protocol: cephx 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding auth protocol: cephx 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding auth protocol: cephx 2024-09-19T13:56:37.341 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:56:37.198+0000 7f3918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: crc 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 AuthRegistry(0x7ffde3ab2f60) adding con mode: secure 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:56:37.198+0000 7f3a67010800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:37.342 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache list hook 0x55c0a8ead5f0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache inspect hook 0x55c0a8ead5f0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache erase hook 0x55c0a8ead5f0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command cache zap hook 0x55c0a8ead5f0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 note: GC not initialized 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:56:37.198+0000 7f38937fe640 20 reqs_thread_entry: start 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace show hook 0x7f3a5800b7d0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace history hook 0x7f3a5800b7d0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace active hook 0x7f3a5800b7d0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:56:37.198+0000 7f3a67010800 5 asok(0x55c0a8bc2410) register_command sync trace active_short hook 0x7f3a5800b7d0 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:56:37.198+0000 7f3a67010800 20 Filter name: none 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:56:37.198+0000 7f38917fa640 20 reqs_thread_entry: start 2024-09-19T13:56:37.343 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : miss 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:56:37.199+0000 7f3a67010800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:56:37.199+0000 7f3a67010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.344 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:56:37.204+0000 7f3a67010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595132 cookie 94285956246608 notifier 6941 bl.length()=1015 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:56:37.204+0000 7f3945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:56:37.205+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:56:37.345 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:56:37.346 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:56:37.209+0000 7f3a67010800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:56:37.209+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:56:37.210+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:56:37.210+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:56:37.211+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:56:37.211+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:56:37.212+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:56:37.347 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:56:37.212+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:56:37.213+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:56:37.213+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:56:37.214+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:56:37.217+0000 7f3a67010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:56:37.217+0000 7f3a67010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:56:37.218+0000 7f3a67010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595133 cookie 94285956246608 notifier 6941 bl.length()=1015 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:56:37.218+0000 7f3945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:56:37.348 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:56:37.219+0000 7f3a67010800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:56:37.221+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:56:37.222+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:56:37.223+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:56:37.349 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:56:37.224+0000 7f3a67010800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:56:37.225+0000 7f3a67010800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a67010800 time 2024-09-19T13:56:37.225709+0000 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a6818c76a] 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.350 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:56:37.225+0000 7f3a67010800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3a67010800 thread_name:radosgw-admin 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a66e3e6f0] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a66e8b99c] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a6818c7c4] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a6818c928] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c0a75c5791] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55c0a75d5757] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3a66e29590] 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:56:37.351 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:56:37.352 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:56:37.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:56:37.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:56:37.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:56:37.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:56:37.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38917fa640 / http_manager 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 7f38937fe640 / http_manager 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3918fe1640 / rgw_dt_lg_renew 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3933fff640 / ms_dispatch 2024-09-19T13:56:37.358 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3945ffb640 / io_context_pool 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3947fff640 / ms_dispatch 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f394ee05640 / ms_dispatch 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3950608640 / io_context_pool 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a61fdf640 / msgr-worker-2 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a627e0640 / msgr-worker-1 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a62fe1640 / msgr-worker-0 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a637e2640 / io_context_pool 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3a67010800 / radosgw-admin 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:56:37.227092Z_2d9948c6-ed03-49ff-8c29-cd93b50f9b57/log 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:56:37.359 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.300+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.301+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.301+0000 7f144d52e800 20 realm 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.301+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.302+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.302+0000 7f144d52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.302+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.302+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.302+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.302+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.303+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.303+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.303+0000 7f144d52e800 20 searching for the correct realm 2024-09-19T13:56:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.304+0000 7f14492dd640 0 -- 172.21.15.94:0/2654917728 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f144405b040 msgr2=0x7f144405c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:37.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.509+0000 7f1449ade640 0 -- 172.21.15.94:0/2654917728 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f1434080040 msgr2=0x7f1434069150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.514+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 zone default found 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 4 Realm: () 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 zonegroup default 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.515+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:37.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 started sync module instance, tier type = 2024-09-19T13:56:37.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.516+0000 7f144d52e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=0 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=1 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=2 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=3 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=4 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=5 2024-09-19T13:56:37.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.525+0000 7f144d52e800 20 add_watcher() i=6 2024-09-19T13:56:37.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.526+0000 7f144d52e800 20 add_watcher() i=7 2024-09-19T13:56:37.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.526+0000 7f144d52e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:37.529 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.527+0000 7f12fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:37.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:37.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:37.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 5 note: GC not initialized 2024-09-19T13:56:37.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f12fefe5640 20 reqs_thread_entry: start 2024-09-19T13:56:37.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 init_complete bucket index max shards: 11 2024-09-19T13:56:37.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 Filter name: none 2024-09-19T13:56:37.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f12fcfe1640 20 reqs_thread_entry: start 2024-09-19T13:56:37.531 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.528+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 rados->read ofs=0 len=0 2024-09-19T13:56:37.532 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:56:37.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.529+0000 7f144d52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:56:37.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.531+0000 7f12fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:37.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.533+0000 7f144d52e800 20 remove_watcher() i=0 2024-09-19T13:56:37.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.533+0000 7f144d52e800 2 removed watcher, disabling cache 2024-09-19T13:56:37.536 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.534+0000 7f144d52e800 20 remove_watcher() i=1 2024-09-19T13:56:37.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.535+0000 7f144d52e800 20 remove_watcher() i=2 2024-09-19T13:56:37.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.536+0000 7f144d52e800 20 remove_watcher() i=3 2024-09-19T13:56:37.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.537+0000 7f144d52e800 20 remove_watcher() i=4 2024-09-19T13:56:37.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.538+0000 7f144d52e800 20 remove_watcher() i=5 2024-09-19T13:56:37.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.539+0000 7f144d52e800 20 remove_watcher() i=6 2024-09-19T13:56:37.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:56:37.540+0000 7f144d52e800 20 remove_watcher() i=7 2024-09-19T13:56:37.552 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:56:37.552 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:56:37.552 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:56:37.552 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:07.635 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:57:07.668 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:07.669 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:07.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.707+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 realm 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.709+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.710+0000 7fac3a411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:07.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.710+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.711+0000 7fac3a411800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:07.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.711+0000 7fac3a411800 20 searching for the correct realm 2024-09-19T13:57:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.715+0000 7fac36393640 0 -- 172.21.15.94:0/3678434402 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fac2009b040 msgr2=0x7fac2009c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:07.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.923+0000 7fac35b92640 0 -- 172.21.15.94:0/3678434402 >> [v2:172.21.15.149:6810/155328186,v1:172.21.15.149:6811/155328186] conn(0x55b0ed4b8b00 msgr2=0x55b0ed4baf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.925+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 zone default found 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 4 Realm: () 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 zonegroup default 2024-09-19T13:57:07.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.926+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 started sync module instance, tier type = 2024-09-19T13:57:07.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.927+0000 7fac3a411800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=0 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=1 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=2 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=3 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=4 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=5 2024-09-19T13:57:07.938 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.937+0000 7fac3a411800 20 add_watcher() i=6 2024-09-19T13:57:07.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.938+0000 7fac3a411800 20 add_watcher() i=7 2024-09-19T13:57:07.939 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.938+0000 7fac3a411800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:07.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.939+0000 7faae77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:07.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:07.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:07.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 5 note: GC not initialized 2024-09-19T13:57:07.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7faae67fc640 20 reqs_thread_entry: start 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 20 Filter name: none 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7faa57fff640 20 reqs_thread_entry: start 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.940+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:57:07.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : miss 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 20 rados->read ofs=0 len=0 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.943 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.941+0000 7fac3a411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:57:07.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.951+0000 7fac3a411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.951+0000 7fac3a411800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.951+0000 7fac3a411800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.951+0000 7fac3a411800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:57:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fab18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595135 cookie 94218383800240 notifier 7344 bl.length()=1015 2024-09-19T13:57:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fab18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fab18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fab18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:57:07.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:57:07.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:57:07.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.952+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:57:07.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:57:07.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.0 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.1 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.2 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.3 2024-09-19T13:57:07.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.4 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.5 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.6 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.7 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.8 2024-09-19T13:57:07.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.9 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.10 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1.11 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:57:07.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.958+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:57:07.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.959+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:57:07.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.959+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:57:07.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.960+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:57:07.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.960+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:57:07.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.961+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:57:07.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.961+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:57:07.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.962+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:57:07.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.962+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:57:07.965 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.963+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:57:07.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.966+0000 7fac3a411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:07.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.966+0000 7fac3a411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:57:07.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fac3a411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fac3a411800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fac3a411800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fac3a411800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fab197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595136 cookie 94218383800240 notifier 7344 bl.length()=1015 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fab197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fab197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.967+0000 7fab197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.968+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.968+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:57:07.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.968+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:57:07.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.968+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:57:07.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.970+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.0 2024-09-19T13:57:07.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.970+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.1 2024-09-19T13:57:07.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.971+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.2 2024-09-19T13:57:07.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.971+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.3 2024-09-19T13:57:07.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.971+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.4 2024-09-19T13:57:07.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.971+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.5 2024-09-19T13:57:07.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.972+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.6 2024-09-19T13:57:07.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.972+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.7 2024-09-19T13:57:07.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.973+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.8 2024-09-19T13:57:07.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.973+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.9 2024-09-19T13:57:07.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.973+0000 7fac3a411800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33.10 2024-09-19T13:57:07.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.974+0000 7fac3a411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:07.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.974+0000 7fac3a411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 2024-09-19T13:57:07.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fac3a411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fac3a411800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fac3a411800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fac3a411800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33, ofs0, ns] 2024-09-19T13:57:07.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fab18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595137 cookie 94218383800240 notifier 7344 bl.length()=983 2024-09-19T13:57:07.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fab18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 info.flags=0x17 2024-09-19T13:57:07.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fab18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 to cache LRU end 2024-09-19T13:57:07.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.975+0000 7fab18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:07.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.976+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_sources= new_sources= 2024-09-19T13:57:07.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.976+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential sources added=[] removed=[] 2024-09-19T13:57:07.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.976+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): orig_dests= new_dests= 2024-09-19T13:57:07.978 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.976+0000 7fac3a411800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33]): potential dests added=[] removed=[] 2024-09-19T13:57:07.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.978+0000 7fac3a411800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T13:57:07.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.980+0000 7faae77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:07.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.982+0000 7fac3a411800 20 remove_watcher() i=0 2024-09-19T13:57:07.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.982+0000 7fac3a411800 2 removed watcher, disabling cache 2024-09-19T13:57:07.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.983+0000 7fac3a411800 20 remove_watcher() i=1 2024-09-19T13:57:07.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.984+0000 7fac3a411800 20 remove_watcher() i=2 2024-09-19T13:57:07.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.985+0000 7fac3a411800 20 remove_watcher() i=3 2024-09-19T13:57:07.987 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.986+0000 7fac3a411800 20 remove_watcher() i=4 2024-09-19T13:57:07.988 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.987+0000 7fac3a411800 20 remove_watcher() i=5 2024-09-19T13:57:07.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.988+0000 7fac3a411800 20 remove_watcher() i=6 2024-09-19T13:57:07.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:07.989+0000 7fac3a411800 20 remove_watcher() i=7 2024-09-19T13:57:08.002 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T13:57:08.030 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:08.031 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:08.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.065+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 realm 2024-09-19T13:57:08.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:08.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.067+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.068+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:08.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.068+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.068+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:08.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.069+0000 7f98f873c800 20 searching for the correct realm 2024-09-19T13:57:08.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.072+0000 7f98f4c82640 0 -- 172.21.15.94:0/1386184353 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f98dc086020 msgr2=0x7f98dc07c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:08.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.075+0000 7f98f4481640 0 -- 172.21.15.94:0/1386184353 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f98dc073a40 msgr2=0x7f98dc068b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:08.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.281+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:08.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 zone default found 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 4 Realm: () 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 zonegroup default 2024-09-19T13:57:08.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.282+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 started sync module instance, tier type = 2024-09-19T13:57:08.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.283+0000 7f98f873c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:08.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=0 2024-09-19T13:57:08.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=1 2024-09-19T13:57:08.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=2 2024-09-19T13:57:08.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=3 2024-09-19T13:57:08.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=4 2024-09-19T13:57:08.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=5 2024-09-19T13:57:08.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.292+0000 7f98f873c800 20 add_watcher() i=6 2024-09-19T13:57:08.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.293+0000 7f98f873c800 20 add_watcher() i=7 2024-09-19T13:57:08.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.293+0000 7f98f873c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:08.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.295+0000 7f97aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.295+0000 7f98f873c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.295+0000 7f98f873c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.295+0000 7f98f873c800 5 note: GC not initialized 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.295+0000 7f97a97e2640 20 reqs_thread_entry: start 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.295+0000 7f98f873c800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 Filter name: none 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f971affd640 20 reqs_thread_entry: start 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:57:08.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:57:08.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:08.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.296+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.297+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:57:08.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.297+0000 7f98f873c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.297+0000 7f98f873c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:57:08.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.297+0000 7f98f873c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:08.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.299+0000 7f97aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:08.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.301+0000 7f98f873c800 20 remove_watcher() i=0 2024-09-19T13:57:08.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.301+0000 7f98f873c800 2 removed watcher, disabling cache 2024-09-19T13:57:08.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.302+0000 7f98f873c800 20 remove_watcher() i=1 2024-09-19T13:57:08.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.303+0000 7f98f873c800 20 remove_watcher() i=2 2024-09-19T13:57:08.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.304+0000 7f98f873c800 20 remove_watcher() i=3 2024-09-19T13:57:08.306 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.305+0000 7f98f873c800 20 remove_watcher() i=4 2024-09-19T13:57:08.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.306+0000 7f98f873c800 20 remove_watcher() i=5 2024-09-19T13:57:08.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.307+0000 7f98f873c800 20 remove_watcher() i=6 2024-09-19T13:57:08.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.308+0000 7f98f873c800 20 remove_watcher() i=7 2024-09-19T13:57:08.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:08.320 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:08.320 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-commit-target-layout id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:57:08.320 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:08.395 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-19T13:57:08.395 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:08.604 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T13:57:08.633 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:08.633 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:08.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.667+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 realm 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.669+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.670+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.670+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.670+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:08.672 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.670+0000 7eff22d24800 20 searching for the correct realm 2024-09-19T13:57:08.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.673+0000 7eff16267640 0 -- 172.21.15.94:0/1232967601 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7eff1002b070 msgr2=0x7eff10039430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:08.678 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.677+0000 7eff1ea68640 0 -- 172.21.15.94:0/1232967601 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7eff0807e400 msgr2=0x7eff08088a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.883+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 zone default found 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 4 Realm: () 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:08.887 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 zonegroup default 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.884+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.885+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.885+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.885+0000 7eff22d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.885+0000 7eff22d24800 20 started sync module instance, tier type = 2024-09-19T13:57:08.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.885+0000 7eff22d24800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=0 2024-09-19T13:57:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=1 2024-09-19T13:57:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=2 2024-09-19T13:57:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=3 2024-09-19T13:57:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=4 2024-09-19T13:57:08.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=5 2024-09-19T13:57:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.894+0000 7eff22d24800 20 add_watcher() i=6 2024-09-19T13:57:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.895+0000 7eff22d24800 20 add_watcher() i=7 2024-09-19T13:57:08.896 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.895+0000 7eff22d24800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:08.897 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.896+0000 7efdd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7eff22d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7eff22d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7eff22d24800 5 note: GC not initialized 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7efd4ffff640 20 reqs_thread_entry: start 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7eff22d24800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7eff22d24800 20 Filter name: none 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7efd4dffb640 20 reqs_thread_entry: start 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.897+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:08.899 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.898+0000 7eff22d24800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.899+0000 7eff22d24800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:08.901 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.899+0000 7eff22d24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:08.902 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.900+0000 7efdd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:08.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.902+0000 7eff22d24800 20 remove_watcher() i=0 2024-09-19T13:57:08.903 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.902+0000 7eff22d24800 2 removed watcher, disabling cache 2024-09-19T13:57:08.904 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.903+0000 7eff22d24800 20 remove_watcher() i=1 2024-09-19T13:57:08.905 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.904+0000 7eff22d24800 20 remove_watcher() i=2 2024-09-19T13:57:08.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.905+0000 7eff22d24800 20 remove_watcher() i=3 2024-09-19T13:57:08.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.906+0000 7eff22d24800 20 remove_watcher() i=4 2024-09-19T13:57:08.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.907+0000 7eff22d24800 20 remove_watcher() i=5 2024-09-19T13:57:08.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.908+0000 7eff22d24800 20 remove_watcher() i=6 2024-09-19T13:57:08.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.909+0000 7eff22d24800 20 remove_watcher() i=7 2024-09-19T13:57:08.920 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:08.920 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:08.920 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:08.920 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:08.921 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-19T13:57:08.955 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:08.955 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:08.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.990+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.991+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.991+0000 7f708312c800 20 realm 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.991+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:08.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:08.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.992+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:08.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.993+0000 7f708312c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:08.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.993+0000 7f708312c800 20 searching for the correct realm 2024-09-19T13:57:08.997 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.996+0000 7f7077fff640 0 -- 172.21.15.94:0/2095415097 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f707001a040 msgr2=0x7f707003b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:09.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:08.999+0000 7f707ed45640 0 -- 172.21.15.94:0/2095415097 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f7068096000 msgr2=0x7f7068062160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:09.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.205+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 zone default found 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 4 Realm: () 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 zonegroup default 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.206+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.207+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.207+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.207+0000 7f708312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.207+0000 7f708312c800 20 started sync module instance, tier type = 2024-09-19T13:57:09.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.207+0000 7f708312c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=0 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=1 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=2 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=3 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=4 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=5 2024-09-19T13:57:09.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.216+0000 7f708312c800 20 add_watcher() i=6 2024-09-19T13:57:09.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.217+0000 7f708312c800 20 add_watcher() i=7 2024-09-19T13:57:09.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.217+0000 7f708312c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:09.219 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.218+0000 7f6f357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 5 note: GC not initialized 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f6eaffff640 20 reqs_thread_entry: start 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 20 Filter name: none 2024-09-19T13:57:09.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f6eadffb640 20 reqs_thread_entry: start 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.219+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 : miss 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.220+0000 7f708312c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 2024-09-19T13:57:09.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f708312c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f708312c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f708312c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f708312c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34, ofs0, ns] 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f6f61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595165 cookie 94012193180208 notifier 7398 bl.length()=995 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f6f61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f6f61ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.225+0000 7f6f61ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.226+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_sources= new_sources= 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.226+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential sources added=[] removed=[] 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.226+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_dests= new_dests= 2024-09-19T13:57:09.227 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.226+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential dests added=[] removed=[] 2024-09-19T13:57:09.231 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.230+0000 7f708312c800 -1 Injecting error=-5 at location=do_reshard 2024-09-19T13:57:09.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.237+0000 7f708312c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:09.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.237+0000 7f708312c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 2024-09-19T13:57:09.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.239 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34, ofs0, ns] 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f6f61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595166 cookie 94012193180208 notifier 7398 bl.length()=963 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f6f61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f6f61ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f6f61ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_sources= new_sources= 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential sources added=[] removed=[] 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_dests= new_dests= 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential dests added=[] removed=[] 2024-09-19T13:57:09.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.238+0000 7f708312c800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-19T13:57:09.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.240+0000 7f6f357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.242+0000 7f708312c800 20 remove_watcher() i=0 2024-09-19T13:57:09.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.242+0000 7f708312c800 2 removed watcher, disabling cache 2024-09-19T13:57:09.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.244+0000 7f708312c800 20 remove_watcher() i=1 2024-09-19T13:57:09.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.245+0000 7f708312c800 20 remove_watcher() i=2 2024-09-19T13:57:09.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.246+0000 7f708312c800 20 remove_watcher() i=3 2024-09-19T13:57:09.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.247+0000 7f708312c800 20 remove_watcher() i=4 2024-09-19T13:57:09.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.248+0000 7f708312c800 20 remove_watcher() i=5 2024-09-19T13:57:09.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.249+0000 7f708312c800 20 remove_watcher() i=6 2024-09-19T13:57:09.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.250+0000 7f708312c800 20 remove_watcher() i=7 2024-09-19T13:57:09.262 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T13:57:09.290 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:09.291 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:09.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.326+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 realm 2024-09-19T13:57:09.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:09.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.328+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.329+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.329+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.329+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:09.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.329+0000 7f9562f2e800 20 searching for the correct realm 2024-09-19T13:57:09.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.332+0000 7f955e4dc640 0 -- 172.21.15.94:0/55590291 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55de3e9d0e40 msgr2=0x55de3e9d3290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:09.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.336+0000 7f955ecdd640 0 -- 172.21.15.94:0/55590291 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f95480741b0 msgr2=0x7f9548035970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.339+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 zone default found 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 4 Realm: () 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 zonegroup default 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.340+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 started sync module instance, tier type = 2024-09-19T13:57:09.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.341+0000 7f9562f2e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:09.350 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=0 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=1 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=2 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=3 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=4 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=5 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.349+0000 7f9562f2e800 20 add_watcher() i=6 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.350+0000 7f9562f2e800 20 add_watcher() i=7 2024-09-19T13:57:09.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.350+0000 7f9562f2e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f94157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f9562f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f9562f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f9562f2e800 5 note: GC not initialized 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f938ffff640 20 reqs_thread_entry: start 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f9562f2e800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.352+0000 7f9562f2e800 20 Filter name: none 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f938dffb640 20 reqs_thread_entry: start 2024-09-19T13:57:09.354 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:09.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:09.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f9562f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:09.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.353+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.354+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:09.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.354+0000 7f9562f2e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.354+0000 7f9562f2e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:09.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.354+0000 7f9562f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:09.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.356+0000 7f94157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.358+0000 7f9562f2e800 20 remove_watcher() i=0 2024-09-19T13:57:09.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.358+0000 7f9562f2e800 2 removed watcher, disabling cache 2024-09-19T13:57:09.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.359+0000 7f9562f2e800 20 remove_watcher() i=1 2024-09-19T13:57:09.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.360+0000 7f9562f2e800 20 remove_watcher() i=2 2024-09-19T13:57:09.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.360+0000 7f9562f2e800 20 remove_watcher() i=3 2024-09-19T13:57:09.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.361+0000 7f9562f2e800 20 remove_watcher() i=4 2024-09-19T13:57:09.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.362+0000 7f9562f2e800 20 remove_watcher() i=5 2024-09-19T13:57:09.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.363+0000 7f9562f2e800 20 remove_watcher() i=6 2024-09-19T13:57:09.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.364+0000 7f9562f2e800 20 remove_watcher() i=7 2024-09-19T13:57:09.375 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:09.375 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:09.375 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:09.375 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:09.427 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:57:09.457 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:09.457 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:09.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.492+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.493+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.493+0000 7f6329736800 20 realm 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.493+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.494+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.494+0000 7f6329736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.494+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.494+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.494+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.495+0000 7f6329736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.495+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.495+0000 7f6329736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:09.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.495+0000 7f6329736800 20 searching for the correct realm 2024-09-19T13:57:09.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.498+0000 7f631ccb6640 0 -- 172.21.15.94:0/2205438567 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6318094070 msgr2=0x7f63180aa630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:09.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.501+0000 7f63254b7640 0 -- 172.21.15.94:0/2205438567 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6310008410 msgr2=0x7f6310008890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 zone default found 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 4 Realm: () 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.708+0000 7f6329736800 20 zonegroup default 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 started sync module instance, tier type = 2024-09-19T13:57:09.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.709+0000 7f6329736800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:09.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=0 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=1 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=2 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=3 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=4 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=5 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.718+0000 7f6329736800 20 add_watcher() i=6 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.719+0000 7f6329736800 20 add_watcher() i=7 2024-09-19T13:57:09.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.719+0000 7f6329736800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:09.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.721+0000 7f61db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.721+0000 7f6329736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:09.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.721+0000 7f6329736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:09.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.721+0000 7f6329736800 5 note: GC not initialized 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.721+0000 7f61da7e4640 20 reqs_thread_entry: start 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.721+0000 7f6329736800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 20 Filter name: none 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f614bfff640 20 reqs_thread_entry: start 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 : miss 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.724 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:09.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:09.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.722+0000 7f6329736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f6329736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f6329736800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f6329736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f6329736800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34, ofs0, ns] 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f61f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595167 cookie 94483814038368 notifier 7434 bl.length()=995 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f61f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f61f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.728+0000 7f61f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.729+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_sources= new_sources= 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.729+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential sources added=[] removed=[] 2024-09-19T13:57:09.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.729+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_dests= new_dests= 2024-09-19T13:57:09.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.729+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential dests added=[] removed=[] 2024-09-19T13:57:09.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.0 2024-09-19T13:57:09.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.0 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.1 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.1 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.2 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.2 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.3 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.3 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.4 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.4 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.5 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.5 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.6 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.6 2024-09-19T13:57:09.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.7 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.7 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.8 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.8 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.9 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.9 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.10 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.10 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.11 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1.11 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.0 2024-09-19T13:57:09.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.734+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1 2024-09-19T13:57:09.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.735+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.2 2024-09-19T13:57:09.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.735+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.3 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.736+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.4 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.736+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.5 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.737+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.6 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.737+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.7 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.737+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.8 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.738+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.9 2024-09-19T13:57:09.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.738+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.10 2024-09-19T13:57:09.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.741+0000 7f6329736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:09.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.741+0000 7f6329736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34, ofs0, ns] 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6208ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595168 cookie 94483814038368 notifier 7434 bl.length()=995 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6208ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6208ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.744 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6208ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_sources= new_sources= 2024-09-19T13:57:09.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential sources added=[] removed=[] 2024-09-19T13:57:09.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_dests= new_dests= 2024-09-19T13:57:09.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.743+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential dests added=[] removed=[] 2024-09-19T13:57:09.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.746+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.0 2024-09-19T13:57:09.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.746+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.1 2024-09-19T13:57:09.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.747+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.2 2024-09-19T13:57:09.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.747+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.3 2024-09-19T13:57:09.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.747+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.4 2024-09-19T13:57:09.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.748+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.5 2024-09-19T13:57:09.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.748+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.6 2024-09-19T13:57:09.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.748+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.7 2024-09-19T13:57:09.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.748+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.8 2024-09-19T13:57:09.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.749+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.9 2024-09-19T13:57:09.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.749+0000 7f6329736800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34.10 2024-09-19T13:57:09.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.749+0000 7f6329736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:09.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.749+0000 7f6329736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.750+0000 7f6329736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.750+0000 7f6329736800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.750+0000 7f6329736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.750+0000 7f6329736800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34, ofs0, ns] 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f61f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595169 cookie 94483814038368 notifier 7434 bl.length()=963 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f61f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 info.flags=0x17 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f61f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 to cache LRU end 2024-09-19T13:57:09.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f61f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:09.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_sources= new_sources= 2024-09-19T13:57:09.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential sources added=[] removed=[] 2024-09-19T13:57:09.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): orig_dests= new_dests= 2024-09-19T13:57:09.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.751+0000 7f6329736800 20 handle_bi_update(): bucket=:error-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34]): potential dests added=[] removed=[] 2024-09-19T13:57:09.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.754+0000 7f6329736800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-19T13:57:09.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.756+0000 7f61db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.758+0000 7f6329736800 20 remove_watcher() i=0 2024-09-19T13:57:09.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.758+0000 7f6329736800 2 removed watcher, disabling cache 2024-09-19T13:57:09.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.759+0000 7f6329736800 20 remove_watcher() i=1 2024-09-19T13:57:09.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.760+0000 7f6329736800 20 remove_watcher() i=2 2024-09-19T13:57:09.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.761+0000 7f6329736800 20 remove_watcher() i=3 2024-09-19T13:57:09.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.762+0000 7f6329736800 20 remove_watcher() i=4 2024-09-19T13:57:09.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.763+0000 7f6329736800 20 remove_watcher() i=5 2024-09-19T13:57:09.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.763+0000 7f6329736800 20 remove_watcher() i=6 2024-09-19T13:57:09.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.764+0000 7f6329736800 20 remove_watcher() i=7 2024-09-19T13:57:09.777 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T13:57:09.806 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:09.806 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:09.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.841+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.842+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.842+0000 7fefbbbaf800 20 realm 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.842+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.843+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.843+0000 7fefbbbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.843+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.843+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.843+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.844+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.844+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.844+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:09.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.844+0000 7fefbbbaf800 20 searching for the correct realm 2024-09-19T13:57:09.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.847+0000 7fefb9e9a640 0 -- 172.21.15.94:0/2259199094 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fefa405e9c0 msgr2=0x7fefa4061d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:09.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.850+0000 7fefb8e98640 0 -- 172.21.15.94:0/2259199094 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fefb40cbc60 msgr2=0x7fefb40ac730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:09.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:09.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:09.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:09.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:09.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.855+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 zone default found 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 4 Realm: () 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:09.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 zonegroup default 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 started sync module instance, tier type = 2024-09-19T13:57:09.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.856+0000 7fefbbbaf800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=0 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=1 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=2 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=3 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=4 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=5 2024-09-19T13:57:09.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=6 2024-09-19T13:57:09.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 20 add_watcher() i=7 2024-09-19T13:57:09.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.865+0000 7fefbbbaf800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:09.868 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.867+0000 7fee6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.867+0000 7fefbbbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:09.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.867+0000 7fefbbbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:09.869 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fefbbbaf800 5 note: GC not initialized 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fee6e7e4640 20 reqs_thread_entry: start 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fefbbbaf800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fefbbbaf800 20 Filter name: none 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7feddffff640 20 reqs_thread_entry: start 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:09.870 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.868+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 rados->read ofs=0 len=0 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:09.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.869+0000 7fefbbbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:09.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.871+0000 7fee6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:09.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.873+0000 7fefbbbaf800 20 remove_watcher() i=0 2024-09-19T13:57:09.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.873+0000 7fefbbbaf800 2 removed watcher, disabling cache 2024-09-19T13:57:09.875 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.874+0000 7fefbbbaf800 20 remove_watcher() i=1 2024-09-19T13:57:09.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.876+0000 7fefbbbaf800 20 remove_watcher() i=2 2024-09-19T13:57:09.878 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.877+0000 7fefbbbaf800 20 remove_watcher() i=3 2024-09-19T13:57:09.879 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.878+0000 7fefbbbaf800 20 remove_watcher() i=4 2024-09-19T13:57:09.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.879+0000 7fefbbbaf800 20 remove_watcher() i=5 2024-09-19T13:57:09.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.880+0000 7fefbbbaf800 20 remove_watcher() i=6 2024-09-19T13:57:09.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:09.881+0000 7fefbbbaf800 20 remove_watcher() i=7 2024-09-19T13:57:09.892 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:09.892 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:09.892 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-do-reshard id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:57:09.892 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:09.968 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-19T13:57:09.968 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.143 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T13:57:10.171 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:10.171 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:10.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.206+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.209 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.208+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.208+0000 7f1c811a7800 20 realm 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.208+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.208+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.208+0000 7f1c811a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.208+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.209+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.209+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.209+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.209+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.210+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:10.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.210+0000 7f1c811a7800 20 searching for the correct realm 2024-09-19T13:57:10.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.213+0000 7f1c7f492640 0 -- 172.21.15.94:0/2132714820 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f1c740b8d40 msgr2=0x7f1c740ac310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.217 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.216+0000 7f1c7ec91640 0 -- 172.21.15.94:0/2132714820 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f1c740bd120 msgr2=0x7f1c740c9e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.422+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.425 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 zone default found 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 4 Realm: () 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 zonegroup default 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.423+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.426 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 started sync module instance, tier type = 2024-09-19T13:57:10.427 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.424+0000 7f1c811a7800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.434+0000 7f1c811a7800 20 add_watcher() i=0 2024-09-19T13:57:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.434+0000 7f1c811a7800 20 add_watcher() i=1 2024-09-19T13:57:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.434+0000 7f1c811a7800 20 add_watcher() i=2 2024-09-19T13:57:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.434+0000 7f1c811a7800 20 add_watcher() i=3 2024-09-19T13:57:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.434+0000 7f1c811a7800 20 add_watcher() i=4 2024-09-19T13:57:10.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.434+0000 7f1c811a7800 20 add_watcher() i=5 2024-09-19T13:57:10.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.435+0000 7f1c811a7800 20 add_watcher() i=6 2024-09-19T13:57:10.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.435+0000 7f1c811a7800 20 add_watcher() i=7 2024-09-19T13:57:10.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.435+0000 7f1c811a7800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.437+0000 7f1b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.437+0000 7f1c811a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.437+0000 7f1c811a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.437+0000 7f1c811a7800 5 note: GC not initialized 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.437+0000 7f1aaffff640 20 reqs_thread_entry: start 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.438+0000 7f1c811a7800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.438+0000 7f1c811a7800 20 Filter name: none 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.438+0000 7f1aadffb640 20 reqs_thread_entry: start 2024-09-19T13:57:10.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.438+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.438+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:10.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.438+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.439+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:10.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.439+0000 7f1c811a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:10.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.439+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.439+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:10.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.439+0000 7f1c811a7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.440+0000 7f1c811a7800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:10.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.440+0000 7f1c811a7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:10.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.441+0000 7f1b357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:10.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.445+0000 7f1c811a7800 20 remove_watcher() i=0 2024-09-19T13:57:10.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.445+0000 7f1c811a7800 2 removed watcher, disabling cache 2024-09-19T13:57:10.447 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.446+0000 7f1c811a7800 20 remove_watcher() i=1 2024-09-19T13:57:10.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.447+0000 7f1c811a7800 20 remove_watcher() i=2 2024-09-19T13:57:10.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.448+0000 7f1c811a7800 20 remove_watcher() i=3 2024-09-19T13:57:10.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.449+0000 7f1c811a7800 20 remove_watcher() i=4 2024-09-19T13:57:10.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.450+0000 7f1c811a7800 20 remove_watcher() i=5 2024-09-19T13:57:10.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.451+0000 7f1c811a7800 20 remove_watcher() i=6 2024-09-19T13:57:10.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.452+0000 7f1c811a7800 20 remove_watcher() i=7 2024-09-19T13:57:10.463 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.464 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:10.464 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:10.464 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.465 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T13:57:10.499 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:10.499 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:10.535 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.534+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 realm 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.537 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:10.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.537+0000 7fd72933e800 20 searching for the correct realm 2024-09-19T13:57:10.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.540+0000 7fd7248bf640 0 -- 172.21.15.94:0/2109605272 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd718060ce0 msgr2=0x7fd71806ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.543+0000 7fd7250c0640 0 -- 172.21.15.94:0/2109605272 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd71c08c040 msgr2=0x7fd71c09e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 zone default found 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 4 Realm: () 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 zonegroup default 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 started sync module instance, tier type = 2024-09-19T13:57:10.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.750+0000 7fd72933e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:10.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=0 2024-09-19T13:57:10.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=1 2024-09-19T13:57:10.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=2 2024-09-19T13:57:10.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=3 2024-09-19T13:57:10.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=4 2024-09-19T13:57:10.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=5 2024-09-19T13:57:10.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=6 2024-09-19T13:57:10.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.760+0000 7fd72933e800 20 add_watcher() i=7 2024-09-19T13:57:10.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.760+0000 7fd72933e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:10.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.761+0000 7fd5db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:10.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:10.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:10.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 5 note: GC not initialized 2024-09-19T13:57:10.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd5da7e4640 20 reqs_thread_entry: start 2024-09-19T13:57:10.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:10.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 20 Filter name: none 2024-09-19T13:57:10.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd54bfff640 20 reqs_thread_entry: start 2024-09-19T13:57:10.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T13:57:10.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.762+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : miss 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:10.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.763+0000 7fd72933e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:10.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.768+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.768+0000 7fd72933e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.768+0000 7fd72933e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.768+0000 7fd72933e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35, ofs0, ns] 2024-09-19T13:57:10.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595142 cookie 94586812246592 notifier 7106 bl.length()=995 2024-09-19T13:57:10.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_sources= new_sources= 2024-09-19T13:57:10.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential sources added=[] removed=[] 2024-09-19T13:57:10.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_dests= new_dests= 2024-09-19T13:57:10.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential dests added=[] removed=[] 2024-09-19T13:57:10.776 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd72933e800 time 2024-09-19T13:57:10.775507+0000 2024-09-19T13:57:10.776 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:10.776 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.776 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd72ab8c76a] 2024-09-19T13:57:10.776 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fd72933e800 thread_name:radosgw-admin 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.775+0000 7fd72933e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd72933e800 time 2024-09-19T13:57:10.775507+0000 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.777 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd72ab8c76a] 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:57:10.778 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.793 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.793 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd72983e6f0] 2024-09-19T13:57:10.793 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd72988b99c] 2024-09-19T13:57:10.793 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:10.793 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd72ab8c7c4] 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.776+0000 7fd72933e800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fd72933e800 thread_name:radosgw-admin 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.794 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd72983e6f0] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd72988b99c] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd72ab8c7c4] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.795 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:57:10.518+0000 7fd72933e800 4 set_mon_vals no callback set 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: shutdown 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 asok(0x5606b5268410) unregister_commands rotate-key 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:57:10.518+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.796 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding auth protocol: cephx 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding auth protocol: cephx 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding auth protocol: cephx 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.797 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:57:10.519+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: starting msgr at 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: starting objecter 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 asok(0x5606b5268410) register_command objecter_requests hook 0x5606b53d3430 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: setting wanted keys 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: calling monclient init 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding auth protocol: cephx 2024-09-19T13:57:10.798 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding auth protocol: cephx 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding auth protocol: cephx 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.799 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:57:10.519+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:57:10.519+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key hook 0x5606b5489738 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b5336700 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5336ae0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b53cc2c0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.175884s 2024-09-19T13:57:10.800 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): get_auth_request con 0x5606b5336700 auth_method 0 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:57:10.519+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b5336ae0 auth_method 0 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.801 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b53cc2c0 auth_method 0 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:57:10.520+0000 7fd7250c0640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.802 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: dump: 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.803 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: dump: 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:57:10.520+0000 7fd72933e800 5 monclient: authenticate success, global_id 7097 2024-09-19T13:57:10.804 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:57:10.520+0000 7fd613606640 4 set_mon_vals no callback set 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:57:10.520+0000 7fd72933e800 1 librados: init done 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:57:10.522+0000 7fd611e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:57:10.522+0000 7fd611e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:57:10.522+0000 7fd611e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:57:10.522+0000 7fd7248bf640 10 monclient: get_auth_request con 0x7fd60c077570 auth_method 0 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:57:10.523+0000 7fd7258c1640 10 monclient: get_auth_request con 0x5606b54c9000 auth_method 0 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:57:10.523+0000 7fd7250c0640 10 monclient: get_auth_request con 0x5606b54d5dc0 auth_method 0 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:57:10.525+0000 7fd7248bf640 10 monclient: get_auth_request con 0x5606b54db060 auth_method 0 2024-09-19T13:57:10.805 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:57:10.525+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:57:10.525+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:57:10.525+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding auth protocol: cephx 2024-09-19T13:57:10.806 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding auth protocol: cephx 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding auth protocol: cephx 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.807 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:57:10.525+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 asok(0x5606b5268410) register_command objecter_requests cmddesc objecter_requests hook 0x5606b54e2560 EEXIST 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding auth protocol: cephx 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding auth protocol: cephx 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding auth protocol: cephx 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.808 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:57:10.526+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:57:10.526+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key cmddesc rotate-key hook 0x5606b54de190 EEXIST 2024-09-19T13:57:10.809 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b5506880 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5506c60 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b5505590 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.182674s 2024-09-19T13:57:10.810 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b5506c60 auth_method 0 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b5505590 auth_method 0 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): get_auth_request con 0x5606b5506880 auth_method 0 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.811 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:57:10.527+0000 7fd7258c1640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:57:10.527+0000 7fd7258c1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:57:10.527+0000 7fd7258c1640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:57:10.527+0000 7fd7258c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: dump: 2024-09-19T13:57:10.812 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.813 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: dump: 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.814 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:57:10.527+0000 7fd72933e800 5 monclient: authenticate success, global_id 7100 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:57:10.527+0000 7fd7260c2640 4 set_mon_vals no callback set 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:57:10.529+0000 7fd60affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:57:10.529+0000 7fd60affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:57:10.529+0000 7fd60affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:57:10.529+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd600077480 auth_method 0 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:57:10.529+0000 7fd72933e800 10 monclient: get_monmap_and_config 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:57:10.529+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.815 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:57:10.529+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:57:10.529+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding auth protocol: cephx 2024-09-19T13:57:10.816 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding auth protocol: cephx 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding auth protocol: cephx 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.817 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:57:10.529+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding auth protocol: cephx 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding auth protocol: cephx 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding auth protocol: cephx 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.818 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:57:10.530+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:57:10.530+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key cmddesc rotate-key hook 0x7fffb0a69758 EEXIST 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b555ac80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b552aa90 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5556040 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.819 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.186541s 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): get_auth_request con 0x5606b555ac80 auth_method 0 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b5556040 auth_method 0 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.820 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b552aa90 auth_method 0 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_done global_id 7103 payload 274 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:57:10.530+0000 7fd7250c0640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.821 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: dump: 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.822 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: dump: 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.823 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 monclient: authenticate success, global_id 7103 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:57:10.531+0000 7fd72933e800 4 set_mon_vals no callback set 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: shutdown 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:57:10.531+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.824 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding auth protocol: cephx 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding auth protocol: cephx 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding auth protocol: cephx 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.825 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:57:10.531+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: starting msgr at 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: starting objecter 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 asok(0x5606b5268410) register_command objecter_requests cmddesc objecter_requests hook 0x5606b555a3f0 EEXIST 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: setting wanted keys 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: calling monclient init 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding auth protocol: cephx 2024-09-19T13:57:10.826 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding auth protocol: cephx 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding auth protocol: cephx 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:57:10.532+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.827 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:57:10.532+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key cmddesc rotate-key hook 0x5606b551b288 EEXIST 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b552aa90 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5556040 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b555ac80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.188715s 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b5556040 auth_method 0 2024-09-19T13:57:10.828 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b555ac80 auth_method 0 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.829 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:57:10.533+0000 7fd7258c1640 10 monclient(hunting): handle_auth_done global_id 7106 payload 824 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:57:10.533+0000 7fd7258c1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:57:10.533+0000 7fd7258c1640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:57:10.533+0000 7fd7258c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:57:10.533+0000 7fd7250c0640 10 monclient: get_auth_request con 0x5606b552aa90 auth_method 0 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: dump: 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.830 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:57:10.533+0000 7fd72933e800 5 monclient: authenticate success, global_id 7106 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: dump: 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.831 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:57:10.533+0000 7fd608ff9640 4 set_mon_vals no callback set 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:57:10.533+0000 7fd72933e800 1 librados: init done 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:57:10.533+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cr dump hook 0x5606b5553db8 2024-09-19T13:57:10.832 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:57:10.534+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:57:10.535+0000 7fd5f6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:57:10.535+0000 7fd5f6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:57:10.535+0000 7fd5f6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:57:10.535+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd5f0077570 auth_method 0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:57:10.535+0000 7fd7248bf640 10 monclient: get_auth_request con 0x5606b5575710 auth_method 0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 realm 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:57:10.536+0000 7fd72933e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.833 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:57:10.536+0000 7fd7250c0640 10 monclient: get_auth_request con 0x5606b5579b90 auth_method 0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 searching for the correct realm 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:57:10.537+0000 7fd7248bf640 10 monclient: get_auth_request con 0x5606b557ecd0 auth_method 0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:57:10.538+0000 7fd7258c1640 10 monclient: get_auth_request con 0x7fd71c064430 auth_method 0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:57:10.539+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd72007fc20 auth_method 0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:57:10.539+0000 7fd7248bf640 10 monclient: get_auth_request con 0x7fd718060ce0 auth_method 0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:57:10.540+0000 7fd7248bf640 0 -- 172.21.15.94:0/2109605272 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd718060ce0 msgr2=0x7fd71806ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:57:10.540+0000 7fd5f6ffd640 1 client.7106.objecter ms_handle_reset 0x7fd718060ce0 session 0x7fd71807c040 osd.4 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:57:10.540+0000 7fd5f6ffd640 10 monclient: _renew_subs 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:57:10.540+0000 7fd5f6ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.834 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:57:10.540+0000 7fd7248bf640 10 monclient: get_auth_request con 0x7fd5f0087390 auth_method 0 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:57:10.541+0000 7fd7258c1640 10 monclient: get_auth_request con 0x7fd71c09c040 auth_method 0 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:57:10.543+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd71c08c040 auth_method 0 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:57:10.543+0000 7fd7250c0640 0 -- 172.21.15.94:0/2109605272 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd71c08c040 msgr2=0x7fd71c09e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:57:10.744+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd71c08c040 auth_method 0 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.835 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 zone default found 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:57:10.750+0000 7fd72933e800 4 Realm: () 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:57:10.750+0000 7fd72933e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:57:10.750+0000 7fd72933e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:57:10.750+0000 7fd72933e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 zonegroup default 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.836 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 started sync module instance, tier type = 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=0 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=1 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=2 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=3 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=4 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=5 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=6 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:57:10.760+0000 7fd72933e800 20 add_watcher() i=7 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:57:10.760+0000 7fd72933e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding auth protocol: cephx 2024-09-19T13:57:10.837 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding auth protocol: cephx 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding auth protocol: cephx 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.838 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:57:10.761+0000 7fd5db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:57:10.762+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache list hook 0x5606b5549380 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache inspect hook 0x5606b5549380 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache erase hook 0x5606b5549380 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache zap hook 0x5606b5549380 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 note: GC not initialized 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:57:10.762+0000 7fd5da7e4640 20 reqs_thread_entry: start 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace show hook 0x7fd71c004aa0 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace history hook 0x7fd71c004aa0 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace active hook 0x7fd71c004aa0 2024-09-19T13:57:10.839 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace active_short hook 0x7fd71c004aa0 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 Filter name: none 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:57:10.762+0000 7fd54bfff640 20 reqs_thread_entry: start 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:57:10.762+0000 7fd72933e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : miss 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.840 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35, ofs0, ns] 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595142 cookie 94586812246592 notifier 7106 bl.length()=995 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_sources= new_sources= 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential sources added=[] removed=[] 2024-09-19T13:57:10.841 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_dests= new_dests= 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential dests added=[] removed=[] 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:57:10.775+0000 7fd72933e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd72933e800 time 2024-09-19T13:57:10.775507+0000 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd72ab8c76a] 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:57:10.842 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:57:10.776+0000 7fd72933e800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fd72933e800 thread_name:radosgw-admin 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd72983e6f0] 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd72988b99c] 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd72ab8c7c4] 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:57:10.843 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:57:10.844 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:57:10.845 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:57:10.846 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:57:10.847 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:57:10.848 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:57:10.849 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:57:10.850 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd54bfff640 / http_manager 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5da7e4640 / http_manager 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5db7e6640 / rgw_dt_lg_renew 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5f6ffd640 / ms_dispatch 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5f7fff640 / io_context_pool 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd608ff9640 / io_context_pool 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd60affd640 / ms_dispatch 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd611e03640 / ms_dispatch 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd613606640 / io_context_pool 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7248bf640 / msgr-worker-2 2024-09-19T13:57:10.851 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7250c0640 / msgr-worker-1 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7258c1640 / msgr-worker-0 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7260c2640 / io_context_pool 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd72933e800 / radosgw-admin 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.127347.log 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:57:10.518+0000 7fd72933e800 4 set_mon_vals no callback set 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: shutdown 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 asok(0x5606b5268410) unregister_commands rotate-key 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.852 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:57:10.518+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:57:10.518+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding auth protocol: cephx 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding auth protocol: cephx 2024-09-19T13:57:10.853 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding auth protocol: cephx 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: crc 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:57:10.518+0000 7fd72933e800 5 AuthRegistry(0x5606b548ed90) adding con mode: secure 2024-09-19T13:57:10.854 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:57:10.519+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: starting msgr at 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: starting objecter 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 asok(0x5606b5268410) register_command objecter_requests hook 0x5606b53d3430 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: setting wanted keys 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:57:10.519+0000 7fd72933e800 1 librados: calling monclient init 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding auth protocol: cephx 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding auth protocol: cephx 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding auth protocol: cephx 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.855 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: crc 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 AuthRegistry(0x5606b54895f0) adding con mode: secure 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:57:10.519+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:57:10.519+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:57:10.519+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key hook 0x5606b5489738 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b5336700 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.856 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5336ae0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b53cc2c0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:57:10.519+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.175884s 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): get_auth_request con 0x5606b5336700 auth_method 0 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:57:10.519+0000 7fd7250c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:57:10.519+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b5336ae0 auth_method 0 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.857 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:57:10.520+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b53cc2c0 auth_method 0 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.858 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:57:10.520+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:57:10.520+0000 7fd7250c0640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:57:10.520+0000 7fd7250c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: dump: 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.859 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:57:10.520+0000 7fd611e03640 10 monclient: dump: 2024-09-19T13:57:10.860 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:57:10.520+0000 7fd72933e800 5 monclient: authenticate success, global_id 7097 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:57:10.520+0000 7fd613606640 4 set_mon_vals no callback set 2024-09-19T13:57:10.861 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:57:10.520+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:57:10.520+0000 7fd72933e800 1 librados: init done 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:57:10.522+0000 7fd611e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:57:10.522+0000 7fd611e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:57:10.522+0000 7fd611e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:57:10.522+0000 7fd7248bf640 10 monclient: get_auth_request con 0x7fd60c077570 auth_method 0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:57:10.523+0000 7fd7258c1640 10 monclient: get_auth_request con 0x5606b54c9000 auth_method 0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:57:10.523+0000 7fd7250c0640 10 monclient: get_auth_request con 0x5606b54d5dc0 auth_method 0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:57:10.525+0000 7fd7248bf640 10 monclient: get_auth_request con 0x5606b54db060 auth_method 0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:57:10.525+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:57:10.525+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:57:10.525+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.862 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding auth protocol: cephx 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding auth protocol: cephx 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding auth protocol: cephx 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.863 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: crc 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:57:10.525+0000 7fd72933e800 5 AuthRegistry(0x5606b54df090) adding con mode: secure 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:57:10.525+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 asok(0x5606b5268410) register_command objecter_requests cmddesc objecter_requests hook 0x5606b54e2560 EEXIST 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding auth protocol: cephx 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding auth protocol: cephx 2024-09-19T13:57:10.864 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding auth protocol: cephx 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: crc 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 AuthRegistry(0x5606b54de048) adding con mode: secure 2024-09-19T13:57:10.865 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:57:10.526+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:57:10.526+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:57:10.526+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key cmddesc rotate-key hook 0x5606b54de190 EEXIST 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b5506880 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5506c60 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b5505590 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:57:10.526+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.182674s 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b5506c60 auth_method 0 2024-09-19T13:57:10.866 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b5505590 auth_method 0 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): get_auth_request con 0x5606b5506880 auth_method 0 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:57:10.526+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.867 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:57:10.526+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:57:10.526+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:57:10.527+0000 7fd7258c1640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:57:10.527+0000 7fd7258c1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:57:10.527+0000 7fd7258c1640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:57:10.527+0000 7fd7258c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: dump: 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.868 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:57:10.527+0000 7fd60affd640 10 monclient: dump: 2024-09-19T13:57:10.869 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:57:10.527+0000 7fd72933e800 5 monclient: authenticate success, global_id 7100 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:57:10.527+0000 7fd7260c2640 4 set_mon_vals no callback set 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.870 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:57:10.527+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:57:10.529+0000 7fd60affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:57:10.529+0000 7fd60affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:57:10.529+0000 7fd60affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:57:10.529+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd600077480 auth_method 0 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:57:10.529+0000 7fd72933e800 10 monclient: get_monmap_and_config 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:57:10.529+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:57:10.529+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:57:10.529+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.871 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding auth protocol: cephx 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding auth protocol: cephx 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding auth protocol: cephx 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.872 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: crc 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:57:10.529+0000 7fd72933e800 5 AuthRegistry(0x5606b55265e0) adding con mode: secure 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:57:10.529+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding auth protocol: cephx 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding auth protocol: cephx 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding auth protocol: cephx 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.873 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: crc 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69610) adding con mode: secure 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:57:10.530+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:57:10.530+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:57:10.530+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key cmddesc rotate-key hook 0x7fffb0a69758 EEXIST 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:57:10.874 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b555ac80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b552aa90 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5556040 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:57:10.530+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.186541s 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): get_auth_request con 0x5606b555ac80 auth_method 0 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b5556040 auth_method 0 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.875 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b552aa90 auth_method 0 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:57:10.530+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.876 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:57:10.530+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient(hunting): handle_auth_done global_id 7103 payload 274 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:57:10.530+0000 7fd7250c0640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:57:10.530+0000 7fd7250c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: dump: 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.877 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:57:10.531+0000 7fd608ff9640 10 monclient: dump: 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.878 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 monclient: authenticate success, global_id 7103 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:57:10.531+0000 7fd72933e800 4 set_mon_vals no callback set 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: shutdown 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: build_initial_monmap 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:57:10.531+0000 7fd72933e800 1 build_initial for_mkfs: 0 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:57:10.531+0000 7fd72933e800 10 monclient: monmap: 2024-09-19T13:57:10.879 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding auth protocol: cephx 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding auth protocol: cephx 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding auth protocol: cephx 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.880 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: crc 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:57:10.531+0000 7fd72933e800 5 AuthRegistry(0x5606b552b8d0) adding con mode: secure 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:57:10.531+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: starting msgr at 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: starting objecter 2024-09-19T13:57:10.881 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 asok(0x5606b5268410) register_command objecter_requests cmddesc objecter_requests hook 0x5606b555a3f0 EEXIST 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: setting wanted keys 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:57:10.532+0000 7fd72933e800 1 librados: calling monclient init 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient: init 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding auth protocol: cephx 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding auth protocol: cephx 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding auth protocol: cephx 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.882 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: crc 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 AuthRegistry(0x5606b551b140) adding con mode: secure 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:57:10.532+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:57:10.532+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:57:10.532+0000 7fd72933e800 5 asok(0x5606b5268410) register_command rotate-key cmddesc rotate-key hook 0x5606b551b288 EEXIST 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-b con 0x5606b552aa90 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-a con 0x5606b5556040 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): picked mon.noname-c con 0x5606b555ac80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.883 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:57:10.532+0000 7fd72933e800 10 monclient(hunting): authenticate will time out at 2044.188715s 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): get_auth_request con 0x5606b5556040 auth_method 0 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): get_auth_request con 0x5606b555ac80 auth_method 0 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.884 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:57:10.532+0000 7fd7248bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:57:10.532+0000 7fd7258c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:57:10.533+0000 7fd7258c1640 10 monclient(hunting): handle_auth_done global_id 7106 payload 824 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:57:10.533+0000 7fd7258c1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:57:10.533+0000 7fd7258c1640 1 monclient: found mon.noname-c 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:57:10.533+0000 7fd7258c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:57:10.533+0000 7fd7250c0640 10 monclient: get_auth_request con 0x5606b552aa90 auth_method 0 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: dump: 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.885 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: _finish_auth 0 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:57:10.533+0000 7fd72933e800 5 monclient: authenticate success, global_id 7106 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.886 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:57:10.533+0000 7fd5f6ffd640 10 monclient: dump: 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.887 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:57:10.533+0000 7fd608ff9640 4 set_mon_vals no callback set 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _renew_subs 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:57:10.533+0000 7fd72933e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:57:10.533+0000 7fd72933e800 1 librados: init done 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:57:10.533+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cr dump hook 0x5606b5553db8 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:57:10.534+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:57:10.535+0000 7fd5f6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:57:10.535+0000 7fd5f6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:57:10.535+0000 7fd5f6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:57:10.535+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd5f0077570 auth_method 0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:57:10.535+0000 7fd7248bf640 10 monclient: get_auth_request con 0x5606b5575710 auth_method 0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 realm 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.888 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:57:10.536+0000 7fd72933e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:57:10.536+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:57:10.536+0000 7fd7250c0640 10 monclient: get_auth_request con 0x5606b5579b90 auth_method 0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:57:10.537+0000 7fd72933e800 20 searching for the correct realm 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:57:10.537+0000 7fd7248bf640 10 monclient: get_auth_request con 0x5606b557ecd0 auth_method 0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:57:10.538+0000 7fd7258c1640 10 monclient: get_auth_request con 0x7fd71c064430 auth_method 0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:57:10.539+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd72007fc20 auth_method 0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:57:10.539+0000 7fd7248bf640 10 monclient: get_auth_request con 0x7fd718060ce0 auth_method 0 2024-09-19T13:57:10.889 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:57:10.540+0000 7fd7248bf640 0 -- 172.21.15.94:0/2109605272 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fd718060ce0 msgr2=0x7fd71806ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:57:10.540+0000 7fd5f6ffd640 1 client.7106.objecter ms_handle_reset 0x7fd718060ce0 session 0x7fd71807c040 osd.4 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:57:10.540+0000 7fd5f6ffd640 10 monclient: _renew_subs 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:57:10.540+0000 7fd5f6ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:57:10.540+0000 7fd7248bf640 10 monclient: get_auth_request con 0x7fd5f0087390 auth_method 0 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:57:10.541+0000 7fd7258c1640 10 monclient: get_auth_request con 0x7fd71c09c040 auth_method 0 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:57:10.543+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd71c08c040 auth_method 0 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:57:10.543+0000 7fd7250c0640 0 -- 172.21.15.94:0/2109605272 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd71c08c040 msgr2=0x7fd71c09e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:57:10.744+0000 7fd7250c0640 10 monclient: get_auth_request con 0x7fd71c08c040 auth_method 0 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:10.890 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:57:10.749+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 zone default found 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:57:10.750+0000 7fd72933e800 4 Realm: () 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:57:10.750+0000 7fd72933e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:57:10.750+0000 7fd72933e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:57:10.750+0000 7fd72933e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 zonegroup default 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.891 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 started sync module instance, tier type = 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:57:10.750+0000 7fd72933e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=0 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=1 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=2 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=3 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=4 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=5 2024-09-19T13:57:10.892 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:57:10.759+0000 7fd72933e800 20 add_watcher() i=6 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:57:10.760+0000 7fd72933e800 20 add_watcher() i=7 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:57:10.760+0000 7fd72933e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding auth protocol: cephx 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding auth protocol: cephx 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding auth protocol: cephx 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.893 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: crc 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:57:10.761+0000 7fd72933e800 5 AuthRegistry(0x7fffb0a69ae0) adding con mode: secure 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:57:10.761+0000 7fd5db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:57:10.762+0000 7fd72933e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache list hook 0x5606b5549380 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache inspect hook 0x5606b5549380 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache erase hook 0x5606b5549380 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command cache zap hook 0x5606b5549380 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 note: GC not initialized 2024-09-19T13:57:10.894 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:57:10.762+0000 7fd5da7e4640 20 reqs_thread_entry: start 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace show hook 0x7fd71c004aa0 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace history hook 0x7fd71c004aa0 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace active hook 0x7fd71c004aa0 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:57:10.762+0000 7fd72933e800 5 asok(0x5606b5268410) register_command sync trace active_short hook 0x7fd71c004aa0 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 Filter name: none 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:57:10.762+0000 7fd54bfff640 20 reqs_thread_entry: start 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:57:10.762+0000 7fd72933e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:57:10.762+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : miss 2024-09-19T13:57:10.895 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:57:10.763+0000 7fd72933e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:57:10.763+0000 7fd72933e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:57:10.768+0000 7fd72933e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35, ofs0, ns] 2024-09-19T13:57:10.896 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595142 cookie 94586812246592 notifier 7106 bl.length()=995 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:57:10.769+0000 7fd5f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_sources= new_sources= 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential sources added=[] removed=[] 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_dests= new_dests= 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:57:10.769+0000 7fd72933e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential dests added=[] removed=[] 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:57:10.775+0000 7fd72933e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd72933e800 time 2024-09-19T13:57:10.775507+0000 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd72ab8c76a] 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.897 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:57:10.776+0000 7fd72933e800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fd72933e800 thread_name:radosgw-admin 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd72983e6f0] 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd72988b99c] 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:10.898 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd72ab8c7c4] 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd72ab8c928] 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5606b40d9791] 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5606b40e94aa] 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd729829590] 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:57:10.899 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:57:10.900 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:57:10.901 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:57:10.902 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:57:10.903 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:57:10.904 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:57:10.905 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd54bfff640 / http_manager 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5da7e4640 / http_manager 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5db7e6640 / rgw_dt_lg_renew 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5f6ffd640 / ms_dispatch 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd5f7fff640 / io_context_pool 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd608ff9640 / io_context_pool 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd60affd640 / ms_dispatch 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd611e03640 / ms_dispatch 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd613606640 / io_context_pool 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7248bf640 / msgr-worker-2 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7250c0640 / msgr-worker-1 2024-09-19T13:57:10.906 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7258c1640 / msgr-worker-0 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd7260c2640 / io_context_pool 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr: 7fd72933e800 / radosgw-admin 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:57:10.776898Z_2127e1e3-e990-4427-98a5-bc90c0ebe653/log 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:57:10.907 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T13:57:10.908 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.850+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 realm 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.852+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.853+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.853+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:10.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.853+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.853+0000 7f7088722800 20 searching for the correct realm 2024-09-19T13:57:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.856+0000 7f707bfff640 0 -- 172.21.15.94:0/2702144920 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f7074037030 msgr2=0x7f707404f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:10.910 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:10.860+0000 7f7084302640 0 -- 172.21.15.94:0/2702144920 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f706c0cff70 msgr2=0x7f706c065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:11.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.066+0000 7f7088722800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:11.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.066+0000 7f7088722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:11.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.066+0000 7f7088722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.066+0000 7f7088722800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.066+0000 7f7088722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.066+0000 7f7088722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 zone default found 2024-09-19T13:57:11.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 4 Realm: () 2024-09-19T13:57:11.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:11.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:11.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:11.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 zonegroup default 2024-09-19T13:57:11.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.067+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 started sync module instance, tier type = 2024-09-19T13:57:11.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.068+0000 7f7088722800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=0 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=1 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=2 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=3 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=4 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=5 2024-09-19T13:57:11.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.077+0000 7f7088722800 20 add_watcher() i=6 2024-09-19T13:57:11.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.078+0000 7f7088722800 20 add_watcher() i=7 2024-09-19T13:57:11.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.078+0000 7f7088722800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:11.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.079+0000 7f6f3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:11.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f7088722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f7088722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f7088722800 5 note: GC not initialized 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f6f39fdb640 20 reqs_thread_entry: start 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f7088722800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f7088722800 20 Filter name: none 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f6eab7fe640 20 reqs_thread_entry: start 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.080+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.081+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:11.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.081+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.081+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T13:57:11.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.081+0000 7f7088722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:11.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.081+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.081+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:11.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.082+0000 7f7088722800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.082+0000 7f7088722800 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T13:57:11.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.082+0000 7f7088722800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:11.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.084+0000 7f6f3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:11.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.085+0000 7f7088722800 20 remove_watcher() i=0 2024-09-19T13:57:11.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.085+0000 7f7088722800 2 removed watcher, disabling cache 2024-09-19T13:57:11.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.086+0000 7f7088722800 20 remove_watcher() i=1 2024-09-19T13:57:11.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.088+0000 7f7088722800 20 remove_watcher() i=2 2024-09-19T13:57:11.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.089+0000 7f7088722800 20 remove_watcher() i=3 2024-09-19T13:57:11.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.090+0000 7f7088722800 20 remove_watcher() i=4 2024-09-19T13:57:11.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.091+0000 7f7088722800 20 remove_watcher() i=5 2024-09-19T13:57:11.092 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.091+0000 7f7088722800 20 remove_watcher() i=6 2024-09-19T13:57:11.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.092+0000 7f7088722800 20 remove_watcher() i=7 2024-09-19T13:57:11.103 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:11.104 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:11.104 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:11.104 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:11.154 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:57:11.184 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:11.185 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:11.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.220+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.222 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 realm 2024-09-19T13:57:11.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:11.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.221+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.222+0000 7fbb2f014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:11.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.222+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.222+0000 7fbb2f014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:11.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.222+0000 7fbb2f014800 20 searching for the correct realm 2024-09-19T13:57:11.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.225+0000 7fbb21fdf640 0 -- 172.21.15.94:0/3533444277 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fbb1c039cd0 msgr2=0x7fbb1c084a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:11.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.431+0000 7fbb2a7e0640 0 -- 172.21.15.94:0/3533444277 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fbb140889c0 msgr2=0x7fbb1408f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.637+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:11.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 zone default found 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 4 Realm: () 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 zonegroup default 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.638+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.639+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.639+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.639+0000 7fbb2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:11.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.639+0000 7fbb2f014800 20 started sync module instance, tier type = 2024-09-19T13:57:11.642 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.639+0000 7fbb2f014800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=0 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=1 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=2 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=3 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=4 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=5 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.647+0000 7fbb2f014800 20 add_watcher() i=6 2024-09-19T13:57:11.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.648+0000 7fbb2f014800 20 add_watcher() i=7 2024-09-19T13:57:11.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.648+0000 7fbb2f014800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:11.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.650+0000 7fb9e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.650+0000 7fbb2f014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.650+0000 7fbb2f014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.650+0000 7fbb2f014800 5 note: GC not initialized 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fb95b7fe640 20 reqs_thread_entry: start 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 20 Filter name: none 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fb9597fa640 20 reqs_thread_entry: start 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T13:57:11.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:11.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T13:57:11.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T13:57:11.653 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : miss 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.651+0000 7fbb2f014800 20 rados->read ofs=0 len=0 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.652+0000 7fbb2f014800 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.652+0000 7fbb2f014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.652+0000 7fbb2f014800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.652+0000 7fbb2f014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.652+0000 7fbb2f014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.652+0000 7fbb2f014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:11.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.653+0000 7fbb2f014800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to be held by another RGW process; skipping for now 2024-09-19T13:57:11.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.654+0000 7fb9e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:11.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.656+0000 7fbb2f014800 20 remove_watcher() i=0 2024-09-19T13:57:11.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.656+0000 7fbb2f014800 2 removed watcher, disabling cache 2024-09-19T13:57:11.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.656+0000 7fbb2f014800 20 remove_watcher() i=1 2024-09-19T13:57:11.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.657+0000 7fbb2f014800 20 remove_watcher() i=2 2024-09-19T13:57:11.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.658+0000 7fbb2f014800 20 remove_watcher() i=3 2024-09-19T13:57:11.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.659+0000 7fbb2f014800 20 remove_watcher() i=4 2024-09-19T13:57:11.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.660+0000 7fbb2f014800 20 remove_watcher() i=5 2024-09-19T13:57:11.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.661+0000 7fbb2f014800 20 remove_watcher() i=6 2024-09-19T13:57:11.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:11.662+0000 7fbb2f014800 20 remove_watcher() i=7 2024-09-19T13:57:11.673 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:57:41.706 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:57:41.741 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:41.741 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:41.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.780+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:41.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:41.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 realm 2024-09-19T13:57:41.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:41.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:41.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:41.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:41.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:41.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.782+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:41.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.783+0000 7f32c6b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:41.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.783+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:41.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.783+0000 7f32c6b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:41.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.783+0000 7f32c6b40800 20 searching for the correct realm 2024-09-19T13:57:41.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.787+0000 7f32c30ee640 0 -- 172.21.15.94:0/1684919895 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f32b803a0e0 msgr2=0x7f32b8043c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:41.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.790+0000 7f32c28ed640 0 -- 172.21.15.94:0/1684919895 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f32b803f140 msgr2=0x7f32b8044940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:41.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:42.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.996+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:42.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 zone default found 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 4 Realm: () 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:42.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 zonegroup default 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.997+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 started sync module instance, tier type = 2024-09-19T13:57:42.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:41.998+0000 7f32c6b40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=0 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=1 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=2 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=3 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=4 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=5 2024-09-19T13:57:42.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.008+0000 7f32c6b40800 20 add_watcher() i=6 2024-09-19T13:57:42.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.009+0000 7f32c6b40800 20 add_watcher() i=7 2024-09-19T13:57:42.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.009+0000 7f32c6b40800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:42.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f3179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:42.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 5 note: GC not initialized 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f3178fe1640 20 reqs_thread_entry: start 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 20 Filter name: none 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f3171ffb640 20 reqs_thread_entry: start 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T13:57:42.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.011+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : miss 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:42.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.012+0000 7f32c6b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:42.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.014+0000 7f32c6b40800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:57:42.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35, ofs0, ns] 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f31a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595143 cookie 94793341905536 notifier 7160 bl.length()=995 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f31a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f31a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f31a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_sources= new_sources= 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential sources added=[] removed=[] 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_dests= new_dests= 2024-09-19T13:57:42.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.022+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential dests added=[] removed=[] 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.0 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.0 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.1 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.1 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.2 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.2 2024-09-19T13:57:42.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.3 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.3 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.4 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.4 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.5 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.5 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.6 2024-09-19T13:57:42.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.6 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.7 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.7 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.8 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.8 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.9 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.9 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.10 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.10 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.11 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2.11 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.029+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.0 2024-09-19T13:57:42.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.030+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.1 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.030+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.031+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.3 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.032+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.4 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.032+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.5 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.033+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.6 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.033+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.7 2024-09-19T13:57:42.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.034+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.8 2024-09-19T13:57:42.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.035+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.9 2024-09-19T13:57:42.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.035+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.10 2024-09-19T13:57:42.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.039+0000 7f32c6b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:42.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.039+0000 7f32c6b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:42.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f32c6b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f32c6b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f32c6b40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f32c6b40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35, ofs0, ns] 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f31a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595144 cookie 94793341905536 notifier 7160 bl.length()=995 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f31a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f31a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.040+0000 7f31a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.041+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_sources= new_sources= 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.041+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential sources added=[] removed=[] 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.041+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_dests= new_dests= 2024-09-19T13:57:42.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.041+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential dests added=[] removed=[] 2024-09-19T13:57:42.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.044+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.0 2024-09-19T13:57:42.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.044+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.1 2024-09-19T13:57:42.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.044+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.2 2024-09-19T13:57:42.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.045+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.3 2024-09-19T13:57:42.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.045+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.4 2024-09-19T13:57:42.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.045+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.5 2024-09-19T13:57:42.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.046+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.6 2024-09-19T13:57:42.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.046+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.7 2024-09-19T13:57:42.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.046+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.8 2024-09-19T13:57:42.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.047+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.9 2024-09-19T13:57:42.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.047+0000 7f32c6b40800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35.10 2024-09-19T13:57:42.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.047+0000 7f32c6b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:42.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.047+0000 7f32c6b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 2024-09-19T13:57:42.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f32c6b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f32c6b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f32c6b40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f32c6b40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35, ofs0, ns] 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f31a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595145 cookie 94793341905536 notifier 7160 bl.length()=963 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f31a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 info.flags=0x17 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f31a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 to cache LRU end 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.049+0000 7f31a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.050+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_sources= new_sources= 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.050+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential sources added=[] removed=[] 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.050+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): orig_dests= new_dests= 2024-09-19T13:57:42.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.050+0000 7f32c6b40800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35]): potential dests added=[] removed=[] 2024-09-19T13:57:42.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.052+0000 7f32c6b40800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-19T13:57:42.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.054+0000 7f3179fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:42.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.056+0000 7f32c6b40800 20 remove_watcher() i=0 2024-09-19T13:57:42.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.056+0000 7f32c6b40800 2 removed watcher, disabling cache 2024-09-19T13:57:42.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.057+0000 7f32c6b40800 20 remove_watcher() i=1 2024-09-19T13:57:42.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.058+0000 7f32c6b40800 20 remove_watcher() i=2 2024-09-19T13:57:42.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.059+0000 7f32c6b40800 20 remove_watcher() i=3 2024-09-19T13:57:42.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.060+0000 7f32c6b40800 20 remove_watcher() i=4 2024-09-19T13:57:42.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.061+0000 7f32c6b40800 20 remove_watcher() i=5 2024-09-19T13:57:42.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.062+0000 7f32c6b40800 20 remove_watcher() i=6 2024-09-19T13:57:42.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.063+0000 7f32c6b40800 20 remove_watcher() i=7 2024-09-19T13:57:42.077 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T13:57:42.106 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:42.106 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:42.143 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.141+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 realm 2024-09-19T13:57:42.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:42.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.142+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.143+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:42.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.143+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.144+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:42.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.144+0000 7fe590925800 20 searching for the correct realm 2024-09-19T13:57:42.149 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.147+0000 7fe58cdaf640 0 -- 172.21.15.94:0/4120738889 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55ed905a8d70 msgr2=0x55ed905ab1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:42.152 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.150+0000 7fe58c5ae640 0 -- 172.21.15.94:0/4120738889 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe5740710b0 msgr2=0x7fe574074900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:42.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:42.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 zone default found 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 4 Realm: () 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 zonegroup default 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.154+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 started sync module instance, tier type = 2024-09-19T13:57:42.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.155+0000 7fe590925800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=0 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=1 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=2 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=3 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=4 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=5 2024-09-19T13:57:42.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.164+0000 7fe590925800 20 add_watcher() i=6 2024-09-19T13:57:42.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.165+0000 7fe590925800 20 add_watcher() i=7 2024-09-19T13:57:42.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.165+0000 7fe590925800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:42.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.166+0000 7fe442fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:42.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe590925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:42.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe590925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:42.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe590925800 5 note: GC not initialized 2024-09-19T13:57:42.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe441fdb640 20 reqs_thread_entry: start 2024-09-19T13:57:42.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe590925800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:42.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe590925800 20 Filter name: none 2024-09-19T13:57:42.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe3b37fe640 20 reqs_thread_entry: start 2024-09-19T13:57:42.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.167+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.168+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.168+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.168+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.168+0000 7fe590925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.168+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.169+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.169+0000 7fe590925800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.169+0000 7fe590925800 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T13:57:42.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.169+0000 7fe590925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:42.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.170+0000 7fe442fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:42.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.173+0000 7fe590925800 20 remove_watcher() i=0 2024-09-19T13:57:42.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.173+0000 7fe590925800 2 removed watcher, disabling cache 2024-09-19T13:57:42.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.174+0000 7fe590925800 20 remove_watcher() i=1 2024-09-19T13:57:42.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.175+0000 7fe590925800 20 remove_watcher() i=2 2024-09-19T13:57:42.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.176+0000 7fe590925800 20 remove_watcher() i=3 2024-09-19T13:57:42.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.177+0000 7fe590925800 20 remove_watcher() i=4 2024-09-19T13:57:42.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.178+0000 7fe590925800 20 remove_watcher() i=5 2024-09-19T13:57:42.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.179+0000 7fe590925800 20 remove_watcher() i=6 2024-09-19T13:57:42.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.180+0000 7fe590925800 20 remove_watcher() i=7 2024-09-19T13:57:42.192 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:42.192 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:42.192 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-do-reshard id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:57:42.192 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:42.268 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-19T13:57:42.268 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:42.445 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T13:57:42.473 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:42.473 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:42.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.508+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.509+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.509+0000 7f16b6b2a800 20 realm 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.509+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.509+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.509+0000 7f16b6b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.509+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.510+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.510+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.510+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:42.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.510+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.511+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:42.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.511+0000 7f16b6b2a800 20 searching for the correct realm 2024-09-19T13:57:42.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.513+0000 7f16aa016640 0 -- 172.21.15.94:0/2869139665 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f16a40a0b70 msgr2=0x7f16a4068ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:42.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.517+0000 7f16b2817640 0 -- 172.21.15.94:0/2869139665 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f169c0b9420 msgr2=0x7f169c05aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:42.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:42.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:42.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:42.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:42.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:42.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:42.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.722+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:42.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 zone default found 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 4 Realm: () 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 zonegroup default 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.723+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 started sync module instance, tier type = 2024-09-19T13:57:42.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.724+0000 7f16b6b2a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:42.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=0 2024-09-19T13:57:42.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=1 2024-09-19T13:57:42.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=2 2024-09-19T13:57:42.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=3 2024-09-19T13:57:42.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=4 2024-09-19T13:57:42.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=5 2024-09-19T13:57:42.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.733+0000 7f16b6b2a800 20 add_watcher() i=6 2024-09-19T13:57:42.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.734+0000 7f16b6b2a800 20 add_watcher() i=7 2024-09-19T13:57:42.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.734+0000 7f16b6b2a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:42.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f15697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:42.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f16b6b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f16b6b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f16b6b2a800 5 note: GC not initialized 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f14e3fff640 20 reqs_thread_entry: start 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f16b6b2a800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f16b6b2a800 20 Filter name: none 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f14e1ffb640 20 reqs_thread_entry: start 2024-09-19T13:57:42.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.737+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.738+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:42.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.738+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.738+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.738+0000 7f16b6b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.738+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.739+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.739+0000 7f16b6b2a800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.739+0000 7f16b6b2a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:42.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.739+0000 7f16b6b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:42.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.741+0000 7f15697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.743+0000 7f16b6b2a800 20 remove_watcher() i=0 2024-09-19T13:57:42.745 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.743+0000 7f16b6b2a800 2 removed watcher, disabling cache 2024-09-19T13:57:42.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.744+0000 7f16b6b2a800 20 remove_watcher() i=1 2024-09-19T13:57:42.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.745+0000 7f16b6b2a800 20 remove_watcher() i=2 2024-09-19T13:57:42.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.746+0000 7f16b6b2a800 20 remove_watcher() i=3 2024-09-19T13:57:42.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.747+0000 7f16b6b2a800 20 remove_watcher() i=4 2024-09-19T13:57:42.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.748+0000 7f16b6b2a800 20 remove_watcher() i=5 2024-09-19T13:57:42.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.749+0000 7f16b6b2a800 20 remove_watcher() i=6 2024-09-19T13:57:42.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.750+0000 7f16b6b2a800 20 remove_watcher() i=7 2024-09-19T13:57:42.762 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:42.762 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:42.762 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:42.762 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:42.763 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-19T13:57:42.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:42.797 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:42.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.831+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 realm 2024-09-19T13:57:42.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:42.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:42.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.833+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.834+0000 7f2a2b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:42.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.834+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:42.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.834+0000 7f2a2b528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:42.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.834+0000 7f2a2b528800 20 searching for the correct realm 2024-09-19T13:57:42.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.837+0000 7f2a1ffff640 0 -- 172.21.15.94:0/2465250193 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f2a18029bc0 msgr2=0x7f2a18069240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:42.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:42.840+0000 7f2a2724b640 0 -- 172.21.15.94:0/2465250193 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f2a100d2c20 msgr2=0x7f2a100b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:43.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:43.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:43.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:43.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:43.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:43.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:43.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.046+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 zone default found 2024-09-19T13:57:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 4 Realm: () 2024-09-19T13:57:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:43.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 zonegroup default 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.047+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 started sync module instance, tier type = 2024-09-19T13:57:43.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.048+0000 7f2a2b528800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:43.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=0 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=1 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=2 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=3 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=4 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=5 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.057+0000 7f2a2b528800 20 add_watcher() i=6 2024-09-19T13:57:43.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.058+0000 7f2a2b528800 20 add_watcher() i=7 2024-09-19T13:57:43.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.058+0000 7f2a2b528800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:43.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f28ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 5 note: GC not initialized 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f28dcfe1640 20 reqs_thread_entry: start 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 20 Filter name: none 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f28567fc640 20 reqs_thread_entry: start 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-19T13:57:43.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.060+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-19T13:57:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-19T13:57:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 : miss 2024-09-19T13:57:43.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.061+0000 7f2a2b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 2024-09-19T13:57:43.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.066+0000 7f2a2b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.066+0000 7f2a2b528800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.066+0000 7f2a2b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.066+0000 7f2a2b528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36, ofs0, ns] 2024-09-19T13:57:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f290affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595148 cookie 94069559167472 notifier 7211 bl.length()=1007 2024-09-19T13:57:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f290affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f290affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f290affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_sources= new_sources= 2024-09-19T13:57:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential sources added=[] removed=[] 2024-09-19T13:57:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_dests= new_dests= 2024-09-19T13:57:43.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.067+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential dests added=[] removed=[] 2024-09-19T13:57:43.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.069+0000 7f2a2b528800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-19T13:57:43.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.069+0000 7f2a2b528800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-19T13:57:43.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.073+0000 7f2a2b528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.073+0000 7f2a2b528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 2024-09-19T13:57:43.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36, ofs0, ns] 2024-09-19T13:57:43.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f290affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595149 cookie 94069559167472 notifier 7211 bl.length()=975 2024-09-19T13:57:43.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f290affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f290affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f290affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_sources= new_sources= 2024-09-19T13:57:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential sources added=[] removed=[] 2024-09-19T13:57:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_dests= new_dests= 2024-09-19T13:57:43.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.075+0000 7f2a2b528800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential dests added=[] removed=[] 2024-09-19T13:57:43.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.077+0000 7f28ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.079+0000 7f2a2b528800 20 remove_watcher() i=0 2024-09-19T13:57:43.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.079+0000 7f2a2b528800 2 removed watcher, disabling cache 2024-09-19T13:57:43.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.080+0000 7f2a2b528800 20 remove_watcher() i=1 2024-09-19T13:57:43.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.081+0000 7f2a2b528800 20 remove_watcher() i=2 2024-09-19T13:57:43.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.082+0000 7f2a2b528800 20 remove_watcher() i=3 2024-09-19T13:57:43.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.083+0000 7f2a2b528800 20 remove_watcher() i=4 2024-09-19T13:57:43.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.084+0000 7f2a2b528800 20 remove_watcher() i=5 2024-09-19T13:57:43.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.085+0000 7f2a2b528800 20 remove_watcher() i=6 2024-09-19T13:57:43.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.086+0000 7f2a2b528800 20 remove_watcher() i=7 2024-09-19T13:57:43.099 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T13:57:43.127 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:43.127 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:43.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.161+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 realm 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.163+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.164+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.164+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.164+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:43.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.164+0000 7ff719ba7800 20 searching for the correct realm 2024-09-19T13:57:43.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.168+0000 7ff70ee90640 0 -- 172.21.15.94:0/39383419 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5630866d57d0 msgr2=0x5630866d7c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:43.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.171+0000 7ff717691640 0 -- 172.21.15.94:0/39383419 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff7000733a0 msgr2=0x7ff7000737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.174+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 zone default found 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 4 Realm: () 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 zonegroup default 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.175+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 started sync module instance, tier type = 2024-09-19T13:57:43.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.176+0000 7ff719ba7800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=0 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=1 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=2 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=3 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=4 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=5 2024-09-19T13:57:43.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.185+0000 7ff719ba7800 20 add_watcher() i=6 2024-09-19T13:57:43.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.186+0000 7ff719ba7800 20 add_watcher() i=7 2024-09-19T13:57:43.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.186+0000 7ff719ba7800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:43.189 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.187+0000 7ff5cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff719ba7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:43.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff719ba7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:43.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff719ba7800 5 note: GC not initialized 2024-09-19T13:57:43.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff5ccfe1640 20 reqs_thread_entry: start 2024-09-19T13:57:43.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff719ba7800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:43.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff719ba7800 20 Filter name: none 2024-09-19T13:57:43.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff5467fc640 20 reqs_thread_entry: start 2024-09-19T13:57:43.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.188+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.189+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:43.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.189+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.189+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:43.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.189+0000 7ff719ba7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:43.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.189+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.190+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:43.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.190+0000 7ff719ba7800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.190+0000 7ff719ba7800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:43.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.190+0000 7ff719ba7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:43.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.192+0000 7ff5cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.194+0000 7ff719ba7800 20 remove_watcher() i=0 2024-09-19T13:57:43.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.194+0000 7ff719ba7800 2 removed watcher, disabling cache 2024-09-19T13:57:43.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.195+0000 7ff719ba7800 20 remove_watcher() i=1 2024-09-19T13:57:43.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.196+0000 7ff719ba7800 20 remove_watcher() i=2 2024-09-19T13:57:43.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.197+0000 7ff719ba7800 20 remove_watcher() i=3 2024-09-19T13:57:43.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.198+0000 7ff719ba7800 20 remove_watcher() i=4 2024-09-19T13:57:43.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.198+0000 7ff719ba7800 20 remove_watcher() i=5 2024-09-19T13:57:43.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.199+0000 7ff719ba7800 20 remove_watcher() i=6 2024-09-19T13:57:43.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.200+0000 7ff719ba7800 20 remove_watcher() i=7 2024-09-19T13:57:43.213 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:43.213 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:43.213 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:43.213 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:43.264 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:57:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:43.295 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:43.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.329+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.330+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.330+0000 7fcf3fa0e800 20 realm 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.330+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.330+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.330+0000 7fcf3fa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.330+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.331+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.331+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.331+0000 7fcf3fa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.331+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.332+0000 7fcf3fa0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:43.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.332+0000 7fcf3fa0e800 20 searching for the correct realm 2024-09-19T13:57:43.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.334+0000 7fcf3b85a640 0 -- 172.21.15.94:0/3349260922 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fcf24027070 msgr2=0x7fcf2409cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:43.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.338+0000 7fcf3b059640 0 -- 172.21.15.94:0/3349260922 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fcf24079aa0 msgr2=0x7fcf240a5a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.544+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 zone default found 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 4 Realm: () 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 zonegroup default 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.545+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.546+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.546+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.546+0000 7fcf3fa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.546+0000 7fcf3fa0e800 20 started sync module instance, tier type = 2024-09-19T13:57:43.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.546+0000 7fcf3fa0e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=0 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=1 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=2 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=3 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=4 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=5 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.554+0000 7fcf3fa0e800 20 add_watcher() i=6 2024-09-19T13:57:43.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.555+0000 7fcf3fa0e800 20 add_watcher() i=7 2024-09-19T13:57:43.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.555+0000 7fcf3fa0e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:43.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcdf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcf3fa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcf3fa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcf3fa0e800 5 note: GC not initialized 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcdf0fe1640 20 reqs_thread_entry: start 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcf3fa0e800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.557+0000 7fcf3fa0e800 20 Filter name: none 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcd6a7fc640 20 reqs_thread_entry: start 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-19T13:57:43.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:43.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-19T13:57:43.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 : miss 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.558+0000 7fcf3fa0e800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.559+0000 7fcf3fa0e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.559+0000 7fcf3fa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.559+0000 7fcf3fa0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.559+0000 7fcf3fa0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.559+0000 7fcf3fa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.559+0000 7fcf3fa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 2024-09-19T13:57:43.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fcf3fa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fcf3fa0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fcf3fa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fcf3fa0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36, ofs0, ns] 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595150 cookie 94212888657872 notifier 7638 bl.length()=1007 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fce1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fce1effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.563+0000 7fce1effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.564+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_sources= new_sources= 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.564+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential sources added=[] removed=[] 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.564+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_dests= new_dests= 2024-09-19T13:57:43.566 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.564+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential dests added=[] removed=[] 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.0 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.0 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.1 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.1 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.2 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.2 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.3 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.3 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.4 2024-09-19T13:57:43.571 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.4 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.5 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.5 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.6 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.6 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.7 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.7 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.8 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.8 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.9 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.9 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.10 2024-09-19T13:57:43.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.10 2024-09-19T13:57:43.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.11 2024-09-19T13:57:43.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1.11 2024-09-19T13:57:43.573 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.0 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.569+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.2 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.570+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.3 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.570+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.4 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.571+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.5 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.572+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.6 2024-09-19T13:57:43.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.572+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.7 2024-09-19T13:57:43.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.572+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.8 2024-09-19T13:57:43.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.573+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.9 2024-09-19T13:57:43.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.573+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.10 2024-09-19T13:57:43.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.576+0000 7fcf3fa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:43.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.577+0000 7fcf3fa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 2024-09-19T13:57:43.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fcf3fa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fcf3fa0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fcf3fa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fcf3fa0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36, ofs0, ns] 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595151 cookie 94212888657872 notifier 7638 bl.length()=1007 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fce1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fce1effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.578+0000 7fce1effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.579+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_sources= new_sources= 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.579+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential sources added=[] removed=[] 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.579+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_dests= new_dests= 2024-09-19T13:57:43.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.579+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential dests added=[] removed=[] 2024-09-19T13:57:43.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.581+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.0 2024-09-19T13:57:43.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.581+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.1 2024-09-19T13:57:43.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.581+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.2 2024-09-19T13:57:43.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.582+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.3 2024-09-19T13:57:43.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.582+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.4 2024-09-19T13:57:43.584 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.582+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.5 2024-09-19T13:57:43.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.583+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.6 2024-09-19T13:57:43.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.583+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.7 2024-09-19T13:57:43.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.583+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.8 2024-09-19T13:57:43.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.583+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.9 2024-09-19T13:57:43.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.584+0000 7fcf3fa0e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36.10 2024-09-19T13:57:43.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.584+0000 7fcf3fa0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 : hit (requested=0x17, cached=0x17) 2024-09-19T13:57:43.586 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.584+0000 7fcf3fa0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 2024-09-19T13:57:43.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.585+0000 7fcf3fa0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.585+0000 7fcf3fa0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.585+0000 7fcf3fa0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.585+0000 7fcf3fa0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36, ofs0, ns] 2024-09-19T13:57:43.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fce1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595152 cookie 94212888657872 notifier 7638 bl.length()=975 2024-09-19T13:57:43.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fce1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 info.flags=0x17 2024-09-19T13:57:43.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fce1e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 to cache LRU end 2024-09-19T13:57:43.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fce1e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:43.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_sources= new_sources= 2024-09-19T13:57:43.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential sources added=[] removed=[] 2024-09-19T13:57:43.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): orig_dests= new_dests= 2024-09-19T13:57:43.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.586+0000 7fcf3fa0e800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36]): potential dests added=[] removed=[] 2024-09-19T13:57:43.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.591+0000 7fcf3fa0e800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-19T13:57:43.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.593+0000 7fcdf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.595+0000 7fcf3fa0e800 20 remove_watcher() i=0 2024-09-19T13:57:43.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.595+0000 7fcf3fa0e800 2 removed watcher, disabling cache 2024-09-19T13:57:43.597 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.595+0000 7fcf3fa0e800 20 remove_watcher() i=1 2024-09-19T13:57:43.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.596+0000 7fcf3fa0e800 20 remove_watcher() i=2 2024-09-19T13:57:43.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.598+0000 7fcf3fa0e800 20 remove_watcher() i=3 2024-09-19T13:57:43.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.599+0000 7fcf3fa0e800 20 remove_watcher() i=4 2024-09-19T13:57:43.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.599+0000 7fcf3fa0e800 20 remove_watcher() i=5 2024-09-19T13:57:43.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.600+0000 7fcf3fa0e800 20 remove_watcher() i=6 2024-09-19T13:57:43.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.601+0000 7fcf3fa0e800 20 remove_watcher() i=7 2024-09-19T13:57:43.615 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T13:57:43.643 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:43.643 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:43.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.678+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 realm 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.680+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.681+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.681+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.681+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:43.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.681+0000 7fca1d52c800 20 searching for the correct realm 2024-09-19T13:57:43.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.684+0000 7fca1093d640 0 -- 172.21.15.94:0/1725079688 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x562b14b88990 msgr2=0x562b14b8ad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:43.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.687+0000 7fca1913e640 0 -- 172.21.15.94:0/1725079688 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fca040aac50 msgr2=0x7fca04001960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.692+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 zone default found 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 4 Realm: () 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 zonegroup default 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:43.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 started sync module instance, tier type = 2024-09-19T13:57:43.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.693+0000 7fca1d52c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:43.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=0 2024-09-19T13:57:43.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=1 2024-09-19T13:57:43.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=2 2024-09-19T13:57:43.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=3 2024-09-19T13:57:43.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=4 2024-09-19T13:57:43.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=5 2024-09-19T13:57:43.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.703+0000 7fca1d52c800 20 add_watcher() i=6 2024-09-19T13:57:43.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.704+0000 7fca1d52c800 20 add_watcher() i=7 2024-09-19T13:57:43.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.704+0000 7fca1d52c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:43.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.705+0000 7fc8cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fca1d52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fca1d52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fca1d52c800 5 note: GC not initialized 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fc8ce7e4640 20 reqs_thread_entry: start 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fca1d52c800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fca1d52c800 20 Filter name: none 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fc83ffff640 20 reqs_thread_entry: start 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.706+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.707+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:43.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.707+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.707+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:43.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.707+0000 7fca1d52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:43.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.707+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.708+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:43.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.708+0000 7fca1d52c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:43.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.708+0000 7fca1d52c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:43.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.708+0000 7fca1d52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:43.712 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.710+0000 7fc8cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:43.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.711+0000 7fca1d52c800 20 remove_watcher() i=0 2024-09-19T13:57:43.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.711+0000 7fca1d52c800 2 removed watcher, disabling cache 2024-09-19T13:57:43.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.712+0000 7fca1d52c800 20 remove_watcher() i=1 2024-09-19T13:57:43.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.713+0000 7fca1d52c800 20 remove_watcher() i=2 2024-09-19T13:57:43.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.714+0000 7fca1d52c800 20 remove_watcher() i=3 2024-09-19T13:57:43.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.715+0000 7fca1d52c800 20 remove_watcher() i=4 2024-09-19T13:57:43.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.716+0000 7fca1d52c800 20 remove_watcher() i=5 2024-09-19T13:57:43.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.717+0000 7fca1d52c800 20 remove_watcher() i=6 2024-09-19T13:57:43.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:43.718+0000 7fca1d52c800 20 remove_watcher() i=7 2024-09-19T13:57:43.730 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:43.730 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:43.730 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-logrecord-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:57:43.730 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:43.803 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-19T13:57:43.803 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:43.977 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T13:57:44.006 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:44.006 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:44.041 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.039+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.041+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.041+0000 7f8af2542800 20 realm 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.041+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.041+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.041+0000 7f8af2542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.042+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.042+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.042+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.042+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.042+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.043+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:44.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.043+0000 7f8af2542800 20 searching for the correct realm 2024-09-19T13:57:44.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.046+0000 7f8ae5aec640 0 -- 172.21.15.94:0/3673846194 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f8ae00cf260 msgr2=0x7f8ae00abd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.049+0000 7f8aeeaee640 0 -- 172.21.15.94:0/3673846194 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7f8ad806da30 msgr2=0x7f8ad80933d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.053+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 20 zone default found 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 4 Realm: () 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 20 zonegroup default 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.054+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 started sync module instance, tier type = 2024-09-19T13:57:44.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.055+0000 7f8af2542800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:44.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=0 2024-09-19T13:57:44.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=1 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=2 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=3 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=4 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=5 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.063+0000 7f8af2542800 20 add_watcher() i=6 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.064+0000 7f8af2542800 20 add_watcher() i=7 2024-09-19T13:57:44.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.064+0000 7f8af2542800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:44.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.066+0000 7f89a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f8af2542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f8af2542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f8af2542800 5 note: GC not initialized 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f891f7fe640 20 reqs_thread_entry: start 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f8af2542800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f8af2542800 20 Filter name: none 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f891d7fa640 20 reqs_thread_entry: start 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.067+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.068+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.068+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.068+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:44.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.068+0000 7f8af2542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:44.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.068+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.069+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.069+0000 7f8af2542800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.069+0000 7f8af2542800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:44.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.069+0000 7f8af2542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:44.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.070+0000 7f89a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.072+0000 7f8af2542800 20 remove_watcher() i=0 2024-09-19T13:57:44.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.072+0000 7f8af2542800 2 removed watcher, disabling cache 2024-09-19T13:57:44.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.073+0000 7f8af2542800 20 remove_watcher() i=1 2024-09-19T13:57:44.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.075+0000 7f8af2542800 20 remove_watcher() i=2 2024-09-19T13:57:44.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.076+0000 7f8af2542800 20 remove_watcher() i=3 2024-09-19T13:57:44.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.076+0000 7f8af2542800 20 remove_watcher() i=4 2024-09-19T13:57:44.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.077+0000 7f8af2542800 20 remove_watcher() i=5 2024-09-19T13:57:44.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.078+0000 7f8af2542800 20 remove_watcher() i=6 2024-09-19T13:57:44.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.079+0000 7f8af2542800 20 remove_watcher() i=7 2024-09-19T13:57:44.091 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.091 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:44.091 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:44.091 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.093 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-19T13:57:44.126 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:44.127 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:44.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.161+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 realm 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:44.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.163+0000 7f3482f22800 20 searching for the correct realm 2024-09-19T13:57:44.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.166+0000 7f347f3d3640 0 -- 172.21.15.94:0/1869915418 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f34740cc040 msgr2=0x7f3474003a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.170+0000 7f347ebd2640 0 -- 172.21.15.94:0/1869915418 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3474063070 msgr2=0x7f3474066970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:44.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:44.176 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:44.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:44.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:44.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:44.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 zone default found 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 4 Realm: () 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 zonegroup default 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.179 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.176+0000 7f3482f22800 20 started sync module instance, tier type = 2024-09-19T13:57:44.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.176+0000 7f3482f22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:44.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=0 2024-09-19T13:57:44.186 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=1 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=2 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=3 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=4 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=5 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=6 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.185+0000 7f3482f22800 20 add_watcher() i=7 2024-09-19T13:57:44.187 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.185+0000 7f3482f22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:44.188 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f33357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:44.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:44.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 5 note: GC not initialized 2024-09-19T13:57:44.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f32affff640 20 reqs_thread_entry: start 2024-09-19T13:57:44.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:44.190 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 20 Filter name: none 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f32adffb640 20 reqs_thread_entry: start 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.187+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : miss 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.191 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.188+0000 7f3482f22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:57:44.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37, ofs0, ns] 2024-09-19T13:57:44.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94131653782864 notifier 7295 bl.length()=1007 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_sources= new_sources= 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential sources added=[] removed=[] 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_dests= new_dests= 2024-09-19T13:57:44.196 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential dests added=[] removed=[] 2024-09-19T13:57:44.197 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3482f22800 time 2024-09-19T13:57:44.197165+0000 2024-09-19T13:57:44.197 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:44.198 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.198 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f348458c76a] 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3482f22800 thread_name:radosgw-admin 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.196+0000 7f3482f22800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3482f22800 time 2024-09-19T13:57:44.197165+0000 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:44.199 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f348458c76a] 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:57:44.200 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.220 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.220 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f348323e6f0] 2024-09-19T13:57:44.220 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f348328b99c] 2024-09-19T13:57:44.220 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:44.220 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:44.220 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f348458c7c4] 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:57:44.221 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.197+0000 7f3482f22800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:57:44.224 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3482f22800 thread_name:radosgw-admin 2024-09-19T13:57:44.224 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f348323e6f0] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f348328b99c] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f348458c7c4] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:57:44.225 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:57:44.144+0000 7f336ce09640 10 monclient: dump: 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.226 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:57:44.144+0000 7f3482f22800 5 monclient: authenticate success, global_id 7283 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:57:44.144+0000 7f3482f22800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:57:44.144+0000 7f3482f22800 4 set_mon_vals no callback set 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: shutdown 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 asok(0x559cbb977410) unregister_commands rotate-key 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.227 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding auth protocol: cephx 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding auth protocol: cephx 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding auth protocol: cephx 2024-09-19T13:57:44.228 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.229 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.229 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.229 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.229 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.229 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.229 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:57:44.145+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.230 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: starting msgr at 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: starting objecter 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 asok(0x559cbb977410) register_command objecter_requests hook 0x559cbbb9cd90 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: setting wanted keys 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: calling monclient init 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding auth protocol: cephx 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding auth protocol: cephx 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding auth protocol: cephx 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.231 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.232 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.232 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.232 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.232 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.232 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.232 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:57:44.145+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:57:44.146+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:57:44.146+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key hook 0x559cbbb98888 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbadaed0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbae1160 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbae1ad0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.233 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.803173s 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbae1160 auth_method 0 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): get_auth_request con 0x559cbbadaed0 auth_method 0 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.234 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbae1ad0 auth_method 0 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:57:44.146+0000 7f347ebd2640 1 monclient: found mon.noname-c 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.235 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: dump: 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.236 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: dump: 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.237 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:57:44.146+0000 7f3482f22800 5 monclient: authenticate success, global_id 7286 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:57:44.146+0000 7f336ce09640 4 set_mon_vals no callback set 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:57:44.146+0000 7f3482f22800 1 librados: init done 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:57:44.148+0000 7f336b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:57:44.148+0000 7f336b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:57:44.148+0000 7f336b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:57:44.149+0000 7f347e3d1640 10 monclient: get_auth_request con 0x7f3364077570 auth_method 0 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:57:44.149+0000 7f347f3d3640 10 monclient: get_auth_request con 0x559cbbbc0a80 auth_method 0 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:57:44.150+0000 7f347ebd2640 10 monclient: get_auth_request con 0x559cbbbe3b50 auth_method 0 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:57:44.151+0000 7f347e3d1640 10 monclient: get_auth_request con 0x559cbbbe8be0 auth_method 0 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:57:44.151+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.238 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:57:44.151+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:57:44.151+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding auth protocol: cephx 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding auth protocol: cephx 2024-09-19T13:57:44.239 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding auth protocol: cephx 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.240 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:57:44.152+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 asok(0x559cbb977410) register_command objecter_requests cmddesc objecter_requests hook 0x559cbbbf12b0 EEXIST 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding auth protocol: cephx 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding auth protocol: cephx 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding auth protocol: cephx 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.241 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:57:44.152+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:57:44.152+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key cmddesc rotate-key hook 0x559cbbbebcc0 EEXIST 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbc15b20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbc17d70 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbc2a2f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.242 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.809918s 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): get_auth_request con 0x559cbbc15b20 auth_method 0 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbc2a2f0 auth_method 0 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.243 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbc17d70 auth_method 0 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.244 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_done global_id 7689 payload 824 2024-09-19T13:57:44.245 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.245 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:57:44.153+0000 7f347ebd2640 1 monclient: found mon.noname-a 2024-09-19T13:57:44.245 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:57:44.245 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.245 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:57:44.245 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: dump: 2024-09-19T13:57:44.246 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.246 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.246 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.246 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.246 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.246 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.247 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.247 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.247 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.247 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.247 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:57:44.153+0000 7f3482f22800 5 monclient: authenticate success, global_id 7689 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:57:44.248 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: dump: 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:57:44.153+0000 7f347fbd4640 4 set_mon_vals no callback set 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:57:44.249 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:57:44.155+0000 7f3368e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:57:44.155+0000 7f3368e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:57:44.155+0000 7f3368e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:57:44.155+0000 7f347e3d1640 10 monclient: get_auth_request con 0x7f3358077570 auth_method 0 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:57:44.155+0000 7f3482f22800 10 monclient: get_monmap_and_config 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:57:44.155+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:57:44.155+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:57:44.155+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.250 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.251 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:57:44.156+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding auth protocol: cephx 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding auth protocol: cephx 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding auth protocol: cephx 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.252 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:57:44.156+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:57:44.156+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key cmddesc rotate-key hook 0x7ffdb61a8158 EEXIST 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbc69430 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbc59d80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbc64860 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.253 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.813638s 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbc59d80 auth_method 0 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbc64860 auth_method 0 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): get_auth_request con 0x559cbbc69430 auth_method 0 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.254 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_done global_id 7292 payload 274 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:57:44.156+0000 7f347e3d1640 1 monclient: found mon.noname-c 2024-09-19T13:57:44.255 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: dump: 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.256 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 monclient: authenticate success, global_id 7292 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: dump: 2024-09-19T13:57:44.257 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:57:44.157+0000 7f3482f22800 4 set_mon_vals no callback set 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: shutdown 2024-09-19T13:57:44.258 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:57:44.157+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.259 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.260 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.260 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.260 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.260 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.260 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.260 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.261 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:57:44.158+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: starting msgr at 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: starting objecter 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 asok(0x559cbb977410) register_command objecter_requests cmddesc objecter_requests hook 0x559cbbc383a0 EEXIST 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: setting wanted keys 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: calling monclient init 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding auth protocol: cephx 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding auth protocol: cephx 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding auth protocol: cephx 2024-09-19T13:57:44.262 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.263 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:57:44.158+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:57:44.158+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key cmddesc rotate-key hook 0x559cbbc34868 EEXIST 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbc59d80 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbc64860 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbc69430 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.264 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.815908s 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbc64860 auth_method 0 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbc69430 auth_method 0 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.265 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:57:44.159+0000 7f347e3d1640 1 monclient: found mon.noname-c 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:57:44.159+0000 7f347ebd2640 10 monclient: get_auth_request con 0x559cbbc59d80 auth_method 0 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: dump: 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.266 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: dump: 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.267 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:57:44.159+0000 7f3482f22800 5 monclient: authenticate success, global_id 7295 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.268 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:57:44.159+0000 7f33627fc640 4 set_mon_vals no callback set 2024-09-19T13:57:44.269 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.269 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.269 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.269 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:57:44.159+0000 7f3482f22800 1 librados: init done 2024-09-19T13:57:44.269 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:57:44.159+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cr dump hook 0x559cbbc5e028 2024-09-19T13:57:44.269 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:57:44.161+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.270 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:57:44.161+0000 7f3360ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:44.270 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:57:44.161+0000 7f3360ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.270 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:57:44.161+0000 7f3360ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.271 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:57:44.161+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f3348077570 auth_method 0 2024-09-19T13:57:44.271 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:57:44.162+0000 7f347f3d3640 10 monclient: get_auth_request con 0x559cbbc83590 auth_method 0 2024-09-19T13:57:44.271 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.271 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 realm 2024-09-19T13:57:44.271 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.271 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.272 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:57:44.162+0000 7f3482f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:44.272 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.272 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.272 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.272 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:57:44.163+0000 7f347ebd2640 10 monclient: get_auth_request con 0x559cbbc87850 auth_method 0 2024-09-19T13:57:44.273 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.273 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.273 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:44.273 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 searching for the correct realm 2024-09-19T13:57:44.273 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:57:44.164+0000 7f347e3d1640 10 monclient: get_auth_request con 0x559cbbc8c5f0 auth_method 0 2024-09-19T13:57:44.273 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:57:44.164+0000 7f347f3d3640 10 monclient: get_auth_request con 0x7f34740cc040 auth_method 0 2024-09-19T13:57:44.274 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:57:44.165+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f3478020040 auth_method 0 2024-09-19T13:57:44.274 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:57:44.166+0000 7f347e3d1640 10 monclient: get_auth_request con 0x7f3470073a70 auth_method 0 2024-09-19T13:57:44.274 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:57:44.166+0000 7f347f3d3640 0 -- 172.21.15.94:0/1869915418 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f34740cc040 msgr2=0x7f3474003a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.274 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:57:44.167+0000 7f3360ff9640 1 client.7295.objecter ms_handle_reset 0x7f34740cc040 session 0x7f3474005040 osd.7 2024-09-19T13:57:44.274 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:57:44.167+0000 7f3360ff9640 10 monclient: _renew_subs 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:57:44.167+0000 7f3360ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:57:44.167+0000 7f347f3d3640 10 monclient: get_auth_request con 0x7f3348087390 auth_method 0 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:57:44.167+0000 7f347f3d3640 10 monclient: get_auth_request con 0x7f3474090030 auth_method 0 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:57:44.169+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f3474063070 auth_method 0 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:57:44.170+0000 7f347ebd2640 0 -- 172.21.15.94:0/1869915418 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3474063070 msgr2=0x7f3474066970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:57:44.170+0000 7f3360ff9640 1 client.7295.objecter ms_handle_reset 0x7f3474063070 session 0x7f34740896e0 osd.0 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:57:44.170+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f34740cc040 auth_method 0 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:44.275 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:44.276 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 zone default found 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:57:44.175+0000 7f3482f22800 4 Realm: () 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:57:44.175+0000 7f3482f22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:57:44.175+0000 7f3482f22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:57:44.175+0000 7f3482f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 zonegroup default 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 started sync module instance, tier type = 2024-09-19T13:57:44.277 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=0 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=1 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=2 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=3 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=4 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=5 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=6 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:57:44.185+0000 7f3482f22800 20 add_watcher() i=7 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:57:44.185+0000 7f3482f22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding auth protocol: cephx 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding auth protocol: cephx 2024-09-19T13:57:44.278 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding auth protocol: cephx 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.279 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:57:44.187+0000 7f33357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:57:44.187+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache list hook 0x559cbbc621c0 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache inspect hook 0x559cbbc621c0 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache erase hook 0x559cbbc621c0 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache zap hook 0x559cbbc621c0 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 note: GC not initialized 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:57:44.187+0000 7f32affff640 20 reqs_thread_entry: start 2024-09-19T13:57:44.280 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace show hook 0x7f34740568f0 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace history hook 0x7f34740568f0 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace active hook 0x7f34740568f0 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace active_short hook 0x7f34740568f0 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 Filter name: none 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:57:44.187+0000 7f32adffb640 20 reqs_thread_entry: start 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:57:44.187+0000 7f3482f22800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : miss 2024-09-19T13:57:44.281 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37, ofs0, ns] 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94131653782864 notifier 7295 bl.length()=1007 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.282 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_sources= new_sources= 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential sources added=[] removed=[] 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_dests= new_dests= 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential dests added=[] removed=[] 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:57:44.196+0000 7f3482f22800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3482f22800 time 2024-09-19T13:57:44.197165+0000 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f348458c76a] 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.283 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:57:44.197+0000 7f3482f22800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3482f22800 thread_name:radosgw-admin 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.284 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f348323e6f0] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f348328b99c] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f348458c7c4] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:57:44.285 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:57:44.286 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:57:44.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:57:44.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:57:44.289 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:57:44.290 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:57:44.291 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 7f32adffb640 / http_manager 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 7f32affff640 / http_manager 2024-09-19T13:57:44.292 INFO:tasks.workunit.client.0.smithi094.stderr: 7f33357e2640 / rgw_dt_lg_renew 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3360ff9640 / ms_dispatch 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f33627fc640 / io_context_pool 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3368e01640 / ms_dispatch 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f336b606640 / ms_dispatch 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f336ce09640 / io_context_pool 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347e3d1640 / msgr-worker-2 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347ebd2640 / msgr-worker-1 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347f3d3640 / msgr-worker-0 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347fbd4640 / io_context_pool 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3482f22800 / radosgw-admin 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.133826.log 2024-09-19T13:57:44.293 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:57:44.144+0000 7f336ce09640 10 monclient: dump: 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:57:44.144+0000 7f3482f22800 5 monclient: authenticate success, global_id 7283 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:57:44.144+0000 7f3482f22800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:44.294 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:57:44.144+0000 7f3482f22800 4 set_mon_vals no callback set 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: shutdown 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 asok(0x559cbb977410) unregister_commands rotate-key 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.295 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.296 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding auth protocol: cephx 2024-09-19T13:57:44.296 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding auth protocol: cephx 2024-09-19T13:57:44.296 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding auth protocol: cephx 2024-09-19T13:57:44.296 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.296 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.296 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.297 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.297 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.297 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.297 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.297 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.297 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.298 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.298 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: crc 2024-09-19T13:57:44.298 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb9df50) adding con mode: secure 2024-09-19T13:57:44.298 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:57:44.145+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.298 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: starting msgr at 2024-09-19T13:57:44.298 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: starting objecter 2024-09-19T13:57:44.299 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 asok(0x559cbb977410) register_command objecter_requests hook 0x559cbbb9cd90 2024-09-19T13:57:44.299 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: setting wanted keys 2024-09-19T13:57:44.299 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:57:44.145+0000 7f3482f22800 1 librados: calling monclient init 2024-09-19T13:57:44.299 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:57:44.145+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.299 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding auth protocol: cephx 2024-09-19T13:57:44.299 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding auth protocol: cephx 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding auth protocol: cephx 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.300 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: crc 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:57:44.145+0000 7f3482f22800 5 AuthRegistry(0x559cbbb98740) adding con mode: secure 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:57:44.145+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:57:44.146+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:57:44.146+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key hook 0x559cbbb98888 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbadaed0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbae1160 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbae1ad0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.301 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.803173s 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbae1160 auth_method 0 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): get_auth_request con 0x559cbbadaed0 auth_method 0 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.302 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:57:44.146+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbae1ad0 auth_method 0 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:57:44.146+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:57:44.146+0000 7f347ebd2640 1 monclient: found mon.noname-c 2024-09-19T13:57:44.303 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:57:44.146+0000 7f347ebd2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: dump: 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.304 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:57:44.146+0000 7f336b606640 10 monclient: dump: 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.305 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:57:44.146+0000 7f3482f22800 5 monclient: authenticate success, global_id 7286 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:57:44.146+0000 7f336ce09640 4 set_mon_vals no callback set 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:57:44.146+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:57:44.146+0000 7f3482f22800 1 librados: init done 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:57:44.148+0000 7f336b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:57:44.148+0000 7f336b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:57:44.148+0000 7f336b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.306 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:57:44.149+0000 7f347e3d1640 10 monclient: get_auth_request con 0x7f3364077570 auth_method 0 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:57:44.149+0000 7f347f3d3640 10 monclient: get_auth_request con 0x559cbbbc0a80 auth_method 0 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:57:44.150+0000 7f347ebd2640 10 monclient: get_auth_request con 0x559cbbbe3b50 auth_method 0 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:57:44.151+0000 7f347e3d1640 10 monclient: get_auth_request con 0x559cbbbe8be0 auth_method 0 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:57:44.151+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:57:44.151+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:57:44.151+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.307 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding auth protocol: cephx 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding auth protocol: cephx 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding auth protocol: cephx 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.308 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: crc 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:57:44.151+0000 7f3482f22800 5 AuthRegistry(0x559cbbbecbc0) adding con mode: secure 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:57:44.152+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 asok(0x559cbb977410) register_command objecter_requests cmddesc objecter_requests hook 0x559cbbbf12b0 EEXIST 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding auth protocol: cephx 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding auth protocol: cephx 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding auth protocol: cephx 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.309 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: crc 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 AuthRegistry(0x559cbbbebb78) adding con mode: secure 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:57:44.152+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:57:44.152+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:57:44.152+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key cmddesc rotate-key hook 0x559cbbbebcc0 EEXIST 2024-09-19T13:57:44.310 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbc15b20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbc17d70 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbc2a2f0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:57:44.152+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.809918s 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): get_auth_request con 0x559cbbc15b20 auth_method 0 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.311 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbc2a2f0 auth_method 0 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:57:44.153+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbc17d70 auth_method 0 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.312 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:57:44.153+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient(hunting): handle_auth_done global_id 7689 payload 824 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:57:44.153+0000 7f347ebd2640 1 monclient: found mon.noname-a 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:57:44.153+0000 7f347ebd2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: dump: 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.313 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:57:44.153+0000 7f3482f22800 5 monclient: authenticate success, global_id 7689 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:57:44.314 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:57:44.153+0000 7f3368e01640 10 monclient: dump: 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:57:44.153+0000 7f347fbd4640 4 set_mon_vals no callback set 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.315 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:57:44.153+0000 7f3482f22800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:57:44.155+0000 7f3368e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:57:44.155+0000 7f3368e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:57:44.155+0000 7f3368e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:57:44.155+0000 7f347e3d1640 10 monclient: get_auth_request con 0x7f3358077570 auth_method 0 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:57:44.155+0000 7f3482f22800 10 monclient: get_monmap_and_config 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:57:44.155+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:57:44.155+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:57:44.155+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.316 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.317 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:57:44.155+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:57:44.156+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding auth protocol: cephx 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding auth protocol: cephx 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding auth protocol: cephx 2024-09-19T13:57:44.318 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: crc 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a8010) adding con mode: secure 2024-09-19T13:57:44.319 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:57:44.156+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:57:44.156+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:57:44.156+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key cmddesc rotate-key hook 0x7ffdb61a8158 EEXIST 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbc69430 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbc59d80 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbc64860 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:57:44.156+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.813638s 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbc59d80 auth_method 0 2024-09-19T13:57:44.320 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbc64860 auth_method 0 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): get_auth_request con 0x559cbbc69430 auth_method 0 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.321 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:57:44.156+0000 7f347ebd2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:57:44.156+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient(hunting): handle_auth_done global_id 7292 payload 274 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:57:44.156+0000 7f347e3d1640 1 monclient: found mon.noname-c 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:57:44.156+0000 7f347e3d1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:44.322 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: dump: 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 monclient: authenticate success, global_id 7292 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.323 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:57:44.157+0000 7f33627fc640 10 monclient: dump: 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.324 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: get_monmap_and_config success 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:57:44.157+0000 7f3482f22800 4 set_mon_vals no callback set 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: shutdown 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: build_initial_monmap 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:57:44.157+0000 7f3482f22800 1 build_initial for_mkfs: 0 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:57:44.157+0000 7f3482f22800 10 monclient: monmap: 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:57:44.325 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding auth protocol: cephx 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.326 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: crc 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:57:44.157+0000 7f3482f22800 5 AuthRegistry(0x559cbbc354e0) adding con mode: secure 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:57:44.158+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: starting msgr at 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: starting objecter 2024-09-19T13:57:44.327 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 asok(0x559cbb977410) register_command objecter_requests cmddesc objecter_requests hook 0x559cbbc383a0 EEXIST 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: setting wanted keys 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:57:44.158+0000 7f3482f22800 1 librados: calling monclient init 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient: init 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding auth protocol: cephx 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding auth protocol: cephx 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding auth protocol: cephx 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.328 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: crc 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 AuthRegistry(0x559cbbc34720) adding con mode: secure 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:57:44.158+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:57:44.158+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:57:44.158+0000 7f3482f22800 5 asok(0x559cbb977410) register_command rotate-key cmddesc rotate-key hook 0x559cbbc34868 EEXIST 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient: _reopen_session rank -1 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-b con 0x559cbbc59d80 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-c con 0x559cbbc64860 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): picked mon.noname-a con 0x559cbbc69430 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.329 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): start opening mon connection 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): _renew_subs 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:57:44.158+0000 7f3482f22800 10 monclient(hunting): authenticate will time out at 2077.815908s 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): get_auth_request con 0x559cbbc64860 auth_method 0 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:57:44.158+0000 7f347e3d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): get_auth_request con 0x559cbbc69430 auth_method 0 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.330 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:57:44.159+0000 7f347f3d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient(hunting): handle_auth_done global_id 7295 payload 824 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient: _finish_hunting 0 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:57:44.159+0000 7f347e3d1640 1 monclient: found mon.noname-c 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:57:44.159+0000 7f347e3d1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:57:44.159+0000 7f347ebd2640 10 monclient: get_auth_request con 0x559cbbc59d80 auth_method 0 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.331 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: dump: 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: _finish_auth 0 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:57:44.332 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:57:44.159+0000 7f3360ff9640 10 monclient: dump: 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:57:44.333 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:57:44.159+0000 7f3482f22800 5 monclient: authenticate success, global_id 7295 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:57:44.159+0000 7f33627fc640 4 set_mon_vals no callback set 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _renew_subs 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:57:44.159+0000 7f3482f22800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:57:44.159+0000 7f3482f22800 1 librados: init done 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:57:44.159+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cr dump hook 0x559cbbc5e028 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:57:44.161+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:57:44.161+0000 7f3360ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:57:44.161+0000 7f3360ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:57:44.161+0000 7f3360ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:57:44.334 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:57:44.161+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f3348077570 auth_method 0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:57:44.162+0000 7f347f3d3640 10 monclient: get_auth_request con 0x559cbbc83590 auth_method 0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 realm 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:57:44.162+0000 7f3482f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:57:44.162+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:57:44.163+0000 7f347ebd2640 10 monclient: get_auth_request con 0x559cbbc87850 auth_method 0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:44.335 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:57:44.163+0000 7f3482f22800 20 searching for the correct realm 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:57:44.164+0000 7f347e3d1640 10 monclient: get_auth_request con 0x559cbbc8c5f0 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:57:44.164+0000 7f347f3d3640 10 monclient: get_auth_request con 0x7f34740cc040 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:57:44.165+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f3478020040 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:57:44.166+0000 7f347e3d1640 10 monclient: get_auth_request con 0x7f3470073a70 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:57:44.166+0000 7f347f3d3640 0 -- 172.21.15.94:0/1869915418 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f34740cc040 msgr2=0x7f3474003a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:57:44.167+0000 7f3360ff9640 1 client.7295.objecter ms_handle_reset 0x7f34740cc040 session 0x7f3474005040 osd.7 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:57:44.167+0000 7f3360ff9640 10 monclient: _renew_subs 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:57:44.167+0000 7f3360ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:57:44.167+0000 7f347f3d3640 10 monclient: get_auth_request con 0x7f3348087390 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:57:44.167+0000 7f347f3d3640 10 monclient: get_auth_request con 0x7f3474090030 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:57:44.169+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f3474063070 auth_method 0 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:57:44.170+0000 7f347ebd2640 0 -- 172.21.15.94:0/1869915418 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f3474063070 msgr2=0x7f3474066970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.336 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:57:44.170+0000 7f3360ff9640 1 client.7295.objecter ms_handle_reset 0x7f3474063070 session 0x7f34740896e0 osd.0 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:57:44.170+0000 7f347ebd2640 10 monclient: get_auth_request con 0x7f34740cc040 auth_method 0 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:57:44.174+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.337 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 zone default found 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:57:44.175+0000 7f3482f22800 4 Realm: () 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:57:44.175+0000 7f3482f22800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:57:44.175+0000 7f3482f22800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:57:44.175+0000 7f3482f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 zonegroup default 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:57:44.175+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.338 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 started sync module instance, tier type = 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:57:44.176+0000 7f3482f22800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=0 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=1 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=2 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=3 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=4 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=5 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:57:44.184+0000 7f3482f22800 20 add_watcher() i=6 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:57:44.185+0000 7f3482f22800 20 add_watcher() i=7 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:57:44.185+0000 7f3482f22800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding auth protocol: cephx 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding auth protocol: cephx 2024-09-19T13:57:44.339 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding auth protocol: cephx 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: crc 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 AuthRegistry(0x7ffdb61a84e0) adding con mode: secure 2024-09-19T13:57:44.340 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:57:44.187+0000 7f33357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:57:44.187+0000 7f3482f22800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache list hook 0x559cbbc621c0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache inspect hook 0x559cbbc621c0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache erase hook 0x559cbbc621c0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command cache zap hook 0x559cbbc621c0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 note: GC not initialized 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:57:44.187+0000 7f32affff640 20 reqs_thread_entry: start 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace show hook 0x7f34740568f0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace history hook 0x7f34740568f0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace active hook 0x7f34740568f0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:57:44.187+0000 7f3482f22800 5 asok(0x559cbb977410) register_command sync trace active_short hook 0x7f34740568f0 2024-09-19T13:57:44.341 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 Filter name: none 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:57:44.187+0000 7f32adffb640 20 reqs_thread_entry: start 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:57:44.187+0000 7f3482f22800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:57:44.187+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : miss 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:57:44.188+0000 7f3482f22800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.342 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:57:44.188+0000 7f3482f22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:57:44.193+0000 7f3482f22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37, ofs0, ns] 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94131653782864 notifier 7295 bl.length()=1007 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.343 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:57:44.193+0000 7f33627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_sources= new_sources= 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential sources added=[] removed=[] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_dests= new_dests= 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:57:44.193+0000 7f3482f22800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential dests added=[] removed=[] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:57:44.196+0000 7f3482f22800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3482f22800 time 2024-09-19T13:57:44.197165+0000 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f348458c76a] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.344 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:57:44.197+0000 7f3482f22800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f3482f22800 thread_name:radosgw-admin 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f348323e6f0] 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f348328b99c] 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:57:44.345 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f348458c7c4] 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f348458c928] 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559cb996a791] 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x559cb9e78d0c] 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559cb997a43d] 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3483229590] 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:57:44.346 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:57:44.347 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:57:44.348 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:57:44.349 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:57:44.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:57:44.351 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:57:44.352 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 7f32adffb640 / http_manager 2024-09-19T13:57:44.353 INFO:tasks.workunit.client.0.smithi094.stderr: 7f32affff640 / http_manager 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f33357e2640 / rgw_dt_lg_renew 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3360ff9640 / ms_dispatch 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f33627fc640 / io_context_pool 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3368e01640 / ms_dispatch 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f336b606640 / ms_dispatch 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f336ce09640 / io_context_pool 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347e3d1640 / msgr-worker-2 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347ebd2640 / msgr-worker-1 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347f3d3640 / msgr-worker-0 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f347fbd4640 / io_context_pool 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7f3482f22800 / radosgw-admin 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:57:44.354 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:57:44.198800Z_6ab79b3a-7929-4c7f-bd39-de55b8841d03/log 2024-09-19T13:57:44.355 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:57:44.355 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T13:57:44.356 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:44.356 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:44.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.271+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 realm 2024-09-19T13:57:44.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:44.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.273+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.277+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.277+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.277+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.277+0000 7fe47cb0c800 20 searching for the correct realm 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.285+0000 7fe473fff640 0 -- 172.21.15.94:0/1539591040 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe46c07eba0 msgr2=0x7fe46c011460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:57:44.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.292+0000 7fe47a5f6640 0 -- 172.21.15.94:0/1539591040 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe46406c410 msgr2=0x7fe46406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:44.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.498+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:44.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 zone default found 2024-09-19T13:57:44.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 4 Realm: () 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 zonegroup default 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 started sync module instance, tier type = 2024-09-19T13:57:44.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.499+0000 7fe47cb0c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:44.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=0 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=1 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=2 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=3 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=4 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=5 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.508+0000 7fe47cb0c800 20 add_watcher() i=6 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.509+0000 7fe47cb0c800 20 add_watcher() i=7 2024-09-19T13:57:44.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.509+0000 7fe47cb0c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:44.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe330fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe47cb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe47cb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe47cb0c800 5 note: GC not initialized 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe2ab7fe640 20 reqs_thread_entry: start 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe47cb0c800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.511+0000 7fe47cb0c800 20 Filter name: none 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.512+0000 7fe2a97fa640 20 reqs_thread_entry: start 2024-09-19T13:57:44.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.512+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.512+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.512+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.515 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T13:57:44.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:44.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T13:57:44.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.513+0000 7fe47cb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:57:44.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.515+0000 7fe330fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.517+0000 7fe47cb0c800 20 remove_watcher() i=0 2024-09-19T13:57:44.519 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.517+0000 7fe47cb0c800 2 removed watcher, disabling cache 2024-09-19T13:57:44.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.518+0000 7fe47cb0c800 20 remove_watcher() i=1 2024-09-19T13:57:44.521 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.519+0000 7fe47cb0c800 20 remove_watcher() i=2 2024-09-19T13:57:44.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.520+0000 7fe47cb0c800 20 remove_watcher() i=3 2024-09-19T13:57:44.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.521+0000 7fe47cb0c800 20 remove_watcher() i=4 2024-09-19T13:57:44.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.522+0000 7fe47cb0c800 20 remove_watcher() i=5 2024-09-19T13:57:44.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.523+0000 7fe47cb0c800 20 remove_watcher() i=6 2024-09-19T13:57:44.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.524+0000 7fe47cb0c800 20 remove_watcher() i=7 2024-09-19T13:57:44.536 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.536 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:57:44.536 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:57:44.536 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:57:44.587 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:57:44.618 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:57:44.618 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:57:44.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.652+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.653+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.653+0000 7fec7191f800 20 realm 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.653+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.654+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.654+0000 7fec7191f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.654+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.654+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.654+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.655+0000 7fec7191f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.655+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.655+0000 7fec7191f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:57:44.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.655+0000 7fec7191f800 20 searching for the correct realm 2024-09-19T13:57:44.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.658+0000 7fec6dea3640 0 -- 172.21.15.94:0/3451266487 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fec580373f0 msgr2=0x7fec58037870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.662+0000 7fec6d6a2640 0 -- 172.21.15.94:0/3451266487 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fec58058960 msgr2=0x7fec58047410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:57:44.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.867+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 zone default found 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 4 Realm: () 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 zonegroup default 2024-09-19T13:57:44.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.868+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.869+0000 7fec7191f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:57:44.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.869+0000 7fec7191f800 20 started sync module instance, tier type = 2024-09-19T13:57:44.874 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.869+0000 7fec7191f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=0 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=1 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=2 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=3 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=4 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=5 2024-09-19T13:57:44.880 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.878+0000 7fec7191f800 20 add_watcher() i=6 2024-09-19T13:57:44.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.879+0000 7fec7191f800 20 add_watcher() i=7 2024-09-19T13:57:44.881 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.879+0000 7fec7191f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:57:44.882 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.880+0000 7feb237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.880+0000 7fec7191f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.880+0000 7fec7191f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.880+0000 7fec7191f800 5 note: GC not initialized 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.881+0000 7feb227e4640 20 reqs_thread_entry: start 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.881+0000 7fec7191f800 20 init_complete bucket index max shards: 11 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.881+0000 7fec7191f800 20 Filter name: none 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.881+0000 7fea93fff640 20 reqs_thread_entry: start 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.881+0000 7fec7191f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T13:57:44.883 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.881+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:57:44.884 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : miss 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 20 rados->read ofs=0 len=0 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:57:44.885 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.882+0000 7fec7191f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:57:44.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.883+0000 7fec7191f800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to be held by another RGW process; skipping for now 2024-09-19T13:57:44.886 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.884+0000 7feb237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:57:44.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.886+0000 7fec7191f800 20 remove_watcher() i=0 2024-09-19T13:57:44.888 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.886+0000 7fec7191f800 2 removed watcher, disabling cache 2024-09-19T13:57:44.889 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.887+0000 7fec7191f800 20 remove_watcher() i=1 2024-09-19T13:57:44.890 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.888+0000 7fec7191f800 20 remove_watcher() i=2 2024-09-19T13:57:44.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.889+0000 7fec7191f800 20 remove_watcher() i=3 2024-09-19T13:57:44.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.890+0000 7fec7191f800 20 remove_watcher() i=4 2024-09-19T13:57:44.893 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.891+0000 7fec7191f800 20 remove_watcher() i=5 2024-09-19T13:57:44.894 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.892+0000 7fec7191f800 20 remove_watcher() i=6 2024-09-19T13:57:44.895 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:57:44.893+0000 7fec7191f800 20 remove_watcher() i=7 2024-09-19T13:57:44.905 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:58:14.938 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:58:14.973 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:14.973 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:15.016 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.014+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 realm 2024-09-19T13:58:15.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:15.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.016+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.017+0000 7f8da0122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:15.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.017+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.018+0000 7f8da0122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:15.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.018+0000 7f8da0122800 20 searching for the correct realm 2024-09-19T13:58:15.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.021+0000 7f8d93501640 0 -- 172.21.15.94:0/1590113059 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5591fb81abb0 msgr2=0x5591fb81d070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:15.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.025+0000 7f8d9bd02640 0 -- 172.21.15.94:0/1590113059 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8d84047b60 msgr2=0x7f8d84054910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.029+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 zone default found 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 4 Realm: () 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:15.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 zonegroup default 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.030+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 started sync module instance, tier type = 2024-09-19T13:58:15.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.031+0000 7f8da0122800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=0 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=1 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=2 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=3 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=4 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=5 2024-09-19T13:58:15.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.040+0000 7f8da0122800 20 add_watcher() i=6 2024-09-19T13:58:15.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.041+0000 7f8da0122800 20 add_watcher() i=7 2024-09-19T13:58:15.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.041+0000 7f8da0122800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:15.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.043+0000 7f8c51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:15.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.043+0000 7f8da0122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:15.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.043+0000 7f8da0122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:15.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.043+0000 7f8da0122800 5 note: GC not initialized 2024-09-19T13:58:15.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.044+0000 7f8c50fe1640 20 reqs_thread_entry: start 2024-09-19T13:58:15.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.044+0000 7f8da0122800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:15.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.044+0000 7f8da0122800 20 Filter name: none 2024-09-19T13:58:15.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.044+0000 7f8bca7fc640 20 reqs_thread_entry: start 2024-09-19T13:58:15.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.044+0000 7f8da0122800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T13:58:15.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.044+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : miss 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.045+0000 7f8da0122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:58:15.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.046+0000 7f8da0122800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:58:15.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8da0122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8da0122800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8da0122800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8da0122800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37, ofs0, ns] 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8c7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595099 cookie 94085478211280 notifier 7343 bl.length()=1007 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8c7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8c7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.053+0000 7f8c7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.054+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_sources= new_sources= 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.054+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential sources added=[] removed=[] 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.054+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_dests= new_dests= 2024-09-19T13:58:15.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.054+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential dests added=[] removed=[] 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.0 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.0 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.1 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.1 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.2 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.2 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.3 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.3 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.4 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.4 2024-09-19T13:58:15.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.5 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.5 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.6 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.6 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.7 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.7 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.8 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.8 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.9 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.9 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.10 2024-09-19T13:58:15.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.10 2024-09-19T13:58:15.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.11 2024-09-19T13:58:15.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2.11 2024-09-19T13:58:15.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.058+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.0 2024-09-19T13:58:15.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.059+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.1 2024-09-19T13:58:15.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.059+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2 2024-09-19T13:58:15.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.060+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.3 2024-09-19T13:58:15.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.060+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.4 2024-09-19T13:58:15.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.061+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.5 2024-09-19T13:58:15.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.061+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.6 2024-09-19T13:58:15.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.062+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.7 2024-09-19T13:58:15.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.063+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.8 2024-09-19T13:58:15.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.063+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.9 2024-09-19T13:58:15.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.064+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.10 2024-09-19T13:58:15.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.067+0000 7f8da0122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:15.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.067+0000 7f8da0122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:58:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8da0122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8da0122800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8da0122800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8da0122800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37, ofs0, ns] 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8c7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595100 cookie 94085478211280 notifier 7343 bl.length()=1007 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8c7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8c7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.069+0000 7f8c7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.070+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_sources= new_sources= 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.070+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential sources added=[] removed=[] 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.070+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_dests= new_dests= 2024-09-19T13:58:15.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.070+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential dests added=[] removed=[] 2024-09-19T13:58:15.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.072+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.0 2024-09-19T13:58:15.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.072+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.1 2024-09-19T13:58:15.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.072+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.2 2024-09-19T13:58:15.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.073+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.3 2024-09-19T13:58:15.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.073+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.4 2024-09-19T13:58:15.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.073+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.5 2024-09-19T13:58:15.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.074+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.6 2024-09-19T13:58:15.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.074+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.7 2024-09-19T13:58:15.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.074+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.8 2024-09-19T13:58:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.075+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.9 2024-09-19T13:58:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.075+0000 7f8da0122800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37.10 2024-09-19T13:58:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.075+0000 7f8da0122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:15.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.075+0000 7f8da0122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37, ofs0, ns] 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8c7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595101 cookie 94085478211280 notifier 7343 bl.length()=975 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8c7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 info.flags=0x17 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8c7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 to cache LRU end 2024-09-19T13:58:15.078 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8c7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:15.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_sources= new_sources= 2024-09-19T13:58:15.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential sources added=[] removed=[] 2024-09-19T13:58:15.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): orig_dests= new_dests= 2024-09-19T13:58:15.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.077+0000 7f8da0122800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37]): potential dests added=[] removed=[] 2024-09-19T13:58:15.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.079+0000 7f8da0122800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-19T13:58:15.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.081+0000 7f8c51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:15.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.083+0000 7f8da0122800 20 remove_watcher() i=0 2024-09-19T13:58:15.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.083+0000 7f8da0122800 2 removed watcher, disabling cache 2024-09-19T13:58:15.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.084+0000 7f8da0122800 20 remove_watcher() i=1 2024-09-19T13:58:15.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.085+0000 7f8da0122800 20 remove_watcher() i=2 2024-09-19T13:58:15.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.087+0000 7f8da0122800 20 remove_watcher() i=3 2024-09-19T13:58:15.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.087+0000 7f8da0122800 20 remove_watcher() i=4 2024-09-19T13:58:15.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.088+0000 7f8da0122800 20 remove_watcher() i=5 2024-09-19T13:58:15.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.089+0000 7f8da0122800 20 remove_watcher() i=6 2024-09-19T13:58:15.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.090+0000 7f8da0122800 20 remove_watcher() i=7 2024-09-19T13:58:15.104 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T13:58:15.131 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:15.131 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:15.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.167+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.168+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.168+0000 7f0ac5928800 20 realm 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.168+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.169+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.169+0000 7f0ac5928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.169+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.169+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.170 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.169+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.170+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:15.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.170+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.170+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:15.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.170+0000 7f0ac5928800 20 searching for the correct realm 2024-09-19T13:58:15.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.174+0000 7f0ac1ed7640 0 -- 172.21.15.94:0/3525442431 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55696bad0a90 msgr2=0x55696bad2e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:15.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.177+0000 7f0ac16d6640 0 -- 172.21.15.94:0/3525442431 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f0aac09ab90 msgr2=0x7f0aac06a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:15.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:15.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 zone default found 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 4 Realm: () 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 zonegroup default 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.181+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.184 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 started sync module instance, tier type = 2024-09-19T13:58:15.185 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.182+0000 7f0ac5928800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=0 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=1 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=2 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=3 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=4 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=5 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.191+0000 7f0ac5928800 20 add_watcher() i=6 2024-09-19T13:58:15.192 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.192+0000 7f0ac5928800 20 add_watcher() i=7 2024-09-19T13:58:15.193 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.192+0000 7f0ac5928800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:15.194 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.193+0000 7f0977fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.193+0000 7f0ac5928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.193+0000 7f0ac5928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.193+0000 7f0ac5928800 5 note: GC not initialized 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0976fe5640 20 reqs_thread_entry: start 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0ac5928800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0ac5928800 20 Filter name: none 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0974fe1640 20 reqs_thread_entry: start 2024-09-19T13:58:15.195 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.194+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.195+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.195+0000 7f0ac5928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.195+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.195+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.195+0000 7f0ac5928800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.196+0000 7f0ac5928800 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T13:58:15.197 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.196+0000 7f0ac5928800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:15.198 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.197+0000 7f0977fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:15.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.199+0000 7f0ac5928800 20 remove_watcher() i=0 2024-09-19T13:58:15.200 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.199+0000 7f0ac5928800 2 removed watcher, disabling cache 2024-09-19T13:58:15.201 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.200+0000 7f0ac5928800 20 remove_watcher() i=1 2024-09-19T13:58:15.202 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.201+0000 7f0ac5928800 20 remove_watcher() i=2 2024-09-19T13:58:15.203 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.202+0000 7f0ac5928800 20 remove_watcher() i=3 2024-09-19T13:58:15.204 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.203+0000 7f0ac5928800 20 remove_watcher() i=4 2024-09-19T13:58:15.205 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.204+0000 7f0ac5928800 20 remove_watcher() i=5 2024-09-19T13:58:15.206 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.205+0000 7f0ac5928800 20 remove_watcher() i=6 2024-09-19T13:58:15.207 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.206+0000 7f0ac5928800 20 remove_watcher() i=7 2024-09-19T13:58:15.217 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:15.217 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:15.217 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-logrecord-writes id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:58:15.217 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:15.296 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-19T13:58:15.296 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:15.478 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T13:58:15.506 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:15.506 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:15.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.541+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.542+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.542+0000 7efc3ad25800 20 realm 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.542+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.542+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.542+0000 7efc3ad25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.542+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.543+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.543+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.543+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:15.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.543+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.544+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:15.545 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.544+0000 7efc3ad25800 20 searching for the correct realm 2024-09-19T13:58:15.547 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.546+0000 7efc2e1ad640 0 -- 172.21.15.94:0/495835278 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7efc2808c030 msgr2=0x7efc2808c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:15.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.752+0000 7efc369ae640 0 -- 172.21.15.94:0/495835278 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7efc2000c9d0 msgr2=0x7efc200539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:15.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:15.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.958+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 zone default found 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 4 Realm: () 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 zonegroup default 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.959+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.960+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.960+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.962 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.960+0000 7efc3ad25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:15.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.960+0000 7efc3ad25800 20 started sync module instance, tier type = 2024-09-19T13:58:15.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.960+0000 7efc3ad25800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=0 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=1 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=2 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=3 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=4 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=5 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.968+0000 7efc3ad25800 20 add_watcher() i=6 2024-09-19T13:58:15.970 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.969+0000 7efc3ad25800 20 add_watcher() i=7 2024-09-19T13:58:15.971 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.969+0000 7efc3ad25800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:15.972 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.971+0000 7efaed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:15.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efc3ad25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:15.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efc3ad25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:15.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efc3ad25800 5 note: GC not initialized 2024-09-19T13:58:15.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efa67fff640 20 reqs_thread_entry: start 2024-09-19T13:58:15.973 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efc3ad25800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:15.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efc3ad25800 20 Filter name: none 2024-09-19T13:58:15.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efa65ffb640 20 reqs_thread_entry: start 2024-09-19T13:58:15.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.972+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.974 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.973+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:15.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.973+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.973+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:15.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.973+0000 7efc3ad25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:15.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.973+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.974+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:15.975 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.974+0000 7efc3ad25800 20 rados->read ofs=0 len=0 2024-09-19T13:58:15.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.975+0000 7efc3ad25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:15.976 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.975+0000 7efc3ad25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:15.977 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.976+0000 7efaed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:15.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.978+0000 7efc3ad25800 20 remove_watcher() i=0 2024-09-19T13:58:15.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.978+0000 7efc3ad25800 2 removed watcher, disabling cache 2024-09-19T13:58:15.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.980+0000 7efc3ad25800 20 remove_watcher() i=1 2024-09-19T13:58:15.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.981+0000 7efc3ad25800 20 remove_watcher() i=2 2024-09-19T13:58:15.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.982+0000 7efc3ad25800 20 remove_watcher() i=3 2024-09-19T13:58:15.983 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.983+0000 7efc3ad25800 20 remove_watcher() i=4 2024-09-19T13:58:15.984 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.983+0000 7efc3ad25800 20 remove_watcher() i=5 2024-09-19T13:58:15.985 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.984+0000 7efc3ad25800 20 remove_watcher() i=6 2024-09-19T13:58:15.986 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:15.985+0000 7efc3ad25800 20 remove_watcher() i=7 2024-09-19T13:58:15.997 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:15.997 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:15.997 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:58:15.997 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:15.998 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-19T13:58:16.032 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:16.032 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:16.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.067+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 realm 2024-09-19T13:58:16.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:16.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.069+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.070+0000 7fddb9d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.070+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.070+0000 7fddb9d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:16.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.070+0000 7fddb9d2c800 20 searching for the correct realm 2024-09-19T13:58:16.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.073+0000 7fddb613f640 0 -- 172.21.15.94:0/2574550854 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fddac044060 msgr2=0x7fddac06eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:16.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.076+0000 7fddb593e640 0 -- 172.21.15.94:0/2574550854 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fddac06daa0 msgr2=0x7fddac0868d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:16.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:16.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:16.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:16.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:16.283 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:16.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:16.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.284 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.285 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.282+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 zone default found 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 4 Realm: () 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 zonegroup default 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.283+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.284+0000 7fddb9d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.284+0000 7fddb9d2c800 20 started sync module instance, tier type = 2024-09-19T13:58:16.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.284+0000 7fddb9d2c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=0 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=1 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=2 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=3 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=4 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=5 2024-09-19T13:58:16.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.293+0000 7fddb9d2c800 20 add_watcher() i=6 2024-09-19T13:58:16.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.294+0000 7fddb9d2c800 20 add_watcher() i=7 2024-09-19T13:58:16.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.294+0000 7fddb9d2c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:16.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.295+0000 7fdc677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.295+0000 7fddb9d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:16.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.295+0000 7fddb9d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:16.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.295+0000 7fddb9d2c800 5 note: GC not initialized 2024-09-19T13:58:16.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fdc667fc640 20 reqs_thread_entry: start 2024-09-19T13:58:16.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:16.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 20 Filter name: none 2024-09-19T13:58:16.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fdbd7fff640 20 reqs_thread_entry: start 2024-09-19T13:58:16.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T13:58:16.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:16.298 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 : miss 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.296+0000 7fddb9d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.297+0000 7fddb9d2c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.297+0000 7fddb9d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.297+0000 7fddb9d2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.297+0000 7fddb9d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.297+0000 7fddb9d2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.297+0000 7fddb9d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 2024-09-19T13:58:16.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38, ofs0, ns] 2024-09-19T13:58:16.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fdc997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595155 cookie 94484662811120 notifier 7812 bl.length()=1015 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fdc997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fdc997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fdc997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_sources= new_sources= 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential sources added=[] removed=[] 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_dests= new_dests= 2024-09-19T13:58:16.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.302+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential dests added=[] removed=[] 2024-09-19T13:58:16.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.0 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.0 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.1 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.1 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.2 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.2 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.3 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.3 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.4 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.4 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.5 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.5 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.6 2024-09-19T13:58:16.308 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.6 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.7 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.7 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.8 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.8 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.9 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.9 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.10 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.10 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.11 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.11 2024-09-19T13:58:16.309 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.306+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.0 2024-09-19T13:58:16.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.307+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1 2024-09-19T13:58:16.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.307+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.2 2024-09-19T13:58:16.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.308+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.3 2024-09-19T13:58:16.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.308+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.4 2024-09-19T13:58:16.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.308+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.5 2024-09-19T13:58:16.310 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.309+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.6 2024-09-19T13:58:16.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.309+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.7 2024-09-19T13:58:16.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.310+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.8 2024-09-19T13:58:16.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.311+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.9 2024-09-19T13:58:16.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.311+0000 7fddb9d2c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.10 2024-09-19T13:58:16.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.316+0000 7fddb9d2c800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-19T13:58:16.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.316+0000 7fddb9d2c800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-19T13:58:16.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.325+0000 7fddb9d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:16.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.325+0000 7fddb9d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.326+0000 7fddb9d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.326+0000 7fddb9d2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.326+0000 7fddb9d2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.326+0000 7fddb9d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38, ofs0, ns] 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fdc98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595156 cookie 94484662811120 notifier 7812 bl.length()=983 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fdc98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fdc98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fdc98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_sources= new_sources= 2024-09-19T13:58:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential sources added=[] removed=[] 2024-09-19T13:58:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_dests= new_dests= 2024-09-19T13:58:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fddb9d2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential dests added=[] removed=[] 2024-09-19T13:58:16.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.327+0000 7fddb9d2c800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-19T13:58:16.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.329+0000 7fdc677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.331+0000 7fddb9d2c800 20 remove_watcher() i=0 2024-09-19T13:58:16.332 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.331+0000 7fddb9d2c800 2 removed watcher, disabling cache 2024-09-19T13:58:16.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.332+0000 7fddb9d2c800 20 remove_watcher() i=1 2024-09-19T13:58:16.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.333+0000 7fddb9d2c800 20 remove_watcher() i=2 2024-09-19T13:58:16.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.334+0000 7fddb9d2c800 20 remove_watcher() i=3 2024-09-19T13:58:16.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.334+0000 7fddb9d2c800 20 remove_watcher() i=4 2024-09-19T13:58:16.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.335+0000 7fddb9d2c800 20 remove_watcher() i=5 2024-09-19T13:58:16.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.336+0000 7fddb9d2c800 20 remove_watcher() i=6 2024-09-19T13:58:16.338 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.337+0000 7fddb9d2c800 20 remove_watcher() i=7 2024-09-19T13:58:16.350 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T13:58:16.379 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:16.379 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:16.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.415+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 realm 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.417+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.418+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.418+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.418+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:16.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.418+0000 7f696f520800 20 searching for the correct realm 2024-09-19T13:58:16.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.420+0000 7f696b102640 0 -- 172.21.15.94:0/709528937 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x55ac6c023850 msgr2=0x7f6964064240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:16.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.423+0000 7f696b102640 0 -- 172.21.15.94:0/709528937 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f6834087420 msgr2=0x7f6834089850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:16.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.429+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 zone default found 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 4 Realm: () 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 zonegroup default 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.430+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.431+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.431+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.431+0000 7f696f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.431+0000 7f696f520800 20 started sync module instance, tier type = 2024-09-19T13:58:16.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.431+0000 7f696f520800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:16.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=0 2024-09-19T13:58:16.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=1 2024-09-19T13:58:16.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=2 2024-09-19T13:58:16.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=3 2024-09-19T13:58:16.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=4 2024-09-19T13:58:16.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=5 2024-09-19T13:58:16.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.439+0000 7f696f520800 20 add_watcher() i=6 2024-09-19T13:58:16.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.440+0000 7f696f520800 20 add_watcher() i=7 2024-09-19T13:58:16.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.440+0000 7f696f520800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:16.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f6821fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f696f520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f696f520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f696f520800 5 note: GC not initialized 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f6820fe1640 20 reqs_thread_entry: start 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f696f520800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f696f520800 20 Filter name: none 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f679a7fc640 20 reqs_thread_entry: start 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.442+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:16.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.443+0000 7f696f520800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.444+0000 7f696f520800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:16.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.444+0000 7f696f520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:16.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.445+0000 7f6821fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.447+0000 7f696f520800 20 remove_watcher() i=0 2024-09-19T13:58:16.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.447+0000 7f696f520800 2 removed watcher, disabling cache 2024-09-19T13:58:16.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.448+0000 7f696f520800 20 remove_watcher() i=1 2024-09-19T13:58:16.450 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.449+0000 7f696f520800 20 remove_watcher() i=2 2024-09-19T13:58:16.451 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.450+0000 7f696f520800 20 remove_watcher() i=3 2024-09-19T13:58:16.452 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.451+0000 7f696f520800 20 remove_watcher() i=4 2024-09-19T13:58:16.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.452+0000 7f696f520800 20 remove_watcher() i=5 2024-09-19T13:58:16.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.453+0000 7f696f520800 20 remove_watcher() i=6 2024-09-19T13:58:16.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.454+0000 7f696f520800 20 remove_watcher() i=7 2024-09-19T13:58:16.465 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:16.465 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:16.465 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:58:16.465 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:16.516 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:58:16.547 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:16.548 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:16.585 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.584+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 realm 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.586+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.587+0000 7f73f2539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.587+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.587+0000 7f73f2539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:16.588 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.587+0000 7f73f2539800 20 searching for the correct realm 2024-09-19T13:58:16.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.590+0000 7f73e7fff640 0 -- 172.21.15.94:0/193371704 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f73e002d460 msgr2=0x7f73e002d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:16.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.593+0000 7f73ee1ce640 0 -- 172.21.15.94:0/193371704 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f73d80b6a00 msgr2=0x7f73d80cf290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:16.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:16.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:16.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:16.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.799+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 zone default found 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 4 Realm: () 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 zonegroup default 2024-09-19T13:58:16.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.800+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.801+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.801+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.801+0000 7f73f2539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.801+0000 7f73f2539800 20 started sync module instance, tier type = 2024-09-19T13:58:16.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.801+0000 7f73f2539800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:16.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=0 2024-09-19T13:58:16.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=1 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=2 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=3 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=4 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=5 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.809+0000 7f73f2539800 20 add_watcher() i=6 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.810+0000 7f73f2539800 20 add_watcher() i=7 2024-09-19T13:58:16.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.810+0000 7f73f2539800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:16.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.812+0000 7f72a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.812+0000 7f73f2539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.812+0000 7f73f2539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.812+0000 7f73f2539800 5 note: GC not initialized 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.812+0000 7f721f7fe640 20 reqs_thread_entry: start 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 20 Filter name: none 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f721d7fa640 20 reqs_thread_entry: start 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T13:58:16.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 : miss 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.813+0000 7f73f2539800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.814+0000 7f73f2539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.814+0000 7f73f2539800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.814+0000 7f73f2539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.814+0000 7f73f2539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.814+0000 7f73f2539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 2024-09-19T13:58:16.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f73f2539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f73f2539800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f73f2539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f73f2539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38, ofs0, ns] 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f72d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595157 cookie 93842493211760 notifier 7418 bl.length()=1015 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f72d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f72d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.818+0000 7f72d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.819+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_sources= new_sources= 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.819+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential sources added=[] removed=[] 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.819+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_dests= new_dests= 2024-09-19T13:58:16.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.819+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential dests added=[] removed=[] 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.0 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.0 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.1 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.1 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.2 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.2 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.3 2024-09-19T13:58:16.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.3 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.4 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.4 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.5 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.5 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.6 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.6 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.7 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.7 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.8 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.8 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.9 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.9 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.10 2024-09-19T13:58:16.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.10 2024-09-19T13:58:16.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.11 2024-09-19T13:58:16.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1.11 2024-09-19T13:58:16.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.0 2024-09-19T13:58:16.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.823+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1 2024-09-19T13:58:16.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.824+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.2 2024-09-19T13:58:16.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.824+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.3 2024-09-19T13:58:16.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.825+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.4 2024-09-19T13:58:16.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.825+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.5 2024-09-19T13:58:16.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.826+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.6 2024-09-19T13:58:16.827 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.826+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.7 2024-09-19T13:58:16.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.827+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.8 2024-09-19T13:58:16.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.827+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.9 2024-09-19T13:58:16.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.828+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.10 2024-09-19T13:58:16.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.831+0000 7f73f2539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:16.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.831+0000 7f73f2539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f73f2539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f73f2539800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f73f2539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f73f2539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38, ofs0, ns] 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f72d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595158 cookie 93842493211760 notifier 7418 bl.length()=1015 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f72d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.833 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f72d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.832+0000 7f72d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.833+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_sources= new_sources= 2024-09-19T13:58:16.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.833+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential sources added=[] removed=[] 2024-09-19T13:58:16.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.833+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_dests= new_dests= 2024-09-19T13:58:16.834 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.833+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential dests added=[] removed=[] 2024-09-19T13:58:16.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.835+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.0 2024-09-19T13:58:16.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.835+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.1 2024-09-19T13:58:16.836 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.835+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.2 2024-09-19T13:58:16.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.835+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.3 2024-09-19T13:58:16.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.836+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.4 2024-09-19T13:58:16.837 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.836+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.5 2024-09-19T13:58:16.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.837+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.6 2024-09-19T13:58:16.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.837+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.7 2024-09-19T13:58:16.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.837+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.8 2024-09-19T13:58:16.838 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.837+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.9 2024-09-19T13:58:16.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.838+0000 7f73f2539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38.10 2024-09-19T13:58:16.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.838+0000 7f73f2539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:16.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.838+0000 7f73f2539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 2024-09-19T13:58:16.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.839+0000 7f73f2539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.839+0000 7f73f2539800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.839+0000 7f73f2539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.839+0000 7f73f2539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38, ofs0, ns] 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f72d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595159 cookie 93842493211760 notifier 7418 bl.length()=983 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f72d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 info.flags=0x17 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f72d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 to cache LRU end 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f72d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_sources= new_sources= 2024-09-19T13:58:16.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential sources added=[] removed=[] 2024-09-19T13:58:16.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): orig_dests= new_dests= 2024-09-19T13:58:16.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.840+0000 7f73f2539800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38]): potential dests added=[] removed=[] 2024-09-19T13:58:16.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.842+0000 7f73f2539800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-19T13:58:16.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.844+0000 7f72a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.846+0000 7f73f2539800 20 remove_watcher() i=0 2024-09-19T13:58:16.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.846+0000 7f73f2539800 2 removed watcher, disabling cache 2024-09-19T13:58:16.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.847+0000 7f73f2539800 20 remove_watcher() i=1 2024-09-19T13:58:16.849 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.848+0000 7f73f2539800 20 remove_watcher() i=2 2024-09-19T13:58:16.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.849+0000 7f73f2539800 20 remove_watcher() i=3 2024-09-19T13:58:16.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.850+0000 7f73f2539800 20 remove_watcher() i=4 2024-09-19T13:58:16.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.850+0000 7f73f2539800 20 remove_watcher() i=5 2024-09-19T13:58:16.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.851+0000 7f73f2539800 20 remove_watcher() i=6 2024-09-19T13:58:16.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.852+0000 7f73f2539800 20 remove_watcher() i=7 2024-09-19T13:58:16.865 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T13:58:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:16.894 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:16.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.929+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 realm 2024-09-19T13:58:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.931+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.932+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.932+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.932+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:16.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.932+0000 7fd061725800 20 searching for the correct realm 2024-09-19T13:58:16.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.935+0000 7fd05cca1640 0 -- 172.21.15.94:0/3363550505 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55779a02fe30 msgr2=0x55779a032220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:16.940 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.939+0000 7fd05d4a2640 0 -- 172.21.15.94:0/3363550505 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd0540bdba0 msgr2=0x7fd0540bce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:16.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:16.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:16.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:16.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:16.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:16.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.943+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 zone default found 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 4 Realm: () 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:16.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 zonegroup default 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 started sync module instance, tier type = 2024-09-19T13:58:16.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.944+0000 7fd061725800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:16.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=0 2024-09-19T13:58:16.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=1 2024-09-19T13:58:16.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=2 2024-09-19T13:58:16.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=3 2024-09-19T13:58:16.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=4 2024-09-19T13:58:16.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=5 2024-09-19T13:58:16.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.953+0000 7fd061725800 20 add_watcher() i=6 2024-09-19T13:58:16.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.954+0000 7fd061725800 20 add_watcher() i=7 2024-09-19T13:58:16.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.954+0000 7fd061725800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:16.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.955+0000 7fcf137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fd061725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:16.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fd061725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:16.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fd061725800 5 note: GC not initialized 2024-09-19T13:58:16.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fcf127e4640 20 reqs_thread_entry: start 2024-09-19T13:58:16.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fd061725800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:16.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fd061725800 20 Filter name: none 2024-09-19T13:58:16.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fce83fff640 20 reqs_thread_entry: start 2024-09-19T13:58:16.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.956+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.957+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:16.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.957+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.957+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:16.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.957+0000 7fd061725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:16.959 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.957+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.958+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:16.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.958+0000 7fd061725800 20 rados->read ofs=0 len=0 2024-09-19T13:58:16.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.958+0000 7fd061725800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:16.960 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.958+0000 7fd061725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:16.961 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.960+0000 7fcf137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:16.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.962+0000 7fd061725800 20 remove_watcher() i=0 2024-09-19T13:58:16.963 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.962+0000 7fd061725800 2 removed watcher, disabling cache 2024-09-19T13:58:16.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.963+0000 7fd061725800 20 remove_watcher() i=1 2024-09-19T13:58:16.964 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.964+0000 7fd061725800 20 remove_watcher() i=2 2024-09-19T13:58:16.966 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.965+0000 7fd061725800 20 remove_watcher() i=3 2024-09-19T13:58:16.967 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.966+0000 7fd061725800 20 remove_watcher() i=4 2024-09-19T13:58:16.968 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.967+0000 7fd061725800 20 remove_watcher() i=5 2024-09-19T13:58:16.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.968+0000 7fd061725800 20 remove_watcher() i=6 2024-09-19T13:58:16.969 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:16.969+0000 7fd061725800 20 remove_watcher() i=7 2024-09-19T13:58:16.980 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:16.980 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:16.980 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:58:16.980 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:17.055 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-19T13:58:17.055 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:17.223 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T13:58:17.251 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:17.252 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:17.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.286+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.288+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.288+0000 7f3159f0c800 20 realm 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.288+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.288+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.288+0000 7f3159f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.288+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.289+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.289+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.289+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:17.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.289+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.290+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:17.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.290+0000 7f3159f0c800 20 searching for the correct realm 2024-09-19T13:58:17.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.293+0000 7f314f1fc640 0 -- 172.21.15.94:0/4186471617 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x556293145280 msgr2=0x5562931476d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:17.297 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.296+0000 7f314f1fc640 0 -- 172.21.15.94:0/4186471617 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f314806b030 msgr2=0x7f31480dca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:17.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:17.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:17.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.300+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 zone default found 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 4 Realm: () 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:17.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 zonegroup default 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.301+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.302+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.302+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.302+0000 7f3159f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.302+0000 7f3159f0c800 20 started sync module instance, tier type = 2024-09-19T13:58:17.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.302+0000 7f3159f0c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:17.311 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=0 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=1 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=2 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=3 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=4 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=5 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.310+0000 7f3159f0c800 20 add_watcher() i=6 2024-09-19T13:58:17.312 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.311+0000 7f3159f0c800 20 add_watcher() i=7 2024-09-19T13:58:17.313 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.311+0000 7f3159f0c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:17.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f300dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f3159f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f3159f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f3159f0c800 5 note: GC not initialized 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f300cfe1640 20 reqs_thread_entry: start 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f3159f0c800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.313+0000 7f3159f0c800 20 Filter name: none 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.314+0000 7f2f867fc640 20 reqs_thread_entry: start 2024-09-19T13:58:17.315 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.314+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.314+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.314+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.315+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.315+0000 7f3159f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:17.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.315+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.315+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.315+0000 7f3159f0c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.316+0000 7f3159f0c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:17.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.316+0000 7f3159f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:17.318 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.317+0000 7f300dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.319+0000 7f3159f0c800 20 remove_watcher() i=0 2024-09-19T13:58:17.320 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.319+0000 7f3159f0c800 2 removed watcher, disabling cache 2024-09-19T13:58:17.321 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.320+0000 7f3159f0c800 20 remove_watcher() i=1 2024-09-19T13:58:17.322 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.322+0000 7f3159f0c800 20 remove_watcher() i=2 2024-09-19T13:58:17.323 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.323+0000 7f3159f0c800 20 remove_watcher() i=3 2024-09-19T13:58:17.324 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.324+0000 7f3159f0c800 20 remove_watcher() i=4 2024-09-19T13:58:17.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.324+0000 7f3159f0c800 20 remove_watcher() i=5 2024-09-19T13:58:17.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.325+0000 7f3159f0c800 20 remove_watcher() i=6 2024-09-19T13:58:17.327 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.326+0000 7f3159f0c800 20 remove_watcher() i=7 2024-09-19T13:58:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:17.338 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:17.338 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:58:17.338 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:17.340 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-19T13:58:17.377 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:17.377 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:17.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.414+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.415+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.415+0000 7ff6dfcbb800 20 realm 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.415+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.416+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.416+0000 7ff6dfcbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.416+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.416+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.417 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.416+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.417+0000 7ff6dfcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:17.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.417+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.417+0000 7ff6dfcbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:17.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.417+0000 7ff6dfcbb800 20 searching for the correct realm 2024-09-19T13:58:17.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.420+0000 7ff6d4fa4640 0 -- 172.21.15.94:0/1887970722 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55a7ea88c360 msgr2=0x55a7ea88e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:17.424 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.423+0000 7ff6dd7a5640 0 -- 172.21.15.94:0/1887970722 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff6c806f3f0 msgr2=0x7ff6c806f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:17.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:17.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:17.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:17.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.428+0000 7ff6dfcbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 zone default found 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 4 Realm: () 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 zonegroup default 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.431 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 started sync module instance, tier type = 2024-09-19T13:58:17.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.429+0000 7ff6dfcbb800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=0 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=1 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=2 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=3 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=4 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=5 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.438+0000 7ff6dfcbb800 20 add_watcher() i=6 2024-09-19T13:58:17.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.439+0000 7ff6dfcbb800 20 add_watcher() i=7 2024-09-19T13:58:17.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.439+0000 7ff6dfcbb800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.440+0000 7ff5937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.440+0000 7ff6dfcbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.440+0000 7ff6dfcbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff6dfcbb800 5 note: GC not initialized 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff5927e4640 20 reqs_thread_entry: start 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff6dfcbb800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff6dfcbb800 20 Filter name: none 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff503fff640 20 reqs_thread_entry: start 2024-09-19T13:58:17.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff6dfcbb800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T13:58:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.441+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:17.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 : miss 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.442+0000 7ff6dfcbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 2024-09-19T13:58:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39, ofs0, ns] 2024-09-19T13:58:17.448 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff5affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595162 cookie 94179682752288 notifier 7463 bl.length()=1015 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff5affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff5affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff5affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): orig_sources= new_sources= 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): potential sources added=[] removed=[] 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): orig_dests= new_dests= 2024-09-19T13:58:17.449 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.447+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): potential dests added=[] removed=[] 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.0 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.0 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.1 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.1 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.2 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.2 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.3 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.3 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.4 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.4 2024-09-19T13:58:17.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.5 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.5 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.6 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.6 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.7 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.7 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.8 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.8 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.9 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.9 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.10 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.10 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.11 2024-09-19T13:58:17.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1.11 2024-09-19T13:58:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.451+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.0 2024-09-19T13:58:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.452+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1 2024-09-19T13:58:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.452+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.2 2024-09-19T13:58:17.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.453+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.3 2024-09-19T13:58:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.453+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.4 2024-09-19T13:58:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.454+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.5 2024-09-19T13:58:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.454+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.6 2024-09-19T13:58:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.455+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.7 2024-09-19T13:58:17.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.455+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.8 2024-09-19T13:58:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.456+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.9 2024-09-19T13:58:17.457 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.456+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.10 2024-09-19T13:58:17.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.459+0000 7ff6dfcbb800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-19T13:58:17.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.459+0000 7ff6dfcbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:17.460 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.459+0000 7ff6dfcbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 2024-09-19T13:58:17.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff6dfcbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff6dfcbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff6dfcbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff6dfcbb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39, ofs0, ns] 2024-09-19T13:58:17.461 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff5affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595163 cookie 94179682752288 notifier 7463 bl.length()=1015 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff5affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff5affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.460+0000 7ff5affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.461+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): orig_sources= new_sources= 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.461+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): potential sources added=[] removed=[] 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.461+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): orig_dests= new_dests= 2024-09-19T13:58:17.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.461+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): potential dests added=[] removed=[] 2024-09-19T13:58:17.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.463+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.0 2024-09-19T13:58:17.464 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.463+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.1 2024-09-19T13:58:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.464+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.2 2024-09-19T13:58:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.464+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.3 2024-09-19T13:58:17.465 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.464+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.4 2024-09-19T13:58:17.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.465+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.5 2024-09-19T13:58:17.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.465+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.6 2024-09-19T13:58:17.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.465+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.7 2024-09-19T13:58:17.466 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.466+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.8 2024-09-19T13:58:17.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.466+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.9 2024-09-19T13:58:17.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.466+0000 7ff6dfcbb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39.10 2024-09-19T13:58:17.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.466+0000 7ff6dfcbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:17.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.466+0000 7ff6dfcbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39, ofs0, ns] 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff5affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595164 cookie 94179682752288 notifier 7463 bl.length()=983 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff5affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 info.flags=0x17 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff5affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 to cache LRU end 2024-09-19T13:58:17.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff5affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): orig_sources= new_sources= 2024-09-19T13:58:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): potential sources added=[] removed=[] 2024-09-19T13:58:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): orig_dests= new_dests= 2024-09-19T13:58:17.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.468+0000 7ff6dfcbb800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39]): potential dests added=[] removed=[] 2024-09-19T13:58:17.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.472+0000 7ff6dfcbb800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-19T13:58:17.475 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.474+0000 7ff5937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:17.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.476+0000 7ff6dfcbb800 20 remove_watcher() i=0 2024-09-19T13:58:17.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.476+0000 7ff6dfcbb800 2 removed watcher, disabling cache 2024-09-19T13:58:17.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.477+0000 7ff6dfcbb800 20 remove_watcher() i=1 2024-09-19T13:58:17.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.478+0000 7ff6dfcbb800 20 remove_watcher() i=2 2024-09-19T13:58:17.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.479+0000 7ff6dfcbb800 20 remove_watcher() i=3 2024-09-19T13:58:17.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.480+0000 7ff6dfcbb800 20 remove_watcher() i=4 2024-09-19T13:58:17.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.481+0000 7ff6dfcbb800 20 remove_watcher() i=5 2024-09-19T13:58:17.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.482+0000 7ff6dfcbb800 20 remove_watcher() i=6 2024-09-19T13:58:17.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.483+0000 7ff6dfcbb800 20 remove_watcher() i=7 2024-09-19T13:58:17.495 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T13:58:17.524 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:17.524 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:17.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.559+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.560+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.560+0000 7f7babf39800 20 realm 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.560+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.561+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.561+0000 7f7babf39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.561+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.561+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.562 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.561+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.562+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:17.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.562+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.562+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:17.563 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.562+0000 7f7babf39800 20 searching for the correct realm 2024-09-19T13:58:17.565 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.564+0000 7f7b9f3c6640 0 -- 172.21.15.94:0/3318610152 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f7b98074020 msgr2=0x7f7b9808c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:17.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.771+0000 7f7ba7bc7640 0 -- 172.21.15.94:0/3318610152 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f7b900258c0 msgr2=0x7f7b90067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.977+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.979 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 zone default found 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 4 Realm: () 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 zonegroup default 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.978+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.981 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:17.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 started sync module instance, tier type = 2024-09-19T13:58:17.982 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.979+0000 7f7babf39800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=0 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=1 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=2 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=3 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=4 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=5 2024-09-19T13:58:17.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.988+0000 7f7babf39800 20 add_watcher() i=6 2024-09-19T13:58:17.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.989+0000 7f7babf39800 20 add_watcher() i=7 2024-09-19T13:58:17.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.989+0000 7f7babf39800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:17.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.990+0000 7f7a5e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:17.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7babf39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:17.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7babf39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:17.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7babf39800 5 note: GC not initialized 2024-09-19T13:58:17.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7a5d7e2640 20 reqs_thread_entry: start 2024-09-19T13:58:17.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7babf39800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:17.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7babf39800 20 Filter name: none 2024-09-19T13:58:17.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7a567fc640 20 reqs_thread_entry: start 2024-09-19T13:58:17.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.991+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.992+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.992+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.992+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.992+0000 7f7babf39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.992+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.993+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.993+0000 7f7babf39800 20 rados->read ofs=0 len=0 2024-09-19T13:58:17.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.993+0000 7f7babf39800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:17.995 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.993+0000 7f7babf39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:17.996 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.995+0000 7f7a5e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:17.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.997+0000 7f7babf39800 20 remove_watcher() i=0 2024-09-19T13:58:17.998 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.997+0000 7f7babf39800 2 removed watcher, disabling cache 2024-09-19T13:58:17.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.998+0000 7f7babf39800 20 remove_watcher() i=1 2024-09-19T13:58:18.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:17.999+0000 7f7babf39800 20 remove_watcher() i=2 2024-09-19T13:58:18.001 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.000+0000 7f7babf39800 20 remove_watcher() i=3 2024-09-19T13:58:18.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.001+0000 7f7babf39800 20 remove_watcher() i=4 2024-09-19T13:58:18.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.002+0000 7f7babf39800 20 remove_watcher() i=5 2024-09-19T13:58:18.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.003+0000 7f7babf39800 20 remove_watcher() i=6 2024-09-19T13:58:18.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.004+0000 7f7babf39800 20 remove_watcher() i=7 2024-09-19T13:58:18.015 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.015 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:18.015 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: error-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T13:58:18.016 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.091 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-19T13:58:18.091 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.267 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T13:58:18.296 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:18.296 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:18.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.330+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.333 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 realm 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.332+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.334 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.333+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.333+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.333+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:18.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.333+0000 7f6ddf32a800 20 searching for the correct realm 2024-09-19T13:58:18.337 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.336+0000 7f6ddaf61640 0 -- 172.21.15.94:0/1601448766 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f6dd4027040 msgr2=0x7f6dd4018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.340 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.339+0000 7f6ddaf61640 0 -- 172.21.15.94:0/1601448766 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f6ca4087390 msgr2=0x7f6ca40897c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.344+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 zone default found 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 4 Realm: () 2024-09-19T13:58:18.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 zonegroup default 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 started sync module instance, tier type = 2024-09-19T13:58:18.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.345+0000 7f6ddf32a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=0 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=1 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=2 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=3 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=4 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=5 2024-09-19T13:58:18.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=6 2024-09-19T13:58:18.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 20 add_watcher() i=7 2024-09-19T13:58:18.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.354+0000 7f6ddf32a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:18.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.356+0000 7f6c917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6ddf32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:18.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6ddf32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:18.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6ddf32a800 5 note: GC not initialized 2024-09-19T13:58:18.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6c0bfff640 20 reqs_thread_entry: start 2024-09-19T13:58:18.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6ddf32a800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:18.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6ddf32a800 20 Filter name: none 2024-09-19T13:58:18.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6c09ffb640 20 reqs_thread_entry: start 2024-09-19T13:58:18.359 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.357+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.358+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.358+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.358+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:18.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.358+0000 7f6ddf32a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:18.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.358+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.359+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.359+0000 7f6ddf32a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.359+0000 7f6ddf32a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:18.361 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.359+0000 7f6ddf32a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:18.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.361+0000 7f6c917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.363+0000 7f6ddf32a800 20 remove_watcher() i=0 2024-09-19T13:58:18.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.363+0000 7f6ddf32a800 2 removed watcher, disabling cache 2024-09-19T13:58:18.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.364+0000 7f6ddf32a800 20 remove_watcher() i=1 2024-09-19T13:58:18.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.365+0000 7f6ddf32a800 20 remove_watcher() i=2 2024-09-19T13:58:18.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.366+0000 7f6ddf32a800 20 remove_watcher() i=3 2024-09-19T13:58:18.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.367+0000 7f6ddf32a800 20 remove_watcher() i=4 2024-09-19T13:58:18.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.368+0000 7f6ddf32a800 20 remove_watcher() i=5 2024-09-19T13:58:18.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.369+0000 7f6ddf32a800 20 remove_watcher() i=6 2024-09-19T13:58:18.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.370+0000 7f6ddf32a800 20 remove_watcher() i=7 2024-09-19T13:58:18.381 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.381 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:18.381 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:58:18.381 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.384 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-19T13:58:18.417 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:18.417 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:18.453 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.452+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 realm 2024-09-19T13:58:18.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.454 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:18.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.455 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:18.456 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 searching for the correct realm 2024-09-19T13:58:18.459 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.458+0000 7fc595cff640 0 -- 172.21.15.94:0/1336323773 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55a336976160 msgr2=0x55a336978600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.462 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.461+0000 7fc59e500640 0 -- 172.21.15.94:0/1336323773 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc58800cc20 msgr2=0x7fc5880791f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:18.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:18.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:18.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:18.467 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 zone default found 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 Realm: () 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 zonegroup default 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.468 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 started sync module instance, tier type = 2024-09-19T13:58:18.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=0 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=1 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=2 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=3 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=4 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=5 2024-09-19T13:58:18.476 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=6 2024-09-19T13:58:18.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.476+0000 7fc5a0a0f800 20 add_watcher() i=7 2024-09-19T13:58:18.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.476+0000 7fc5a0a0f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:18.478 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.477+0000 7fc454fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:18.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:18.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 note: GC not initialized 2024-09-19T13:58:18.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc3cf7fe640 20 reqs_thread_entry: start 2024-09-19T13:58:18.479 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:18.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 Filter name: none 2024-09-19T13:58:18.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc3cd7fa640 20 reqs_thread_entry: start 2024-09-19T13:58:18.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T13:58:18.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : miss 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:18.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40, ofs0, ns] 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94159483938336 notifier 7962 bl.length()=1015 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_sources= new_sources= 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential sources added=[] removed=[] 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_dests= new_dests= 2024-09-19T13:58:18.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential dests added=[] removed=[] 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.0 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.0 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.1 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.1 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.2 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.2 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.3 2024-09-19T13:58:18.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.3 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.4 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.4 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.5 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.5 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.6 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.6 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.7 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.7 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.8 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.8 2024-09-19T13:58:18.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.9 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.9 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.10 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.10 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.11 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.11 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.0 2024-09-19T13:58:18.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1 2024-09-19T13:58:18.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2 2024-09-19T13:58:18.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.490+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.3 2024-09-19T13:58:18.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.490+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.4 2024-09-19T13:58:18.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.491+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.5 2024-09-19T13:58:18.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.491+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.6 2024-09-19T13:58:18.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.492+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.7 2024-09-19T13:58:18.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.493+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.8 2024-09-19T13:58:18.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.493+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.9 2024-09-19T13:58:18.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.494+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.10 2024-09-19T13:58:18.498 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5a0a0f800 time 2024-09-19T13:58:18.497629+0000 2024-09-19T13:58:18.498 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5a3f8c76a] 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.498+0000 7fc5a0a0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5a0a0f800 time 2024-09-19T13:58:18.497629+0000 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:18.499 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5a3f8c76a] 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:58:18.500 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc5a0a0f800 thread_name:radosgw-admin 2024-09-19T13:58:18.514 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a2c3e6f0] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5a2c8b99c] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5a3f8c7c4] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:18.515 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.498+0000 7fc5a0a0f800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc5a0a0f800 thread_name:radosgw-admin 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a2c3e6f0] 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5a2c8b99c] 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5a3f8c7c4] 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.516 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.517 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key hook 0x55a336883788 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a3367c5ed0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a3367cc160 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a3367ccad0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.518 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.093615s 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): get_auth_request con 0x55a3367cc160 auth_method 0 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a3367ccad0 auth_method 0 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.519 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a3367c5ed0 auth_method 0 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.520 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_done global_id 7953 payload 824 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:58:18.437+0000 7fc595cff640 1 monclient: found mon.noname-a 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: dump: 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.521 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: dump: 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.522 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7953 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:58:18.438+0000 7fc48c608640 4 set_mon_vals no callback set 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 1 librados: init done 2024-09-19T13:58:18.523 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:58:18.440+0000 7fc48ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:58:18.440+0000 7fc48ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:58:18.440+0000 7fc48ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:58:18.440+0000 7fc59e500640 10 monclient: get_auth_request con 0x7fc484077570 auth_method 0 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:58:18.440+0000 7fc59ed01640 10 monclient: get_auth_request con 0x55a33670dc20 auth_method 0 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:58:18.441+0000 7fc59e500640 10 monclient: get_auth_request con 0x55a3368cdbf0 auth_method 0 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:58:18.442+0000 7fc595cff640 10 monclient: get_auth_request con 0x55a3368d2c80 auth_method 0 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 10 monclient: build_initial_monmap 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 1 build_initial for_mkfs: 0 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 10 monclient: monmap: 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:18.524 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding auth protocol: cephx 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding auth protocol: cephx 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding auth protocol: cephx 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.525 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command objecter_requests cmddesc objecter_requests hook 0x55a3368da100 EEXIST 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 10 monclient: init 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding auth protocol: cephx 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding auth protocol: cephx 2024-09-19T13:58:18.526 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding auth protocol: cephx 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.527 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key cmddesc rotate-key hook 0x55a3368d5c70 EEXIST 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a3368fe420 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a3368fe800 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a3368fd130 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.100298s 2024-09-19T13:58:18.528 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a3368fe420 auth_method 0 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a3368fd130 auth_method 0 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.529 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): get_auth_request con 0x55a3368fe800 auth_method 0 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_done global_id 7505 payload 824 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:58:18.444+0000 7fc59e500640 1 monclient: found mon.noname-c 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: dump: 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.530 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: dump: 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.531 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7505 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:58:18.444+0000 7fc59f502640 4 set_mon_vals no callback set 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:58:18.445+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:58:18.445+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:18.532 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:58:18.446+0000 7fc483fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:58:18.446+0000 7fc483fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:58:18.446+0000 7fc483fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:58:18.447+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc478077480 auth_method 0 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: get_monmap_and_config 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: build_initial_monmap 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 1 build_initial for_mkfs: 0 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: monmap: 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:18.533 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding auth protocol: cephx 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding auth protocol: cephx 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding auth protocol: cephx 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.534 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: init 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding auth protocol: cephx 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding auth protocol: cephx 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding auth protocol: cephx 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.535 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key cmddesc rotate-key hook 0x7ffcea25ff58 EEXIST 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a3369528a0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a336923820 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.536 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a33694ce20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.104066s 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): get_auth_request con 0x55a336923820 auth_method 0 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a33694ce20 auth_method 0 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.537 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a3369528a0 auth_method 0 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_done global_id 7959 payload 274 2024-09-19T13:58:18.538 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:58:18.448+0000 7fc595cff640 1 monclient: found mon.noname-a 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: dump: 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.539 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: dump: 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.540 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7959 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient: get_monmap_and_config success 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 4 set_mon_vals no callback set 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: shutdown 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: build_initial_monmap 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 build_initial for_mkfs: 0 2024-09-19T13:58:18.541 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: monmap: 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding auth protocol: cephx 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding auth protocol: cephx 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding auth protocol: cephx 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.542 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: starting msgr at 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: starting objecter 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command objecter_requests cmddesc objecter_requests hook 0x55a3368fc860 EEXIST 2024-09-19T13:58:18.543 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: setting wanted keys 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: calling monclient init 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: init 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding auth protocol: cephx 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding auth protocol: cephx 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding auth protocol: cephx 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.544 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key cmddesc rotate-key hook 0x55a336912e28 EEXIST 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a336923820 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a33694ce20 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a3369528a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.545 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.106153s 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a336923820 auth_method 0 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a3369528a0 auth_method 0 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.546 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_done global_id 7962 payload 824 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:58:18.450+0000 7fc59e500640 1 monclient: found mon.noname-a 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: dump: 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.547 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:58:18.548 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: dump: 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7962 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:58:18.450+0000 7fc481ffb640 4 set_mon_vals no callback set 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.549 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 1 librados: init done 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cr dump hook 0x55a336946be8 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:58:18.452+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:58:18.452+0000 7fc46ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:58:18.452+0000 7fc46ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:58:18.452+0000 7fc46ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:58:18.452+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc468077570 auth_method 0 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:58:18.452+0000 7fc59ed01640 10 monclient: get_auth_request con 0x55a33696cc30 auth_method 0 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 realm 2024-09-19T13:58:18.550 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:58:18.454+0000 7fc59e500640 10 monclient: get_auth_request con 0x55a336971010 auth_method 0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 searching for the correct realm 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:58:18.455+0000 7fc595cff640 10 monclient: get_auth_request con 0x55a336976160 auth_method 0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:58:18.455+0000 7fc59ed01640 10 monclient: get_auth_request con 0x7fc588075020 auth_method 0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:58:18.456+0000 7fc59e500640 10 monclient: get_auth_request con 0x7fc59806f040 auth_method 0 2024-09-19T13:58:18.551 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:58:18.457+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc590083870 auth_method 0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:58:18.458+0000 7fc595cff640 0 -- 172.21.15.94:0/1336323773 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55a336976160 msgr2=0x55a336978600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:58:18.458+0000 7fc46ffff640 1 client.7962.objecter ms_handle_reset 0x55a336976160 session 0x55a336975ae0 osd.3 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:58:18.458+0000 7fc46ffff640 10 monclient: _renew_subs 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:58:18.458+0000 7fc46ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:58:18.458+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc468087390 auth_method 0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:58:18.458+0000 7fc59ed01640 10 monclient: get_auth_request con 0x7fc588027070 auth_method 0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:58:18.460+0000 7fc59e500640 10 monclient: get_auth_request con 0x7fc58800cc20 auth_method 0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:58:18.461+0000 7fc59e500640 0 -- 172.21.15.94:0/1336323773 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc58800cc20 msgr2=0x7fc5880791f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:58:18.461+0000 7fc46ffff640 1 client.7962.objecter ms_handle_reset 0x7fc58800cc20 session 0x7fc58801fd50 osd.0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:58:18.461+0000 7fc59e500640 10 monclient: get_auth_request con 0x55a336976160 auth_method 0 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:18.552 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 zone default found 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 Realm: () 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:18.553 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 zonegroup default 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 started sync module instance, tier type = 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=0 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=1 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=2 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=3 2024-09-19T13:58:18.554 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=4 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=5 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=6 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:58:18.476+0000 7fc5a0a0f800 20 add_watcher() i=7 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:58:18.476+0000 7fc5a0a0f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding auth protocol: cephx 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding auth protocol: cephx 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding auth protocol: cephx 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.555 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:58:18.477+0000 7fc454fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:18.556 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache list hook 0x55a336946860 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache inspect hook 0x55a336946860 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache erase hook 0x55a336946860 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache zap hook 0x55a336946860 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 note: GC not initialized 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:58:18.478+0000 7fc3cf7fe640 20 reqs_thread_entry: start 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace show hook 0x7fc588068040 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace history hook 0x7fc588068040 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace active hook 0x7fc588068040 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace active_short hook 0x7fc588068040 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 Filter name: none 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:58:18.478+0000 7fc3cd7fa640 20 reqs_thread_entry: start 2024-09-19T13:58:18.557 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : miss 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:18.558 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40, ofs0, ns] 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94159483938336 notifier 7962 bl.length()=1015 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_sources= new_sources= 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential sources added=[] removed=[] 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_dests= new_dests= 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential dests added=[] removed=[] 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.0 2024-09-19T13:58:18.559 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.0 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.1 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.1 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.2 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.2 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.3 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.3 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.4 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.4 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.5 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.5 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.6 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.6 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.7 2024-09-19T13:58:18.560 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.7 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.8 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.8 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.9 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.9 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.10 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.10 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.11 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.11 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.0 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:58:18.490+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.3 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:58:18.490+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.4 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:58:18.491+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.5 2024-09-19T13:58:18.561 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:58:18.491+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.6 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:58:18.492+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.7 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:58:18.493+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.8 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:58:18.493+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.9 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:58:18.494+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.10 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:58:18.498+0000 7fc5a0a0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5a0a0f800 time 2024-09-19T13:58:18.497629+0000 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5a3f8c76a] 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:18.562 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:58:18.498+0000 7fc5a0a0f800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc5a0a0f800 thread_name:radosgw-admin 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a2c3e6f0] 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5a2c8b99c] 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5a3f8c7c4] 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.563 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:58:18.564 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:58:18.565 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:58:18.566 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:58:18.567 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:58:18.568 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:58:18.569 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:58:18.570 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc3cd7fa640 / http_manager 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc3cf7fe640 / http_manager 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc454fe1640 / rgw_dt_lg_renew 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc46ffff640 / ms_dispatch 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc4817fa640 / io_context_pool 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc481ffb640 / io_context_pool 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc483fff640 / ms_dispatch 2024-09-19T13:58:18.571 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc48ae05640 / ms_dispatch 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc48c608640 / io_context_pool 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc595cff640 / msgr-worker-2 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc59e500640 / msgr-worker-1 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc59ed01640 / msgr-worker-0 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc59f502640 / io_context_pool 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc5a0a0f800 / radosgw-admin 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.142072.log 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.572 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: crc 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336883640) adding con mode: secure 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key hook 0x55a336883788 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a3367c5ed0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.573 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a3367cc160 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a3367ccad0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:58:18.437+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.093615s 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): get_auth_request con 0x55a3367cc160 auth_method 0 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a3367ccad0 auth_method 0 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.574 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a3367c5ed0 auth_method 0 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:58:18.437+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.575 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:58:18.437+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient(hunting): handle_auth_done global_id 7953 payload 824 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:58:18.437+0000 7fc595cff640 1 monclient: found mon.noname-a 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:58:18.437+0000 7fc595cff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: dump: 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.576 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:58:18.438+0000 7fc48ae05640 10 monclient: dump: 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.577 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.578 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.578 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.578 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.578 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7953 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:58:18.438+0000 7fc48c608640 4 set_mon_vals no callback set 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.580 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:58:18.438+0000 7fc5a0a0f800 1 librados: init done 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:58:18.440+0000 7fc48ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:58:18.440+0000 7fc48ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:58:18.440+0000 7fc48ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:58:18.440+0000 7fc59e500640 10 monclient: get_auth_request con 0x7fc484077570 auth_method 0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:58:18.440+0000 7fc59ed01640 10 monclient: get_auth_request con 0x55a33670dc20 auth_method 0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:58:18.441+0000 7fc59e500640 10 monclient: get_auth_request con 0x55a3368cdbf0 auth_method 0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:58:18.442+0000 7fc595cff640 10 monclient: get_auth_request con 0x55a3368d2c80 auth_method 0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 10 monclient: build_initial_monmap 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 1 build_initial for_mkfs: 0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 10 monclient: monmap: 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:18.581 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding auth protocol: cephx 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding auth protocol: cephx 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding auth protocol: cephx 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.582 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: crc 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d6c80) adding con mode: secure 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command objecter_requests cmddesc objecter_requests hook 0x55a3368da100 EEXIST 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 10 monclient: init 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding auth protocol: cephx 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding auth protocol: cephx 2024-09-19T13:58:18.583 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding auth protocol: cephx 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: crc 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 5 AuthRegistry(0x55a3368d5b28) adding con mode: secure 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:58:18.443+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.584 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key cmddesc rotate-key hook 0x55a3368d5c70 EEXIST 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a3368fe420 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a3368fe800 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a3368fd130 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.100298s 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a3368fe420 auth_method 0 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.585 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a3368fd130 auth_method 0 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:58:18.444+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): get_auth_request con 0x55a3368fe800 auth_method 0 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:58:18.444+0000 7fc595cff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.586 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient(hunting): handle_auth_done global_id 7505 payload 824 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:58:18.444+0000 7fc59e500640 1 monclient: found mon.noname-c 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:58:18.444+0000 7fc59e500640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: dump: 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.587 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:58:18.444+0000 7fc483fff640 10 monclient: dump: 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.588 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7505 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:58:18.444+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:58:18.444+0000 7fc59f502640 4 set_mon_vals no callback set 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:58:18.445+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:58:18.445+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:18.589 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:58:18.446+0000 7fc483fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:58:18.446+0000 7fc483fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:58:18.446+0000 7fc483fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:58:18.447+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc478077480 auth_method 0 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: get_monmap_and_config 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: build_initial_monmap 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 1 build_initial for_mkfs: 0 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: monmap: 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.590 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding auth protocol: cephx 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding auth protocol: cephx 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding auth protocol: cephx 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.591 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: crc 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x55a33691e290) adding con mode: secure 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 10 monclient: init 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding auth protocol: cephx 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding auth protocol: cephx 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding auth protocol: cephx 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.592 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: crc 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea25fe10) adding con mode: secure 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:58:18.447+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key cmddesc rotate-key hook 0x7ffcea25ff58 EEXIST 2024-09-19T13:58:18.593 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a3369528a0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a336923820 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a33694ce20 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.104066s 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): get_auth_request con 0x55a336923820 auth_method 0 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.594 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a33694ce20 auth_method 0 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a3369528a0 auth_method 0 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.595 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:58:18.448+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:58:18.448+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient(hunting): handle_auth_done global_id 7959 payload 274 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:58:18.448+0000 7fc595cff640 1 monclient: found mon.noname-a 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:58:18.448+0000 7fc595cff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: dump: 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.596 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:58:18.448+0000 7fc481ffb640 10 monclient: dump: 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.597 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7959 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 10 monclient: get_monmap_and_config success 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:58:18.448+0000 7fc5a0a0f800 4 set_mon_vals no callback set 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: shutdown 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: build_initial_monmap 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 build_initial for_mkfs: 0 2024-09-19T13:58:18.598 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: monmap: 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding auth protocol: cephx 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding auth protocol: cephx 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding auth protocol: cephx 2024-09-19T13:58:18.599 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: crc 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336923020) adding con mode: secure 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.600 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: starting msgr at 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: starting objecter 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command objecter_requests cmddesc objecter_requests hook 0x55a3368fc860 EEXIST 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: setting wanted keys 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 1 librados: calling monclient init 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 10 monclient: init 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding auth protocol: cephx 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding auth protocol: cephx 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding auth protocol: cephx 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.601 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: crc 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 5 AuthRegistry(0x55a336912ce0) adding con mode: secure 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:58:18.449+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command rotate-key cmddesc rotate-key hook 0x55a336912e28 EEXIST 2024-09-19T13:58:18.602 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-a con 0x55a336923820 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-b con 0x55a33694ce20 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): picked mon.noname-c con 0x55a3369528a0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient(hunting): authenticate will time out at 2112.106153s 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): get_auth_request con 0x55a336923820 auth_method 0 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.603 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): get_auth_request con 0x55a3369528a0 auth_method 0 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:58:18.450+0000 7fc59ed01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient(hunting): handle_auth_done global_id 7962 payload 824 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient: _finish_hunting 0 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:58:18.450+0000 7fc59e500640 1 monclient: found mon.noname-a 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:58:18.450+0000 7fc59e500640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.604 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: dump: 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.605 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: _finish_auth 0 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: _check_auth_tickets 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:58:18.450+0000 7fc46ffff640 10 monclient: dump: 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:18.606 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 5 monclient: authenticate success, global_id 7962 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:58:18.450+0000 7fc481ffb640 4 set_mon_vals no callback set 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _renew_subs 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 1 librados: init done 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:58:18.450+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cr dump hook 0x55a336946be8 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:58:18.452+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:58:18.452+0000 7fc46ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:58:18.452+0000 7fc46ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.607 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:58:18.452+0000 7fc46ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:58:18.452+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc468077570 auth_method 0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:58:18.452+0000 7fc59ed01640 10 monclient: get_auth_request con 0x55a33696cc30 auth_method 0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 realm 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:58:18.453+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:58:18.454+0000 7fc59e500640 10 monclient: get_auth_request con 0x55a336971010 auth_method 0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.608 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:58:18.454+0000 7fc5a0a0f800 20 searching for the correct realm 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:58:18.455+0000 7fc595cff640 10 monclient: get_auth_request con 0x55a336976160 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:58:18.455+0000 7fc59ed01640 10 monclient: get_auth_request con 0x7fc588075020 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:58:18.456+0000 7fc59e500640 10 monclient: get_auth_request con 0x7fc59806f040 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:58:18.457+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc590083870 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:58:18.458+0000 7fc595cff640 0 -- 172.21.15.94:0/1336323773 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55a336976160 msgr2=0x55a336978600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:58:18.458+0000 7fc46ffff640 1 client.7962.objecter ms_handle_reset 0x55a336976160 session 0x55a336975ae0 osd.3 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:58:18.458+0000 7fc46ffff640 10 monclient: _renew_subs 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:58:18.458+0000 7fc46ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:58:18.458+0000 7fc595cff640 10 monclient: get_auth_request con 0x7fc468087390 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:58:18.458+0000 7fc59ed01640 10 monclient: get_auth_request con 0x7fc588027070 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:58:18.460+0000 7fc59e500640 10 monclient: get_auth_request con 0x7fc58800cc20 auth_method 0 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:58:18.461+0000 7fc59e500640 0 -- 172.21.15.94:0/1336323773 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc58800cc20 msgr2=0x7fc5880791f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:18.609 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:58:18.461+0000 7fc46ffff640 1 client.7962.objecter ms_handle_reset 0x7fc58800cc20 session 0x7fc58801fd50 osd.0 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:58:18.461+0000 7fc59e500640 10 monclient: get_auth_request con 0x55a336976160 auth_method 0 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:18.610 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 zone default found 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 Realm: () 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 zonegroup default 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:58:18.465+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 started sync module instance, tier type = 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:58:18.466+0000 7fc5a0a0f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:18.611 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=0 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=1 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=2 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=3 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=4 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=5 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:58:18.475+0000 7fc5a0a0f800 20 add_watcher() i=6 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:58:18.476+0000 7fc5a0a0f800 20 add_watcher() i=7 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:58:18.476+0000 7fc5a0a0f800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding auth protocol: cephx 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding auth protocol: cephx 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding auth protocol: cephx 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.612 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:58:18.477+0000 7fc454fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: crc 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:58:18.477+0000 7fc5a0a0f800 5 AuthRegistry(0x7ffcea2602e0) adding con mode: secure 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache list hook 0x55a336946860 2024-09-19T13:58:18.613 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache inspect hook 0x55a336946860 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache erase hook 0x55a336946860 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command cache zap hook 0x55a336946860 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 note: GC not initialized 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:58:18.478+0000 7fc3cf7fe640 20 reqs_thread_entry: start 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace show hook 0x7fc588068040 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace history hook 0x7fc588068040 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace active hook 0x7fc588068040 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 5 asok(0x55a336662410) register_command sync trace active_short hook 0x7fc588068040 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 Filter name: none 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:58:18.478+0000 7fc3cd7fa640 20 reqs_thread_entry: start 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:58:18.478+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.614 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : miss 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:58:18.479+0000 7fc5a0a0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.615 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:58:18.484+0000 7fc5a0a0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40, ofs0, ns] 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94159483938336 notifier 7962 bl.length()=1015 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:58:18.484+0000 7fc4817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_sources= new_sources= 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential sources added=[] removed=[] 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_dests= new_dests= 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:58:18.485+0000 7fc5a0a0f800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential dests added=[] removed=[] 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.0 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.0 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.1 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.1 2024-09-19T13:58:18.616 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.2 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.2 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.3 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.3 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.4 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.4 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.5 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.5 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.6 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.6 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.7 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.7 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.8 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.8 2024-09-19T13:58:18.617 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.9 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.9 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.10 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.10 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.11 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1.11 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.0 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:58:18.489+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:58:18.490+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.3 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:58:18.490+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.4 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:58:18.491+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.5 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:58:18.491+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.6 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:58:18.492+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.7 2024-09-19T13:58:18.618 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:58:18.493+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.8 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:58:18.493+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.9 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:58:18.494+0000 7fc5a0a0f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.10 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:58:18.498+0000 7fc5a0a0f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5a0a0f800 time 2024-09-19T13:58:18.497629+0000 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5a3f8c76a] 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:18.619 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:58:18.498+0000 7fc5a0a0f800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fc5a0a0f800 thread_name:radosgw-admin 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc5a2c3e6f0] 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc5a2c8b99c] 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5a3f8c7c4] 2024-09-19T13:58:18.620 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc5a3f8c928] 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a334aa6791] 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55a334ab5664] 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a334ab6504] 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc5a2c29590] 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:58:18.621 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:58:18.622 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:58:18.623 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:58:18.624 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:58:18.625 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:58:18.626 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:58:18.627 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc3cd7fa640 / http_manager 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc3cf7fe640 / http_manager 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc454fe1640 / rgw_dt_lg_renew 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc46ffff640 / ms_dispatch 2024-09-19T13:58:18.628 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc4817fa640 / io_context_pool 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc481ffb640 / io_context_pool 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc483fff640 / ms_dispatch 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc48ae05640 / ms_dispatch 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc48c608640 / io_context_pool 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc595cff640 / msgr-worker-2 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc59e500640 / msgr-worker-1 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc59ed01640 / msgr-worker-0 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc59f502640 / io_context_pool 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: 7fc5a0a0f800 / radosgw-admin 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:58:18.499229Z_8e13f0db-cd34-44dd-970f-eaa89ac443fe/log 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:58:18.629 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T13:58:18.631 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:18.631 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:18.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.572+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.574+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.574+0000 7f6820d2c800 20 realm 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.574+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.574+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.574+0000 7f6820d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.574+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.575+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.575+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.575+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.575+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.576+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.576+0000 7f6820d2c800 20 searching for the correct realm 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.578+0000 7f681c24e640 0 -- 172.21.15.94:0/496649058 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6814018070 msgr2=0x7f6814068710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:18.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.582+0000 7f681ca4f640 0 -- 172.21.15.94:0/496649058 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6804086b70 msgr2=0x7f68040821b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:18.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:18.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:18.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:18.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:18.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:18.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:18.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 zone default found 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 4 Realm: () 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:18.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 zonegroup default 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.789+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 started sync module instance, tier type = 2024-09-19T13:58:18.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.790+0000 7f6820d2c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=0 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=1 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=2 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=3 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=4 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=5 2024-09-19T13:58:18.800 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.799+0000 7f6820d2c800 20 add_watcher() i=6 2024-09-19T13:58:18.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.800+0000 7f6820d2c800 20 add_watcher() i=7 2024-09-19T13:58:18.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.800+0000 7f6820d2c800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:18.802 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.801+0000 7f66d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 5 note: GC not initialized 2024-09-19T13:58:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f66d27e4640 20 reqs_thread_entry: start 2024-09-19T13:58:18.803 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 Filter name: none 2024-09-19T13:58:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f66cb7fe640 20 reqs_thread_entry: start 2024-09-19T13:58:18.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.802+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.803+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.803+0000 7f6820d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.803+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.804+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.804+0000 7f6820d2c800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.804+0000 7f6820d2c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:58:18.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.804+0000 7f6820d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:18.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.806+0000 7f66d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:18.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.808+0000 7f6820d2c800 20 remove_watcher() i=0 2024-09-19T13:58:18.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.808+0000 7f6820d2c800 2 removed watcher, disabling cache 2024-09-19T13:58:18.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.809+0000 7f6820d2c800 20 remove_watcher() i=1 2024-09-19T13:58:18.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.810+0000 7f6820d2c800 20 remove_watcher() i=2 2024-09-19T13:58:18.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.811+0000 7f6820d2c800 20 remove_watcher() i=3 2024-09-19T13:58:18.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.812+0000 7f6820d2c800 20 remove_watcher() i=4 2024-09-19T13:58:18.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.812+0000 7f6820d2c800 20 remove_watcher() i=5 2024-09-19T13:58:18.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.813+0000 7f6820d2c800 20 remove_watcher() i=6 2024-09-19T13:58:18.815 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.814+0000 7f6820d2c800 20 remove_watcher() i=7 2024-09-19T13:58:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.825 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:18.825 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T13:58:18.825 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:18.876 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:58:18.908 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:18.908 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:18.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.944+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.945+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.945+0000 7f41c46bb800 20 realm 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.945+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:18.948 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:18.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.946+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:18.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.947+0000 7f41c46bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:18.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.947+0000 7f41c46bb800 20 searching for the correct realm 2024-09-19T13:58:18.950 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:18.949+0000 7f41b99a4640 0 -- 172.21.15.94:0/859914303 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f41b4032020 msgr2=0x7f41b4082b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:19.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.155+0000 7f41c21a5640 0 -- 172.21.15.94:0/859914303 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f41ac04b920 msgr2=0x7f41ac03f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:19.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:19.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:19.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:19.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:19.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:19.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:19.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:19.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.361+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:19.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 zone default found 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 4 Realm: () 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 zonegroup default 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.362+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.363+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.363+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.363+0000 7f41c46bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.363+0000 7f41c46bb800 20 started sync module instance, tier type = 2024-09-19T13:58:19.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.363+0000 7f41c46bb800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:19.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=0 2024-09-19T13:58:19.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=1 2024-09-19T13:58:19.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=2 2024-09-19T13:58:19.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=3 2024-09-19T13:58:19.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=4 2024-09-19T13:58:19.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=5 2024-09-19T13:58:19.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.372+0000 7f41c46bb800 20 add_watcher() i=6 2024-09-19T13:58:19.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.373+0000 7f41c46bb800 20 add_watcher() i=7 2024-09-19T13:58:19.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.373+0000 7f41c46bb800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:19.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f40797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f41c46bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f41c46bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f41c46bb800 5 note: GC not initialized 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f40737fe640 20 reqs_thread_entry: start 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f41c46bb800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.375+0000 7f41c46bb800 20 Filter name: none 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f40717fa640 20 reqs_thread_entry: start 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T13:58:19.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T13:58:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : miss 2024-09-19T13:58:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 20 rados->read ofs=0 len=0 2024-09-19T13:58:19.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.376+0000 7f41c46bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.377+0000 7f41c46bb800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to be held by another RGW process; skipping for now 2024-09-19T13:58:19.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.378+0000 7f40797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:19.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.380+0000 7f41c46bb800 20 remove_watcher() i=0 2024-09-19T13:58:19.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.380+0000 7f41c46bb800 2 removed watcher, disabling cache 2024-09-19T13:58:19.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.381+0000 7f41c46bb800 20 remove_watcher() i=1 2024-09-19T13:58:19.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.382+0000 7f41c46bb800 20 remove_watcher() i=2 2024-09-19T13:58:19.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.383+0000 7f41c46bb800 20 remove_watcher() i=3 2024-09-19T13:58:19.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.385+0000 7f41c46bb800 20 remove_watcher() i=4 2024-09-19T13:58:19.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.386+0000 7f41c46bb800 20 remove_watcher() i=5 2024-09-19T13:58:19.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.387+0000 7f41c46bb800 20 remove_watcher() i=6 2024-09-19T13:58:19.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:19.388+0000 7f41c46bb800 20 remove_watcher() i=7 2024-09-19T13:58:19.399 INFO:tasks.workunit.client.0.smithi094.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T13:58:49.418 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T13:58:49.454 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:49.454 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:49.496 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.493+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 realm 2024-09-19T13:58:49.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:49.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.495+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.496+0000 7f646612a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:49.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.496+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.497+0000 7f646612a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:49.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.497+0000 7f646612a800 20 searching for the correct realm 2024-09-19T13:58:49.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.500+0000 7f6462618640 0 -- 172.21.15.94:0/2428053098 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f6458037070 msgr2=0x7f6458015910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:49.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.504+0000 7f6461e17640 0 -- 172.21.15.94:0/2428053098 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6458056940 msgr2=0x7f6458037450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.711+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:49.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 20 zone default found 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 4 Realm: () 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 20 zonegroup default 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.712+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 started sync module instance, tier type = 2024-09-19T13:58:49.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.713+0000 7f646612a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:49.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=0 2024-09-19T13:58:49.725 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=1 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=2 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=3 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=4 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=5 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.723+0000 7f646612a800 20 add_watcher() i=6 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.724+0000 7f646612a800 20 add_watcher() i=7 2024-09-19T13:58:49.726 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.724+0000 7f646612a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:49.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.726+0000 7f6313fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:49.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.727+0000 7f646612a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:49.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.727+0000 7f646612a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.727+0000 7f646612a800 5 note: GC not initialized 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.727+0000 7f6312ffd640 20 reqs_thread_entry: start 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.727+0000 7f646612a800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.727+0000 7f646612a800 20 Filter name: none 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f6310ff9640 20 reqs_thread_entry: start 2024-09-19T13:58:49.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : miss 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.728+0000 7f646612a800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.729+0000 7f646612a800 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.729+0000 7f646612a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.729+0000 7f646612a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.729+0000 7f646612a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:49.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.729+0000 7f646612a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.729+0000 7f646612a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:49.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.730+0000 7f646612a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:58:49.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.737+0000 7f646612a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.737+0000 7f646612a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.737+0000 7f646612a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.737+0000 7f646612a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40, ofs0, ns] 2024-09-19T13:58:49.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f6344ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 93865273460768 notifier 7562 bl.length()=1015 2024-09-19T13:58:49.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f6344ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f6344ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f6344ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_sources= new_sources= 2024-09-19T13:58:49.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential sources added=[] removed=[] 2024-09-19T13:58:49.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_dests= new_dests= 2024-09-19T13:58:49.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.738+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential dests added=[] removed=[] 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.0 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.0 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.1 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.1 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.2 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.2 2024-09-19T13:58:49.746 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.3 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.3 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.4 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.4 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.5 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.5 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.6 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.6 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.7 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.7 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.8 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.8 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.9 2024-09-19T13:58:49.747 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.9 2024-09-19T13:58:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.10 2024-09-19T13:58:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.10 2024-09-19T13:58:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.11 2024-09-19T13:58:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2.11 2024-09-19T13:58:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.0 2024-09-19T13:58:49.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.744+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1 2024-09-19T13:58:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.745+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2 2024-09-19T13:58:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.745+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.3 2024-09-19T13:58:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.746+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.4 2024-09-19T13:58:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.746+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.5 2024-09-19T13:58:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.747+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.6 2024-09-19T13:58:49.749 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.747+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.7 2024-09-19T13:58:49.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.748+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.8 2024-09-19T13:58:49.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.749+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.9 2024-09-19T13:58:49.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.749+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.10 2024-09-19T13:58:49.754 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.752+0000 7f646612a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:49.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.752+0000 7f646612a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f646612a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f646612a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f646612a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f646612a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40, ofs0, ns] 2024-09-19T13:58:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f6344ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 93865273460768 notifier 7562 bl.length()=1015 2024-09-19T13:58:49.756 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f6344ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f6344ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.754+0000 7f6344ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.755+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_sources= new_sources= 2024-09-19T13:58:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.755+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential sources added=[] removed=[] 2024-09-19T13:58:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.755+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_dests= new_dests= 2024-09-19T13:58:49.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.755+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential dests added=[] removed=[] 2024-09-19T13:58:49.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.757+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.0 2024-09-19T13:58:49.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.757+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.1 2024-09-19T13:58:49.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.758+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.2 2024-09-19T13:58:49.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.758+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.3 2024-09-19T13:58:49.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.758+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.4 2024-09-19T13:58:49.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.759+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.5 2024-09-19T13:58:49.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.759+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.6 2024-09-19T13:58:49.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.759+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.7 2024-09-19T13:58:49.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.760+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.8 2024-09-19T13:58:49.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.760+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.9 2024-09-19T13:58:49.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.760+0000 7f646612a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40.10 2024-09-19T13:58:49.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.761+0000 7f646612a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 : hit (requested=0x17, cached=0x17) 2024-09-19T13:58:49.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.761+0000 7f646612a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 2024-09-19T13:58:49.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.762+0000 7f646612a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.762+0000 7f646612a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.762+0000 7f646612a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.762+0000 7f646612a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40, ofs0, ns] 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f63457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 93865273460768 notifier 7562 bl.length()=983 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f63457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 info.flags=0x17 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f63457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 to cache LRU end 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f63457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_sources= new_sources= 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential sources added=[] removed=[] 2024-09-19T13:58:49.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): orig_dests= new_dests= 2024-09-19T13:58:49.766 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.763+0000 7f646612a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40]): potential dests added=[] removed=[] 2024-09-19T13:58:49.767 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.765+0000 7f646612a800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-19T13:58:49.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.767+0000 7f6313fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:49.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.769+0000 7f646612a800 20 remove_watcher() i=0 2024-09-19T13:58:49.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.769+0000 7f646612a800 2 removed watcher, disabling cache 2024-09-19T13:58:49.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.770+0000 7f646612a800 20 remove_watcher() i=1 2024-09-19T13:58:49.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.771+0000 7f646612a800 20 remove_watcher() i=2 2024-09-19T13:58:49.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.773+0000 7f646612a800 20 remove_watcher() i=3 2024-09-19T13:58:49.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.774+0000 7f646612a800 20 remove_watcher() i=4 2024-09-19T13:58:49.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.775+0000 7f646612a800 20 remove_watcher() i=5 2024-09-19T13:58:49.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.776+0000 7f646612a800 20 remove_watcher() i=6 2024-09-19T13:58:49.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.777+0000 7f646612a800 20 remove_watcher() i=7 2024-09-19T13:58:49.791 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T13:58:49.820 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:49.820 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:49.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.855+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.856+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.856+0000 7fa515d23800 20 realm 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.856+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.857+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.857+0000 7fa515d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.857+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.857+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:49.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.857+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.858+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:49.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.858+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:49.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.858+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:49.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.858+0000 7fa515d23800 20 searching for the correct realm 2024-09-19T13:58:49.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.861+0000 7fa50920b640 0 -- 172.21.15.94:0/3564030351 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fa50407c050 msgr2=0x7fa504096120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:49.866 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:49.865+0000 7fa511a0c640 0 -- 172.21.15.94:0/3564030351 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa4fc0b51a0 msgr2=0x7fa4fc0b5620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:50.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.070+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:50.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 zone default found 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 4 Realm: () 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:50.075 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 zonegroup default 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.071+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 started sync module instance, tier type = 2024-09-19T13:58:50.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.072+0000 7fa515d23800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:50.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=0 2024-09-19T13:58:50.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=1 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=2 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=3 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=4 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=5 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.082+0000 7fa515d23800 20 add_watcher() i=6 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.083+0000 7fa515d23800 20 add_watcher() i=7 2024-09-19T13:58:50.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.083+0000 7fa515d23800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.085+0000 7fa3ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.085+0000 7fa515d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 5 note: GC not initialized 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa3aa7fc640 20 reqs_thread_entry: start 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 20 Filter name: none 2024-09-19T13:58:50.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa337fff640 20 reqs_thread_entry: start 2024-09-19T13:58:50.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.086+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.087+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.087+0000 7fa515d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.087+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.087+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.087+0000 7fa515d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.088+0000 7fa515d23800 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T13:58:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.088+0000 7fa515d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:50.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.089+0000 7fa3ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:50.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.091+0000 7fa515d23800 20 remove_watcher() i=0 2024-09-19T13:58:50.093 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.091+0000 7fa515d23800 2 removed watcher, disabling cache 2024-09-19T13:58:50.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.093+0000 7fa515d23800 20 remove_watcher() i=1 2024-09-19T13:58:50.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.093+0000 7fa515d23800 20 remove_watcher() i=2 2024-09-19T13:58:50.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.095+0000 7fa515d23800 20 remove_watcher() i=3 2024-09-19T13:58:50.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.095+0000 7fa515d23800 20 remove_watcher() i=4 2024-09-19T13:58:50.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.096+0000 7fa515d23800 20 remove_watcher() i=5 2024-09-19T13:58:50.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.097+0000 7fa515d23800 20 remove_watcher() i=6 2024-09-19T13:58:50.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.098+0000 7fa515d23800 20 remove_watcher() i=7 2024-09-19T13:58:50.111 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:50.111 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:50.111 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: abort-at-change-reshard-state id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T13:58:50.111 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:50.187 INFO:tasks.workunit.client.0.smithi094.stderr: test: logrecord could be stopped after reshard failed 2024-09-19T13:58:50.189 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:58:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:50.217 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:50.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.252+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 realm 2024-09-19T13:58:50.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:50.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.254+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.255+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:50.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.255+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.255+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:50.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.255+0000 7f8283c0e800 20 searching for the correct realm 2024-09-19T13:58:50.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.258+0000 7f827ebbb640 0 -- 172.21.15.94:0/2744274532 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f827006e040 msgr2=0x7f8270009960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:50.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.261+0000 7f827f3bc640 0 -- 172.21.15.94:0/2744274532 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8268070bc0 msgr2=0x7f82680729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:50.469 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:50.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:50.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:50.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:50.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.470 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.467+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 zone default found 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 4 Realm: () 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 zonegroup default 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.468+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.472 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.469+0000 7f8283c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.469+0000 7f8283c0e800 20 started sync module instance, tier type = 2024-09-19T13:58:50.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.469+0000 7f8283c0e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=0 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=1 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=2 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=3 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=4 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=5 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.477+0000 7f8283c0e800 20 add_watcher() i=6 2024-09-19T13:58:50.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.478+0000 7f8283c0e800 20 add_watcher() i=7 2024-09-19T13:58:50.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.478+0000 7f8283c0e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:50.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.480+0000 7f8135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.480+0000 7f8283c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.480+0000 7f8283c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.480+0000 7f8283c0e800 5 note: GC not initialized 2024-09-19T13:58:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.481+0000 7f8134fe1640 20 reqs_thread_entry: start 2024-09-19T13:58:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.481+0000 7f8283c0e800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:50.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.481+0000 7f8283c0e800 20 Filter name: none 2024-09-19T13:58:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.481+0000 7f80ae7fc640 20 reqs_thread_entry: start 2024-09-19T13:58:50.484 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.481+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.482+0000 7f8283c0e800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.483+0000 7f8283c0e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:50.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.483+0000 7f8283c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:50.487 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.485+0000 7f8135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:50.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.487+0000 7f8283c0e800 20 remove_watcher() i=0 2024-09-19T13:58:50.489 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.487+0000 7f8283c0e800 2 removed watcher, disabling cache 2024-09-19T13:58:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.488+0000 7f8283c0e800 20 remove_watcher() i=1 2024-09-19T13:58:50.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.489+0000 7f8283c0e800 20 remove_watcher() i=2 2024-09-19T13:58:50.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.490+0000 7f8283c0e800 20 remove_watcher() i=3 2024-09-19T13:58:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.491+0000 7f8283c0e800 20 remove_watcher() i=4 2024-09-19T13:58:50.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.492+0000 7f8283c0e800 20 remove_watcher() i=5 2024-09-19T13:58:50.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.492+0000 7f8283c0e800 20 remove_watcher() i=6 2024-09-19T13:58:50.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.493+0000 7f8283c0e800 20 remove_watcher() i=7 2024-09-19T13:58:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:58:50.506 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-19T13:58:50.506 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:50.507 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:58:50.536 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:50.536 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:50.572 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.569+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.571+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.571+0000 7f1888d23800 20 realm 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.571+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.571+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.571+0000 7f1888d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.571+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.572+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.574 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.572+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.573+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.573+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.573+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:50.575 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.573+0000 7f1888d23800 20 searching for the correct realm 2024-09-19T13:58:50.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.575+0000 7f187ffff640 0 -- 172.21.15.94:0/1448740532 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f18780803f0 msgr2=0x7f18780737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:50.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.780+0000 7f1884a0c640 0 -- 172.21.15.94:0/1448740532 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f18700db050 msgr2=0x7f18700a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.989 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.986+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:50.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 zone default found 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 4 Realm: () 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 zonegroup default 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.987+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.988+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.988+0000 7f1888d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.988+0000 7f1888d23800 20 started sync module instance, tier type = 2024-09-19T13:58:50.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.988+0000 7f1888d23800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:50.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=0 2024-09-19T13:58:50.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=1 2024-09-19T13:58:50.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=2 2024-09-19T13:58:50.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=3 2024-09-19T13:58:50.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=4 2024-09-19T13:58:50.999 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=5 2024-09-19T13:58:51.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.997+0000 7f1888d23800 20 add_watcher() i=6 2024-09-19T13:58:51.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.998+0000 7f1888d23800 20 add_watcher() i=7 2024-09-19T13:58:51.000 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:50.998+0000 7f1888d23800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:51.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f173afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f1888d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f1888d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f1888d23800 5 note: GC not initialized 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f1739fe3640 20 reqs_thread_entry: start 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f1888d23800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f1888d23800 20 Filter name: none 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.000+0000 7f16ab7fe640 20 reqs_thread_entry: start 2024-09-19T13:58:51.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.001+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.001+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.001+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:51.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.002+0000 7f1888d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:51.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.004+0000 7f173afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.006+0000 7f1888d23800 20 remove_watcher() i=0 2024-09-19T13:58:51.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.006+0000 7f1888d23800 2 removed watcher, disabling cache 2024-09-19T13:58:51.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.007+0000 7f1888d23800 20 remove_watcher() i=1 2024-09-19T13:58:51.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.009+0000 7f1888d23800 20 remove_watcher() i=2 2024-09-19T13:58:51.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.010+0000 7f1888d23800 20 remove_watcher() i=3 2024-09-19T13:58:51.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.011+0000 7f1888d23800 20 remove_watcher() i=4 2024-09-19T13:58:51.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.012+0000 7f1888d23800 20 remove_watcher() i=5 2024-09-19T13:58:51.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.013+0000 7f1888d23800 20 remove_watcher() i=6 2024-09-19T13:58:51.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.015+0000 7f1888d23800 20 remove_watcher() i=7 2024-09-19T13:58:51.029 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-19T13:58:51.062 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:51.062 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:51.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.096+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 realm 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:51.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.099+0000 7f8f6d040800 20 searching for the correct realm 2024-09-19T13:58:51.104 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.102+0000 7f8f6a329640 0 -- 172.21.15.94:0/1425265899 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f8f5c06b020 msgr2=0x7f8f5c0a4560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:51.107 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.105+0000 7f8f6ab2a640 0 -- 172.21.15.94:0/1425265899 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8f600453f0 msgr2=0x7f8f60045870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.314 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 zone default found 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 4 Realm: () 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 zonegroup default 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.316 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.313+0000 7f8f6d040800 20 started sync module instance, tier type = 2024-09-19T13:58:51.317 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.313+0000 7f8f6d040800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=0 2024-09-19T13:58:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=1 2024-09-19T13:58:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=2 2024-09-19T13:58:51.325 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=3 2024-09-19T13:58:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=4 2024-09-19T13:58:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=5 2024-09-19T13:58:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.324+0000 7f8f6d040800 20 add_watcher() i=6 2024-09-19T13:58:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.324+0000 7f8f6d040800 20 add_watcher() i=7 2024-09-19T13:58:51.326 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.324+0000 7f8f6d040800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:51.328 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8e217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8f6d040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8f6d040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8f6d040800 5 note: GC not initialized 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8d9bfff640 20 reqs_thread_entry: start 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8f6d040800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.326+0000 7f8f6d040800 20 Filter name: none 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8d99ffb640 20 reqs_thread_entry: start 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:58:51.329 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.328+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:51.330 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.328+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.328+0000 7f8f6d040800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.328+0000 7f8f6d040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:51.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.328+0000 7f8f6d040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.331 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.328+0000 7f8f6d040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:58:51.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8f6d040800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8f6d040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.335 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8f6d040800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595166 cookie 94492317330848 notifier 7631 bl.length()=911 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:58:51.336 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:58:51.341 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.1 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.1 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.2 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.2 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.3 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.3 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.4 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.4 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.5 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.5 2024-09-19T13:58:51.342 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.6 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.6 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.7 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.7 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.8 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.8 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.9 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.9 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.10 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.10 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.11 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.11 2024-09-19T13:58:51.343 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.12 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.12 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.13 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.13 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.344 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.341+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.341+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.341+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.341+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.342+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.342+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.342+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.342+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.343+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.343+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.343+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.343+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.344+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.344+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.345+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.345+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.345+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.345+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f6d040800 time 2024-09-19T13:58:51.349044+0000 2024-09-19T13:58:51.349 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f7058c76a] 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:51.350 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.348+0000 7f8f6d040800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f6d040800 time 2024-09-19T13:58:51.349044+0000 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f7058c76a] 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.351 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:51.352 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.352 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:51.352 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:51.352 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.352 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:58:51.352 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8f6d040800 thread_name:radosgw-admin 2024-09-19T13:58:51.369 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.369 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f6f23e6f0] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f6f28b99c] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f7058c7c4] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.349+0000 7f8f6d040800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:58:51.370 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8f6d040800 thread_name:radosgw-admin 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f6f23e6f0] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f6f28b99c] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f7058c7c4] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.371 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4de00e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4e71a20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4f52020 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.739224s 2024-09-19T13:58:51.372 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4e71a20 auth_method 0 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4de00e0 auth_method 0 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.373 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_done global_id 7622 payload 824 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: dump: 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.374 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: dump: 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.375 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:58:51.082+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7622 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:58:51.082+0000 7f8e58e09640 4 set_mon_vals no callback set 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.376 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:58:51.082+0000 7f8f6d040800 1 librados: init done 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:58:51.084+0000 7f8e57606640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:58:51.084+0000 7f8e57606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:58:51.084+0000 7f8e57606640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:58:51.085+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e50077570 auth_method 0 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:58:51.085+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x55f0b4f70ca0 auth_method 0 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:58:51.085+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x55f0b4f73e80 auth_method 0 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:58:51.087+0000 7f8f6a329640 10 monclient: get_auth_request con 0x55f0b4f78f10 auth_method 0 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:58:51.087+0000 7f8f6d040800 10 monclient: build_initial_monmap 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:58:51.087+0000 7f8f6d040800 1 build_initial for_mkfs: 0 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:58:51.087+0000 7f8f6d040800 10 monclient: monmap: 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:51.377 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding auth protocol: cephx 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding auth protocol: cephx 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding auth protocol: cephx 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.378 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:58:51.088+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command objecter_requests cmddesc objecter_requests hook 0x55f0b4f803f0 EEXIST 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient: init 2024-09-19T13:58:51.379 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding auth protocol: cephx 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding auth protocol: cephx 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding auth protocol: cephx 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.380 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:58:51.088+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:58:51.088+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command rotate-key cmddesc rotate-key hook 0x55f0b4f7bf50 EEXIST 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4fa4710 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4fa4af0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4fa3420 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.381 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.745919s 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4fa4710 auth_method 0 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request con 0x55f0b4fa3420 auth_method 0 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.382 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4fa4af0 auth_method 0 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_done global_id 7625 payload 824 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: dump: 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.383 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: dump: 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.384 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:58:51.089+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7625 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:58:51.089+0000 7f8f6bb2c640 4 set_mon_vals no callback set 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.385 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:58:51.091+0000 7f8e54e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:58:51.091+0000 7f8e54e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:58:51.091+0000 7f8e54e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:58:51.091+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e44077480 auth_method 0 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: get_monmap_and_config 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: build_initial_monmap 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:58:51.091+0000 7f8f6d040800 1 build_initial for_mkfs: 0 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: monmap: 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:51.386 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding auth protocol: cephx 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding auth protocol: cephx 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding auth protocol: cephx 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.387 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:58:51.091+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: init 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding auth protocol: cephx 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding auth protocol: cephx 2024-09-19T13:58:51.388 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding auth protocol: cephx 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:58:51.092+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.389 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:58:51.092+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:58:51.092+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command rotate-key cmddesc rotate-key hook 0x7ffc8068a548 EEXIST 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4ff8990 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4fe92e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4ff3dc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.749470s 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4fe92e0 auth_method 0 2024-09-19T13:58:51.390 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request con 0x55f0b4ff3dc0 auth_method 0 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4ff8990 auth_method 0 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.391 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_done global_id 7628 payload 274 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:58:51.092+0000 7f8f6a329640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.392 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: dump: 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7628 2024-09-19T13:58:51.393 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: dump: 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.394 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: get_monmap_and_config success 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:58:51.093+0000 7f8f6d040800 4 set_mon_vals no callback set 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: shutdown 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: build_initial_monmap 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:58:51.093+0000 7f8f6d040800 1 build_initial for_mkfs: 0 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: monmap: 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:51.395 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding auth protocol: cephx 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding auth protocol: cephx 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding auth protocol: cephx 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.396 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:58:51.093+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:58:51.093+0000 7f8f6d040800 1 librados: starting msgr at 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:58:51.093+0000 7f8f6d040800 1 librados: starting objecter 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command objecter_requests cmddesc objecter_requests hook 0x55f0b4faaf40 EEXIST 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:58:51.094+0000 7f8f6d040800 1 librados: setting wanted keys 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:58:51.094+0000 7f8f6d040800 1 librados: calling monclient init 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient: init 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding auth protocol: cephx 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding auth protocol: cephx 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding auth protocol: cephx 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.397 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:58:51.094+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:58:51.094+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command rotate-key cmddesc rotate-key hook 0x55f0b4fb9118 EEXIST 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4fe92e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.398 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4ff3dc0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4ff8990 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.751674s 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4fe92e0 auth_method 0 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request con 0x55f0b4ff8990 auth_method 0 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.399 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4ff3dc0 auth_method 0 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_done global_id 7631 payload 824 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.400 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: dump: 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.401 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: dump: 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.402 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:58:51.095+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7631 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:58:51.095+0000 7f8e4e7fc640 4 set_mon_vals no callback set 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:58:51.095+0000 7f8f6d040800 1 librados: init done 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:58:51.095+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cr dump hook 0x55f0b4ff2a08 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:58:51.096+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:58:51.097+0000 7f8e4cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:58:51.097+0000 7f8e4cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.403 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:58:51.097+0000 7f8e4cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:58:51.097+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e34077570 auth_method 0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:58:51.097+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x55f0b5012710 auth_method 0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 realm 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:58:51.098+0000 7f8f6d040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:58:51.098+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x55f0b5016ac0 auth_method 0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.404 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 searching for the correct realm 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:58:51.099+0000 7f8f6a329640 10 monclient: get_auth_request con 0x55f0b501bbd0 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:58:51.100+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x7f8f60038070 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:58:51.101+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x7f8f64017020 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:58:51.101+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8f5c06b020 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:58:51.102+0000 7f8f6a329640 0 -- 172.21.15.94:0/1425265899 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f8f5c06b020 msgr2=0x7f8f5c0a4560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:58:51.102+0000 7f8e4cff9640 1 client.7631.objecter ms_handle_reset 0x7f8f5c06b020 session 0x7f8f5c005040 osd.4 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:58:51.102+0000 7f8e4cff9640 10 monclient: _renew_subs 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:58:51.102+0000 7f8e4cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:58:51.102+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e34087310 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:58:51.103+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x7f8f60058950 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:58:51.105+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x7f8f600453f0 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:58:51.105+0000 7f8f6ab2a640 0 -- 172.21.15.94:0/1425265899 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8f600453f0 msgr2=0x7f8f60045870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:58:51.307+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x7f8f600453f0 auth_method 0 2024-09-19T13:58:51.405 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 zone default found 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:58:51.312+0000 7f8f6d040800 4 Realm: () 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:58:51.312+0000 7f8f6d040800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:58:51.312+0000 7f8f6d040800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:51.406 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:58:51.312+0000 7f8f6d040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 zonegroup default 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 started sync module instance, tier type = 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=0 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=1 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=2 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=3 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=4 2024-09-19T13:58:51.407 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=5 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:58:51.324+0000 7f8f6d040800 20 add_watcher() i=6 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:58:51.324+0000 7f8f6d040800 20 add_watcher() i=7 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:58:51.324+0000 7f8f6d040800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding auth protocol: cephx 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding auth protocol: cephx 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding auth protocol: cephx 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.408 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:58:51.326+0000 7f8e217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:58:51.326+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache list hook 0x55f0b4ff1500 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache inspect hook 0x55f0b4ff1500 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache erase hook 0x55f0b4ff1500 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache zap hook 0x55f0b4ff1500 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 note: GC not initialized 2024-09-19T13:58:51.409 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:58:51.326+0000 7f8d9bfff640 20 reqs_thread_entry: start 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace show hook 0x7f8f60013070 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace history hook 0x7f8f60013070 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace active hook 0x7f8f60013070 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace active_short hook 0x7f8f60013070 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 Filter name: none 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:58:51.327+0000 7f8d99ffb640 20 reqs_thread_entry: start 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:58:51.410 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:58:51.328+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595166 cookie 94492317330848 notifier 7631 bl.length()=911 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.411 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.1 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.1 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.2 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.2 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.3 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.3 2024-09-19T13:58:51.412 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.4 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.4 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.5 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.5 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.6 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.6 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.7 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.7 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.8 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.8 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.9 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.9 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.10 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.10 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.11 2024-09-19T13:58:51.413 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.11 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.12 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.12 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.13 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.13 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:58:51.341+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:58:51.341+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.414 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:58:51.341+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:58:51.341+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:58:51.342+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:58:51.342+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:58:51.342+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:58:51.342+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:58:51.343+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:58:51.343+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:58:51.343+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:58:51.343+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:58:51.344+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:58:51.344+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:58:51.345+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:58:51.345+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.415 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:58:51.345+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:58:51.345+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:58:51.348+0000 7f8f6d040800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f6d040800 time 2024-09-19T13:58:51.349044+0000 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f7058c76a] 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:51.416 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:58:51.349+0000 7f8f6d040800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8f6d040800 thread_name:radosgw-admin 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f6f23e6f0] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f6f28b99c] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f7058c7c4] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:51.417 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:58:51.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:58:51.419 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:58:51.420 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:58:51.421 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:58:51.422 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:58:51.423 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:58:51.424 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d99ffb640 / http_manager 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d9bfff640 / http_manager 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e217e2640 / rgw_dt_lg_renew 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e4cff9640 / ms_dispatch 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e4e7fc640 / io_context_pool 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e54e01640 / ms_dispatch 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e57606640 / ms_dispatch 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e58e09640 / io_context_pool 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6a329640 / msgr-worker-2 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6ab2a640 / msgr-worker-1 2024-09-19T13:58:51.425 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6b32b640 / msgr-worker-0 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6bb2c640 / io_context_pool 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6d040800 / radosgw-admin 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.146208.log 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4de00e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4e71a20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4f52020 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.426 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.739224s 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4e71a20 auth_method 0 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4de00e0 auth_method 0 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:58:51.082+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.427 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_done global_id 7622 payload 824 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:58:51.082+0000 7f8f6ab2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: dump: 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.428 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:58:51.082+0000 7f8e57606640 10 monclient: dump: 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.429 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:58:51.082+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7622 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:58:51.082+0000 7f8e58e09640 4 set_mon_vals no callback set 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:58:51.082+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.430 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:58:51.082+0000 7f8f6d040800 1 librados: init done 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:58:51.084+0000 7f8e57606640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:58:51.084+0000 7f8e57606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:58:51.084+0000 7f8e57606640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:58:51.085+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e50077570 auth_method 0 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:58:51.085+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x55f0b4f70ca0 auth_method 0 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:58:51.085+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x55f0b4f73e80 auth_method 0 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:58:51.087+0000 7f8f6a329640 10 monclient: get_auth_request con 0x55f0b4f78f10 auth_method 0 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:58:51.087+0000 7f8f6d040800 10 monclient: build_initial_monmap 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:58:51.087+0000 7f8f6d040800 1 build_initial for_mkfs: 0 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:58:51.087+0000 7f8f6d040800 10 monclient: monmap: 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:51.431 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding auth protocol: cephx 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding auth protocol: cephx 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding auth protocol: cephx 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.432 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: crc 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:58:51.087+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7cf60) adding con mode: secure 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:58:51.088+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command objecter_requests cmddesc objecter_requests hook 0x55f0b4f803f0 EEXIST 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient: init 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding auth protocol: cephx 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding auth protocol: cephx 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding auth protocol: cephx 2024-09-19T13:58:51.433 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: crc 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4f7be08) adding con mode: secure 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:58:51.088+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:58:51.088+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.434 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:58:51.088+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command rotate-key cmddesc rotate-key hook 0x55f0b4f7bf50 EEXIST 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4fa4710 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4fa4af0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4fa3420 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:58:51.088+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.745919s 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4fa4710 auth_method 0 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.435 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request con 0x55f0b4fa3420 auth_method 0 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:58:51.089+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4fa4af0 auth_method 0 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.436 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:58:51.089+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_done global_id 7625 payload 824 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:58:51.089+0000 7f8f6ab2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: dump: 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.437 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:58:51.089+0000 7f8e54e01640 10 monclient: dump: 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.438 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:58:51.089+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7625 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:58:51.089+0000 7f8f6bb2c640 4 set_mon_vals no callback set 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:58:51.089+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:58:51.091+0000 7f8e54e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:58:51.091+0000 7f8e54e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.439 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:58:51.091+0000 7f8e54e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:58:51.091+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e44077480 auth_method 0 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: get_monmap_and_config 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: build_initial_monmap 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:58:51.091+0000 7f8f6d040800 1 build_initial for_mkfs: 0 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: monmap: 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:51.440 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding auth protocol: cephx 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding auth protocol: cephx 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding auth protocol: cephx 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: crc 2024-09-19T13:58:51.441 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc4390) adding con mode: secure 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:58:51.091+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:58:51.091+0000 7f8f6d040800 10 monclient: init 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding auth protocol: cephx 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding auth protocol: cephx 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding auth protocol: cephx 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.442 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: crc 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:58:51.091+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a400) adding con mode: secure 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:58:51.092+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:58:51.092+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:58:51.092+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command rotate-key cmddesc rotate-key hook 0x7ffc8068a548 EEXIST 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4ff8990 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4fe92e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4ff3dc0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.443 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:58:51.092+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.749470s 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4fe92e0 auth_method 0 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request con 0x55f0b4ff3dc0 auth_method 0 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4ff8990 auth_method 0 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.444 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:58:51.092+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:58:51.092+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient(hunting): handle_auth_done global_id 7628 payload 274 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:58:51.092+0000 7f8f6a329640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:58:51.092+0000 7f8f6a329640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.445 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: dump: 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7628 2024-09-19T13:58:51.446 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:58:51.093+0000 7f8e4e7fc640 10 monclient: dump: 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: get_monmap_and_config success 2024-09-19T13:58:51.447 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:58:51.093+0000 7f8f6d040800 4 set_mon_vals no callback set 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: shutdown 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: build_initial_monmap 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:58:51.093+0000 7f8f6d040800 1 build_initial for_mkfs: 0 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:58:51.093+0000 7f8f6d040800 10 monclient: monmap: 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding auth protocol: cephx 2024-09-19T13:58:51.448 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding auth protocol: cephx 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding auth protocol: cephx 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: crc 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:58:51.093+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fc7ef0) adding con mode: secure 2024-09-19T13:58:51.449 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:58:51.093+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:58:51.093+0000 7f8f6d040800 1 librados: starting msgr at 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:58:51.093+0000 7f8f6d040800 1 librados: starting objecter 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command objecter_requests cmddesc objecter_requests hook 0x55f0b4faaf40 EEXIST 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:58:51.094+0000 7f8f6d040800 1 librados: setting wanted keys 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:58:51.094+0000 7f8f6d040800 1 librados: calling monclient init 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient: init 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding auth protocol: cephx 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding auth protocol: cephx 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding auth protocol: cephx 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.450 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: crc 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 AuthRegistry(0x55f0b4fb8fd0) adding con mode: secure 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:58:51.094+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:58:51.094+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:58:51.094+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command rotate-key cmddesc rotate-key hook 0x55f0b4fb9118 EEXIST 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient: _reopen_session rank -1 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-c con 0x55f0b4fe92e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:58:51.451 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-b con 0x55f0b4ff3dc0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): picked mon.noname-a con 0x55f0b4ff8990 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): start opening mon connection 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): _renew_subs 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:58:51.094+0000 7f8f6d040800 10 monclient(hunting): authenticate will time out at 2144.751674s 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request con 0x55f0b4fe92e0 auth_method 0 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request con 0x55f0b4ff8990 auth_method 0 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.452 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:58:51.094+0000 7f8f6b32b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): get_auth_request con 0x55f0b4ff3dc0 auth_method 0 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:58:51.094+0000 7f8f6a329640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient(hunting): handle_auth_done global_id 7631 payload 824 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient: _finish_hunting 0 2024-09-19T13:58:51.453 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 1 monclient: found mon.noname-c 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:58:51.094+0000 7f8f6ab2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: dump: 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.454 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: _finish_auth 0 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: _check_auth_tickets 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:58:51.095+0000 7f8e4cff9640 10 monclient: dump: 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:58:51.455 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:58:51.095+0000 7f8f6d040800 5 monclient: authenticate success, global_id 7631 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:58:51.095+0000 7f8e4e7fc640 4 set_mon_vals no callback set 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _renew_subs 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:58:51.095+0000 7f8f6d040800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:58:51.095+0000 7f8f6d040800 1 librados: init done 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:58:51.095+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cr dump hook 0x55f0b4ff2a08 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:58:51.096+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:58:51.097+0000 7f8e4cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:58:51.097+0000 7f8e4cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.456 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:58:51.097+0000 7f8e4cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:58:51.097+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e34077570 auth_method 0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:58:51.097+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x55f0b5012710 auth_method 0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 realm 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:58:51.098+0000 7f8f6d040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:58:51.098+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:58:51.098+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x55f0b5016ac0 auth_method 0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:51.457 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:58:51.099+0000 7f8f6d040800 20 searching for the correct realm 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:58:51.099+0000 7f8f6a329640 10 monclient: get_auth_request con 0x55f0b501bbd0 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:58:51.100+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x7f8f60038070 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:58:51.101+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x7f8f64017020 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:58:51.101+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8f5c06b020 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:58:51.102+0000 7f8f6a329640 0 -- 172.21.15.94:0/1425265899 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f8f5c06b020 msgr2=0x7f8f5c0a4560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:58:51.102+0000 7f8e4cff9640 1 client.7631.objecter ms_handle_reset 0x7f8f5c06b020 session 0x7f8f5c005040 osd.4 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:58:51.102+0000 7f8e4cff9640 10 monclient: _renew_subs 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:58:51.102+0000 7f8e4cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:58:51.102+0000 7f8f6a329640 10 monclient: get_auth_request con 0x7f8e34087310 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:58:51.103+0000 7f8f6b32b640 10 monclient: get_auth_request con 0x7f8f60058950 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:58:51.105+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x7f8f600453f0 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:58:51.105+0000 7f8f6ab2a640 0 -- 172.21.15.94:0/1425265899 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8f600453f0 msgr2=0x7f8f60045870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:58:51.307+0000 7f8f6ab2a640 10 monclient: get_auth_request con 0x7f8f600453f0 auth_method 0 2024-09-19T13:58:51.458 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:58:51.311+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 zone default found 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:58:51.312+0000 7f8f6d040800 4 Realm: () 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:58:51.312+0000 7f8f6d040800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:51.459 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:58:51.312+0000 7f8f6d040800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:58:51.312+0000 7f8f6d040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 zonegroup default 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:58:51.312+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 started sync module instance, tier type = 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:58:51.313+0000 7f8f6d040800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=0 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=1 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=2 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=3 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=4 2024-09-19T13:58:51.460 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:58:51.323+0000 7f8f6d040800 20 add_watcher() i=5 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:58:51.324+0000 7f8f6d040800 20 add_watcher() i=6 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:58:51.324+0000 7f8f6d040800 20 add_watcher() i=7 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:58:51.324+0000 7f8f6d040800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding auth protocol: cephx 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding auth protocol: cephx 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding auth protocol: cephx 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.461 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:58:51.326+0000 7f8e217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: crc 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 AuthRegistry(0x7ffc8068a8d0) adding con mode: secure 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:58:51.326+0000 7f8f6d040800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache list hook 0x55f0b4ff1500 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache inspect hook 0x55f0b4ff1500 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache erase hook 0x55f0b4ff1500 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command cache zap hook 0x55f0b4ff1500 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 note: GC not initialized 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:58:51.326+0000 7f8d9bfff640 20 reqs_thread_entry: start 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace show hook 0x7f8f60013070 2024-09-19T13:58:51.462 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace history hook 0x7f8f60013070 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace active hook 0x7f8f60013070 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:58:51.326+0000 7f8f6d040800 5 asok(0x55f0b4d06410) register_command sync trace active_short hook 0x7f8f60013070 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:58:51.326+0000 7f8f6d040800 20 Filter name: none 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:58:51.327+0000 7f8d99ffb640 20 reqs_thread_entry: start 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:58:51.327+0000 7f8f6d040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:58:51.327+0000 7f8f6d040800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:58:51.328+0000 7f8f6d040800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.463 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:58:51.328+0000 7f8f6d040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:58:51.333+0000 7f8f6d040800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595166 cookie 94492317330848 notifier 7631 bl.length()=911 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:58:51.333+0000 7f8e4e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:58:51.464 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:58:51.334+0000 7f8f6d040800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.1 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.1 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.2 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.2 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.3 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.3 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.4 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.4 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.5 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.5 2024-09-19T13:58:51.465 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.6 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.6 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.7 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.7 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.8 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.8 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.9 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.9 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.10 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.10 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.11 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.11 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.12 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.12 2024-09-19T13:58:51.466 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.13 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.13 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:58:51.339+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:58:51.339+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:58:51.340+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:58:51.340+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:58:51.341+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:58:51.341+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:58:51.341+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:58:51.341+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:58:51.342+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.467 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:58:51.342+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:58:51.342+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:58:51.342+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:58:51.343+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:58:51.343+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:58:51.343+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:58:51.343+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:58:51.344+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:58:51.344+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:58:51.345+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:58:51.345+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:58:51.345+0000 7f8f6d040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:58:51.345+0000 7f8f6d040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.468 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:58:51.348+0000 7f8f6d040800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f6d040800 time 2024-09-19T13:58:51.349044+0000 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f7058c76a] 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:58:51.349+0000 7f8f6d040800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:58:51.469 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f8f6d040800 thread_name:radosgw-admin 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f6f23e6f0] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f6f28b99c] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f7058c7c4] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f7058c928] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0b28b3791] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55f0b28c2664] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f0b28c3504] 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:58:51.470 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f6f229590] 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:58:51.471 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:58:51.472 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:58:51.473 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:58:51.474 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:58:51.475 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:58:51.476 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d99ffb640 / http_manager 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8d9bfff640 / http_manager 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e217e2640 / rgw_dt_lg_renew 2024-09-19T13:58:51.477 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e4cff9640 / ms_dispatch 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e4e7fc640 / io_context_pool 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e54e01640 / ms_dispatch 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e57606640 / ms_dispatch 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8e58e09640 / io_context_pool 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6a329640 / msgr-worker-2 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6ab2a640 / msgr-worker-1 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6b32b640 / msgr-worker-0 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6bb2c640 / io_context_pool 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: 7f8f6d040800 / radosgw-admin 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:58:51.350645Z_d19c794e-97e5-412b-8397-0ed1314ce1f9/log 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:58:51.478 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.424+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.425+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.425+0000 7f11a6125800 20 realm 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.425+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.426+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.426+0000 7f11a6125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:51.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.426+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.426+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.426+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.427+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.427+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.427+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.427+0000 7f11a6125800 20 searching for the correct realm 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.430+0000 7f119bfff640 0 -- 172.21.15.94:0/2489776628 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f119406c630 msgr2=0x7f1194061e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:51.481 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.434+0000 7f11a1d33640 0 -- 172.21.15.94:0/2489776628 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f118c07b900 msgr2=0x7f118c0d39f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:51.643 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.640+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.644 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 zone default found 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 4 Realm: () 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 zonegroup default 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.641+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 started sync module instance, tier type = 2024-09-19T13:58:51.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.642+0000 7f11a6125800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=0 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=1 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=2 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=3 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=4 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=5 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=6 2024-09-19T13:58:51.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 20 add_watcher() i=7 2024-09-19T13:58:51.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.652+0000 7f11a6125800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:51.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.654+0000 7f10537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.654+0000 7f11a6125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.654+0000 7f11a6125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.654+0000 7f11a6125800 5 note: GC not initialized 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.654+0000 7f10527fc640 20 reqs_thread_entry: start 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.655+0000 7f11a6125800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.655+0000 7f11a6125800 20 Filter name: none 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.655+0000 7f0fc3fff640 20 reqs_thread_entry: start 2024-09-19T13:58:51.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.655+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.655+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.655+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.656+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:58:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.656+0000 7f11a6125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:51.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.656+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.657+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.657+0000 7f11a6125800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.657+0000 7f11a6125800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:58:51.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.657+0000 7f11a6125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:58:51.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.659+0000 7f10537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.661+0000 7f11a6125800 20 remove_watcher() i=0 2024-09-19T13:58:51.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.661+0000 7f11a6125800 2 removed watcher, disabling cache 2024-09-19T13:58:51.664 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.662+0000 7f11a6125800 20 remove_watcher() i=1 2024-09-19T13:58:51.665 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.663+0000 7f11a6125800 20 remove_watcher() i=2 2024-09-19T13:58:51.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.664+0000 7f11a6125800 20 remove_watcher() i=3 2024-09-19T13:58:51.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.665+0000 7f11a6125800 20 remove_watcher() i=4 2024-09-19T13:58:51.667 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.666+0000 7f11a6125800 20 remove_watcher() i=5 2024-09-19T13:58:51.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.666+0000 7f11a6125800 20 remove_watcher() i=6 2024-09-19T13:58:51.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.667+0000 7f11a6125800 20 remove_watcher() i=7 2024-09-19T13:58:51.689 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T13:58:51.717 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:58:51.717 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:58:51.755 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.753+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.754+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.754+0000 7fb4a3132800 20 realm 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.754+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.754+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.754+0000 7fb4a3132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.754+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.755+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.755+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.755+0000 7fb4a3132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.755+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.756+0000 7fb4a3132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:58:51.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.756+0000 7fb4a3132800 20 searching for the correct realm 2024-09-19T13:58:51.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.759+0000 7fb4966af640 0 -- 172.21.15.94:0/1151698325 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55a569cf8ea0 msgr2=0x55a569cfb2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:58:51.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.763+0000 7fb49eeb0640 0 -- 172.21.15.94:0/1151698325 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fb48806c8e0 msgr2=0x7fb48809a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:58:51.768 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.766+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:58:51.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:58:51.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 zone default found 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 4 Realm: () 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 zonegroup default 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.767+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.768+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.768+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.768+0000 7fb4a3132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.768+0000 7fb4a3132800 20 started sync module instance, tier type = 2024-09-19T13:58:51.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.768+0000 7fb4a3132800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:58:51.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=0 2024-09-19T13:58:51.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=1 2024-09-19T13:58:51.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=2 2024-09-19T13:58:51.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=3 2024-09-19T13:58:51.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=4 2024-09-19T13:58:51.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=5 2024-09-19T13:58:51.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.777+0000 7fb4a3132800 20 add_watcher() i=6 2024-09-19T13:58:51.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.778+0000 7fb4a3132800 20 add_watcher() i=7 2024-09-19T13:58:51.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.778+0000 7fb4a3132800 2 all 8 watchers are set, enabling cache 2024-09-19T13:58:51.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb3557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb4a3132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb4a3132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb4a3132800 5 note: GC not initialized 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb2cffff640 20 reqs_thread_entry: start 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb4a3132800 20 init_complete bucket index max shards: 11 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.780+0000 7fb4a3132800 20 Filter name: none 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb2cdffb640 20 reqs_thread_entry: start 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:58:51.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 20 rados->read ofs=0 len=0 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.781+0000 7fb4a3132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:58:51.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.782+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.783+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.783+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.783+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.783+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:58:51.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.783+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.783+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:58:51.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.784+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.784+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.784+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.784+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.784+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.784+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.785+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.785+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.785+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.785+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.785+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.785+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:58:51.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.786+0000 7fb4a3132800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.786+0000 7fb4a3132800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:58:51.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.787+0000 7fb3557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:58:51.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.789+0000 7fb4a3132800 20 remove_watcher() i=0 2024-09-19T13:58:51.791 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.789+0000 7fb4a3132800 2 removed watcher, disabling cache 2024-09-19T13:58:51.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.790+0000 7fb4a3132800 20 remove_watcher() i=1 2024-09-19T13:58:51.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.791+0000 7fb4a3132800 20 remove_watcher() i=2 2024-09-19T13:58:51.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.792+0000 7fb4a3132800 20 remove_watcher() i=3 2024-09-19T13:58:51.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.793+0000 7fb4a3132800 20 remove_watcher() i=4 2024-09-19T13:58:51.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.794+0000 7fb4a3132800 20 remove_watcher() i=5 2024-09-19T13:58:51.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.795+0000 7fb4a3132800 20 remove_watcher() i=6 2024-09-19T13:58:51.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:58:51.796+0000 7fb4a3132800 20 remove_watcher() i=7 2024-09-19T13:59:21.841 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:59:21.874 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:21.874 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:21.915 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.913+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 realm 2024-09-19T13:59:21.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.915+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.916+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:21.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.916+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.917+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:21.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.917+0000 7f9cdfb42800 20 searching for the correct realm 2024-09-19T13:59:21.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.920+0000 7f9cdce2b640 0 -- 172.21.15.94:0/2753559838 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x561d25283150 msgr2=0x561d25285540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:21.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.924+0000 7f9cdd62c640 0 -- 172.21.15.94:0/2753559838 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9cc8002bc0 msgr2=0x7f9cc8047810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.928+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:21.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 zone default found 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 4 Realm: () 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 zonegroup default 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.929+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:21.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 started sync module instance, tier type = 2024-09-19T13:59:21.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.930+0000 7f9cdfb42800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:21.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=0 2024-09-19T13:59:21.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=1 2024-09-19T13:59:21.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=2 2024-09-19T13:59:21.941 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=3 2024-09-19T13:59:21.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=4 2024-09-19T13:59:21.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=5 2024-09-19T13:59:21.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.939+0000 7f9cdfb42800 20 add_watcher() i=6 2024-09-19T13:59:21.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.940+0000 7f9cdfb42800 20 add_watcher() i=7 2024-09-19T13:59:21.942 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.940+0000 7f9cdfb42800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:21.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9b937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:21.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9cdfb42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:21.944 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9cdfb42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9cdfb42800 5 note: GC not initialized 2024-09-19T13:59:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9b927e4640 20 reqs_thread_entry: start 2024-09-19T13:59:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9cdfb42800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9cdfb42800 20 Filter name: none 2024-09-19T13:59:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9b03fff640 20 reqs_thread_entry: start 2024-09-19T13:59:21.945 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.942+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.943+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.943+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.944+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.944+0000 7f9cdfb42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.944+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.946 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.944+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:21.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.944+0000 7f9cdfb42800 20 rados->read ofs=0 len=0 2024-09-19T13:59:21.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.945+0000 7f9cdfb42800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:21.947 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.945+0000 7f9cdfb42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:21.949 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.947+0000 7f9b937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:21.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.949+0000 7f9cdfb42800 20 remove_watcher() i=0 2024-09-19T13:59:21.951 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.949+0000 7f9cdfb42800 2 removed watcher, disabling cache 2024-09-19T13:59:21.952 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.950+0000 7f9cdfb42800 20 remove_watcher() i=1 2024-09-19T13:59:21.953 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.951+0000 7f9cdfb42800 20 remove_watcher() i=2 2024-09-19T13:59:21.954 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.952+0000 7f9cdfb42800 20 remove_watcher() i=3 2024-09-19T13:59:21.955 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.953+0000 7f9cdfb42800 20 remove_watcher() i=4 2024-09-19T13:59:21.956 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.954+0000 7f9cdfb42800 20 remove_watcher() i=5 2024-09-19T13:59:21.957 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.955+0000 7f9cdfb42800 20 remove_watcher() i=6 2024-09-19T13:59:21.958 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:21.956+0000 7f9cdfb42800 20 remove_watcher() i=7 2024-09-19T13:59:21.994 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T13:59:22.023 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:22.023 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:22.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.057+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.058+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.058+0000 7f7125663800 20 realm 2024-09-19T13:59:22.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.058+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.059+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.059+0000 7f7125663800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:22.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.059+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.059+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.059+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.060+0000 7f7125663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.060+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.062 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.060+0000 7f7125663800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:22.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.060+0000 7f7125663800 20 searching for the correct realm 2024-09-19T13:59:22.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.063+0000 7f7122953640 0 -- 172.21.15.94:0/1610295359 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55dd2b466d40 msgr2=0x55dd2b469200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:22.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.067+0000 7f7123154640 0 -- 172.21.15.94:0/1610295359 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f710c08b910 msgr2=0x7f710c063450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.274+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 zone default found 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 4 Realm: () 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 zonegroup default 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.279 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 started sync module instance, tier type = 2024-09-19T13:59:22.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.275+0000 7f7125663800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:22.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=0 2024-09-19T13:59:22.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=1 2024-09-19T13:59:22.286 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=2 2024-09-19T13:59:22.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=3 2024-09-19T13:59:22.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=4 2024-09-19T13:59:22.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=5 2024-09-19T13:59:22.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.284+0000 7f7125663800 20 add_watcher() i=6 2024-09-19T13:59:22.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.285+0000 7f7125663800 20 add_watcher() i=7 2024-09-19T13:59:22.287 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.285+0000 7f7125663800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.287+0000 7f6fd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.287+0000 7f7125663800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.287+0000 7f7125663800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.287+0000 7f7125663800 5 note: GC not initialized 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.287+0000 7f6fd8fe1640 20 reqs_thread_entry: start 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.287+0000 7f7125663800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 20 Filter name: none 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f6f527fc640 20 reqs_thread_entry: start 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:22.290 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.291 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.288+0000 7f7125663800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:59:22.292 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.289+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:59:22.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.290+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:59:22.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.290+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:59:22.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.290+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:59:22.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.290+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:59:22.293 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.290+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.290+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.291+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.291+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.291+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.291+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.291+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:59:22.294 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.291+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:59:22.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.292+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:59:22.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.292+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:59:22.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.292+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:59:22.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.292+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:59:22.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.293+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:59:22.295 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.293+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:59:22.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.293+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:59:22.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.293+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:59:22.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.293+0000 7f7125663800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:59:22.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.293+0000 7f7125663800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:59:22.296 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.295+0000 7f6fd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.297+0000 7f7125663800 20 remove_watcher() i=0 2024-09-19T13:59:22.299 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.297+0000 7f7125663800 2 removed watcher, disabling cache 2024-09-19T13:59:22.300 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.298+0000 7f7125663800 20 remove_watcher() i=1 2024-09-19T13:59:22.301 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.299+0000 7f7125663800 20 remove_watcher() i=2 2024-09-19T13:59:22.302 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.300+0000 7f7125663800 20 remove_watcher() i=3 2024-09-19T13:59:22.303 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.301+0000 7f7125663800 20 remove_watcher() i=4 2024-09-19T13:59:22.304 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.302+0000 7f7125663800 20 remove_watcher() i=5 2024-09-19T13:59:22.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.303+0000 7f7125663800 20 remove_watcher() i=6 2024-09-19T13:59:22.305 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.304+0000 7f7125663800 20 remove_watcher() i=7 2024-09-19T13:59:22.317 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:59:22.346 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:22.346 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:22.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.380+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 realm 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.382+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.383+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.383+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.384+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:22.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.384+0000 7f5154925800 20 searching for the correct realm 2024-09-19T13:59:22.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.387+0000 7f514fd32640 0 -- 172.21.15.94:0/149837851 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f5140009040 msgr2=0x7f5140061800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.391+0000 7f514fd32640 0 -- 172.21.15.94:0/149837851 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f5018087390 msgr2=0x7f50180897c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.394+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 zone default found 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 4 Realm: () 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 zonegroup default 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.395+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.396+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.396+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.396+0000 7f5154925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.396+0000 7f5154925800 20 started sync module instance, tier type = 2024-09-19T13:59:22.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.396+0000 7f5154925800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:22.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=0 2024-09-19T13:59:22.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=1 2024-09-19T13:59:22.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=2 2024-09-19T13:59:22.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=3 2024-09-19T13:59:22.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=4 2024-09-19T13:59:22.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=5 2024-09-19T13:59:22.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.404+0000 7f5154925800 20 add_watcher() i=6 2024-09-19T13:59:22.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.405+0000 7f5154925800 20 add_watcher() i=7 2024-09-19T13:59:22.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.405+0000 7f5154925800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:22.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5006fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5154925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5154925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5154925800 5 note: GC not initialized 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5005fdb640 20 reqs_thread_entry: start 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5154925800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.407+0000 7f5154925800 20 Filter name: none 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f4f777fe640 20 reqs_thread_entry: start 2024-09-19T13:59:22.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f5154925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.408+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.409+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.409+0000 7f5154925800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.409+0000 7f5154925800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.412 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.409+0000 7f5154925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:22.413 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.411+0000 7f5006fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.413+0000 7f5154925800 20 remove_watcher() i=0 2024-09-19T13:59:22.415 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.413+0000 7f5154925800 2 removed watcher, disabling cache 2024-09-19T13:59:22.416 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.414+0000 7f5154925800 20 remove_watcher() i=1 2024-09-19T13:59:22.418 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.416+0000 7f5154925800 20 remove_watcher() i=2 2024-09-19T13:59:22.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.417+0000 7f5154925800 20 remove_watcher() i=3 2024-09-19T13:59:22.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.418+0000 7f5154925800 20 remove_watcher() i=4 2024-09-19T13:59:22.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.418+0000 7f5154925800 20 remove_watcher() i=5 2024-09-19T13:59:22.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.419+0000 7f5154925800 20 remove_watcher() i=6 2024-09-19T13:59:22.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.420+0000 7f5154925800 20 remove_watcher() i=7 2024-09-19T13:59:22.433 INFO:tasks.workunit.client.0.smithi094.stderr: test: duplicated entries should be purged before reshard 2024-09-19T13:59:22.434 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:59:22.463 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:22.463 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:22.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.497+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.499+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.499+0000 7fbe20540800 20 realm 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.499+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.500+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.500+0000 7fbe20540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.500+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.500+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.500+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.501+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.501+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.501+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:22.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.501+0000 7fbe20540800 20 searching for the correct realm 2024-09-19T13:59:22.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.505+0000 7fbe1cac1640 0 -- 172.21.15.94:0/3482912614 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fbe0406a010 msgr2=0x7fbe0404ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:22.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.710+0000 7fbe1cac1640 0 -- 172.21.15.94:0/3482912614 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fbe04048b30 msgr2=0x7fbe0405fec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:22.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:22.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:22.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:22.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:22.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:22.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.714+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:22.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 zone default found 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 4 Realm: () 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 zonegroup default 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.715+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.716+0000 7fbe20540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.716+0000 7fbe20540800 20 started sync module instance, tier type = 2024-09-19T13:59:22.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.716+0000 7fbe20540800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=0 2024-09-19T13:59:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=1 2024-09-19T13:59:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=2 2024-09-19T13:59:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=3 2024-09-19T13:59:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=4 2024-09-19T13:59:22.727 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=5 2024-09-19T13:59:22.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.725+0000 7fbe20540800 20 add_watcher() i=6 2024-09-19T13:59:22.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.726+0000 7fbe20540800 20 add_watcher() i=7 2024-09-19T13:59:22.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.726+0000 7fbe20540800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:22.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbcd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbe20540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbe20540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbe20540800 5 note: GC not initialized 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbcd1fdb640 20 reqs_thread_entry: start 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbe20540800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbe20540800 20 Filter name: none 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbc437fe640 20 reqs_thread_entry: start 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.728+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.729+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.729+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.729+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.734 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.729+0000 7fbe20540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:22.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.729+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.730+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.730+0000 7fbe20540800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.730+0000 7fbe20540800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.735 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.730+0000 7fbe20540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:22.736 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.732+0000 7fbcd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.734+0000 7fbe20540800 20 remove_watcher() i=0 2024-09-19T13:59:22.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.734+0000 7fbe20540800 2 removed watcher, disabling cache 2024-09-19T13:59:22.737 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.735+0000 7fbe20540800 20 remove_watcher() i=1 2024-09-19T13:59:22.738 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.736+0000 7fbe20540800 20 remove_watcher() i=2 2024-09-19T13:59:22.739 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.737+0000 7fbe20540800 20 remove_watcher() i=3 2024-09-19T13:59:22.740 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.738+0000 7fbe20540800 20 remove_watcher() i=4 2024-09-19T13:59:22.741 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.739+0000 7fbe20540800 20 remove_watcher() i=5 2024-09-19T13:59:22.742 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.740+0000 7fbe20540800 20 remove_watcher() i=6 2024-09-19T13:59:22.743 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.741+0000 7fbe20540800 20 remove_watcher() i=7 2024-09-19T13:59:22.754 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.754 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T13:59:22.754 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-19T13:59:22.754 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.755 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T13:59:22.789 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:22.790 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:22.826 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.824+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.825+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.825+0000 7fa561722800 20 realm 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.825+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.825+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.825+0000 7fa561722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.825+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.826+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.828 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.826+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.826+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.826+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.827+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:22.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.827+0000 7fa561722800 20 searching for the correct realm 2024-09-19T13:59:22.832 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.830+0000 7fa554c67640 0 -- 172.21.15.94:0/905649245 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55f65bf81b70 msgr2=0x55f65bf84030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.835 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.834+0000 7fa55d468640 0 -- 172.21.15.94:0/905649245 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa54804c400 msgr2=0x7fa54804c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:22.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:22.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.837+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:22.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 zone default found 2024-09-19T13:59:22.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 4 Realm: () 2024-09-19T13:59:22.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 zonegroup default 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 started sync module instance, tier type = 2024-09-19T13:59:22.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.839+0000 7fa561722800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=0 2024-09-19T13:59:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=1 2024-09-19T13:59:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=2 2024-09-19T13:59:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=3 2024-09-19T13:59:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=4 2024-09-19T13:59:22.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=5 2024-09-19T13:59:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=6 2024-09-19T13:59:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.849+0000 7fa561722800 20 add_watcher() i=7 2024-09-19T13:59:22.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.849+0000 7fa561722800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:22.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.850+0000 7fa4137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:22.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:22.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 5 note: GC not initialized 2024-09-19T13:59:22.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa4127e4640 20 reqs_thread_entry: start 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 20 Filter name: none 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa383fff640 20 reqs_thread_entry: start 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.851+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:22.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.852+0000 7fa561722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:22.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa561722800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa561722800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.859 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa561722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595168 cookie 94516593323632 notifier 8217 bl.length()=911 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:59:22.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:59:22.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:59:22.865 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa561722800 time 2024-09-19T13:59:22.864987+0000 2024-09-19T13:59:22.865 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa562f8c76a] 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:22.866 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.864+0000 7fa561722800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa561722800 time 2024-09-19T13:59:22.864987+0000 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa562f8c76a] 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:22.867 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:59:22.868 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:59:22.868 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.868 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:59:22.868 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa561722800 thread_name:radosgw-admin 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa561c3e6f0] 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa561c8b99c] 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa562f8c7c4] 2024-09-19T13:59:22.891 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.865+0000 7fa561722800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa561722800 thread_name:radosgw-admin 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:22.892 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa561c3e6f0] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa561c8b99c] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa562f8c7c4] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:59:22.893 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:59:22.807+0000 7fa44b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:59:22.807+0000 7fa44b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:59:22.807+0000 7fa44b606640 10 monclient: dump: 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.894 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:59:22.807+0000 7fa561722800 10 monclient: get_monmap_and_config success 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:59:22.807+0000 7fa561722800 4 set_mon_vals no callback set 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: shutdown 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:59:22.808+0000 7fa561722800 5 asok(0x55f65bc6c410) unregister_commands rotate-key 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:59:22.808+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.895 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding auth protocol: cephx 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding auth protocol: cephx 2024-09-19T13:59:22.896 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding auth protocol: cephx 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.897 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:59:22.808+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: starting msgr at 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: starting objecter 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:59:22.808+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command objecter_requests hook 0x55f65be8fa70 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: setting wanted keys 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: calling monclient init 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding auth protocol: cephx 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding auth protocol: cephx 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding auth protocol: cephx 2024-09-19T13:59:22.898 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.899 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:59:22.809+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:59:22.809+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:59:22.809+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key hook 0x55f65be8e598 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bdd0d90 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bdd3d80 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bddc5a0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.900 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.466395s 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bdd0d90 auth_method 0 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bdd3d80 auth_method 0 2024-09-19T13:59:22.901 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_done global_id 7736 payload 824 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:59:22.809+0000 7fa55d468640 1 monclient: found mon.noname-c 2024-09-19T13:59:22.902 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: dump: 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.903 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: dump: 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.904 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:59:22.809+0000 7fa561722800 5 monclient: authenticate success, global_id 7736 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:59:22.809+0000 7fa44b606640 4 set_mon_vals no callback set 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:59:22.810+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:59:22.810+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.905 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:59:22.810+0000 7fa561722800 1 librados: init done 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:59:22.811+0000 7fa449e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:59:22.811+0000 7fa449e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:59:22.811+0000 7fa449e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:59:22.812+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa444077570 auth_method 0 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:59:22.812+0000 7fa55dc69640 10 monclient: get_auth_request con 0x55f65bebba80 auth_method 0 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:59:22.813+0000 7fa55d468640 10 monclient: get_auth_request con 0x55f65bed95d0 auth_method 0 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:59:22.814+0000 7fa554c67640 10 monclient: get_auth_request con 0x55f65bede770 auth_method 0 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:59:22.814+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:59:22.814+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:59:22.814+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.906 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding auth protocol: cephx 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding auth protocol: cephx 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding auth protocol: cephx 2024-09-19T13:59:22.907 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.908 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:59:22.815+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:59:22.815+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command objecter_requests cmddesc objecter_requests hook 0x55f65bee5d40 EEXIST 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding auth protocol: cephx 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding auth protocol: cephx 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding auth protocol: cephx 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.909 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:59:22.815+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:59:22.815+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:59:22.815+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key cmddesc rotate-key hook 0x55f65bee18a0 EEXIST 2024-09-19T13:59:22.910 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bf0a060 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bf0a440 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bf08d70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.473020s 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): get_auth_request con 0x55f65bf08d70 auth_method 0 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.911 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bf0a060 auth_method 0 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.912 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bf0a440 auth_method 0 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:59:22.816+0000 7fa55dc69640 1 monclient: found mon.noname-c 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: dump: 2024-09-19T13:59:22.913 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.914 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: dump: 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.915 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:59:22.816+0000 7fa561722800 5 monclient: authenticate success, global_id 7739 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:59:22.816+0000 7fa55e46a640 4 set_mon_vals no callback set 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:59:22.818+0000 7fa442ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:22.916 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:59:22.818+0000 7fa442ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:59:22.818+0000 7fa442ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:59:22.818+0000 7fa55d468640 10 monclient: get_auth_request con 0x7fa438077480 auth_method 0 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:59:22.818+0000 7fa561722800 10 monclient: get_monmap_and_config 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:59:22.818+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:59:22.818+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:59:22.818+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.917 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding auth protocol: cephx 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding auth protocol: cephx 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding auth protocol: cephx 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.918 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:59:22.819+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.919 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding auth protocol: cephx 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding auth protocol: cephx 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding auth protocol: cephx 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.920 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:59:22.819+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:59:22.819+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:59:22.819+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key cmddesc rotate-key hook 0x7fff3f810fb8 EEXIST 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bf5e620 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bf2e430 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bf599e0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.921 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.476918s 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bf5e620 auth_method 0 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bf2e430 auth_method 0 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.922 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): get_auth_request con 0x55f65bf599e0 auth_method 0 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.923 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_done global_id 8214 payload 274 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:59:22.820+0000 7fa55d468640 1 monclient: found mon.noname-a 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: dump: 2024-09-19T13:59:22.924 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.925 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:59:22.820+0000 7fa561722800 5 monclient: authenticate success, global_id 8214 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:59:22.820+0000 7fa561722800 10 monclient: get_monmap_and_config success 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:59:22.820+0000 7fa561722800 4 set_mon_vals no callback set 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: dump: 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.926 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:59:22.820+0000 7fa561722800 10 monclient: shutdown 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:59:22.821+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:59:22.821+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:59:22.821+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.927 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding auth protocol: cephx 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding auth protocol: cephx 2024-09-19T13:59:22.928 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding auth protocol: cephx 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.929 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:59:22.821+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: starting msgr at 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: starting objecter 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:59:22.821+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command objecter_requests cmddesc objecter_requests hook 0x55f65bf09460 EEXIST 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: setting wanted keys 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: calling monclient init 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:59:22.821+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding auth protocol: cephx 2024-09-19T13:59:22.930 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding auth protocol: cephx 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding auth protocol: cephx 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.931 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:59:22.821+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:59:22.821+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:59:22.822+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key cmddesc rotate-key hook 0x55f65bf1ea68 EEXIST 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bf2e430 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bf599e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bf5e620 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.932 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.479061s 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bf599e0 auth_method 0 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bf2e430 auth_method 0 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.933 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.934 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.934 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.934 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.934 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.934 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): get_auth_request con 0x55f65bf5e620 auth_method 0 2024-09-19T13:59:22.935 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_done global_id 8217 payload 824 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:59:22.822+0000 7fa55d468640 1 monclient: found mon.noname-a 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.936 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: dump: 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.937 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:59:22.822+0000 7fa561722800 5 monclient: authenticate success, global_id 8217 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: dump: 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.938 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:59:22.822+0000 7fa440ff9640 4 set_mon_vals no callback set 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:22.939 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:59:22.822+0000 7fa561722800 1 librados: init done 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:59:22.822+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cr dump hook 0x55f65bf4fc38 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:59:22.824+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:59:22.824+0000 7fa42effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:59:22.824+0000 7fa42effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:59:22.824+0000 7fa42effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:59:22.825+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa428077570 auth_method 0 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:59:22.825+0000 7fa55dc69640 10 monclient: get_auth_request con 0x55f65bf78730 auth_method 0 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:59:22.825+0000 7fa561722800 20 realm 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.940 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:59:22.825+0000 7fa561722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:59:22.826+0000 7fa55d468640 10 monclient: get_auth_request con 0x55f65bf7ca30 auth_method 0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:59:22.827+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:59:22.827+0000 7fa561722800 20 searching for the correct realm 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:59:22.827+0000 7fa554c67640 10 monclient: get_auth_request con 0x55f65bf81b70 auth_method 0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:59:22.828+0000 7fa55dc69640 10 monclient: get_auth_request con 0x7fa54801dc20 auth_method 0 2024-09-19T13:59:22.941 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:59:22.828+0000 7fa55d468640 10 monclient: get_auth_request con 0x7fa558074070 auth_method 0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:59:22.829+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa55009e040 auth_method 0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:59:22.830+0000 7fa554c67640 0 -- 172.21.15.94:0/905649245 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55f65bf81b70 msgr2=0x55f65bf84030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:59:22.830+0000 7fa42effd640 1 client.8217.objecter ms_handle_reset 0x55f65bf81b70 session 0x55f65bf814f0 osd.3 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:59:22.830+0000 7fa42effd640 10 monclient: _renew_subs 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:59:22.830+0000 7fa42effd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:59:22.831+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa428087390 auth_method 0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:59:22.831+0000 7fa55dc69640 10 monclient: get_auth_request con 0x7fa54800dc20 auth_method 0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:59:22.833+0000 7fa55d468640 10 monclient: get_auth_request con 0x7fa54804c400 auth_method 0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:59:22.834+0000 7fa55d468640 0 -- 172.21.15.94:0/905649245 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa54804c400 msgr2=0x7fa54804c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:59:22.834+0000 7fa42effd640 1 client.8217.objecter ms_handle_reset 0x7fa54804c400 session 0x7fa54802e5e0 osd.0 2024-09-19T13:59:22.942 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:59:22.834+0000 7fa55d468640 10 monclient: get_auth_request con 0x55f65bf81b70 auth_method 0 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:59:22.837+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.943 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:59:22.838+0000 7fa561722800 20 zone default found 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:59:22.838+0000 7fa561722800 4 Realm: () 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:59:22.838+0000 7fa561722800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:59:22.838+0000 7fa561722800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:59:22.838+0000 7fa561722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:59:22.838+0000 7fa561722800 20 zonegroup default 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.944 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:59:22.839+0000 7fa561722800 20 started sync module instance, tier type = 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:59:22.839+0000 7fa561722800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=0 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=1 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=2 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=3 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=4 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=5 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=6 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:59:22.849+0000 7fa561722800 20 add_watcher() i=7 2024-09-19T13:59:22.945 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:59:22.849+0000 7fa561722800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding auth protocol: cephx 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding auth protocol: cephx 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding auth protocol: cephx 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:59:22.850+0000 7fa4137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:22.946 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:59:22.851+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:59:22.851+0000 7fa561722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:59:22.851+0000 7fa561722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache list hook 0x55f65bf549f0 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache inspect hook 0x55f65bf549f0 2024-09-19T13:59:22.947 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache erase hook 0x55f65bf549f0 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache zap hook 0x55f65bf549f0 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:59:22.851+0000 7fa561722800 5 note: GC not initialized 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:59:22.851+0000 7fa4127e4640 20 reqs_thread_entry: start 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace show hook 0x7fa5500674b0 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace history hook 0x7fa5500674b0 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace active hook 0x7fa5500674b0 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace active_short hook 0x7fa5500674b0 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:59:22.851+0000 7fa561722800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:59:22.851+0000 7fa561722800 20 Filter name: none 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:59:22.851+0000 7fa383fff640 20 reqs_thread_entry: start 2024-09-19T13:59:22.948 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:59:22.851+0000 7fa561722800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:59:22.851+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:59:22.852+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:59:22.852+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:59:22.852+0000 7fa561722800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:59:22.852+0000 7fa561722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:59:22.852+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:59:22.852+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:59:22.852+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:59:22.852+0000 7fa561722800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:59:22.852+0000 7fa561722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:22.949 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:59:22.852+0000 7fa561722800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:59:22.852+0000 7fa561722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:59:22.857+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:59:22.857+0000 7fa561722800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:59:22.857+0000 7fa561722800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:59:22.857+0000 7fa561722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595168 cookie 94516593323632 notifier 8217 bl.length()=911 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:59:22.950 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:59:22.864+0000 7fa561722800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa561722800 time 2024-09-19T13:59:22.864987+0000 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa562f8c76a] 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:59:22.951 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:59:22.865+0000 7fa561722800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa561722800 thread_name:radosgw-admin 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa561c3e6f0] 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa561c8b99c] 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:22.952 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa562f8c7c4] 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:59:22.953 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:59:22.954 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:59:22.955 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:59:22.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:59:22.957 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:59:22.958 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:59:22.959 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:59:22.960 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa383fff640 / http_manager 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa4127e4640 / http_manager 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa4137e6640 / rgw_dt_lg_renew 2024-09-19T13:59:22.961 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa42effd640 / ms_dispatch 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa42ffff640 / io_context_pool 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa440ff9640 / io_context_pool 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa442ffd640 / ms_dispatch 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa449e03640 / ms_dispatch 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa44b606640 / io_context_pool 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa554c67640 / msgr-worker-2 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa55d468640 / msgr-worker-1 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa55dc69640 / msgr-worker-0 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa55e46a640 / io_context_pool 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa561722800 / radosgw-admin 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:59:22.962 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.150332.log 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:59:22.807+0000 7fa44b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:59:22.807+0000 7fa44b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:59:22.807+0000 7fa44b606640 10 monclient: dump: 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.963 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:59:22.807+0000 7fa561722800 10 monclient: get_monmap_and_config success 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:59:22.807+0000 7fa561722800 4 set_mon_vals no callback set 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: shutdown 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:59:22.808+0000 7fa561722800 5 asok(0x55f65bc6c410) unregister_commands rotate-key 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:59:22.808+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.964 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding auth protocol: cephx 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding auth protocol: cephx 2024-09-19T13:59:22.965 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding auth protocol: cephx 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: crc 2024-09-19T13:59:22.966 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be93bc0) adding con mode: secure 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:59:22.808+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: starting msgr at 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: starting objecter 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:59:22.808+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command objecter_requests hook 0x55f65be8fa70 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: setting wanted keys 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:59:22.808+0000 7fa561722800 1 librados: calling monclient init 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:59:22.808+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding auth protocol: cephx 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding auth protocol: cephx 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding auth protocol: cephx 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.967 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: crc 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:59:22.808+0000 7fa561722800 5 AuthRegistry(0x55f65be8e450) adding con mode: secure 2024-09-19T13:59:22.968 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:59:22.809+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:59:22.809+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:59:22.809+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key hook 0x55f65be8e598 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bdd0d90 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bdd3d80 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bddc5a0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.969 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.466395s 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bdd0d90 auth_method 0 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bdd3d80 auth_method 0 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.970 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:59:22.809+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient(hunting): handle_auth_done global_id 7736 payload 824 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:59:22.809+0000 7fa55d468640 1 monclient: found mon.noname-c 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:59:22.809+0000 7fa55d468640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: dump: 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.971 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.972 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:59:22.809+0000 7fa449e03640 10 monclient: dump: 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.973 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:59:22.809+0000 7fa561722800 5 monclient: authenticate success, global_id 7736 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:59:22.809+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:59:22.809+0000 7fa44b606640 4 set_mon_vals no callback set 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:59:22.810+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:59:22.810+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:59:22.810+0000 7fa561722800 1 librados: init done 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:59:22.811+0000 7fa449e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:59:22.811+0000 7fa449e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:59:22.811+0000 7fa449e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:59:22.812+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa444077570 auth_method 0 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:59:22.812+0000 7fa55dc69640 10 monclient: get_auth_request con 0x55f65bebba80 auth_method 0 2024-09-19T13:59:22.974 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:59:22.813+0000 7fa55d468640 10 monclient: get_auth_request con 0x55f65bed95d0 auth_method 0 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:59:22.814+0000 7fa554c67640 10 monclient: get_auth_request con 0x55f65bede770 auth_method 0 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:59:22.814+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:59:22.814+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:59:22.814+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.975 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding auth protocol: cephx 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding auth protocol: cephx 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding auth protocol: cephx 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.976 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: crc 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:59:22.814+0000 7fa561722800 5 AuthRegistry(0x55f65bee28b0) adding con mode: secure 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:59:22.815+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:59:22.815+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command objecter_requests cmddesc objecter_requests hook 0x55f65bee5d40 EEXIST 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding auth protocol: cephx 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding auth protocol: cephx 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding auth protocol: cephx 2024-09-19T13:59:22.977 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: crc 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:59:22.815+0000 7fa561722800 5 AuthRegistry(0x55f65bee1758) adding con mode: secure 2024-09-19T13:59:22.978 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:59:22.815+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:59:22.815+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:59:22.815+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key cmddesc rotate-key hook 0x55f65bee18a0 EEXIST 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bf0a060 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:59:22.815+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bf0a440 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bf08d70 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.979 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.473020s 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): get_auth_request con 0x55f65bf08d70 auth_method 0 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bf0a060 auth_method 0 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.980 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:59:22.816+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bf0a440 auth_method 0 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:59:22.816+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:59:22.816+0000 7fa55dc69640 1 monclient: found mon.noname-c 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:59:22.816+0000 7fa55dc69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.981 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: dump: 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.982 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:59:22.816+0000 7fa442ffd640 10 monclient: dump: 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.983 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:59:22.816+0000 7fa561722800 5 monclient: authenticate success, global_id 7739 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:59:22.816+0000 7fa55e46a640 4 set_mon_vals no callback set 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:59:22.816+0000 7fa561722800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T13:59:22.984 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:59:22.818+0000 7fa442ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:59:22.818+0000 7fa442ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:59:22.818+0000 7fa442ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:59:22.818+0000 7fa55d468640 10 monclient: get_auth_request con 0x7fa438077480 auth_method 0 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:59:22.818+0000 7fa561722800 10 monclient: get_monmap_and_config 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:59:22.818+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:59:22.818+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:59:22.818+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.985 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding auth protocol: cephx 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding auth protocol: cephx 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding auth protocol: cephx 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.986 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: crc 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:59:22.818+0000 7fa561722800 5 AuthRegistry(0x55f65bf29f80) adding con mode: secure 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:59:22.819+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding auth protocol: cephx 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding auth protocol: cephx 2024-09-19T13:59:22.987 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding auth protocol: cephx 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.988 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: crc 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:59:22.819+0000 7fa561722800 5 AuthRegistry(0x7fff3f810e70) adding con mode: secure 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:59:22.819+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:59:22.819+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:59:22.819+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key cmddesc rotate-key hook 0x7fff3f810fb8 EEXIST 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bf5e620 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bf2e430 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bf599e0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.989 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:59:22.819+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.476918s 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bf5e620 auth_method 0 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bf2e430 auth_method 0 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.990 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): get_auth_request con 0x55f65bf599e0 auth_method 0 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:59:22.820+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:22.991 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:59:22.820+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient(hunting): handle_auth_done global_id 8214 payload 274 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient: _finish_hunting 0 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:59:22.820+0000 7fa55d468640 1 monclient: found mon.noname-a 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:59:22.820+0000 7fa55d468640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: dump: 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.992 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: _finish_auth 0 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: _check_auth_tickets 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:59:22.820+0000 7fa561722800 5 monclient: authenticate success, global_id 8214 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:59:22.820+0000 7fa561722800 10 monclient: get_monmap_and_config success 2024-09-19T13:59:22.993 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:59:22.820+0000 7fa561722800 4 set_mon_vals no callback set 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:59:22.820+0000 7fa440ff9640 10 monclient: dump: 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:22.994 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:59:22.820+0000 7fa561722800 10 monclient: shutdown 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:59:22.821+0000 7fa561722800 10 monclient: build_initial_monmap 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:59:22.821+0000 7fa561722800 1 build_initial for_mkfs: 0 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:59:22.821+0000 7fa561722800 10 monclient: monmap: 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:22.995 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding auth protocol: cephx 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding auth protocol: cephx 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding auth protocol: cephx 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.996 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: crc 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf2f270) adding con mode: secure 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:59:22.821+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: starting msgr at 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: starting objecter 2024-09-19T13:59:22.997 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:59:22.821+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command objecter_requests cmddesc objecter_requests hook 0x55f65bf09460 EEXIST 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: setting wanted keys 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:59:22.821+0000 7fa561722800 1 librados: calling monclient init 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:59:22.821+0000 7fa561722800 10 monclient: init 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding auth protocol: cephx 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding auth protocol: cephx 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding auth protocol: cephx 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.998 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: crc 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:59:22.821+0000 7fa561722800 5 AuthRegistry(0x55f65bf1e920) adding con mode: secure 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:59:22.821+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:59:22.821+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:59:22.822+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command rotate-key cmddesc rotate-key hook 0x55f65bf1ea68 EEXIST 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:59:22.999 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): picked mon.noname-a con 0x55f65bf2e430 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): picked mon.noname-c con 0x55f65bf599e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): picked mon.noname-b con 0x55f65bf5e620 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient(hunting): authenticate will time out at 2176.479061s 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): get_auth_request con 0x55f65bf599e0 auth_method 0 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:23.000 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): get_auth_request con 0x55f65bf2e430 auth_method 0 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:59:22.822+0000 7fa554c67640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:23.001 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): get_auth_request con 0x55f65bf5e620 auth_method 0 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:59:22.822+0000 7fa55dc69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient(hunting): handle_auth_done global_id 8217 payload 824 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient: _finish_hunting 0 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:59:22.822+0000 7fa55d468640 1 monclient: found mon.noname-a 2024-09-19T13:59:23.002 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:59:22.822+0000 7fa55d468640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: dump: 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:23.003 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: _finish_auth 0 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: _check_auth_tickets 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:59:22.822+0000 7fa561722800 5 monclient: authenticate success, global_id 8217 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:59:22.822+0000 7fa42effd640 10 monclient: dump: 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:23.004 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:59:22.822+0000 7fa440ff9640 4 set_mon_vals no callback set 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _renew_subs 2024-09-19T13:59:23.005 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:59:22.822+0000 7fa561722800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:59:22.822+0000 7fa561722800 1 librados: init done 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:59:22.822+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cr dump hook 0x55f65bf4fc38 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:59:22.824+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:59:22.824+0000 7fa42effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:59:22.824+0000 7fa42effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:59:22.824+0000 7fa42effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:59:22.825+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa428077570 auth_method 0 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:59:22.825+0000 7fa55dc69640 10 monclient: get_auth_request con 0x55f65bf78730 auth_method 0 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:59:22.825+0000 7fa561722800 20 realm 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.006 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:59:22.825+0000 7fa561722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:59:22.825+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:59:22.826+0000 7fa55d468640 10 monclient: get_auth_request con 0x55f65bf7ca30 auth_method 0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:59:22.826+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:59:22.827+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:59:22.827+0000 7fa561722800 20 searching for the correct realm 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:59:22.827+0000 7fa554c67640 10 monclient: get_auth_request con 0x55f65bf81b70 auth_method 0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:59:22.828+0000 7fa55dc69640 10 monclient: get_auth_request con 0x7fa54801dc20 auth_method 0 2024-09-19T13:59:23.007 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:59:22.828+0000 7fa55d468640 10 monclient: get_auth_request con 0x7fa558074070 auth_method 0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:59:22.829+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa55009e040 auth_method 0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:59:22.830+0000 7fa554c67640 0 -- 172.21.15.94:0/905649245 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55f65bf81b70 msgr2=0x55f65bf84030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:59:22.830+0000 7fa42effd640 1 client.8217.objecter ms_handle_reset 0x55f65bf81b70 session 0x55f65bf814f0 osd.3 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:59:22.830+0000 7fa42effd640 10 monclient: _renew_subs 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:59:22.830+0000 7fa42effd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:59:22.831+0000 7fa554c67640 10 monclient: get_auth_request con 0x7fa428087390 auth_method 0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:59:22.831+0000 7fa55dc69640 10 monclient: get_auth_request con 0x7fa54800dc20 auth_method 0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:59:22.833+0000 7fa55d468640 10 monclient: get_auth_request con 0x7fa54804c400 auth_method 0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:59:22.834+0000 7fa55d468640 0 -- 172.21.15.94:0/905649245 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa54804c400 msgr2=0x7fa54804c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:59:22.834+0000 7fa42effd640 1 client.8217.objecter ms_handle_reset 0x7fa54804c400 session 0x7fa54802e5e0 osd.0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:59:22.834+0000 7fa55d468640 10 monclient: get_auth_request con 0x55f65bf81b70 auth_method 0 2024-09-19T13:59:23.008 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:59:22.837+0000 7fa561722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:59:22.837+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.009 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:59:22.838+0000 7fa561722800 20 zone default found 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:59:22.838+0000 7fa561722800 4 Realm: () 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:59:22.838+0000 7fa561722800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:59:22.838+0000 7fa561722800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:59:22.838+0000 7fa561722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:59:22.838+0000 7fa561722800 20 zonegroup default 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:59:22.838+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.010 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:59:22.839+0000 7fa561722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:59:22.839+0000 7fa561722800 20 started sync module instance, tier type = 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:59:22.839+0000 7fa561722800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=0 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=1 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=2 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=3 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=4 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=5 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:59:22.848+0000 7fa561722800 20 add_watcher() i=6 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:59:22.849+0000 7fa561722800 20 add_watcher() i=7 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:59:22.849+0000 7fa561722800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:23.011 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding auth protocol: cephx 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding auth protocol: cephx 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding auth protocol: cephx 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:59:22.850+0000 7fa4137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:23.012 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: crc 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:59:22.850+0000 7fa561722800 5 AuthRegistry(0x7fff3f811340) adding con mode: secure 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:59:22.851+0000 7fa561722800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:59:22.851+0000 7fa561722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:59:22.851+0000 7fa561722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache list hook 0x55f65bf549f0 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache inspect hook 0x55f65bf549f0 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache erase hook 0x55f65bf549f0 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command cache zap hook 0x55f65bf549f0 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:59:22.851+0000 7fa561722800 5 note: GC not initialized 2024-09-19T13:59:23.013 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:59:22.851+0000 7fa4127e4640 20 reqs_thread_entry: start 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace show hook 0x7fa5500674b0 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace history hook 0x7fa5500674b0 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace active hook 0x7fa5500674b0 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:59:22.851+0000 7fa561722800 5 asok(0x55f65bc6c410) register_command sync trace active_short hook 0x7fa5500674b0 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:59:22.851+0000 7fa561722800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:59:22.851+0000 7fa561722800 20 Filter name: none 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:59:22.851+0000 7fa383fff640 20 reqs_thread_entry: start 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:59:22.851+0000 7fa561722800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:59:22.851+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:59:22.852+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:59:22.852+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:23.014 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:59:22.852+0000 7fa561722800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:59:22.852+0000 7fa561722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:59:22.852+0000 7fa561722800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:59:22.852+0000 7fa561722800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:59:22.852+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:59:22.852+0000 7fa561722800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:59:22.852+0000 7fa561722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:59:22.852+0000 7fa561722800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:59:22.852+0000 7fa561722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:59:22.857+0000 7fa561722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:59:22.857+0000 7fa561722800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:59:22.857+0000 7fa561722800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:23.015 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:59:22.857+0000 7fa561722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595168 cookie 94516593323632 notifier 8217 bl.length()=911 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:59:22.857+0000 7fa42ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:59:22.858+0000 7fa561722800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:59:22.864+0000 7fa561722800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa561722800 time 2024-09-19T13:59:22.864987+0000 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:23.016 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa562f8c76a] 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:59:22.865+0000 7fa561722800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:59:23.017 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fa561722800 thread_name:radosgw-admin 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa561c3e6f0] 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa561c8b99c] 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa562f8c7c4] 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa562f8c928] 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f659a4c791] 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f659a5c4aa] 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T13:59:23.018 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa561c29590] 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:59:23.019 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:59:23.020 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:59:23.021 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:59:23.022 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:59:23.023 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:59:23.024 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:59:23.025 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:59:23.026 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa383fff640 / http_manager 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa4127e4640 / http_manager 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa4137e6640 / rgw_dt_lg_renew 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa42effd640 / ms_dispatch 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa42ffff640 / io_context_pool 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa440ff9640 / io_context_pool 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa442ffd640 / ms_dispatch 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa449e03640 / ms_dispatch 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa44b606640 / io_context_pool 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa554c67640 / msgr-worker-2 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa55d468640 / msgr-worker-1 2024-09-19T13:59:23.027 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa55dc69640 / msgr-worker-0 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa55e46a640 / io_context_pool 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr: 7fa561722800 / radosgw-admin 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:59:22.866415Z_9ef56cb3-a409-43c6-bc42-58f6eeaae1d4/log 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:59:23.028 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.941+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.942+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.942+0000 7ffa79b40800 20 realm 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.942+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.943+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.943+0000 7ffa79b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:23.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.943+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.943+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.943+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.944+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.944+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.944+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.944+0000 7ffa79b40800 20 searching for the correct realm 2024-09-19T13:59:23.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:22.946+0000 7ffa758ed640 0 -- 172.21.15.94:0/1127406716 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7ffa70017020 msgr2=0x7ffa70018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:23.153 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.151+0000 7ffa760ee640 0 -- 172.21.15.94:0/1127406716 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7ffa6c034040 msgr2=0x7ffa6c040920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:23.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.156+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 zone default found 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 4 Realm: () 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 zonegroup default 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.157+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.158+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.158+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.162 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.158+0000 7ffa79b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.158+0000 7ffa79b40800 20 started sync module instance, tier type = 2024-09-19T13:59:23.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.158+0000 7ffa79b40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:23.168 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=0 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=1 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=2 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=3 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=4 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=5 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.166+0000 7ffa79b40800 20 add_watcher() i=6 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.167+0000 7ffa79b40800 20 add_watcher() i=7 2024-09-19T13:59:23.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.167+0000 7ffa79b40800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:23.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ff9277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:23.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ffa79b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:23.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ffa79b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:23.171 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ffa79b40800 5 note: GC not initialized 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ff9267fc640 20 reqs_thread_entry: start 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ffa79b40800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ffa79b40800 20 Filter name: none 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.169+0000 7ff897fff640 20 reqs_thread_entry: start 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.170+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.170+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:23.172 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.170+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:23.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:23.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:23.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:23.174 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.171+0000 7ffa79b40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:59:23.175 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.173+0000 7ff9277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:23.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.175+0000 7ffa79b40800 20 remove_watcher() i=0 2024-09-19T13:59:23.177 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.175+0000 7ffa79b40800 2 removed watcher, disabling cache 2024-09-19T13:59:23.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.176+0000 7ffa79b40800 20 remove_watcher() i=1 2024-09-19T13:59:23.178 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.177+0000 7ffa79b40800 20 remove_watcher() i=2 2024-09-19T13:59:23.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.178+0000 7ffa79b40800 20 remove_watcher() i=3 2024-09-19T13:59:23.180 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.179+0000 7ffa79b40800 20 remove_watcher() i=4 2024-09-19T13:59:23.181 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.180+0000 7ffa79b40800 20 remove_watcher() i=5 2024-09-19T13:59:23.182 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.180+0000 7ffa79b40800 20 remove_watcher() i=6 2024-09-19T13:59:23.183 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.181+0000 7ffa79b40800 20 remove_watcher() i=7 2024-09-19T13:59:23.202 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T13:59:23.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:23.231 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:23.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.265+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.266+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.266+0000 7f13d0f3e800 20 realm 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.266+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.267+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.267+0000 7f13d0f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.267+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.267+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.267+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.268+0000 7f13d0f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:23.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.268+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.268+0000 7f13d0f3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:23.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.268+0000 7f13d0f3e800 20 searching for the correct realm 2024-09-19T13:59:23.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.270+0000 7f13ccc86640 0 -- 172.21.15.94:0/78119724 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x5634df270de0 msgr2=0x7f13c4014460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:23.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.475+0000 7f13cd487640 0 -- 172.21.15.94:0/78119724 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f13c00b5eb0 msgr2=0x7f13c00ab730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:23.482 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.480+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.483 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 zone default found 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 4 Realm: () 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:23.485 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 zonegroup default 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.481+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.482+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.482+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.482+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.482+0000 7f13d0f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.482+0000 7f13d0f3e800 20 started sync module instance, tier type = 2024-09-19T13:59:23.486 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.482+0000 7f13d0f3e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:23.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=0 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=1 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=2 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=3 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=4 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=5 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.490+0000 7f13d0f3e800 20 add_watcher() i=6 2024-09-19T13:59:23.493 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.491+0000 7f13d0f3e800 20 add_watcher() i=7 2024-09-19T13:59:23.494 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.491+0000 7f13d0f3e800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:23.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.493+0000 7f1282fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:23.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.493+0000 7f13d0f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:23.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.493+0000 7f13d0f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:23.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.493+0000 7f13d0f3e800 5 note: GC not initialized 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.493+0000 7f1281fe3640 20 reqs_thread_entry: start 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.493+0000 7f13d0f3e800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 20 Filter name: none 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f11f37fe640 20 reqs_thread_entry: start 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 20 rados->read ofs=0 len=0 2024-09-19T13:59:23.497 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.494+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.495+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:59:23.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.495+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:59:23.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.495+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:59:23.499 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.495+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.495+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.495+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.496+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.496+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.496+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.496+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.497+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.497+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.497+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.497+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.497+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:59:23.500 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.497+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:59:23.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.498+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:59:23.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.498+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:59:23.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.498+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:59:23.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.498+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:59:23.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.498+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:59:23.501 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.498+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:59:23.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.499+0000 7f13d0f3e800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:59:23.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.499+0000 7f13d0f3e800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:59:23.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.500+0000 7f1282fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:23.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.502+0000 7f13d0f3e800 20 remove_watcher() i=0 2024-09-19T13:59:23.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.502+0000 7f13d0f3e800 2 removed watcher, disabling cache 2024-09-19T13:59:23.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.503+0000 7f13d0f3e800 20 remove_watcher() i=1 2024-09-19T13:59:23.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.504+0000 7f13d0f3e800 20 remove_watcher() i=2 2024-09-19T13:59:23.507 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.505+0000 7f13d0f3e800 20 remove_watcher() i=3 2024-09-19T13:59:23.508 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.506+0000 7f13d0f3e800 20 remove_watcher() i=4 2024-09-19T13:59:23.509 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.507+0000 7f13d0f3e800 20 remove_watcher() i=5 2024-09-19T13:59:23.510 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.508+0000 7f13d0f3e800 20 remove_watcher() i=6 2024-09-19T13:59:23.511 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:23.509+0000 7f13d0f3e800 20 remove_watcher() i=7 2024-09-19T13:59:53.553 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-19T13:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:53.588 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:53.628 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.626+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 realm 2024-09-19T13:59:53.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:53.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.629+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:53.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.629+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.630+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:53.632 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.630+0000 7fe7a052a800 20 searching for the correct realm 2024-09-19T13:59:53.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.633+0000 7fe793a4e640 0 -- 172.21.15.94:0/2128615416 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe78c075040 msgr2=0x7fe78c061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:53.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.637+0000 7fe79c24f640 0 -- 172.21.15.94:0/2128615416 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe7840b20b0 msgr2=0x7fe7840abf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:53.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 zone default found 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 4 Realm: () 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 zonegroup default 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.845+0000 7fe7a052a800 20 started sync module instance, tier type = 2024-09-19T13:59:53.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.845+0000 7fe7a052a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=0 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=1 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=2 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=3 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=4 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=5 2024-09-19T13:59:53.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=6 2024-09-19T13:59:53.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.856+0000 7fe7a052a800 20 add_watcher() i=7 2024-09-19T13:59:53.858 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.856+0000 7fe7a052a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:53.860 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe652fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe7a052a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe7a052a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe7a052a800 5 note: GC not initialized 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe651fdb640 20 reqs_thread_entry: start 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe7a052a800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.858+0000 7fe7a052a800 20 Filter name: none 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe5c37fe640 20 reqs_thread_entry: start 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:53.861 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.860+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:53.862 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.860+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.860+0000 7fe7a052a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.860+0000 7fe7a052a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.860+0000 7fe7a052a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.860+0000 7fe7a052a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:53.863 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.861+0000 7fe7a052a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:59:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.869+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.869+0000 7fe7a052a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.869+0000 7fe7a052a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:53.871 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.869+0000 7fe7a052a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:59:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595169 cookie 94261100724896 notifier 8268 bl.length()=911 2024-09-19T13:59:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:59:53.872 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:59:53.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:59:53.873 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:59:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7a052a800 time 2024-09-19T13:59:53.875231+0000 2024-09-19T13:59:53.875 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7a1d8c76a] 2024-09-19T13:59:53.876 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.874+0000 7fe7a052a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7a052a800 time 2024-09-19T13:59:53.875231+0000 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7a1d8c76a] 2024-09-19T13:59:53.877 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T13:59:53.878 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe7a052a800 thread_name:radosgw-admin 2024-09-19T13:59:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe7a0a3e6f0] 2024-09-19T13:59:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe7a0a8b99c] 2024-09-19T13:59:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:53.899 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7a1d8c7c4] 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.875+0000 7fe7a052a800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe7a052a800 thread_name:radosgw-admin 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:53.900 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe7a0a3e6f0] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe7a0a8b99c] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7a1d8c7c4] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:59:53.901 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:59:53.608+0000 7fe7a052a800 4 set_mon_vals no callback set 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: shutdown 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 asok(0x55badf3ae410) unregister_commands rotate-key 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.902 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding auth protocol: cephx 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding auth protocol: cephx 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding auth protocol: cephx 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.903 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:59:53.609+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: starting msgr at 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: starting objecter 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command objecter_requests hook 0x55badf5d59b0 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: setting wanted keys 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: calling monclient init 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding auth protocol: cephx 2024-09-19T13:59:53.904 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding auth protocol: cephx 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding auth protocol: cephx 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.905 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:59:53.609+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:59:53.610+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:59:53.610+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key hook 0x55badf5d07f8 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf4880e0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf519850 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf5fa290 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.267241s 2024-09-19T13:59:53.906 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf4880e0 auth_method 0 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf5fa290 auth_method 0 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.907 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf519850 auth_method 0 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:59:53.610+0000 7fe79c24f640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: dump: 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.908 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.909 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: dump: 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:59:53.610+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8259 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:59:53.610+0000 7fe68a60c640 4 set_mon_vals no callback set 2024-09-19T13:59:53.910 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:59:53.611+0000 7fe7a052a800 1 librados: init done 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:59:53.612+0000 7fe688e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:59:53.612+0000 7fe688e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:59:53.612+0000 7fe688e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:59:53.613+0000 7fe793a4e640 10 monclient: get_auth_request con 0x7fe684077570 auth_method 0 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:59:53.613+0000 7fe79ca50640 10 monclient: get_auth_request con 0x55badf5f71d0 auth_method 0 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:59:53.614+0000 7fe79c24f640 10 monclient: get_auth_request con 0x55badf61bd00 auth_method 0 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:59:53.616+0000 7fe793a4e640 10 monclient: get_auth_request con 0x55badf61f530 auth_method 0 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:59:53.616+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:59:53.616+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:59:53.616+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.911 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding auth protocol: cephx 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding auth protocol: cephx 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding auth protocol: cephx 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.912 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:59:53.616+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command objecter_requests cmddesc objecter_requests hook 0x55badf6284a0 EEXIST 2024-09-19T13:59:53.913 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding auth protocol: cephx 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding auth protocol: cephx 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding auth protocol: cephx 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.914 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:59:53.617+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:59:53.617+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key cmddesc rotate-key hook 0x55badf623fe0 EEXIST 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf64c7c0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf64cba0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf64b4d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.915 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.274782s 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf64b4d0 auth_method 0 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf64cba0 auth_method 0 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf64c7c0 auth_method 0 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.916 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:59:53.618+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:59:53.618+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:59:53.618+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:59:53.618+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:59:53.618+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:59:53.618+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:59:53.618+0000 7fe79ca50640 10 monclient(hunting): handle_auth_done global_id 8262 payload 824 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:59:53.618+0000 7fe79ca50640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:59:53.618+0000 7fe79ca50640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:59:53.618+0000 7fe79ca50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.917 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: dump: 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.918 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: dump: 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.919 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:59:53.618+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8262 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:59:53.618+0000 7fe79d251640 4 set_mon_vals no callback set 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:59:53.620+0000 7fe681ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:59:53.620+0000 7fe681ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:59:53.620+0000 7fe681ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:59:53.620+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe674077480 auth_method 0 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:59:53.620+0000 7fe7a052a800 10 monclient: get_monmap_and_config 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:59:53.620+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:59:53.620+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:59:53.620+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.920 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding auth protocol: cephx 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding auth protocol: cephx 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding auth protocol: cephx 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.921 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:59:53.621+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.922 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding auth protocol: cephx 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding auth protocol: cephx 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding auth protocol: cephx 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.923 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:59:53.621+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:59:53.621+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key cmddesc rotate-key hook 0x7ffc9a9d2578 EEXIST 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf6a0d30 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf670b40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf69c0f0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.924 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.278748s 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf6a0d30 auth_method 0 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf670b40 auth_method 0 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.925 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf69c0f0 auth_method 0 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:59:53.622+0000 7fe79c24f640 10 monclient(hunting): handle_auth_done global_id 8265 payload 274 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:59:53.622+0000 7fe79c24f640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:59:53.622+0000 7fe79c24f640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:59:53.622+0000 7fe79c24f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.926 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: dump: 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.927 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: dump: 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.928 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:59:53.622+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8265 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:59:53.622+0000 7fe7a052a800 10 monclient: get_monmap_and_config success 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:59:53.622+0000 7fe7a052a800 4 set_mon_vals no callback set 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:59:53.622+0000 7fe7a052a800 10 monclient: shutdown 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.929 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding auth protocol: cephx 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding auth protocol: cephx 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding auth protocol: cephx 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.930 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:59:53.623+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: starting msgr at 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: starting objecter 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command objecter_requests cmddesc objecter_requests hook 0x55badf69ade0 EEXIST 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: setting wanted keys 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: calling monclient init 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.931 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding auth protocol: cephx 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding auth protocol: cephx 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding auth protocol: cephx 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.932 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:59:53.623+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:59:53.623+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key cmddesc rotate-key hook 0x55badf6611c8 EEXIST 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf670b40 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf69c0f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf6a0d30 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.933 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.281028s 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf69c0f0 auth_method 0 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf6a0d30 auth_method 0 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.934 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf670b40 auth_method 0 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:59:53.624+0000 7fe793a4e640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.935 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: dump: 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.936 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: dump: 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.937 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:59:53.624+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8268 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:59:53.624+0000 7fe6737fe640 4 set_mon_vals no callback set 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:59:53.624+0000 7fe7a052a800 1 librados: init done 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:59:53.624+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cr dump hook 0x7fe78c062b98 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:59:53.626+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:59:53.627+0000 7fe671ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:59:53.627+0000 7fe671ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.938 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:59:53.627+0000 7fe671ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:59:53.627+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe664077570 auth_method 0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:59:53.627+0000 7fe79ca50640 10 monclient: get_auth_request con 0x55badf6bb170 auth_method 0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 realm 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:59:53.628+0000 7fe7a052a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:59:53.629+0000 7fe79c24f640 10 monclient: get_auth_request con 0x55badf6bf330 auth_method 0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:59:53.629+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:59:53.629+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.939 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:59:53.630+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:59:53.630+0000 7fe7a052a800 20 searching for the correct realm 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:59:53.630+0000 7fe793a4e640 10 monclient: get_auth_request con 0x55badf6c4580 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:59:53.631+0000 7fe79ca50640 10 monclient: get_auth_request con 0x7fe7840adde0 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:59:53.631+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe79406f040 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:59:53.632+0000 7fe793a4e640 10 monclient: get_auth_request con 0x7fe78c075040 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:59:53.633+0000 7fe793a4e640 0 -- 172.21.15.94:0/2128615416 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe78c075040 msgr2=0x7fe78c061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:59:53.633+0000 7fe671ffb640 1 client.8268.objecter ms_handle_reset 0x7fe78c075040 session 0x7fe78c06c860 osd.4 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:59:53.633+0000 7fe671ffb640 10 monclient: _renew_subs 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:59:53.633+0000 7fe671ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:59:53.633+0000 7fe793a4e640 10 monclient: get_auth_request con 0x7fe664087390 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:59:53.634+0000 7fe79ca50640 10 monclient: get_auth_request con 0x7fe7840b6fd0 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:59:53.637+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe7840b20b0 auth_method 0 2024-09-19T13:59:53.940 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:59:53.637+0000 7fe79c24f640 0 -- 172.21.15.94:0/2128615416 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe7840b20b0 msgr2=0x7fe7840abf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:59:53.838+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe7840b20b0 auth_method 0 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:53.941 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 zone default found 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:59:53.844+0000 7fe7a052a800 4 Realm: () 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:59:53.844+0000 7fe7a052a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:59:53.844+0000 7fe7a052a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:59:53.844+0000 7fe7a052a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 zonegroup default 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 started sync module instance, tier type = 2024-09-19T13:59:53.942 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=0 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=1 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=2 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=3 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=4 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=5 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=6 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:59:53.856+0000 7fe7a052a800 20 add_watcher() i=7 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:59:53.856+0000 7fe7a052a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding auth protocol: cephx 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding auth protocol: cephx 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding auth protocol: cephx 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:53.943 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:59:53.858+0000 7fe652fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:59:53.858+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.944 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache list hook 0x55badf691710 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache inspect hook 0x55badf691710 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache erase hook 0x55badf691710 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache zap hook 0x55badf691710 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 note: GC not initialized 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:59:53.858+0000 7fe651fdb640 20 reqs_thread_entry: start 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace show hook 0x7fe78c0674b0 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace history hook 0x7fe78c0674b0 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace active hook 0x7fe78c0674b0 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace active_short hook 0x7fe78c0674b0 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:53.945 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 Filter name: none 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:59:53.859+0000 7fe5c37fe640 20 reqs_thread_entry: start 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:59:53.860+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:53.946 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:59:53.861+0000 7fe7a052a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595169 cookie 94261100724896 notifier 8268 bl.length()=911 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:59:53.947 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:59:53.874+0000 7fe7a052a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7a052a800 time 2024-09-19T13:59:53.875231+0000 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7a1d8c76a] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:53.948 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:59:53.875+0000 7fe7a052a800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe7a052a800 thread_name:radosgw-admin 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe7a0a3e6f0] 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe7a0a8b99c] 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7a1d8c7c4] 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:53.949 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:59:53.950 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:59:53.951 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:59:53.952 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:59:53.953 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:59:53.954 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:59:53.955 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:59:53.956 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe5c37fe640 / http_manager 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe651fdb640 / http_manager 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe652fdd640 / rgw_dt_lg_renew 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe671ffb640 / ms_dispatch 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe6737fe640 / io_context_pool 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe681ffb640 / ms_dispatch 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe688e09640 / ms_dispatch 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe68a60c640 / io_context_pool 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe793a4e640 / msgr-worker-2 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe79c24f640 / msgr-worker-1 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe79ca50640 / msgr-worker-0 2024-09-19T13:59:53.957 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe79d251640 / io_context_pool 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe7a052a800 / radosgw-admin 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.152099.log 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T13:59:53.608+0000 7fe7a052a800 4 set_mon_vals no callback set 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: shutdown 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 asok(0x55badf3ae410) unregister_commands rotate-key 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.958 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.959 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding auth protocol: cephx 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding auth protocol: cephx 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding auth protocol: cephx 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.960 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: crc 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5fa890) adding con mode: secure 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T13:59:53.609+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: starting msgr at 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: starting objecter 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command objecter_requests hook 0x55badf5d59b0 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: setting wanted keys 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T13:59:53.609+0000 7fe7a052a800 1 librados: calling monclient init 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T13:59:53.609+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding auth protocol: cephx 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding auth protocol: cephx 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding auth protocol: cephx 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.961 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: crc 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T13:59:53.609+0000 7fe7a052a800 5 AuthRegistry(0x55badf5d06b0) adding con mode: secure 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T13:59:53.609+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T13:59:53.610+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T13:59:53.610+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key hook 0x55badf5d07f8 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.962 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf4880e0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf519850 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf5fa290 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.267241s 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf4880e0 auth_method 0 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf5fa290 auth_method 0 2024-09-19T13:59:53.963 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T13:59:53.610+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf519850 auth_method 0 2024-09-19T13:59:53.964 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T13:59:53.610+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T13:59:53.610+0000 7fe79c24f640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T13:59:53.610+0000 7fe79c24f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: dump: 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.965 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T13:59:53.610+0000 7fe688e09640 10 monclient: dump: 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.966 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T13:59:53.610+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8259 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T13:59:53.610+0000 7fe68a60c640 4 set_mon_vals no callback set 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T13:59:53.610+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.967 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T13:59:53.611+0000 7fe7a052a800 1 librados: init done 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T13:59:53.612+0000 7fe688e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T13:59:53.612+0000 7fe688e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T13:59:53.612+0000 7fe688e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T13:59:53.613+0000 7fe793a4e640 10 monclient: get_auth_request con 0x7fe684077570 auth_method 0 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T13:59:53.613+0000 7fe79ca50640 10 monclient: get_auth_request con 0x55badf5f71d0 auth_method 0 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T13:59:53.614+0000 7fe79c24f640 10 monclient: get_auth_request con 0x55badf61bd00 auth_method 0 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T13:59:53.616+0000 7fe793a4e640 10 monclient: get_auth_request con 0x55badf61f530 auth_method 0 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T13:59:53.616+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T13:59:53.616+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T13:59:53.616+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.968 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding auth protocol: cephx 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding auth protocol: cephx 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding auth protocol: cephx 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.969 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: crc 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T13:59:53.616+0000 7fe7a052a800 5 AuthRegistry(0x55badf625040) adding con mode: secure 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T13:59:53.616+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command objecter_requests cmddesc objecter_requests hook 0x55badf6284a0 EEXIST 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding auth protocol: cephx 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding auth protocol: cephx 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding auth protocol: cephx 2024-09-19T13:59:53.970 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: crc 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 AuthRegistry(0x55badf623e98) adding con mode: secure 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T13:59:53.617+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T13:59:53.617+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.971 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T13:59:53.617+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key cmddesc rotate-key hook 0x55badf623fe0 EEXIST 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf64c7c0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf64cba0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf64b4d0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T13:59:53.617+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.274782s 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf64b4d0 auth_method 0 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.972 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf64cba0 auth_method 0 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T13:59:53.617+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T13:59:53.617+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf64c7c0 auth_method 0 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.973 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T13:59:53.617+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T13:59:53.618+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T13:59:53.618+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T13:59:53.618+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T13:59:53.618+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T13:59:53.618+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T13:59:53.618+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T13:59:53.618+0000 7fe79ca50640 10 monclient(hunting): handle_auth_done global_id 8262 payload 824 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T13:59:53.618+0000 7fe79ca50640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T13:59:53.618+0000 7fe79ca50640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T13:59:53.618+0000 7fe79ca50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: dump: 2024-09-19T13:59:53.974 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.975 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T13:59:53.618+0000 7fe681ffb640 10 monclient: dump: 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.976 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T13:59:53.618+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8262 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T13:59:53.618+0000 7fe79d251640 4 set_mon_vals no callback set 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T13:59:53.618+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T13:59:53.620+0000 7fe681ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T13:59:53.620+0000 7fe681ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T13:59:53.620+0000 7fe681ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T13:59:53.620+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe674077480 auth_method 0 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T13:59:53.620+0000 7fe7a052a800 10 monclient: get_monmap_and_config 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T13:59:53.620+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T13:59:53.620+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.977 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T13:59:53.620+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding auth protocol: cephx 2024-09-19T13:59:53.978 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding auth protocol: cephx 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding auth protocol: cephx 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.980 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: crc 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T13:59:53.620+0000 7fe7a052a800 5 AuthRegistry(0x55badf66c690) adding con mode: secure 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T13:59:53.621+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding auth protocol: cephx 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding auth protocol: cephx 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding auth protocol: cephx 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.981 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: crc 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2430) adding con mode: secure 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T13:59:53.621+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T13:59:53.621+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T13:59:53.621+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key cmddesc rotate-key hook 0x7ffc9a9d2578 EEXIST 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf6a0d30 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.982 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf670b40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf69c0f0 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T13:59:53.621+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.278748s 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf6a0d30 auth_method 0 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf670b40 auth_method 0 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.983 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T13:59:53.621+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T13:59:53.621+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf69c0f0 auth_method 0 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T13:59:53.621+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.984 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T13:59:53.622+0000 7fe79c24f640 10 monclient(hunting): handle_auth_done global_id 8265 payload 274 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T13:59:53.622+0000 7fe79c24f640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T13:59:53.622+0000 7fe79c24f640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T13:59:53.622+0000 7fe79c24f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: dump: 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.985 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T13:59:53.622+0000 7fe6737fe640 10 monclient: dump: 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.986 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T13:59:53.622+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8265 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T13:59:53.622+0000 7fe7a052a800 10 monclient: get_monmap_and_config success 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T13:59:53.622+0000 7fe7a052a800 4 set_mon_vals no callback set 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T13:59:53.622+0000 7fe7a052a800 10 monclient: shutdown 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: build_initial_monmap 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 build_initial for_mkfs: 0 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: monmap: 2024-09-19T13:59:53.987 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding auth protocol: cephx 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding auth protocol: cephx 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding auth protocol: cephx 2024-09-19T13:59:53.988 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: crc 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf671980) adding con mode: secure 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T13:59:53.623+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: starting msgr at 2024-09-19T13:59:53.989 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: starting objecter 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command objecter_requests cmddesc objecter_requests hook 0x55badf69ade0 EEXIST 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: setting wanted keys 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T13:59:53.623+0000 7fe7a052a800 1 librados: calling monclient init 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: init 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding auth protocol: cephx 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding auth protocol: cephx 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding auth protocol: cephx 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.990 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: crc 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 AuthRegistry(0x55badf661080) adding con mode: secure 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T13:59:53.623+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T13:59:53.623+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T13:59:53.623+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command rotate-key cmddesc rotate-key hook 0x55badf6611c8 EEXIST 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: _reopen_session rank -1 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-b con 0x55badf670b40 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-a con 0x55badf69c0f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T13:59:53.991 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T13:59:53.623+0000 7fe7a052a800 10 monclient(hunting): picked mon.noname-c con 0x55badf6a0d30 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): start opening mon connection 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): _renew_subs 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient(hunting): authenticate will time out at 2207.281028s 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): get_auth_request con 0x55badf69c0f0 auth_method 0 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): get_auth_request con 0x55badf6a0d30 auth_method 0 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.992 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): get_auth_request con 0x55badf670b40 auth_method 0 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): _init_auth method 2 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T13:59:53.624+0000 7fe79ca50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T13:59:53.624+0000 7fe79c24f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T13:59:53.993 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient: _finish_hunting 0 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T13:59:53.624+0000 7fe793a4e640 1 monclient: found mon.noname-a 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T13:59:53.624+0000 7fe793a4e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: dump: 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.994 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: _finish_auth 0 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: _check_auth_tickets 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T13:59:53.624+0000 7fe671ffb640 10 monclient: dump: 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T13:59:53.995 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T13:59:53.624+0000 7fe7a052a800 5 monclient: authenticate success, global_id 8268 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T13:59:53.624+0000 7fe6737fe640 4 set_mon_vals no callback set 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _renew_subs 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T13:59:53.624+0000 7fe7a052a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T13:59:53.624+0000 7fe7a052a800 1 librados: init done 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T13:59:53.624+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cr dump hook 0x7fe78c062b98 2024-09-19T13:59:53.996 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T13:59:53.626+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T13:59:53.627+0000 7fe671ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T13:59:53.627+0000 7fe671ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T13:59:53.627+0000 7fe671ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T13:59:53.627+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe664077570 auth_method 0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T13:59:53.627+0000 7fe79ca50640 10 monclient: get_auth_request con 0x55badf6bb170 auth_method 0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 realm 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T13:59:53.628+0000 7fe7a052a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T13:59:53.628+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.997 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T13:59:53.629+0000 7fe79c24f640 10 monclient: get_auth_request con 0x55badf6bf330 auth_method 0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T13:59:53.629+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T13:59:53.629+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T13:59:53.630+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T13:59:53.630+0000 7fe7a052a800 20 searching for the correct realm 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T13:59:53.630+0000 7fe793a4e640 10 monclient: get_auth_request con 0x55badf6c4580 auth_method 0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T13:59:53.631+0000 7fe79ca50640 10 monclient: get_auth_request con 0x7fe7840adde0 auth_method 0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T13:59:53.631+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe79406f040 auth_method 0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T13:59:53.632+0000 7fe793a4e640 10 monclient: get_auth_request con 0x7fe78c075040 auth_method 0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T13:59:53.633+0000 7fe793a4e640 0 -- 172.21.15.94:0/2128615416 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe78c075040 msgr2=0x7fe78c061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T13:59:53.633+0000 7fe671ffb640 1 client.8268.objecter ms_handle_reset 0x7fe78c075040 session 0x7fe78c06c860 osd.4 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T13:59:53.633+0000 7fe671ffb640 10 monclient: _renew_subs 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T13:59:53.633+0000 7fe671ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T13:59:53.633+0000 7fe793a4e640 10 monclient: get_auth_request con 0x7fe664087390 auth_method 0 2024-09-19T13:59:53.998 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T13:59:53.634+0000 7fe79ca50640 10 monclient: get_auth_request con 0x7fe7840b6fd0 auth_method 0 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T13:59:53.637+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe7840b20b0 auth_method 0 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T13:59:53.637+0000 7fe79c24f640 0 -- 172.21.15.94:0/2128615416 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fe7840b20b0 msgr2=0x7fe7840abf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T13:59:53.838+0000 7fe79c24f640 10 monclient: get_auth_request con 0x7fe7840b20b0 auth_method 0 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T13:59:53.843+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:53.999 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 zone default found 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T13:59:53.844+0000 7fe7a052a800 4 Realm: () 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T13:59:53.844+0000 7fe7a052a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T13:59:53.844+0000 7fe7a052a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T13:59:53.844+0000 7fe7a052a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 zonegroup default 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T13:59:53.844+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.000 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 started sync module instance, tier type = 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T13:59:53.845+0000 7fe7a052a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=0 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=1 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=2 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=3 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=4 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=5 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T13:59:53.855+0000 7fe7a052a800 20 add_watcher() i=6 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T13:59:53.856+0000 7fe7a052a800 20 add_watcher() i=7 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T13:59:53.856+0000 7fe7a052a800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding auth protocol: cephx 2024-09-19T13:59:54.001 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding auth protocol: cephx 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding auth protocol: cephx 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: crc 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 AuthRegistry(0x7ffc9a9d2900) adding con mode: secure 2024-09-19T13:59:54.002 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T13:59:53.858+0000 7fe652fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T13:59:53.858+0000 7fe7a052a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache list hook 0x55badf691710 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache inspect hook 0x55badf691710 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache erase hook 0x55badf691710 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command cache zap hook 0x55badf691710 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 note: GC not initialized 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T13:59:53.858+0000 7fe651fdb640 20 reqs_thread_entry: start 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace show hook 0x7fe78c0674b0 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace history hook 0x7fe78c0674b0 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace active hook 0x7fe78c0674b0 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T13:59:53.858+0000 7fe7a052a800 5 asok(0x55badf3ae410) register_command sync trace active_short hook 0x7fe78c0674b0 2024-09-19T13:59:54.003 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T13:59:53.858+0000 7fe7a052a800 20 Filter name: none 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T13:59:53.859+0000 7fe5c37fe640 20 reqs_thread_entry: start 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T13:59:53.859+0000 7fe7a052a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T13:59:53.859+0000 7fe7a052a800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T13:59:53.860+0000 7fe7a052a800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:54.004 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T13:59:53.860+0000 7fe7a052a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T13:59:53.861+0000 7fe7a052a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T13:59:53.869+0000 7fe7a052a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595169 cookie 94261100724896 notifier 8268 bl.length()=911 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T13:59:53.870+0000 7fe6737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T13:59:54.005 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T13:59:53.870+0000 7fe7a052a800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T13:59:53.874+0000 7fe7a052a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7a052a800 time 2024-09-19T13:59:53.875231+0000 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe7a1d8c76a] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 4: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 6: main() 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 8: __libc_start_main() 2024-09-19T13:59:54.006 INFO:tasks.workunit.client.0.smithi094.stderr: 9: _start() 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T13:59:53.875+0000 7fe7a052a800 -1 *** Caught signal (Aborted) ** 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7fe7a052a800 thread_name:radosgw-admin 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe7a0a3e6f0] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe7a0a8b99c] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe7a1d8c7c4] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe7a1d8c928] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bade34a791] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 8: radosgw-admin(+0xd74d0c) [0x55bade858d0c] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bade35a43d] 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 10: main() 2024-09-19T13:59:54.007 INFO:tasks.workunit.client.0.smithi094.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe7a0a29590] 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 12: __libc_start_main() 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 13: _start() 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T13:59:54.008 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T13:59:54.009 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T13:59:54.010 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T13:59:54.011 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T13:59:54.012 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T13:59:54.013 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T13:59:54.014 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe5c37fe640 / http_manager 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe651fdb640 / http_manager 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe652fdd640 / rgw_dt_lg_renew 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe671ffb640 / ms_dispatch 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe6737fe640 / io_context_pool 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe681ffb640 / ms_dispatch 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe688e09640 / ms_dispatch 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe68a60c640 / io_context_pool 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe793a4e640 / msgr-worker-2 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe79c24f640 / msgr-worker-1 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe79ca50640 / msgr-worker-0 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe79d251640 / io_context_pool 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: 7fe7a052a800 / radosgw-admin 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T13:59:54.015 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T13:59:53.876954Z_a45d2cba-fe8f-4b8f-8f64-9c33e3c9a87b/log 2024-09-19T13:59:54.016 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T13:59:54.016 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.954+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 realm 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:59:54.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.956+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.957+0000 7f85a8f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.957+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.958+0000 7f85a8f31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.958+0000 7f85a8f31800 20 searching for the correct realm 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.961+0000 7f859c475640 0 -- 172.21.15.94:0/1713487151 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55b371c36760 msgr2=0x55b371c38c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.964+0000 7f85a4c76640 0 -- 172.21.15.94:0/1713487151 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f858c00fa50 msgr2=0x7f858c059390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T13:59:54.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.969+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 zone default found 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 4 Realm: () 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 zonegroup default 2024-09-19T13:59:54.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.970+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.971+0000 7f85a8f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.971+0000 7f85a8f31800 20 started sync module instance, tier type = 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.971+0000 7f85a8f31800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=0 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=1 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=2 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=3 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=4 2024-09-19T13:59:54.025 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=5 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.979+0000 7f85a8f31800 20 add_watcher() i=6 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.980+0000 7f85a8f31800 20 add_watcher() i=7 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.980+0000 7f85a8f31800 2 all 8 watchers are set, enabling cache 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.982+0000 7f845afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.982+0000 7f85a8f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.982+0000 7f85a8f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.982+0000 7f85a8f31800 5 note: GC not initialized 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.982+0000 7f8459fe3640 20 reqs_thread_entry: start 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.982+0000 7f85a8f31800 20 init_complete bucket index max shards: 11 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 20 Filter name: none 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f83cb7fe640 20 reqs_thread_entry: start 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.983+0000 7f85a8f31800 20 rados->read ofs=0 len=0 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:59:54.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.984+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.985+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.985+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.985+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.985+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.986+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.986+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.986+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.986+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.986+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.986+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.987+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:59:54.028 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.987+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.987+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.987+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.987+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.987+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.988+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.988+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.988+0000 7f85a8f31800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.988+0000 7f85a8f31800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.990+0000 7f845afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.992+0000 7f85a8f31800 20 remove_watcher() i=0 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.992+0000 7f85a8f31800 2 removed watcher, disabling cache 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.993+0000 7f85a8f31800 20 remove_watcher() i=1 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.994+0000 7f85a8f31800 20 remove_watcher() i=2 2024-09-19T13:59:54.029 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.995+0000 7f85a8f31800 20 remove_watcher() i=3 2024-09-19T13:59:54.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.996+0000 7f85a8f31800 20 remove_watcher() i=4 2024-09-19T13:59:54.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.997+0000 7f85a8f31800 20 remove_watcher() i=5 2024-09-19T13:59:54.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.997+0000 7f85a8f31800 20 remove_watcher() i=6 2024-09-19T13:59:54.030 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T13:59:53.998+0000 7f85a8f31800 20 remove_watcher() i=7 2024-09-19T13:59:54.030 INFO:tasks.workunit.client.0.smithi094.stderr: test: duplicated entries can be purged manually 2024-09-19T14:00:24.044 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:00:24.075 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:24.076 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:24.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.115+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.117+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.117+0000 7fc501326800 20 realm 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.117+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.117+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.117+0000 7fc501326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.117+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.118+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.118+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.119+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.119+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.119+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:24.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.119+0000 7fc501326800 20 searching for the correct realm 2024-09-19T14:00:24.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.123+0000 7fc4f47d8640 0 -- 172.21.15.94:0/3083284366 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5610fb0e9330 msgr2=0x5610fb0eb720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.126+0000 7fc4fcfd9640 0 -- 172.21.15.94:0/3083284366 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc4e40b6660 msgr2=0x7fc4e40c7620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:24.134 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.131+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 zone default found 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 4 Realm: () 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 zonegroup default 2024-09-19T14:00:24.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.136 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.132+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.133+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.133+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.133+0000 7fc501326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.133+0000 7fc501326800 20 started sync module instance, tier type = 2024-09-19T14:00:24.138 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.133+0000 7fc501326800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=0 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=1 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=2 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=3 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=4 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=5 2024-09-19T14:00:24.144 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.142+0000 7fc501326800 20 add_watcher() i=6 2024-09-19T14:00:24.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.143+0000 7fc501326800 20 add_watcher() i=7 2024-09-19T14:00:24.145 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.143+0000 7fc501326800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:24.146 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.144+0000 7fc3b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc501326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:24.147 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc501326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:24.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc501326800 5 note: GC not initialized 2024-09-19T14:00:24.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc3b27e4640 20 reqs_thread_entry: start 2024-09-19T14:00:24.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc501326800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:24.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc501326800 20 Filter name: none 2024-09-19T14:00:24.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc3abfff640 20 reqs_thread_entry: start 2024-09-19T14:00:24.148 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.145+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.146+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.146+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.150 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.147+0000 7fc501326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:24.151 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.149+0000 7fc3b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.152+0000 7fc501326800 20 remove_watcher() i=0 2024-09-19T14:00:24.154 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.152+0000 7fc501326800 2 removed watcher, disabling cache 2024-09-19T14:00:24.155 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.153+0000 7fc501326800 20 remove_watcher() i=1 2024-09-19T14:00:24.156 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.154+0000 7fc501326800 20 remove_watcher() i=2 2024-09-19T14:00:24.157 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.155+0000 7fc501326800 20 remove_watcher() i=3 2024-09-19T14:00:24.158 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.156+0000 7fc501326800 20 remove_watcher() i=4 2024-09-19T14:00:24.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.157+0000 7fc501326800 20 remove_watcher() i=5 2024-09-19T14:00:24.159 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.158+0000 7fc501326800 20 remove_watcher() i=6 2024-09-19T14:00:24.160 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.159+0000 7fc501326800 20 remove_watcher() i=7 2024-09-19T14:00:24.171 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.171 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T14:00:24.171 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-19T14:00:24.171 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.172 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T14:00:24.206 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:24.206 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:24.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.240+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 realm 2024-09-19T14:00:24.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.244 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:24.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:24.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.243+0000 7f494fd0c800 20 searching for the correct realm 2024-09-19T14:00:24.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.247+0000 7f4947fff640 0 -- 172.21.15.94:0/3152596165 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x558ccc14b5f0 msgr2=0x558ccc14d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.251+0000 7f4947fff640 0 -- 172.21.15.94:0/3152596165 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f494007ec50 msgr2=0x7f494008d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 zone default found 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 4 Realm: () 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 zonegroup default 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 started sync module instance, tier type = 2024-09-19T14:00:24.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.256+0000 7f494fd0c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=0 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=1 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=2 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=3 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=4 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=5 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=6 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.266+0000 7f494fd0c800 20 add_watcher() i=7 2024-09-19T14:00:24.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.266+0000 7f494fd0c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:24.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.267+0000 7f48037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.267+0000 7f494fd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.267+0000 7f494fd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 5 note: GC not initialized 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f48027e4640 20 reqs_thread_entry: start 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 20 Filter name: none 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f4773fff640 20 reqs_thread_entry: start 2024-09-19T14:00:24.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:24.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:24.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.269+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.269+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.269+0000 7f494fd0c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.269+0000 7f494fd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.269+0000 7f494fd0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.269+0000 7f494fd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:24.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.270+0000 7f494fd0c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:00:24.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f494fd0c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f494fd0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.280 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f494fd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595170 cookie 94063207750880 notifier 7844 bl.length()=911 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T14:00:24.281 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T14:00:24.286 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f494fd0c800 time 2024-09-19T14:00:24.286241+0000 2024-09-19T14:00:24.286 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:00:24.287 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.287 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f495318c76a] 2024-09-19T14:00:24.287 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.287 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.287 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.287 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.285+0000 7f494fd0c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f494fd0c800 time 2024-09-19T14:00:24.286241+0000 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f495318c76a] 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.288 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T14:00:24.289 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T14:00:24.289 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.289 INFO:tasks.workunit.client.0.smithi094.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:00:24.289 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f494fd0c800 thread_name:radosgw-admin 2024-09-19T14:00:24.306 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.306 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4951e3e6f0] 2024-09-19T14:00:24.306 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4951e8b99c] 2024-09-19T14:00:24.306 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f495318c7c4] 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.286+0000 7f494fd0c800 -1 *** Caught signal (Aborted) ** 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f494fd0c800 thread_name:radosgw-admin 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.307 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4951e3e6f0] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4951e8b99c] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f495318c7c4] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T14:00:24.308 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: dump: 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.309 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T14:00:24.224+0000 7f494fd0c800 5 monclient: authenticate success, global_id 8310 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: dump: 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.310 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T14:00:24.224+0000 7f494fd0c800 10 monclient: get_monmap_and_config success 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T14:00:24.224+0000 7f494fd0c800 4 set_mon_vals no callback set 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T14:00:24.224+0000 7f494fd0c800 10 monclient: shutdown 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T14:00:24.224+0000 7f494fd0c800 5 asok(0x558ccbe3e410) unregister_commands rotate-key 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.311 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding auth protocol: cephx 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding auth protocol: cephx 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding auth protocol: cephx 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.312 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T14:00:24.225+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: starting msgr at 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: starting objecter 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command objecter_requests hook 0x558ccc064480 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: setting wanted keys 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: calling monclient init 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding auth protocol: cephx 2024-09-19T14:00:24.313 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding auth protocol: cephx 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding auth protocol: cephx 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.314 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T14:00:24.225+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T14:00:24.225+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key hook 0x558ccc0607c8 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccbf14f60 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccbf180e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc08a260 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.315 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.882977s 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc08a260 auth_method 0 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccbf180e0 auth_method 0 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.316 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_done global_id 8313 payload 824 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T14:00:24.226+0000 7f494dff7640 1 monclient: found mon.noname-a 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T14:00:24.226+0000 7f494d7f6640 10 monclient: get_auth_request con 0x558ccbf14f60 auth_method 0 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: dump: 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.317 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: dump: 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.318 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T14:00:24.226+0000 7f494fd0c800 5 monclient: authenticate success, global_id 8313 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T14:00:24.226+0000 7f483b606640 4 set_mon_vals no callback set 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T14:00:24.226+0000 7f494fd0c800 1 librados: init done 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T14:00:24.228+0000 7f4839e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T14:00:24.228+0000 7f4839e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T14:00:24.228+0000 7f4839e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T14:00:24.228+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4834077570 auth_method 0 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T14:00:24.228+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc0874c0 auth_method 0 2024-09-19T14:00:24.319 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T14:00:24.229+0000 7f494d7f6640 10 monclient: get_auth_request con 0x558ccc0ac160 auth_method 0 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T14:00:24.230+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc0af9c0 auth_method 0 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T14:00:24.231+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T14:00:24.231+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T14:00:24.231+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.320 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding auth protocol: cephx 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding auth protocol: cephx 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding auth protocol: cephx 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.321 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T14:00:24.231+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command objecter_requests cmddesc objecter_requests hook 0x558ccc0b8820 EEXIST 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding auth protocol: cephx 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding auth protocol: cephx 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding auth protocol: cephx 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.322 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T14:00:24.232+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T14:00:24.232+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key cmddesc rotate-key hook 0x558ccc0b43a0 EEXIST 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccc0dcb40 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc0dcf20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccc0db850 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.323 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.889656s 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc0db850 auth_method 0 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccc0dcf20 auth_method 0 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.324 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): get_auth_request con 0x558ccc0dcb40 auth_method 0 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T14:00:24.233+0000 7f494d7f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T14:00:24.233+0000 7f4947fff640 10 monclient(hunting): handle_auth_done global_id 8316 payload 824 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T14:00:24.233+0000 7f4947fff640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T14:00:24.233+0000 7f4947fff640 1 monclient: found mon.noname-a 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T14:00:24.233+0000 7f4947fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.325 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: dump: 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.326 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: dump: 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.327 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T14:00:24.233+0000 7f494fd0c800 5 monclient: authenticate success, global_id 8316 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T14:00:24.233+0000 7f494e7f8640 4 set_mon_vals no callback set 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T14:00:24.235+0000 7f4832ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T14:00:24.235+0000 7f4832ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T14:00:24.235+0000 7f4832ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T14:00:24.235+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4828077480 auth_method 0 2024-09-19T14:00:24.328 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T14:00:24.235+0000 7f494fd0c800 10 monclient: get_monmap_and_config 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T14:00:24.235+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T14:00:24.235+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T14:00:24.235+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.329 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding auth protocol: cephx 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding auth protocol: cephx 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding auth protocol: cephx 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.330 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T14:00:24.235+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding auth protocol: cephx 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding auth protocol: cephx 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding auth protocol: cephx 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.331 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T14:00:24.236+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T14:00:24.236+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key cmddesc rotate-key hook 0x7ffe60595968 EEXIST 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccc131030 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccc100e40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc12c3f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.332 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.893543s 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccc100e40 auth_method 0 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc12c3f0 auth_method 0 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.333 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_done global_id 7841 payload 274 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T14:00:24.236+0000 7f4947fff640 1 monclient: found mon.noname-c 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: dump: 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.334 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: dump: 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.335 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 monclient: authenticate success, global_id 7841 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: get_monmap_and_config success 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T14:00:24.237+0000 7f494fd0c800 4 set_mon_vals no callback set 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: shutdown 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T14:00:24.237+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.336 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding auth protocol: cephx 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding auth protocol: cephx 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding auth protocol: cephx 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.337 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T14:00:24.237+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: starting msgr at 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: starting objecter 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command objecter_requests cmddesc objecter_requests hook 0x558ccc12b6d0 EEXIST 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: setting wanted keys 2024-09-19T14:00:24.338 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: calling monclient init 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding auth protocol: cephx 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding auth protocol: cephx 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding auth protocol: cephx 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.339 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T14:00:24.238+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T14:00:24.238+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key cmddesc rotate-key hook 0x558ccc0f1548 EEXIST 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccc100e40 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc12c3f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccc131030 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.340 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.895698s 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccc12c3f0 auth_method 0 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc131030 auth_method 0 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.341 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): get_auth_request con 0x558ccc100e40 auth_method 0 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T14:00:24.239+0000 7f494dff7640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T14:00:24.239+0000 7f494dff7640 1 monclient: found mon.noname-c 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T14:00:24.239+0000 7f494dff7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: dump: 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.342 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: dump: 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.343 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T14:00:24.239+0000 7f4830ff9640 4 set_mon_vals no callback set 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T14:00:24.239+0000 7f494fd0c800 5 monclient: authenticate success, global_id 7844 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.344 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T14:00:24.239+0000 7f494fd0c800 1 librados: init done 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T14:00:24.239+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cr dump hook 0x558ccc127338 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T14:00:24.240+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T14:00:24.241+0000 7f481effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T14:00:24.241+0000 7f481effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T14:00:24.241+0000 7f481effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T14:00:24.241+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4818077570 auth_method 0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T14:00:24.241+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc14b5f0 auth_method 0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 realm 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T14:00:24.242+0000 7f494fd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.345 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T14:00:24.242+0000 7f494d7f6640 10 monclient: get_auth_request con 0x558ccc14f7e0 auth_method 0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 searching for the correct realm 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T14:00:24.244+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc154a50 auth_method 0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T14:00:24.244+0000 7f494dff7640 10 monclient: get_auth_request con 0x7f493802fc90 auth_method 0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T14:00:24.245+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4948088520 auth_method 0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T14:00:24.246+0000 7f4947fff640 10 monclient: get_auth_request con 0x7f494007ec50 auth_method 0 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T14:00:24.247+0000 7f4947fff640 0 -- 172.21.15.94:0/3152596165 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x558ccc14b5f0 msgr2=0x558ccc14d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T14:00:24.247+0000 7f481effd640 1 client.7844.objecter ms_handle_reset 0x558ccc14b5f0 session 0x558ccc14af70 osd.1 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T14:00:24.247+0000 7f481effd640 10 monclient: _renew_subs 2024-09-19T14:00:24.346 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T14:00:24.247+0000 7f481effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T14:00:24.247+0000 7f4947fff640 10 monclient: get_auth_request con 0x7f48180873f0 auth_method 0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T14:00:24.248+0000 7f494dff7640 10 monclient: get_auth_request con 0x7f493801f040 auth_method 0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T14:00:24.250+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f49380696d0 auth_method 0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T14:00:24.251+0000 7f4947fff640 0 -- 172.21.15.94:0/3152596165 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f494007ec50 msgr2=0x7f494008d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T14:00:24.251+0000 7f481effd640 1 client.7844.objecter ms_handle_reset 0x7f494007ec50 session 0x7f4940077040 osd.4 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T14:00:24.251+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc14b5f0 auth_method 0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.347 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 zone default found 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T14:00:24.256+0000 7f494fd0c800 4 Realm: () 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T14:00:24.256+0000 7f494fd0c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T14:00:24.256+0000 7f494fd0c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T14:00:24.256+0000 7f494fd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 zonegroup default 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.348 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 started sync module instance, tier type = 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=0 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=1 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=2 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=3 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=4 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=5 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=6 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T14:00:24.266+0000 7f494fd0c800 20 add_watcher() i=7 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T14:00:24.266+0000 7f494fd0c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding auth protocol: cephx 2024-09-19T14:00:24.349 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding auth protocol: cephx 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding auth protocol: cephx 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T14:00:24.267+0000 7f48037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.350 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T14:00:24.267+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T14:00:24.267+0000 7f494fd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T14:00:24.267+0000 7f494fd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache list hook 0x558ccc126590 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache inspect hook 0x558ccc126590 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache erase hook 0x558ccc126590 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache zap hook 0x558ccc126590 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 note: GC not initialized 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T14:00:24.268+0000 7f48027e4640 20 reqs_thread_entry: start 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace show hook 0x7f494004e5a0 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace history hook 0x7f494004e5a0 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace active hook 0x7f494004e5a0 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace active_short hook 0x7f494004e5a0 2024-09-19T14:00:24.351 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 Filter name: none 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T14:00:24.268+0000 7f4773fff640 20 reqs_thread_entry: start 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T14:00:24.269+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.352 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T14:00:24.270+0000 7f494fd0c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595170 cookie 94063207750880 notifier 7844 bl.length()=911 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T14:00:24.353 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T14:00:24.285+0000 7f494fd0c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f494fd0c800 time 2024-09-19T14:00:24.286241+0000 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f495318c76a] 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T14:00:24.354 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T14:00:24.286+0000 7f494fd0c800 -1 *** Caught signal (Aborted) ** 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f494fd0c800 thread_name:radosgw-admin 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4951e3e6f0] 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4951e8b99c] 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f495318c7c4] 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.355 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T14:00:24.356 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T14:00:24.357 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T14:00:24.358 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:00:24.359 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T14:00:24.360 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T14:00:24.361 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T14:00:24.362 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4773fff640 / http_manager 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48027e4640 / http_manager 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48037e6640 / rgw_dt_lg_renew 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f481effd640 / ms_dispatch 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4830ff9640 / io_context_pool 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4832ffd640 / ms_dispatch 2024-09-19T14:00:24.363 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4839e03640 / ms_dispatch 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: 7f483b606640 / io_context_pool 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4947fff640 / msgr-worker-2 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494d7f6640 / msgr-worker-1 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494dff7640 / msgr-worker-0 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494e7f8640 / io_context_pool 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494fd0c800 / radosgw-admin 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/log/ceph/ceph-client.admin.153868.log 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr:--- begin dump of recent events --- 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr: -499> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: dump: 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.364 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -498> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -497> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -496> 2024-09-19T14:00:24.224+0000 7f494fd0c800 5 monclient: authenticate success, global_id 8310 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -495> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -494> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -493> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:00:24.365 INFO:tasks.workunit.client.0.smithi094.stderr: -492> 2024-09-19T14:00:24.224+0000 7f483b606640 10 monclient: dump: 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr: -491> 2024-09-19T14:00:24.224+0000 7f494fd0c800 10 monclient: get_monmap_and_config success 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr: -490> 2024-09-19T14:00:24.224+0000 7f494fd0c800 4 set_mon_vals no callback set 2024-09-19T14:00:24.366 INFO:tasks.workunit.client.0.smithi094.stderr: -489> 2024-09-19T14:00:24.224+0000 7f494fd0c800 10 monclient: shutdown 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr: -488> 2024-09-19T14:00:24.224+0000 7f494fd0c800 5 asok(0x558ccbe3e410) unregister_commands rotate-key 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr: -487> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr: -486> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr: -485> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.367 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -484> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding auth protocol: cephx 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -483> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding auth protocol: cephx 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -482> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding auth protocol: cephx 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -481> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -480> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -479> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -478> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -477> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -476> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -475> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -474> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -473> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -472> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.368 INFO:tasks.workunit.client.0.smithi094.stderr: -471> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: crc 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -470> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc08a860) adding con mode: secure 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -469> 2024-09-19T14:00:24.225+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -468> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: starting msgr at 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -467> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: starting objecter 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -466> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command objecter_requests hook 0x558ccc064480 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -465> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: setting wanted keys 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -464> 2024-09-19T14:00:24.225+0000 7f494fd0c800 1 librados: calling monclient init 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -463> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -462> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding auth protocol: cephx 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -461> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding auth protocol: cephx 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -460> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding auth protocol: cephx 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -459> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -458> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.369 INFO:tasks.workunit.client.0.smithi094.stderr: -457> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -456> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -455> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -454> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -453> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -452> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -451> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -450> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -449> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: crc 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -448> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 AuthRegistry(0x558ccc060680) adding con mode: secure 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -447> 2024-09-19T14:00:24.225+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -446> 2024-09-19T14:00:24.225+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -445> 2024-09-19T14:00:24.225+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key hook 0x558ccc0607c8 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -444> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.370 INFO:tasks.workunit.client.0.smithi094.stderr: -443> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -442> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccbf14f60 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -441> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccbf180e0 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -440> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc08a260 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -439> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -438> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -437> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -436> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -435> 2024-09-19T14:00:24.225+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.882977s 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -434> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc08a260 auth_method 0 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -433> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -432> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -431> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.371 INFO:tasks.workunit.client.0.smithi094.stderr: -430> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccbf180e0 auth_method 0 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -429> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -428> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -427> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -426> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -425> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -424> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -423> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -422> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -421> 2024-09-19T14:00:24.226+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -420> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient(hunting): handle_auth_done global_id 8313 payload 824 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -419> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -418> 2024-09-19T14:00:24.226+0000 7f494dff7640 1 monclient: found mon.noname-a 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -417> 2024-09-19T14:00:24.226+0000 7f494dff7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -416> 2024-09-19T14:00:24.226+0000 7f494d7f6640 10 monclient: get_auth_request con 0x558ccbf14f60 auth_method 0 2024-09-19T14:00:24.372 INFO:tasks.workunit.client.0.smithi094.stderr: -415> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr: -414> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr: -413> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: dump: 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr: -412> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.373 INFO:tasks.workunit.client.0.smithi094.stderr: -411> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr: -410> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr: -409> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr: -408> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr: -407> 2024-09-19T14:00:24.226+0000 7f4839e03640 10 monclient: dump: 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.374 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -406> 2024-09-19T14:00:24.226+0000 7f494fd0c800 5 monclient: authenticate success, global_id 8313 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -405> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -404> 2024-09-19T14:00:24.226+0000 7f483b606640 4 set_mon_vals no callback set 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -403> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -402> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -401> 2024-09-19T14:00:24.226+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -400> 2024-09-19T14:00:24.226+0000 7f494fd0c800 1 librados: init done 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -399> 2024-09-19T14:00:24.228+0000 7f4839e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -398> 2024-09-19T14:00:24.228+0000 7f4839e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -397> 2024-09-19T14:00:24.228+0000 7f4839e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -396> 2024-09-19T14:00:24.228+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4834077570 auth_method 0 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -395> 2024-09-19T14:00:24.228+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc0874c0 auth_method 0 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -394> 2024-09-19T14:00:24.229+0000 7f494d7f6640 10 monclient: get_auth_request con 0x558ccc0ac160 auth_method 0 2024-09-19T14:00:24.375 INFO:tasks.workunit.client.0.smithi094.stderr: -393> 2024-09-19T14:00:24.230+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc0af9c0 auth_method 0 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr: -392> 2024-09-19T14:00:24.231+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr: -391> 2024-09-19T14:00:24.231+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr: -390> 2024-09-19T14:00:24.231+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr: -389> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding auth protocol: cephx 2024-09-19T14:00:24.376 INFO:tasks.workunit.client.0.smithi094.stderr: -388> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding auth protocol: cephx 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -387> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding auth protocol: cephx 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -386> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -385> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -384> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -383> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -382> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -381> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -380> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -379> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -378> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -377> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -376> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: crc 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -375> 2024-09-19T14:00:24.231+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b5310) adding con mode: secure 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -374> 2024-09-19T14:00:24.231+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.377 INFO:tasks.workunit.client.0.smithi094.stderr: -373> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command objecter_requests cmddesc objecter_requests hook 0x558ccc0b8820 EEXIST 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -372> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -371> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding auth protocol: cephx 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -370> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding auth protocol: cephx 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -369> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding auth protocol: cephx 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -368> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -367> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -366> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -365> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -364> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -363> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -362> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -361> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -360> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.378 INFO:tasks.workunit.client.0.smithi094.stderr: -359> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -358> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: crc 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -357> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0b4258) adding con mode: secure 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -356> 2024-09-19T14:00:24.232+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -355> 2024-09-19T14:00:24.232+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -354> 2024-09-19T14:00:24.232+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key cmddesc rotate-key hook 0x558ccc0b43a0 EEXIST 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -353> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -352> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -351> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccc0dcb40 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -350> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc0dcf20 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -349> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccc0db850 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -348> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -347> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -346> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -345> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.379 INFO:tasks.workunit.client.0.smithi094.stderr: -344> 2024-09-19T14:00:24.232+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.889656s 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -343> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc0db850 auth_method 0 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -342> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -341> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -340> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -339> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccc0dcf20 auth_method 0 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -338> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -337> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -336> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -335> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -334> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -333> 2024-09-19T14:00:24.232+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -332> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.380 INFO:tasks.workunit.client.0.smithi094.stderr: -331> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -330> 2024-09-19T14:00:24.232+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -329> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): get_auth_request con 0x558ccc0dcb40 auth_method 0 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -328> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -327> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -326> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -325> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -324> 2024-09-19T14:00:24.232+0000 7f494d7f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -323> 2024-09-19T14:00:24.233+0000 7f494d7f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -322> 2024-09-19T14:00:24.233+0000 7f4947fff640 10 monclient(hunting): handle_auth_done global_id 8316 payload 824 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -321> 2024-09-19T14:00:24.233+0000 7f4947fff640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -320> 2024-09-19T14:00:24.233+0000 7f4947fff640 1 monclient: found mon.noname-a 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -319> 2024-09-19T14:00:24.233+0000 7f4947fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -318> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -317> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:00:24.381 INFO:tasks.workunit.client.0.smithi094.stderr: -316> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: dump: 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: -315> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: -314> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: -313> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: -312> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: -311> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:00:24.382 INFO:tasks.workunit.client.0.smithi094.stderr: -310> 2024-09-19T14:00:24.233+0000 7f4832ffd640 10 monclient: dump: 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr: -309> 2024-09-19T14:00:24.233+0000 7f494fd0c800 5 monclient: authenticate success, global_id 8316 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr: -308> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr: -307> 2024-09-19T14:00:24.233+0000 7f494e7f8640 4 set_mon_vals no callback set 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr: -306> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.383 INFO:tasks.workunit.client.0.smithi094.stderr: -305> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -304> 2024-09-19T14:00:24.233+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.94:3300/0 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -303> 2024-09-19T14:00:24.235+0000 7f4832ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -302> 2024-09-19T14:00:24.235+0000 7f4832ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -301> 2024-09-19T14:00:24.235+0000 7f4832ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -300> 2024-09-19T14:00:24.235+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4828077480 auth_method 0 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -299> 2024-09-19T14:00:24.235+0000 7f494fd0c800 10 monclient: get_monmap_and_config 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -298> 2024-09-19T14:00:24.235+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -297> 2024-09-19T14:00:24.235+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr: -296> 2024-09-19T14:00:24.235+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.384 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -295> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding auth protocol: cephx 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -294> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding auth protocol: cephx 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -293> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding auth protocol: cephx 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -292> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -291> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -290> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -289> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -288> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.385 INFO:tasks.workunit.client.0.smithi094.stderr: -287> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -286> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -285> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -284> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -283> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -282> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: crc 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -281> 2024-09-19T14:00:24.235+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0fc990) adding con mode: secure 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -280> 2024-09-19T14:00:24.235+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -279> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -278> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding auth protocol: cephx 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -277> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding auth protocol: cephx 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -276> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding auth protocol: cephx 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -275> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -274> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -273> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.386 INFO:tasks.workunit.client.0.smithi094.stderr: -272> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -271> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -270> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -269> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -268> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -267> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -266> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -265> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: crc 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -264> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595820) adding con mode: secure 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -263> 2024-09-19T14:00:24.236+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -262> 2024-09-19T14:00:24.236+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -261> 2024-09-19T14:00:24.236+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key cmddesc rotate-key hook 0x7ffe60595968 EEXIST 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -260> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -259> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -258> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccc131030 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.387 INFO:tasks.workunit.client.0.smithi094.stderr: -257> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccc100e40 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -256> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc12c3f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -255> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -254> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -253> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -252> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -251> 2024-09-19T14:00:24.236+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.893543s 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -250> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccc100e40 auth_method 0 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -249> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -248> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -247> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -246> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc12c3f0 auth_method 0 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -245> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -244> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -243> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.388 INFO:tasks.workunit.client.0.smithi094.stderr: -242> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -241> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -240> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -239> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -238> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -237> 2024-09-19T14:00:24.236+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -236> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient(hunting): handle_auth_done global_id 7841 payload 274 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -235> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -234> 2024-09-19T14:00:24.236+0000 7f4947fff640 1 monclient: found mon.noname-c 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -233> 2024-09-19T14:00:24.236+0000 7f4947fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -232> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -231> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr: -230> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: dump: 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.389 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: -229> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: -228> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: -227> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: -226> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: -225> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr: -224> 2024-09-19T14:00:24.237+0000 7f4830ff9640 10 monclient: dump: 2024-09-19T14:00:24.390 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr: -223> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 monclient: authenticate success, global_id 7841 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr: -222> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: get_monmap_and_config success 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr: -221> 2024-09-19T14:00:24.237+0000 7f494fd0c800 4 set_mon_vals no callback set 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr: -220> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: shutdown 2024-09-19T14:00:24.391 INFO:tasks.workunit.client.0.smithi094.stderr: -219> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: build_initial_monmap 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr: -218> 2024-09-19T14:00:24.237+0000 7f494fd0c800 1 build_initial for_mkfs: 0 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr: -217> 2024-09-19T14:00:24.237+0000 7f494fd0c800 10 monclient: monmap: 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 0 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 0.000000 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:created 0.000000 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 0 (unknown) 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.noname-a 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.noname-b 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.noname-c 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr: -216> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding auth protocol: cephx 2024-09-19T14:00:24.392 INFO:tasks.workunit.client.0.smithi094.stderr: -215> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding auth protocol: cephx 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -214> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding auth protocol: cephx 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -213> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -212> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -211> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -210> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -209> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -208> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -207> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -206> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -205> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -204> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -203> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: crc 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -202> 2024-09-19T14:00:24.237+0000 7f494fd0c800 5 AuthRegistry(0x558ccc1232c0) adding con mode: secure 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -201> 2024-09-19T14:00:24.237+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.393 INFO:tasks.workunit.client.0.smithi094.stderr: -200> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: starting msgr at 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -199> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: starting objecter 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -198> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command objecter_requests cmddesc objecter_requests hook 0x558ccc12b6d0 EEXIST 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -197> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: setting wanted keys 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -196> 2024-09-19T14:00:24.238+0000 7f494fd0c800 1 librados: calling monclient init 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -195> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient: init 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -194> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding auth protocol: cephx 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -193> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding auth protocol: cephx 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -192> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding auth protocol: cephx 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -191> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -190> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -189> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -188> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -187> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.394 INFO:tasks.workunit.client.0.smithi094.stderr: -186> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -185> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -184> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -183> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -182> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -181> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: crc 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -180> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 AuthRegistry(0x558ccc0f1400) adding con mode: secure 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -179> 2024-09-19T14:00:24.238+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -178> 2024-09-19T14:00:24.238+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -177> 2024-09-19T14:00:24.238+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command rotate-key cmddesc rotate-key hook 0x558ccc0f1548 EEXIST 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -176> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient: _reopen_session rank -1 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -175> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -174> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-b con 0x558ccc100e40 addr [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -173> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-a con 0x558ccc12c3f0 addr [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2024-09-19T14:00:24.395 INFO:tasks.workunit.client.0.smithi094.stderr: -172> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): picked mon.noname-c con 0x558ccc131030 addr [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -171> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -170> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -169> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): start opening mon connection 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -168> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): _renew_subs 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -167> 2024-09-19T14:00:24.238+0000 7f494fd0c800 10 monclient(hunting): authenticate will time out at 2237.895698s 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -166> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): get_auth_request con 0x558ccc12c3f0 auth_method 0 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -165> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -164> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -163> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -162> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): get_auth_request con 0x558ccc131030 auth_method 0 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -161> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -160> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -159> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -158> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.396 INFO:tasks.workunit.client.0.smithi094.stderr: -157> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -156> 2024-09-19T14:00:24.238+0000 7f4947fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -155> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -154> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -153> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -152> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): get_auth_request con 0x558ccc100e40 auth_method 0 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -151> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -150> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -149> 2024-09-19T14:00:24.238+0000 7f494d7f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -148> 2024-09-19T14:00:24.238+0000 7f494dff7640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -147> 2024-09-19T14:00:24.239+0000 7f494dff7640 10 monclient: _finish_hunting 0 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -146> 2024-09-19T14:00:24.239+0000 7f494dff7640 1 monclient: found mon.noname-c 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -145> 2024-09-19T14:00:24.239+0000 7f494dff7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -144> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.397 INFO:tasks.workunit.client.0.smithi094.stderr: -143> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: -142> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: dump: 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: -141> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: _finish_auth 0 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: -140> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: _check_auth_tickets 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: -139> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: -138> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:00:24.398 INFO:tasks.workunit.client.0.smithi094.stderr: -137> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: -136> 2024-09-19T14:00:24.239+0000 7f481effd640 10 monclient: dump: 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:epoch 1 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:fsid 0f9e9aa8-63c5-4955-9c42-4c204ccced9a 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:last_changed 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:created 2024-09-19T13:34:59.994436+0000 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:min_mon_release 19 (squid) 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:election_strategy: 1 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:0: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.a 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: -135> 2024-09-19T14:00:24.239+0000 7f4830ff9640 4 set_mon_vals no callback set 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: -134> 2024-09-19T14:00:24.239+0000 7f494fd0c800 5 monclient: authenticate success, global_id 7844 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: -133> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: -132> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.399 INFO:tasks.workunit.client.0.smithi094.stderr: -131> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _renew_subs 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -130> 2024-09-19T14:00:24.239+0000 7f494fd0c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -129> 2024-09-19T14:00:24.239+0000 7f494fd0c800 1 librados: init done 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -128> 2024-09-19T14:00:24.239+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cr dump hook 0x558ccc127338 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -127> 2024-09-19T14:00:24.240+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -126> 2024-09-19T14:00:24.241+0000 7f481effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -125> 2024-09-19T14:00:24.241+0000 7f481effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -124> 2024-09-19T14:00:24.241+0000 7f481effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.149:6800/3336356154,v1:172.21.15.149:6801/3336356154] 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -123> 2024-09-19T14:00:24.241+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4818077570 auth_method 0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -122> 2024-09-19T14:00:24.241+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc14b5f0 auth_method 0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -121> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -120> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 realm 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -119> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -118> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -117> 2024-09-19T14:00:24.242+0000 7f494fd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:24.400 INFO:tasks.workunit.client.0.smithi094.stderr: -116> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -115> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -114> 2024-09-19T14:00:24.242+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -113> 2024-09-19T14:00:24.242+0000 7f494d7f6640 10 monclient: get_auth_request con 0x558ccc14f7e0 auth_method 0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -112> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -111> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -110> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -109> 2024-09-19T14:00:24.243+0000 7f494fd0c800 20 searching for the correct realm 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -108> 2024-09-19T14:00:24.244+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc154a50 auth_method 0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -107> 2024-09-19T14:00:24.244+0000 7f494dff7640 10 monclient: get_auth_request con 0x7f493802fc90 auth_method 0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -106> 2024-09-19T14:00:24.245+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f4948088520 auth_method 0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -105> 2024-09-19T14:00:24.246+0000 7f4947fff640 10 monclient: get_auth_request con 0x7f494007ec50 auth_method 0 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -104> 2024-09-19T14:00:24.247+0000 7f4947fff640 0 -- 172.21.15.94:0/3152596165 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x558ccc14b5f0 msgr2=0x558ccc14d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.401 INFO:tasks.workunit.client.0.smithi094.stderr: -103> 2024-09-19T14:00:24.247+0000 7f481effd640 1 client.7844.objecter ms_handle_reset 0x558ccc14b5f0 session 0x558ccc14af70 osd.1 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -102> 2024-09-19T14:00:24.247+0000 7f481effd640 10 monclient: _renew_subs 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -101> 2024-09-19T14:00:24.247+0000 7f481effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.94:3301/0 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -100> 2024-09-19T14:00:24.247+0000 7f4947fff640 10 monclient: get_auth_request con 0x7f48180873f0 auth_method 0 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -99> 2024-09-19T14:00:24.248+0000 7f494dff7640 10 monclient: get_auth_request con 0x7f493801f040 auth_method 0 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -98> 2024-09-19T14:00:24.250+0000 7f494d7f6640 10 monclient: get_auth_request con 0x7f49380696d0 auth_method 0 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -97> 2024-09-19T14:00:24.251+0000 7f4947fff640 0 -- 172.21.15.94:0/3152596165 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f494007ec50 msgr2=0x7f494008d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -96> 2024-09-19T14:00:24.251+0000 7f481effd640 1 client.7844.objecter ms_handle_reset 0x7f494007ec50 session 0x7f4940077040 osd.4 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -95> 2024-09-19T14:00:24.251+0000 7f4947fff640 10 monclient: get_auth_request con 0x558ccc14b5f0 auth_method 0 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -94> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -93> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -92> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -91> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -90> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:24.402 INFO:tasks.workunit.client.0.smithi094.stderr: -89> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -88> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -87> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -86> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -85> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -84> 2024-09-19T14:00:24.255+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -83> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -82> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 zone default found 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -81> 2024-09-19T14:00:24.256+0000 7f494fd0c800 4 Realm: () 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -80> 2024-09-19T14:00:24.256+0000 7f494fd0c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -79> 2024-09-19T14:00:24.256+0000 7f494fd0c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -78> 2024-09-19T14:00:24.256+0000 7f494fd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -77> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 zonegroup default 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -76> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.403 INFO:tasks.workunit.client.0.smithi094.stderr: -75> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -74> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -73> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -72> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -71> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -70> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 started sync module instance, tier type = 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -69> 2024-09-19T14:00:24.256+0000 7f494fd0c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -68> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=0 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -67> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=1 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -66> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=2 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -65> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=3 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -64> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=4 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -63> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=5 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -62> 2024-09-19T14:00:24.265+0000 7f494fd0c800 20 add_watcher() i=6 2024-09-19T14:00:24.404 INFO:tasks.workunit.client.0.smithi094.stderr: -61> 2024-09-19T14:00:24.266+0000 7f494fd0c800 20 add_watcher() i=7 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -60> 2024-09-19T14:00:24.266+0000 7f494fd0c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -59> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding auth protocol: cephx 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -58> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding auth protocol: cephx 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -57> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding auth protocol: cephx 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -56> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -55> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -54> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -53> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -52> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -51> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -50> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -49> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -48> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.405 INFO:tasks.workunit.client.0.smithi094.stderr: -47> 2024-09-19T14:00:24.267+0000 7f48037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -46> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -45> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: crc 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -44> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 AuthRegistry(0x7ffe60595cf0) adding con mode: secure 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -43> 2024-09-19T14:00:24.267+0000 7f494fd0c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -42> 2024-09-19T14:00:24.267+0000 7f494fd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -41> 2024-09-19T14:00:24.267+0000 7f494fd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -40> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache list hook 0x558ccc126590 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -39> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache inspect hook 0x558ccc126590 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -38> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache erase hook 0x558ccc126590 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -37> 2024-09-19T14:00:24.267+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command cache zap hook 0x558ccc126590 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -36> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 note: GC not initialized 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -35> 2024-09-19T14:00:24.268+0000 7f48027e4640 20 reqs_thread_entry: start 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -34> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace show hook 0x7f494004e5a0 2024-09-19T14:00:24.406 INFO:tasks.workunit.client.0.smithi094.stderr: -33> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace history hook 0x7f494004e5a0 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -32> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace active hook 0x7f494004e5a0 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -31> 2024-09-19T14:00:24.268+0000 7f494fd0c800 5 asok(0x558ccbe3e410) register_command sync trace active_short hook 0x7f494004e5a0 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -30> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -29> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 Filter name: none 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -28> 2024-09-19T14:00:24.268+0000 7f4773fff640 20 reqs_thread_entry: start 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -27> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -26> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -25> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -24> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -23> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -22> 2024-09-19T14:00:24.268+0000 7f494fd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -21> 2024-09-19T14:00:24.268+0000 7f494fd0c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -20> 2024-09-19T14:00:24.269+0000 7f494fd0c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.407 INFO:tasks.workunit.client.0.smithi094.stderr: -19> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -18> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -17> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -16> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -15> 2024-09-19T14:00:24.269+0000 7f494fd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -14> 2024-09-19T14:00:24.270+0000 7f494fd0c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -13> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -12> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -11> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -10> 2024-09-19T14:00:24.278+0000 7f494fd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T14:00:24.408 INFO:tasks.workunit.client.0.smithi094.stderr: -9> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595170 cookie 94063207750880 notifier 7844 bl.length()=911 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -8> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -7> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -6> 2024-09-19T14:00:24.278+0000 7f4830ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -5> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -4> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -3> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -2> 2024-09-19T14:00:24.279+0000 7f494fd0c800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: -1> 2024-09-19T14:00:24.285+0000 7f494fd0c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f494fd0c800 time 2024-09-19T14:00:24.286241+0000 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5012-g08af21e0/rpm/el9/BUILD/ceph-19.3.0-5012-g08af21e0/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f495318c76a] 2024-09-19T14:00:24.409 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 5: main() 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 7: __libc_start_main() 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 8: _start() 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 0> 2024-09-19T14:00:24.286+0000 7f494fd0c800 -1 *** Caught signal (Aborted) ** 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: in thread 7f494fd0c800 thread_name:radosgw-admin 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4951e3e6f0] 2024-09-19T14:00:24.410 INFO:tasks.workunit.client.0.smithi094.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4951e8b99c] 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 3: raise() 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 4: abort() 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f495318c7c4] 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f495318c928] 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558cc993d791] 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558cc994d4aa] 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 9: main() 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4951e29590] 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 11: __libc_start_main() 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 12: _start() 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:24.411 INFO:tasks.workunit.client.0.smithi094.stderr:--- logging levels --- 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 none 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 lockdep 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 context 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 crush 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_balancer 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_locker 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_log_expire 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mds_migrator 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 3/ 5 mds_quiesce 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 buffer 2024-09-19T14:00:24.412 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 timer 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 filer 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 striper 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 1 objecter 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rados 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_mirror 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_replay 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 rbd_pwl 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 journaler 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objectcacher 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 client 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 osd 2024-09-19T14:00:24.413 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 optracker 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 objclass 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 filestore 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 journal 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 ms 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mon 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/10 monc 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 paxos 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 tp 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 auth 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 crypto 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 finisher 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 reserver 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 heartbeatmap 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 perfcounter 2024-09-19T14:00:24.414 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_sync 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_datacache 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_access 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_flight 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 20/20 rgw_notification 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 javaclient 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 asok 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 1 throttle 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 0 refs 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 compressor 2024-09-19T14:00:24.415 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluestore 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 bluefs 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 3 bdev 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 kstore 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 4/ 5 rocksdb 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 fuse 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 2/ 5 mgr 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mgrc 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 dpdk 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 eventtrace 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 prioritycache 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 test 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cephsqlite 2024-09-19T14:00:24.416 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_onode 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_odata 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_omap 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_tm 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_t 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_epm 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_lba 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_cache 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_journal 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_device 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 seastore_backref 2024-09-19T14:00:24.417 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 alienstore 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 mclock 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 cyanstore 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 ceph_exporter 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 memstore 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 1/ 5 trace 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 0/ 5 ceph_dedup 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: -2/-2 (syslog threshold) 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 99/99 (stderr threshold) 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4773fff640 / http_manager 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48027e4640 / http_manager 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7f48037e6640 / rgw_dt_lg_renew 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7f481effd640 / ms_dispatch 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4830ff9640 / io_context_pool 2024-09-19T14:00:24.418 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4832ffd640 / ms_dispatch 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4839e03640 / ms_dispatch 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f483b606640 / io_context_pool 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f4947fff640 / msgr-worker-2 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494d7f6640 / msgr-worker-1 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494dff7640 / msgr-worker-0 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494e7f8640 / io_context_pool 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: 7f494fd0c800 / radosgw-admin 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: max_recent 500 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: max_new 1000 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:00:24.287646Z_990997cb-8b39-4854-87a8-599da02a51bb/log 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr:--- end dump of recent events --- 2024-09-19T14:00:24.419 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.359+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 realm 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.361+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.362+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.362+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.362+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:24.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.362+0000 7f592aa10800 20 searching for the correct realm 2024-09-19T14:00:24.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.365+0000 7f59269bd640 0 -- 172.21.15.94:0/1898137481 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f5910020040 msgr2=0x7f5910037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:24.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.369+0000 7f59261bc640 0 -- 172.21.15.94:0/1898137481 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f5910020420 msgr2=0x7f59100208a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.578 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 zone default found 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 4 Realm: () 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 zonegroup default 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.576+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 started sync module instance, tier type = 2024-09-19T14:00:24.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.577+0000 7f592aa10800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=0 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=1 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=2 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=3 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=4 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=5 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=6 2024-09-19T14:00:24.589 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 20 add_watcher() i=7 2024-09-19T14:00:24.590 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.587+0000 7f592aa10800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:24.591 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.589+0000 7f57dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.589+0000 7f592aa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.589+0000 7f592aa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.589+0000 7f592aa10800 5 note: GC not initialized 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f57577fe640 20 reqs_thread_entry: start 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f592aa10800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f592aa10800 20 Filter name: none 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f57557fa640 20 reqs_thread_entry: start 2024-09-19T14:00:24.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.590+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.591+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.591+0000 7f592aa10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.591+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.591+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.591+0000 7f592aa10800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.592+0000 7f592aa10800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.592+0000 7f592aa10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:24.596 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.594+0000 7f57dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.596+0000 7f592aa10800 20 remove_watcher() i=0 2024-09-19T14:00:24.598 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.596+0000 7f592aa10800 2 removed watcher, disabling cache 2024-09-19T14:00:24.599 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.597+0000 7f592aa10800 20 remove_watcher() i=1 2024-09-19T14:00:24.600 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.598+0000 7f592aa10800 20 remove_watcher() i=2 2024-09-19T14:00:24.601 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.599+0000 7f592aa10800 20 remove_watcher() i=3 2024-09-19T14:00:24.602 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.600+0000 7f592aa10800 20 remove_watcher() i=4 2024-09-19T14:00:24.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.601+0000 7f592aa10800 20 remove_watcher() i=5 2024-09-19T14:00:24.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.602+0000 7f592aa10800 20 remove_watcher() i=6 2024-09-19T14:00:24.605 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.603+0000 7f592aa10800 20 remove_watcher() i=7 2024-09-19T14:00:24.625 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:00:24.654 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:24.654 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:24.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.688+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.689+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.689+0000 7f8f04040800 20 realm 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.689+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.690+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.690+0000 7f8f04040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.690+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.690+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.692 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.690+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.691+0000 7f8f04040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.691+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.691+0000 7f8f04040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:24.693 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.691+0000 7f8f04040800 20 searching for the correct realm 2024-09-19T14:00:24.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.694+0000 7f8f01329640 0 -- 172.21.15.94:0/3848955212 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x560852651960 msgr2=0x560852653e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:24.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.698+0000 7f8f01b2a640 0 -- 172.21.15.94:0/3848955212 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8ef8069450 msgr2=0x7f8ef80698d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.906 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.907 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.904+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 zone default found 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 4 Realm: () 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 zonegroup default 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.908 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.905+0000 7f8f04040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.906+0000 7f8f04040800 20 started sync module instance, tier type = 2024-09-19T14:00:24.909 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.906+0000 7f8f04040800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=0 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=1 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=2 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=3 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=4 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=5 2024-09-19T14:00:24.917 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.915+0000 7f8f04040800 20 add_watcher() i=6 2024-09-19T14:00:24.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.916+0000 7f8f04040800 20 add_watcher() i=7 2024-09-19T14:00:24.918 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.916+0000 7f8f04040800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:24.919 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.917+0000 7f8db37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.917+0000 7f8f04040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.917+0000 7f8f04040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.917+0000 7f8f04040800 5 note: GC not initialized 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.918+0000 7f8db27fc640 20 reqs_thread_entry: start 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.918+0000 7f8f04040800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.918+0000 7f8f04040800 20 Filter name: none 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.918+0000 7f8d23fff640 20 reqs_thread_entry: start 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.918+0000 7f8f04040800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:24.920 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.918+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.921 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 20 rados->read ofs=0 len=0 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:24.922 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:24.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.919+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:24.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.920+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:24.923 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.920+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.920+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.920+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.920+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.920+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.921+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.921+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.921+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.921+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.922+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:24.924 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.922+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:24.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.922+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:24.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.922+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:24.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.923+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:24.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.923+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:24.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.923+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:24.925 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.923+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:24.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.923+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:24.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.923+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:24.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.924+0000 7f8f04040800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:24.926 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.924+0000 7f8f04040800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:24.927 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.925+0000 7f8db37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:24.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.927+0000 7f8f04040800 20 remove_watcher() i=0 2024-09-19T14:00:24.929 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.927+0000 7f8f04040800 2 removed watcher, disabling cache 2024-09-19T14:00:24.930 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.928+0000 7f8f04040800 20 remove_watcher() i=1 2024-09-19T14:00:24.931 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.929+0000 7f8f04040800 20 remove_watcher() i=2 2024-09-19T14:00:24.932 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.930+0000 7f8f04040800 20 remove_watcher() i=3 2024-09-19T14:00:24.933 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.931+0000 7f8f04040800 20 remove_watcher() i=4 2024-09-19T14:00:24.934 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.932+0000 7f8f04040800 20 remove_watcher() i=5 2024-09-19T14:00:24.935 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.933+0000 7f8f04040800 20 remove_watcher() i=6 2024-09-19T14:00:24.936 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:24.934+0000 7f8f04040800 20 remove_watcher() i=7 2024-09-19T14:00:54.963 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-19T14:00:54.998 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:54.998 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:55.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.038+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 realm 2024-09-19T14:00:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:55.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.040+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.041+0000 7ff5f6b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.041+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.041+0000 7ff5f6b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:55.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.041+0000 7ff5f6b2c800 20 searching for the correct realm 2024-09-19T14:00:55.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.045+0000 7ff5f204e640 0 -- 172.21.15.94:0/3919019737 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5645af2c47f0 msgr2=0x5645af2c6cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:55.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.049+0000 7ff5f284f640 0 -- 172.21.15.94:0/3919019737 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff5e801f040 msgr2=0x7ff5e80a10b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:55.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.054+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 zone default found 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 4 Realm: () 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 zonegroup default 2024-09-19T14:00:55.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.055+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 started sync module instance, tier type = 2024-09-19T14:00:55.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.056+0000 7ff5f6b2c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=0 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=1 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=2 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=3 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=4 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=5 2024-09-19T14:00:55.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.066+0000 7ff5f6b2c800 20 add_watcher() i=6 2024-09-19T14:00:55.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.067+0000 7ff5f6b2c800 20 add_watcher() i=7 2024-09-19T14:00:55.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.067+0000 7ff5f6b2c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:55.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.069+0000 7ff4a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.069+0000 7ff5f6b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.069+0000 7ff5f6b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.069+0000 7ff5f6b2c800 5 note: GC not initialized 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.069+0000 7ff423fff640 20 reqs_thread_entry: start 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 20 Filter name: none 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff421ffb640 20 reqs_thread_entry: start 2024-09-19T14:00:55.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:55.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.070+0000 7ff5f6b2c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.071+0000 7ff5f6b2c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.071+0000 7ff5f6b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.071+0000 7ff5f6b2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.071+0000 7ff5f6b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.071+0000 7ff5f6b2c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.074 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.071+0000 7ff5f6b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:55.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.075+0000 7ff4a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.077+0000 7ff5f6b2c800 20 remove_watcher() i=0 2024-09-19T14:00:55.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.077+0000 7ff5f6b2c800 2 removed watcher, disabling cache 2024-09-19T14:00:55.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.078+0000 7ff5f6b2c800 20 remove_watcher() i=1 2024-09-19T14:00:55.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.079+0000 7ff5f6b2c800 20 remove_watcher() i=2 2024-09-19T14:00:55.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.080+0000 7ff5f6b2c800 20 remove_watcher() i=3 2024-09-19T14:00:55.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.081+0000 7ff5f6b2c800 20 remove_watcher() i=4 2024-09-19T14:00:55.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.082+0000 7ff5f6b2c800 20 remove_watcher() i=5 2024-09-19T14:00:55.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.083+0000 7ff5f6b2c800 20 remove_watcher() i=6 2024-09-19T14:00:55.086 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.084+0000 7ff5f6b2c800 20 remove_watcher() i=7 2024-09-19T14:00:55.098 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:00:55.127 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:55.127 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:55.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.161+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 realm 2024-09-19T14:00:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.163+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.164+0000 7f5d9e0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.164+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.164+0000 7f5d9e0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:55.167 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.164+0000 7f5d9e0bb800 20 searching for the correct realm 2024-09-19T14:00:55.169 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.167+0000 7f5d9c3a6640 0 -- 172.21.15.94:0/1771913573 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f5d9008a000 msgr2=0x7f5d9008a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.173 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.171+0000 7f5d9bba5640 0 -- 172.21.15.94:0/1771913573 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f5d90082b60 msgr2=0x7f5d9006ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:55.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:55.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:55.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.378+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:55.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 zone default found 2024-09-19T14:00:55.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 4 Realm: () 2024-09-19T14:00:55.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:55.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:55.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 zonegroup default 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.379+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.380+0000 7f5d9e0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.380+0000 7f5d9e0bb800 20 started sync module instance, tier type = 2024-09-19T14:00:55.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.380+0000 7f5d9e0bb800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:55.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=0 2024-09-19T14:00:55.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=1 2024-09-19T14:00:55.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=2 2024-09-19T14:00:55.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=3 2024-09-19T14:00:55.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=4 2024-09-19T14:00:55.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=5 2024-09-19T14:00:55.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.389+0000 7f5d9e0bb800 20 add_watcher() i=6 2024-09-19T14:00:55.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.390+0000 7f5d9e0bb800 20 add_watcher() i=7 2024-09-19T14:00:55.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.390+0000 7f5d9e0bb800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:55.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5c51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5d9e0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:55.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5d9e0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:55.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5d9e0bb800 5 note: GC not initialized 2024-09-19T14:00:55.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5c50fe1640 20 reqs_thread_entry: start 2024-09-19T14:00:55.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5d9e0bb800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:55.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.392+0000 7f5d9e0bb800 20 Filter name: none 2024-09-19T14:00:55.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5bca7fc640 20 reqs_thread_entry: start 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:55.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.393+0000 7f5d9e0bb800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T14:00:55.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:55.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:55.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:55.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.394+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.395+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:55.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.395+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.396+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.396+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.396+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.396+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.397+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.397+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.397+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:55.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.397+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.397+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.397+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.398+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.398+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.398+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:55.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.398+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:55.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.399+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:55.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.399+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:55.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.399+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:55.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.399+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:55.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.399+0000 7f5d9e0bb800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:55.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.399+0000 7f5d9e0bb800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:55.403 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.401+0000 7f5c51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.403+0000 7f5d9e0bb800 20 remove_watcher() i=0 2024-09-19T14:00:55.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.403+0000 7f5d9e0bb800 2 removed watcher, disabling cache 2024-09-19T14:00:55.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.404+0000 7f5d9e0bb800 20 remove_watcher() i=1 2024-09-19T14:00:55.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.405+0000 7f5d9e0bb800 20 remove_watcher() i=2 2024-09-19T14:00:55.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.406+0000 7f5d9e0bb800 20 remove_watcher() i=3 2024-09-19T14:00:55.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.407+0000 7f5d9e0bb800 20 remove_watcher() i=4 2024-09-19T14:00:55.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.408+0000 7f5d9e0bb800 20 remove_watcher() i=5 2024-09-19T14:00:55.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.409+0000 7f5d9e0bb800 20 remove_watcher() i=6 2024-09-19T14:00:55.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.410+0000 7f5d9e0bb800 20 remove_watcher() i=7 2024-09-19T14:00:55.422 INFO:tasks.workunit.client.0.smithi094.stderr:check reshard logrecord successfully 2024-09-19T14:00:55.422 INFO:tasks.workunit.client.0.smithi094.stderr: test: reshard versioned bucket 2024-09-19T14:00:55.423 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:00:55.452 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:55.452 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:55.488 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.486+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 realm 2024-09-19T14:00:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:55.490 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.488+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.489+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.489+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.491 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.489+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:55.492 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.489+0000 7f49e790c800 20 searching for the correct realm 2024-09-19T14:00:55.495 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.493+0000 7f49e5bf7640 0 -- 172.21.15.94:0/4171195831 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x558b2bd037c0 msgr2=0x558b2bd05c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.498 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.496+0000 7f49dcbf5640 0 -- 172.21.15.94:0/4171195831 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f49d80aebb0 msgr2=0x7f49d80b6750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:55.502 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.503 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.500+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.504 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 zone default found 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 4 Realm: () 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 zonegroup default 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.501+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.502+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.502+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.502+0000 7f49e790c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.502+0000 7f49e790c800 20 started sync module instance, tier type = 2024-09-19T14:00:55.506 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.502+0000 7f49e790c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=0 2024-09-19T14:00:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=1 2024-09-19T14:00:55.512 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=2 2024-09-19T14:00:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=3 2024-09-19T14:00:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=4 2024-09-19T14:00:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=5 2024-09-19T14:00:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.510+0000 7f49e790c800 20 add_watcher() i=6 2024-09-19T14:00:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.511+0000 7f49e790c800 20 add_watcher() i=7 2024-09-19T14:00:55.513 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.511+0000 7f49e790c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:55.514 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.512+0000 7f489bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f49e790c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f49e790c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f49e790c800 5 note: GC not initialized 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f489afe5640 20 reqs_thread_entry: start 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f49e790c800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f49e790c800 20 Filter name: none 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f4898fe1640 20 reqs_thread_entry: start 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.513+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:55.516 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:55.517 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.514+0000 7f49e790c800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.515+0000 7f49e790c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.515+0000 7f49e790c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:55.518 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.516+0000 7f489bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.518+0000 7f49e790c800 20 remove_watcher() i=0 2024-09-19T14:00:55.520 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.518+0000 7f49e790c800 2 removed watcher, disabling cache 2024-09-19T14:00:55.522 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.520+0000 7f49e790c800 20 remove_watcher() i=1 2024-09-19T14:00:55.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.521+0000 7f49e790c800 20 remove_watcher() i=2 2024-09-19T14:00:55.524 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.522+0000 7f49e790c800 20 remove_watcher() i=3 2024-09-19T14:00:55.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.523+0000 7f49e790c800 20 remove_watcher() i=4 2024-09-19T14:00:55.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.524+0000 7f49e790c800 20 remove_watcher() i=5 2024-09-19T14:00:55.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.525+0000 7f49e790c800 20 remove_watcher() i=6 2024-09-19T14:00:55.528 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.526+0000 7f49e790c800 20 remove_watcher() i=7 2024-09-19T14:00:55.538 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:55.538 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T14:00:55.538 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-19T14:00:55.538 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:55.539 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-19T14:00:55.570 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:55.570 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:55.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.604+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.605+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.605+0000 7f61d8128800 20 realm 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.605+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.606+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.606+0000 7f61d8128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.606+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.606+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.608 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.606+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.607+0000 7f61d8128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.607+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.607+0000 7f61d8128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:55.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.607+0000 7f61d8128800 20 searching for the correct realm 2024-09-19T14:00:55.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.611+0000 7f61cbfff640 0 -- 172.21.15.94:0/1842323297 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f61c402e070 msgr2=0x7f61c4018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:55.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.614+0000 7f61cbfff640 0 -- 172.21.15.94:0/1842323297 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f609c0873f0 msgr2=0x7f609c089820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:55.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.618+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 zone default found 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 4 Realm: () 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:55.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 zonegroup default 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.619+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.620+0000 7f61d8128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.620+0000 7f61d8128800 20 started sync module instance, tier type = 2024-09-19T14:00:55.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.620+0000 7f61d8128800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=0 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=1 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=2 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=3 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=4 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=5 2024-09-19T14:00:55.630 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.628+0000 7f61d8128800 20 add_watcher() i=6 2024-09-19T14:00:55.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.629+0000 7f61d8128800 20 add_watcher() i=7 2024-09-19T14:00:55.631 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.629+0000 7f61d8128800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f6089fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 5 note: GC not initialized 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f6088fe1640 20 reqs_thread_entry: start 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 20 Filter name: none 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f60027fc640 20 reqs_thread_entry: start 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.631+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.634 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:55.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:00:55.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:00:55.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : miss 2024-09-19T14:00:55.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:55.635 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 adding default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.636 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.632+0000 7f61d8128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:00:55.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.637+0000 7f61d8128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.637+0000 7f61d8128800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.637+0000 7f61d8128800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.639 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.637+0000 7f61d8128800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.637+0000 7f60b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595134 cookie 94539810176432 notifier 8436 bl.length()=905 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f60b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f60b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f60b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:00:55.640 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:00:55.641 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.638+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:00:55.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.0 2024-09-19T14:00:55.645 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.0 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.1 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.1 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.2 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.2 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.3 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.3 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.4 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.4 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.5 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.5 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.6 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.6 2024-09-19T14:00:55.646 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.7 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.7 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.8 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.8 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.9 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.9 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.10 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.10 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.11 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.11 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.0 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1 2024-09-19T14:00:55.647 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.643+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2 2024-09-19T14:00:55.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.644+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3 2024-09-19T14:00:55.648 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.644+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.4 2024-09-19T14:00:55.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.645+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.5 2024-09-19T14:00:55.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.645+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.6 2024-09-19T14:00:55.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.646+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.7 2024-09-19T14:00:55.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.646+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.8 2024-09-19T14:00:55.649 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.646+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.9 2024-09-19T14:00:55.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.647+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.10 2024-09-19T14:00:55.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.647+0000 7f61d8128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:00:55.650 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.647+0000 7f61d8128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f60b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595135 cookie 94539810176432 notifier 8436 bl.length()=905 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f60b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f60b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.651 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f60b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:00:55.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:00:55.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:00:55.652 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.649+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:00:55.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.652+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.0 2024-09-19T14:00:55.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.652+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1 2024-09-19T14:00:55.654 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.652+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2 2024-09-19T14:00:55.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.652+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3 2024-09-19T14:00:55.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.653+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.4 2024-09-19T14:00:55.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.653+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.5 2024-09-19T14:00:55.655 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.653+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.6 2024-09-19T14:00:55.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.654+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.7 2024-09-19T14:00:55.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.654+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.8 2024-09-19T14:00:55.656 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.654+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.9 2024-09-19T14:00:55.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.655+0000 7f61d8128800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.10 2024-09-19T14:00:55.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.655+0000 7f61d8128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:00:55.657 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.655+0000 7f61d8128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:00:55.658 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.656+0000 7f61d8128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.656+0000 7f61d8128800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.656+0000 7f61d8128800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.656+0000 7f61d8128800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.656+0000 7f60b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595136 cookie 94539810176432 notifier 8436 bl.length()=873 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f60b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f60b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f60b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:55.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:00:55.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:00:55.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:00:55.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.657+0000 7f61d8128800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:00:55.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.659+0000 7f61d8128800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-19T14:00:55.663 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.661+0000 7f6089fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.663+0000 7f61d8128800 20 remove_watcher() i=0 2024-09-19T14:00:55.668 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.663+0000 7f61d8128800 2 removed watcher, disabling cache 2024-09-19T14:00:55.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.664+0000 7f61d8128800 20 remove_watcher() i=1 2024-09-19T14:00:55.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.665+0000 7f61d8128800 20 remove_watcher() i=2 2024-09-19T14:00:55.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.666+0000 7f61d8128800 20 remove_watcher() i=3 2024-09-19T14:00:55.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.667+0000 7f61d8128800 20 remove_watcher() i=4 2024-09-19T14:00:55.670 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.668+0000 7f61d8128800 20 remove_watcher() i=5 2024-09-19T14:00:55.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.669+0000 7f61d8128800 20 remove_watcher() i=6 2024-09-19T14:00:55.671 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.670+0000 7f61d8128800 20 remove_watcher() i=7 2024-09-19T14:00:55.683 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:00:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:55.712 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:55.748 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.746+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 realm 2024-09-19T14:00:55.750 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.751 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.748+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.749+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.749+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.749+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:55.752 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.749+0000 7fd23780d800 20 searching for the correct realm 2024-09-19T14:00:55.753 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.751+0000 7fd2352f7640 0 -- 172.21.15.94:0/1371043881 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7fd23005b040 msgr2=0x7fd230050960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.757 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.755+0000 7fd2352f7640 0 -- 172.21.15.94:0/1371043881 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7fd100087390 msgr2=0x7fd1000897c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:55.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:55.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:55.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:55.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:55.762 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:55.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:55.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:55.763 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.760+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 zone default found 2024-09-19T14:00:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 4 Realm: () 2024-09-19T14:00:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:55.764 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 zonegroup default 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 started sync module instance, tier type = 2024-09-19T14:00:55.765 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.761+0000 7fd23780d800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=0 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=1 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=2 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=3 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=4 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=5 2024-09-19T14:00:55.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.770+0000 7fd23780d800 20 add_watcher() i=6 2024-09-19T14:00:55.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.771+0000 7fd23780d800 20 add_watcher() i=7 2024-09-19T14:00:55.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.771+0000 7fd23780d800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:55.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.772+0000 7fd0eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd23780d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:55.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd23780d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd23780d800 5 note: GC not initialized 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd0ea7e4640 20 reqs_thread_entry: start 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd23780d800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd23780d800 20 Filter name: none 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd05bfff640 20 reqs_thread_entry: start 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.773+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:55.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.774+0000 7fd23780d800 20 rados->read ofs=0 len=0 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.775+0000 7fd23780d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:55.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.775+0000 7fd23780d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:55.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.776+0000 7fd0eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:55.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.778+0000 7fd23780d800 20 remove_watcher() i=0 2024-09-19T14:00:55.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.778+0000 7fd23780d800 2 removed watcher, disabling cache 2024-09-19T14:00:55.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.779+0000 7fd23780d800 20 remove_watcher() i=1 2024-09-19T14:00:55.782 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.780+0000 7fd23780d800 20 remove_watcher() i=2 2024-09-19T14:00:55.783 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.781+0000 7fd23780d800 20 remove_watcher() i=3 2024-09-19T14:00:55.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.782+0000 7fd23780d800 20 remove_watcher() i=4 2024-09-19T14:00:55.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.783+0000 7fd23780d800 20 remove_watcher() i=5 2024-09-19T14:00:55.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.784+0000 7fd23780d800 20 remove_watcher() i=6 2024-09-19T14:00:55.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:55.785+0000 7fd23780d800 20 remove_watcher() i=7 2024-09-19T14:00:55.797 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:55.797 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T14:00:55.797 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-19T14:00:55.797 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:55.844 INFO:tasks.workunit.client.0.smithi094.stderr: test: reshard removes olh entries with empty name 2024-09-19T14:00:55.938 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:00:55.965 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:55.966 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:56.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.000+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.004 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 realm 2024-09-19T14:00:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.005 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.002+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.003+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.003+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.003+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:56.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.003+0000 7f261fa20800 20 searching for the correct realm 2024-09-19T14:00:56.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.006+0000 7f261cd10640 0 -- 172.21.15.94:0/2190158360 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f2618032020 msgr2=0x7f2618069020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:56.213 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.211+0000 7f261d511640 0 -- 172.21.15.94:0/2190158360 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f2608058bd0 msgr2=0x7f26080567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:56.419 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:56.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.420 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.417+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 zone default found 2024-09-19T14:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 4 Realm: () 2024-09-19T14:00:56.421 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 zonegroup default 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 started sync module instance, tier type = 2024-09-19T14:00:56.422 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.418+0000 7f261fa20800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:56.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=0 2024-09-19T14:00:56.429 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=1 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=2 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=3 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=4 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=5 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.427+0000 7f261fa20800 20 add_watcher() i=6 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.428+0000 7f261fa20800 20 add_watcher() i=7 2024-09-19T14:00:56.430 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.428+0000 7f261fa20800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:56.432 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.430+0000 7f24d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f261fa20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f261fa20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f261fa20800 5 note: GC not initialized 2024-09-19T14:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f24d27e4640 20 reqs_thread_entry: start 2024-09-19T14:00:56.433 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f261fa20800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:56.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f261fa20800 20 Filter name: none 2024-09-19T14:00:56.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f2443fff640 20 reqs_thread_entry: start 2024-09-19T14:00:56.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.431+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.434 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.432+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.432+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.432+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T14:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.432+0000 7f261fa20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.432+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.433+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:56.435 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.433+0000 7f261fa20800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.433+0000 7f261fa20800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T14:00:56.436 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.433+0000 7f261fa20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:56.437 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.435+0000 7f24d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.437+0000 7f261fa20800 20 remove_watcher() i=0 2024-09-19T14:00:56.439 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.437+0000 7f261fa20800 2 removed watcher, disabling cache 2024-09-19T14:00:56.440 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.438+0000 7f261fa20800 20 remove_watcher() i=1 2024-09-19T14:00:56.441 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.439+0000 7f261fa20800 20 remove_watcher() i=2 2024-09-19T14:00:56.442 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.440+0000 7f261fa20800 20 remove_watcher() i=3 2024-09-19T14:00:56.443 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.441+0000 7f261fa20800 20 remove_watcher() i=4 2024-09-19T14:00:56.444 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.442+0000 7f261fa20800 20 remove_watcher() i=5 2024-09-19T14:00:56.445 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.443+0000 7f261fa20800 20 remove_watcher() i=6 2024-09-19T14:00:56.446 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.444+0000 7f261fa20800 20 remove_watcher() i=7 2024-09-19T14:00:56.456 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:56.456 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T14:00:56.456 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: a-bucket id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-19T14:00:56.456 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:56.457 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-19T14:00:56.487 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:56.487 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:56.523 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.521+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.525 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 realm 2024-09-19T14:00:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.526 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.523+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.524+0000 7fd9e6540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.524+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.525+0000 7fd9e6540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:56.527 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.525+0000 7fd9e6540800 20 searching for the correct realm 2024-09-19T14:00:56.530 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.528+0000 7fd9e2ac1640 0 -- 172.21.15.94:0/3299684481 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fd9cc0e9040 msgr2=0x7fd9cc0dcab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:56.533 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.531+0000 7fd9e22c0640 0 -- 172.21.15.94:0/3299684481 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fd9cc0b9ba0 msgr2=0x7fd9cc0b01c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:56.538 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.535+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 zone default found 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 4 Realm: () 2024-09-19T14:00:56.539 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 zonegroup default 2024-09-19T14:00:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.536+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.537+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.537+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.537+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.537+0000 7fd9e6540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.537+0000 7fd9e6540800 20 started sync module instance, tier type = 2024-09-19T14:00:56.541 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.537+0000 7fd9e6540800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=0 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=1 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=2 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=3 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=4 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=5 2024-09-19T14:00:56.548 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.546+0000 7fd9e6540800 20 add_watcher() i=6 2024-09-19T14:00:56.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.547+0000 7fd9e6540800 20 add_watcher() i=7 2024-09-19T14:00:56.549 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.547+0000 7fd9e6540800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:56.550 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.548+0000 7fd898fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:56.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.548+0000 7fd9e6540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:56.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.548+0000 7fd9e6540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:56.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.548+0000 7fd9e6540800 5 note: GC not initialized 2024-09-19T14:00:56.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd8137fe640 20 reqs_thread_entry: start 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd9e6540800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd9e6540800 20 Filter name: none 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd8117fa640 20 reqs_thread_entry: start 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd9e6540800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.549+0000 7fd9e6540800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.552 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.550+0000 7fd9e6540800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T14:00:56.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.550+0000 7fd9e6540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:56.553 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.551+0000 7fd898fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:56.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.553+0000 7fd9e6540800 20 remove_watcher() i=0 2024-09-19T14:00:56.554 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.553+0000 7fd9e6540800 2 removed watcher, disabling cache 2024-09-19T14:00:56.555 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.553+0000 7fd9e6540800 20 remove_watcher() i=1 2024-09-19T14:00:56.556 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.554+0000 7fd9e6540800 20 remove_watcher() i=2 2024-09-19T14:00:56.557 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.555+0000 7fd9e6540800 20 remove_watcher() i=3 2024-09-19T14:00:56.558 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.556+0000 7fd9e6540800 20 remove_watcher() i=4 2024-09-19T14:00:56.559 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.557+0000 7fd9e6540800 20 remove_watcher() i=5 2024-09-19T14:00:56.560 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.558+0000 7fd9e6540800 20 remove_watcher() i=6 2024-09-19T14:00:56.561 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.559+0000 7fd9e6540800 20 remove_watcher() i=7 2024-09-19T14:00:56.573 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.index setomapval .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-19T14:00:56.599 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:56.599 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:56.614 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-19T14:00:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:56.644 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:56.680 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.678+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.680+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.680+0000 7fdb60098800 20 realm 2024-09-19T14:00:56.682 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.680+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.680+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.680+0000 7fdb60098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:56.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.680+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.681+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:56.683 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.681+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.681+0000 7fdb60098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.681+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.682+0000 7fdb60098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:56.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.682+0000 7fdb60098800 20 searching for the correct realm 2024-09-19T14:00:56.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.684+0000 7fdb55381640 0 -- 172.21.15.94:0/3286393768 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fdb5006d070 msgr2=0x7fdb5009e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:56.891 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:56.889+0000 7fdb5db82640 0 -- 172.21.15.94:0/3286393768 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fdb48001c20 msgr2=0x7fdb4806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:57.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.095+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 zone default found 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 4 Realm: () 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 zonegroup default 2024-09-19T14:00:57.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.096+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.097+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.097+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.097+0000 7fdb60098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.097+0000 7fdb60098800 20 started sync module instance, tier type = 2024-09-19T14:00:57.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.097+0000 7fdb60098800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=0 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=1 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=2 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=3 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=4 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=5 2024-09-19T14:00:57.108 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.106+0000 7fdb60098800 20 add_watcher() i=6 2024-09-19T14:00:57.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.107+0000 7fdb60098800 20 add_watcher() i=7 2024-09-19T14:00:57.109 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.107+0000 7fdb60098800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:57.110 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fda0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.111 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fdb60098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fdb60098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fdb60098800 5 note: GC not initialized 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fda0e7fc640 20 reqs_thread_entry: start 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fdb60098800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fdb60098800 20 Filter name: none 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fd97ffff640 20 reqs_thread_entry: start 2024-09-19T14:00:57.112 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.109+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.110+0000 7fdb60098800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.110+0000 7fdb60098800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 INFO: main: starting shard=0 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:57.113 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 INFO: main: starting shard=1 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.111+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 20 INFO: main: starting shard=2 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 20 INFO: main: starting shard=3 2024-09-19T14:00:57.115 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.112+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 20 INFO: main: starting shard=4 2024-09-19T14:00:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:57.116 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 20 INFO: main: starting shard=5 2024-09-19T14:00:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.113+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.117 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 INFO: main: starting shard=6 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 INFO: main: starting shard=7 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 INFO: main: starting shard=8 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.114+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.115+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.118 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.115+0000 7fdb60098800 20 INFO: main: starting shard=9 2024-09-19T14:00:57.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.115+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:57.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.115+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:57.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.115+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.119 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.115+0000 7fdb60098800 20 INFO: main: starting shard=10 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.116+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.116+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.116+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.116+0000 7fdb60098800 20 INFO: main: starting shard=11 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.116+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.116+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.117+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.117+0000 7fdb60098800 20 INFO: main: starting shard=12 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.117+0000 7fdb60098800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.117+0000 7fdb60098800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.117+0000 7fdb60098800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.120 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.117+0000 7fdb60098800 20 INFO: main: done 2024-09-19T14:00:57.121 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.118+0000 7fda0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.120+0000 7fdb60098800 20 remove_watcher() i=0 2024-09-19T14:00:57.122 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.120+0000 7fdb60098800 2 removed watcher, disabling cache 2024-09-19T14:00:57.123 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.121+0000 7fdb60098800 20 remove_watcher() i=1 2024-09-19T14:00:57.124 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.122+0000 7fdb60098800 20 remove_watcher() i=2 2024-09-19T14:00:57.125 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.123+0000 7fdb60098800 20 remove_watcher() i=3 2024-09-19T14:00:57.126 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.124+0000 7fdb60098800 20 remove_watcher() i=4 2024-09-19T14:00:57.127 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.125+0000 7fdb60098800 20 remove_watcher() i=5 2024-09-19T14:00:57.128 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.126+0000 7fdb60098800 20 remove_watcher() i=6 2024-09-19T14:00:57.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.127+0000 7fdb60098800 20 remove_watcher() i=7 2024-09-19T14:00:57.140 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-19T14:00:57.172 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:57.172 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:57.208 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.206+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 realm 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.210 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.208+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.209+0000 7eff1d31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.209+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.211 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.209+0000 7eff1d31f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:57.212 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.209+0000 7eff1d31f800 20 searching for the correct realm 2024-09-19T14:00:57.215 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.213+0000 7eff198a3640 0 -- 172.21.15.94:0/3111042771 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x5629996d29d0 msgr2=0x5629996d4e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:57.218 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.216+0000 7eff108a1640 0 -- 172.21.15.94:0/3111042771 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7eff0c00b040 msgr2=0x7eff0c03e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.223 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 zone default found 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 4 Realm: () 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 zonegroup default 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.220+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.221+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.224 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.221+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.221+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.221+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.221+0000 7eff1d31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.222+0000 7eff1d31f800 20 started sync module instance, tier type = 2024-09-19T14:00:57.225 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.222+0000 7eff1d31f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:57.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=0 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=1 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=2 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=3 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=4 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=5 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.230+0000 7eff1d31f800 20 add_watcher() i=6 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.231+0000 7eff1d31f800 20 add_watcher() i=7 2024-09-19T14:00:57.233 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.231+0000 7eff1d31f800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:57.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.233+0000 7efdcffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.233+0000 7eff1d31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:57.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.233+0000 7eff1d31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:57.235 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.233+0000 7eff1d31f800 5 note: GC not initialized 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.233+0000 7efdcefe5640 20 reqs_thread_entry: start 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.233+0000 7eff1d31f800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 20 Filter name: none 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7efdccfe1640 20 reqs_thread_entry: start 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:57.237 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : miss 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.238 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.234+0000 7eff1d31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7eff1d31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7eff1d31f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7eff1d31f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7eff1d31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T14:00:57.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7efdebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595172 cookie 94736667774656 notifier 8039 bl.length()=911 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7efdebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7efdebfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.238+0000 7efdebfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.239+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.239+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.239+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T14:00:57.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.239+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T14:00:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.243+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T14:00:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.243+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T14:00:57.245 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.243+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.243+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.244+0000 7eff1d31f800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-19T14:00:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.244+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.244+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.244+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:57.246 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.244+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.245+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.245+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:57.247 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.245+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.245+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.246+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.246+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:57.248 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.246+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.246+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.247+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.247+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:57.249 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.247+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.247+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.248+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.248+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.248+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:57.250 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.248+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.249+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.249+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.249+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:57.251 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.249+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:57.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.250+0000 7eff1d31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:00:57.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.250+0000 7eff1d31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:57.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7eff1d31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7eff1d31f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7eff1d31f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7eff1d31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7efdebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595173 cookie 94736667774656 notifier 8039 bl.length()=911 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7efdebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7efdebfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.251+0000 7efdebfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.252+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.252+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.252+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T14:00:57.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.252+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T14:00:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.254+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.254+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.0 2024-09-19T14:00:57.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.254+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.254+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.1 2024-09-19T14:00:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.2 2024-09-19T14:00:57.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.3 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.4 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.255+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.5 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.256+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:57.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.256+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.6 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.256+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.256+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.7 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.256+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.256+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.8 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.257+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.257+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.9 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.257+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:57.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.257+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.10 2024-09-19T14:00:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.257+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.257+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.11 2024-09-19T14:00:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.258+0000 7eff1d31f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.258+0000 7eff1d31f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.2.12 2024-09-19T14:00:57.260 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.258+0000 7eff1d31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:00:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.258+0000 7eff1d31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 2024-09-19T14:00:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.259+0000 7eff1d31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.259+0000 7eff1d31f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.259+0000 7eff1d31f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.259+0000 7eff1d31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18, ofs0, ns] 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.259+0000 7efdebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595174 cookie 94736667774656 notifier 8039 bl.length()=879 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7efdebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 info.flags=0x17 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7efdebfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18 to cache LRU end 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7efdebfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_sources= new_sources= 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential sources added=[] removed=[] 2024-09-19T14:00:57.262 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): orig_dests= new_dests= 2024-09-19T14:00:57.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.260+0000 7eff1d31f800 20 handle_bi_update(): bucket=:a-bucket[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18]): potential dests added=[] removed=[] 2024-09-19T14:00:57.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.264+0000 7eff1d31f800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-19T14:00:57.268 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.266+0000 7efdcffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.268+0000 7eff1d31f800 20 remove_watcher() i=0 2024-09-19T14:00:57.271 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.268+0000 7eff1d31f800 2 removed watcher, disabling cache 2024-09-19T14:00:57.272 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.270+0000 7eff1d31f800 20 remove_watcher() i=1 2024-09-19T14:00:57.273 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.271+0000 7eff1d31f800 20 remove_watcher() i=2 2024-09-19T14:00:57.274 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.272+0000 7eff1d31f800 20 remove_watcher() i=3 2024-09-19T14:00:57.275 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.273+0000 7eff1d31f800 20 remove_watcher() i=4 2024-09-19T14:00:57.276 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.274+0000 7eff1d31f800 20 remove_watcher() i=5 2024-09-19T14:00:57.277 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.275+0000 7eff1d31f800 20 remove_watcher() i=6 2024-09-19T14:00:57.278 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.276+0000 7eff1d31f800 20 remove_watcher() i=7 2024-09-19T14:00:57.290 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-19T14:00:57.318 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:57.318 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:57.355 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.353+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.354+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.354+0000 7f7c16337800 20 realm 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.354+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.354+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.354+0000 7f7c16337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.354+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.355+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.355+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.355+0000 7f7c16337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.355+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.356+0000 7f7c16337800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:57.358 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.356+0000 7f7c16337800 20 searching for the correct realm 2024-09-19T14:00:57.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.358+0000 7f7c0987c640 0 -- 172.21.15.94:0/542636834 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x561809faf600 msgr2=0x561809fb19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:57.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.362+0000 7f7c1207d640 0 -- 172.21.15.94:0/542636834 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f7bfc0177e0 msgr2=0x7f7bfc0673e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:57.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.369 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.366+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 zone default found 2024-09-19T14:00:57.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 4 Realm: () 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 zonegroup default 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.367+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.368+0000 7f7c16337800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.368+0000 7f7c16337800 20 started sync module instance, tier type = 2024-09-19T14:00:57.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.368+0000 7f7c16337800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=0 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=1 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=2 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=3 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=4 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=5 2024-09-19T14:00:57.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=6 2024-09-19T14:00:57.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 20 add_watcher() i=7 2024-09-19T14:00:57.381 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.378+0000 7f7c16337800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.380+0000 7f7ac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.380+0000 7f7c16337800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.380+0000 7f7c16337800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.380+0000 7f7c16337800 5 note: GC not initialized 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.380+0000 7f7a437fe640 20 reqs_thread_entry: start 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.381+0000 7f7c16337800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.381+0000 7f7c16337800 20 Filter name: none 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.381+0000 7f7a417fa640 20 reqs_thread_entry: start 2024-09-19T14:00:57.383 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.381+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.384 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.381+0000 7f7c16337800 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.381+0000 7f7c16337800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 INFO: main: starting shard=0 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18.3.0 2024-09-19T14:00:57.385 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:00:57.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.382+0000 7f7c16337800 20 INFO: main: done 2024-09-19T14:00:57.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.383+0000 7f7ac8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.385+0000 7f7c16337800 20 remove_watcher() i=0 2024-09-19T14:00:57.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.385+0000 7f7c16337800 2 removed watcher, disabling cache 2024-09-19T14:00:57.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.386+0000 7f7c16337800 20 remove_watcher() i=1 2024-09-19T14:00:57.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.387+0000 7f7c16337800 20 remove_watcher() i=2 2024-09-19T14:00:57.389 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.388+0000 7f7c16337800 20 remove_watcher() i=3 2024-09-19T14:00:57.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.389+0000 7f7c16337800 20 remove_watcher() i=4 2024-09-19T14:00:57.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.390+0000 7f7c16337800 20 remove_watcher() i=5 2024-09-19T14:00:57.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.390+0000 7f7c16337800 20 remove_watcher() i=6 2024-09-19T14:00:57.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.391+0000 7f7c16337800 20 remove_watcher() i=7 2024-09-19T14:00:57.405 INFO:tasks.workunit.client.0.smithi094.stderr: test: PUT succeeds during reshard 2024-09-19T14:00:57.407 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:00:57.435 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:57.436 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:57.471 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.469+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.470+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.470+0000 7f0416ab7800 20 realm 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.470+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.470+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.470+0000 7f0416ab7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.470+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.471+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.473 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.471+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.471+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.471+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.472+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:57.474 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.472+0000 7f0416ab7800 20 searching for the correct realm 2024-09-19T14:00:57.477 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.475+0000 7f0413da0640 0 -- 172.21.15.94:0/2782427972 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x559e4b40f170 msgr2=0x559e4b411560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:57.480 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.478+0000 7f04145a1640 0 -- 172.21.15.94:0/2782427972 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f040801c040 msgr2=0x7f04080323f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:57.686 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.687 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.684+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:57.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 zone default found 2024-09-19T14:00:57.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 4 Realm: () 2024-09-19T14:00:57.688 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 zonegroup default 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 started sync module instance, tier type = 2024-09-19T14:00:57.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.685+0000 7f0416ab7800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=0 2024-09-19T14:00:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=1 2024-09-19T14:00:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=2 2024-09-19T14:00:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=3 2024-09-19T14:00:57.696 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=4 2024-09-19T14:00:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=5 2024-09-19T14:00:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.694+0000 7f0416ab7800 20 add_watcher() i=6 2024-09-19T14:00:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.695+0000 7f0416ab7800 20 add_watcher() i=7 2024-09-19T14:00:57.697 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.695+0000 7f0416ab7800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:57.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f02cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.699 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f0416ab7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f0416ab7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f0416ab7800 5 note: GC not initialized 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f02c9fe3640 20 reqs_thread_entry: start 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f0416ab7800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f0416ab7800 20 Filter name: none 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.697+0000 7f02c2ffd640 20 reqs_thread_entry: start 2024-09-19T14:00:57.700 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.698+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.698+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.698+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.698+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.698+0000 7f0416ab7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:57.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.698+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.699+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.699+0000 7f0416ab7800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.699+0000 7f0416ab7800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.699+0000 7f0416ab7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:00:57.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.701+0000 7f02cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:57.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.702+0000 7f0416ab7800 20 remove_watcher() i=0 2024-09-19T14:00:57.705 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.702+0000 7f0416ab7800 2 removed watcher, disabling cache 2024-09-19T14:00:57.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.704+0000 7f0416ab7800 20 remove_watcher() i=1 2024-09-19T14:00:57.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.705+0000 7f0416ab7800 20 remove_watcher() i=2 2024-09-19T14:00:57.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.706+0000 7f0416ab7800 20 remove_watcher() i=3 2024-09-19T14:00:57.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.707+0000 7f0416ab7800 20 remove_watcher() i=4 2024-09-19T14:00:57.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.707+0000 7f0416ab7800 20 remove_watcher() i=5 2024-09-19T14:00:57.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.708+0000 7f0416ab7800 20 remove_watcher() i=6 2024-09-19T14:00:57.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.709+0000 7f0416ab7800 20 remove_watcher() i=7 2024-09-19T14:00:57.721 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:57.722 INFO:tasks.workunit.client.0.smithi094.stderr:BUCKET_STATS: 2024-09-19T14:00:57.722 INFO:tasks.workunit.client.0.smithi094.stderr:bucket: myver id: ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-19T14:00:57.722 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:00:57.723 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-19T14:00:57.755 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:00:57.756 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:00:57.792 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.790+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 realm 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:57.794 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.792+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.793+0000 7f3846487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.793+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.793+0000 7f3846487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:00:57.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.793+0000 7f3846487800 20 searching for the correct realm 2024-09-19T14:00:57.798 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.796+0000 7f3844779640 0 -- 172.21.15.94:0/1463325030 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f383806de30 msgr2=0x7f38380769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:00:57.801 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:57.799+0000 7f3843f78640 0 -- 172.21.15.94:0/1463325030 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f38380758f0 msgr2=0x7f383808e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:00:58.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:00:58.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:00:58.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:00:58.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:00:58.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:00:58.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:00:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.004+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:00:58.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 zone default found 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 4 Realm: () 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 zonegroup default 2024-09-19T14:00:58.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.005+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 started sync module instance, tier type = 2024-09-19T14:00:58.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.006+0000 7f3846487800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:00:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=0 2024-09-19T14:00:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=1 2024-09-19T14:00:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=2 2024-09-19T14:00:58.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=3 2024-09-19T14:00:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=4 2024-09-19T14:00:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=5 2024-09-19T14:00:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.015+0000 7f3846487800 20 add_watcher() i=6 2024-09-19T14:00:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.016+0000 7f3846487800 20 add_watcher() i=7 2024-09-19T14:00:58.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.016+0000 7f3846487800 2 all 8 watchers are set, enabling cache 2024-09-19T14:00:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f36f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:00:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:00:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:00:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 5 note: GC not initialized 2024-09-19T14:00:58.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f36f8fe1640 20 reqs_thread_entry: start 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 20 init_complete bucket index max shards: 11 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 20 Filter name: none 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f36727fc640 20 reqs_thread_entry: start 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.018+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : miss 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 20 rados->read ofs=0 len=0 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:00:58.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 adding default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:00:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:58.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.019+0000 7f3846487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3722ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595137 cookie 93862499459632 notifier 8592 bl.length()=905 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3722ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:00:58.026 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3722ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:00:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3722ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:00:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:00:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:00:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:00:58.027 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.024+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:00:58.031 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:00:58.029+0000 7f3846487800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-19T14:00:58.740 INFO:tasks.workunit.client.0.smithi094.stderr:put object successful 2024-09-19T14:01:03.032 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:03.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:03.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:03.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.030+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:03.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.031+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.0 2024-09-19T14:01:03.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.031+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.0 2024-09-19T14:01:03.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.031+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.1 2024-09-19T14:01:03.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.031+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.1 2024-09-19T14:01:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.032+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.2 2024-09-19T14:01:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.032+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.2 2024-09-19T14:01:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.033+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.3 2024-09-19T14:01:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.033+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.3 2024-09-19T14:01:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.033+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.4 2024-09-19T14:01:03.037 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.033+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.4 2024-09-19T14:01:03.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.034+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.5 2024-09-19T14:01:03.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.034+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.5 2024-09-19T14:01:03.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.035+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.6 2024-09-19T14:01:03.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.035+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.6 2024-09-19T14:01:03.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.036+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.7 2024-09-19T14:01:03.038 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.036+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.7 2024-09-19T14:01:03.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.036+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.8 2024-09-19T14:01:03.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.036+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.8 2024-09-19T14:01:03.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.037+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.9 2024-09-19T14:01:03.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.037+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.9 2024-09-19T14:01:03.039 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.038+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.10 2024-09-19T14:01:03.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.038+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.10 2024-09-19T14:01:03.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.039+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.11 2024-09-19T14:01:03.040 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.039+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.11 2024-09-19T14:01:03.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.041+0000 7f3846487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:01:03.042 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.041+0000 7f3846487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:01:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.042+0000 7f3846487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.042+0000 7f3846487800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.042+0000 7f3846487800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.042+0000 7f3846487800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:01:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3722ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595138 cookie 93862499459632 notifier 8592 bl.length()=905 2024-09-19T14:01:03.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3722ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3722ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3722ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:01:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:01:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:01:03.045 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.043+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:01:03.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.046+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.0 2024-09-19T14:01:03.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.046+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.0 2024-09-19T14:01:03.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.047+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.1 2024-09-19T14:01:03.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.047+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.1 2024-09-19T14:01:03.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.047+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.2 2024-09-19T14:01:03.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.047+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.2 2024-09-19T14:01:03.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.047+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.3 2024-09-19T14:01:03.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.047+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.3 2024-09-19T14:01:03.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.048+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.4 2024-09-19T14:01:03.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.048+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.4 2024-09-19T14:01:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.048+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.5 2024-09-19T14:01:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.048+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.5 2024-09-19T14:01:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.049+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.6 2024-09-19T14:01:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.049+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.6 2024-09-19T14:01:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.049+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.7 2024-09-19T14:01:03.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.049+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.7 2024-09-19T14:01:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.049+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.8 2024-09-19T14:01:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.049+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.8 2024-09-19T14:01:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.050+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.9 2024-09-19T14:01:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.050+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.9 2024-09-19T14:01:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.050+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.10 2024-09-19T14:01:03.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.050+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.10 2024-09-19T14:01:03.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.050+0000 7f3846487800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.11 2024-09-19T14:01:03.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.050+0000 7f3846487800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.1.11 2024-09-19T14:01:03.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.053+0000 7f3846487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:01:03.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.053+0000 7f3846487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:01:03.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.054+0000 7f3846487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:03.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.054+0000 7f3846487800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.054+0000 7f3846487800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.054+0000 7f3846487800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:01:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3722ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595139 cookie 93862499459632 notifier 8592 bl.length()=873 2024-09-19T14:01:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3722ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:03.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3722ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3722ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:01:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:01:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:01:03.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.055+0000 7f3846487800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:01:03.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.060+0000 7f3846487800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-19T14:01:03.063 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.062+0000 7f36f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:03.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.064+0000 7f3846487800 20 remove_watcher() i=0 2024-09-19T14:01:03.065 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.064+0000 7f3846487800 2 removed watcher, disabling cache 2024-09-19T14:01:03.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.065+0000 7f3846487800 20 remove_watcher() i=1 2024-09-19T14:01:03.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.066+0000 7f3846487800 20 remove_watcher() i=2 2024-09-19T14:01:03.069 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.068+0000 7f3846487800 20 remove_watcher() i=3 2024-09-19T14:01:03.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.069+0000 7f3846487800 20 remove_watcher() i=4 2024-09-19T14:01:03.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.070+0000 7f3846487800 20 remove_watcher() i=5 2024-09-19T14:01:03.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.071+0000 7f3846487800 20 remove_watcher() i=6 2024-09-19T14:01:03.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:03.072+0000 7f3846487800 20 remove_watcher() i=7 2024-09-19T14:01:03.745 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-19T14:01:03.746 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:01:03.848 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T14:01:04.245 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T14:01:05.693 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:01:05.695 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-19T14:01:05.729 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:05.730 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:05.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.769+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 realm 2024-09-19T14:01:05.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:05.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.771+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.772+0000 7f6cd471f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:05.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.772+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.773+0000 7f6cd471f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:05.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.773+0000 7f6cd471f800 20 searching for the correct realm 2024-09-19T14:01:05.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.775+0000 7f6cc7ca1640 0 -- 172.21.15.94:0/975125134 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f6cc0044450 msgr2=0x7f6cc00448d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:05.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.781+0000 7f6cd04a2640 0 -- 172.21.15.94:0/975125134 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6cb80bfbc0 msgr2=0x7f6cb80586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:05.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:05.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:05.990 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.991 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:05.992 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.989+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 zone default found 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 4 Realm: () 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 zonegroup default 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.993 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.990+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:05.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.991+0000 7f6cd471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:05.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.991+0000 7f6cd471f800 20 started sync module instance, tier type = 2024-09-19T14:01:05.994 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:05.991+0000 7f6cd471f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:06.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=0 2024-09-19T14:01:06.002 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=1 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=2 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=3 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=4 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=5 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.001+0000 7f6cd471f800 20 add_watcher() i=6 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.002+0000 7f6cd471f800 20 add_watcher() i=7 2024-09-19T14:01:06.003 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.002+0000 7f6cd471f800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.004+0000 7f6b867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.004+0000 7f6cd471f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.004+0000 7f6cd471f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.004+0000 7f6cd471f800 5 note: GC not initialized 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6b857e2640 20 reqs_thread_entry: start 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6cd471f800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6cd471f800 20 Filter name: none 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.006 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6af6ffd640 20 reqs_thread_entry: start 2024-09-19T14:01:06.007 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6cd471f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.005+0000 7f6cd471f800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 INFO: main: starting shard=0 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 INFO: main: starting shard=1 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:06.008 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.006+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:06.009 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.007+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.007+0000 7f6cd471f800 20 INFO: main: starting shard=2 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.007+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.007+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 20 INFO: main: starting shard=3 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 20 INFO: main: starting shard=4 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.008+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 20 INFO: main: starting shard=5 2024-09-19T14:01:06.010 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:06.011 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 20 INFO: main: starting shard=6 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.009+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 INFO: main: starting shard=7 2024-09-19T14:01:06.012 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 INFO: main: starting shard=8 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 INFO: main: starting shard=9 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.010+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.011+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.011+0000 7f6cd471f800 20 INFO: main: starting shard=10 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.011+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:06.013 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.011+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:06.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 20 INFO: main: starting shard=11 2024-09-19T14:01:06.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:06.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:06.014 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 20 INFO: main: starting shard=12 2024-09-19T14:01:06.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:06.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.012+0000 7f6cd471f800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:06.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.013+0000 7f6cd471f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.013+0000 7f6cd471f800 20 INFO: main: done 2024-09-19T14:01:06.015 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.013+0000 7f6b867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:06.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.016+0000 7f6cd471f800 20 remove_watcher() i=0 2024-09-19T14:01:06.017 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.016+0000 7f6cd471f800 2 removed watcher, disabling cache 2024-09-19T14:01:06.018 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.017+0000 7f6cd471f800 20 remove_watcher() i=1 2024-09-19T14:01:06.019 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.018+0000 7f6cd471f800 20 remove_watcher() i=2 2024-09-19T14:01:06.020 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.019+0000 7f6cd471f800 20 remove_watcher() i=3 2024-09-19T14:01:06.021 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.020+0000 7f6cd471f800 20 remove_watcher() i=4 2024-09-19T14:01:06.022 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.021+0000 7f6cd471f800 20 remove_watcher() i=5 2024-09-19T14:01:06.023 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.022+0000 7f6cd471f800 20 remove_watcher() i=6 2024-09-19T14:01:06.024 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.023+0000 7f6cd471f800 20 remove_watcher() i=7 2024-09-19T14:01:06.090 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:01:06.091 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-19T14:01:06.124 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:06.124 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:06.161 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.160+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 realm 2024-09-19T14:01:06.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.163 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:06.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.162+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.163+0000 7f8dc2f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:06.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.163+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.164 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.163+0000 7f8dc2f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:06.165 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.163+0000 7f8dc2f46800 20 searching for the correct realm 2024-09-19T14:01:06.166 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.165+0000 7f8dc0a37640 0 -- 172.21.15.94:0/36055377 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x555a09996620 msgr2=0x7f8dbc0a88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:06.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.370+0000 7f8dc1238640 0 -- 172.21.15.94:0/36055377 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f8dac0734c0 msgr2=0x7f8dac068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.376+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 zone default found 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 4 Realm: () 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 zonegroup default 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.377+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.378+0000 7f8dc2f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.378+0000 7f8dc2f46800 20 started sync module instance, tier type = 2024-09-19T14:01:06.380 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.378+0000 7f8dc2f46800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:06.387 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=0 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=1 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=2 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=3 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=4 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=5 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.386+0000 7f8dc2f46800 20 add_watcher() i=6 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.387+0000 7f8dc2f46800 20 add_watcher() i=7 2024-09-19T14:01:06.388 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.387+0000 7f8dc2f46800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:06.390 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.389+0000 7f8c777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:06.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:06.391 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 5 note: GC not initialized 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8c767e4640 20 reqs_thread_entry: start 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 20 Filter name: none 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8c6ffff640 20 reqs_thread_entry: start 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.390+0000 7f8dc2f46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:06.392 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 INFO: main: starting shard=0 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 INFO: main: starting shard=1 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:06.393 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.391+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:06.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.392+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.392+0000 7f8dc2f46800 20 INFO: main: starting shard=2 2024-09-19T14:01:06.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.392+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:06.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.392+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:06.394 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.393+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.393+0000 7f8dc2f46800 20 INFO: main: starting shard=3 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.393+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.393+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 20 INFO: main: starting shard=4 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:06.395 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 20 INFO: main: starting shard=5 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.394+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 20 INFO: main: starting shard=6 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:06.396 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 20 INFO: main: starting shard=7 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.395+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.396+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.396+0000 7f8dc2f46800 20 INFO: main: starting shard=8 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.396+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:06.397 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.396+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:06.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 20 INFO: main: starting shard=9 2024-09-19T14:01:06.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:06.398 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 20 INFO: main: starting shard=10 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.397+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.398+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.398+0000 7f8dc2f46800 20 INFO: main: starting shard=11 2024-09-19T14:01:06.399 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.398+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:06.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.398+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:06.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.399+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.399+0000 7f8dc2f46800 20 INFO: main: starting shard=12 2024-09-19T14:01:06.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.399+0000 7f8dc2f46800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:06.400 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.399+0000 7f8dc2f46800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:06.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.399+0000 7f8dc2f46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.399+0000 7f8dc2f46800 20 INFO: main: done 2024-09-19T14:01:06.401 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.400+0000 7f8c777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:06.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.403+0000 7f8dc2f46800 20 remove_watcher() i=0 2024-09-19T14:01:06.404 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.403+0000 7f8dc2f46800 2 removed watcher, disabling cache 2024-09-19T14:01:06.405 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.404+0000 7f8dc2f46800 20 remove_watcher() i=1 2024-09-19T14:01:06.406 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.405+0000 7f8dc2f46800 20 remove_watcher() i=2 2024-09-19T14:01:06.407 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.406+0000 7f8dc2f46800 20 remove_watcher() i=3 2024-09-19T14:01:06.408 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.407+0000 7f8dc2f46800 20 remove_watcher() i=4 2024-09-19T14:01:06.409 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.408+0000 7f8dc2f46800 20 remove_watcher() i=5 2024-09-19T14:01:06.410 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.409+0000 7f8dc2f46800 20 remove_watcher() i=6 2024-09-19T14:01:06.411 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.410+0000 7f8dc2f46800 20 remove_watcher() i=7 2024-09-19T14:01:06.473 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:01:06.474 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-19T14:01:06.504 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:06.505 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:06.540 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.539+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 realm 2024-09-19T14:01:06.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.542 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:06.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.541+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.542+0000 7fcb01210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:06.543 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.542+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.543+0000 7fcb01210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:06.544 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.543+0000 7fcb01210800 20 searching for the correct realm 2024-09-19T14:01:06.546 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.546+0000 7fcaf7fff640 0 -- 172.21.15.94:0/1877463770 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fcaf0025bc0 msgr2=0x7fcaf0016430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:06.551 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.550+0000 7fcafc9bc640 0 -- 172.21.15.94:0/1877463770 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fcae8090420 msgr2=0x7fcae80908a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:06.758 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.759 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.757+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:06.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:06.760 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 zone default found 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 4 Realm: () 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 zonegroup default 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.758+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.759+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.759+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.759+0000 7fcb01210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.759+0000 7fcb01210800 20 started sync module instance, tier type = 2024-09-19T14:01:06.761 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.759+0000 7fcb01210800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=0 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=1 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=2 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=3 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=4 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=5 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.768+0000 7fcb01210800 20 add_watcher() i=6 2024-09-19T14:01:06.769 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.769+0000 7fcb01210800 20 add_watcher() i=7 2024-09-19T14:01:06.770 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.769+0000 7fcb01210800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:06.771 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.770+0000 7fc9b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.770+0000 7fcb01210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.770+0000 7fcb01210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.770+0000 7fcb01210800 5 note: GC not initialized 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fc9b1fe3640 20 reqs_thread_entry: start 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fcb01210800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fcb01210800 20 Filter name: none 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fc9237fe640 20 reqs_thread_entry: start 2024-09-19T14:01:06.772 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fcb01210800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:06.773 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.771+0000 7fcb01210800 20 rados->read ofs=0 len=0 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 INFO: main: starting shard=0 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 INFO: main: starting shard=1 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:06.774 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.772+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:06.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.773+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.773+0000 7fcb01210800 20 INFO: main: starting shard=2 2024-09-19T14:01:06.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.773+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:06.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.773+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:06.775 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 20 INFO: main: starting shard=3 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 20 INFO: main: starting shard=4 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:06.776 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.774+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 20 INFO: main: starting shard=5 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 20 INFO: main: starting shard=6 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:06.777 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.775+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.776+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.776+0000 7fcb01210800 20 INFO: main: starting shard=7 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.776+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.776+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 20 INFO: main: starting shard=8 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:06.778 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:06.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 20 INFO: main: starting shard=9 2024-09-19T14:01:06.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:06.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.777+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:06.779 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.778+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.778+0000 7fcb01210800 20 INFO: main: starting shard=10 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.778+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.778+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 20 INFO: main: starting shard=11 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:06.780 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 20 INFO: main: starting shard=12 2024-09-19T14:01:06.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:06.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.779+0000 7fcb01210800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:06.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.780+0000 7fcb01210800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:01:06.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.780+0000 7fcb01210800 20 INFO: main: done 2024-09-19T14:01:06.781 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.780+0000 7fc9b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:06.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.783+0000 7fcb01210800 20 remove_watcher() i=0 2024-09-19T14:01:06.784 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.783+0000 7fcb01210800 2 removed watcher, disabling cache 2024-09-19T14:01:06.785 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.784+0000 7fcb01210800 20 remove_watcher() i=1 2024-09-19T14:01:06.786 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.785+0000 7fcb01210800 20 remove_watcher() i=2 2024-09-19T14:01:06.787 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.786+0000 7fcb01210800 20 remove_watcher() i=3 2024-09-19T14:01:06.788 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.787+0000 7fcb01210800 20 remove_watcher() i=4 2024-09-19T14:01:06.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.788+0000 7fcb01210800 20 remove_watcher() i=5 2024-09-19T14:01:06.789 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.789+0000 7fcb01210800 20 remove_watcher() i=6 2024-09-19T14:01:06.790 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:06.790+0000 7fcb01210800 20 remove_watcher() i=7 2024-09-19T14:01:06.806 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T14:01:07.197 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T14:01:07.589 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-19T14:01:07.621 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:07.622 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:07.659 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.658+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.660 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 realm 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.661 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.659+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.661+0000 7fb89e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:07.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.661+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.661+0000 7fb89e12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:07.662 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.661+0000 7fb89e12c800 20 searching for the correct realm 2024-09-19T14:01:07.666 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.665+0000 7fb89a562640 0 -- 172.21.15.94:0/1695982479 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x55600bee6090 msgr2=0x55600bee84f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:07.669 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.668+0000 7fb891560640 0 -- 172.21.15.94:0/1695982479 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fb88c04cb80 msgr2=0x7fb88c018980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:07.673 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.672+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.674 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:07.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:07.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 zone default found 2024-09-19T14:01:07.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 4 Realm: () 2024-09-19T14:01:07.675 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 zonegroup default 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.673+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.674+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.674+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.674+0000 7fb89e12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.674+0000 7fb89e12c800 20 started sync module instance, tier type = 2024-09-19T14:01:07.676 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.674+0000 7fb89e12c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:07.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=0 2024-09-19T14:01:07.684 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=1 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=2 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=3 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=4 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=5 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.683+0000 7fb89e12c800 20 add_watcher() i=6 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.684+0000 7fb89e12c800 20 add_watcher() i=7 2024-09-19T14:01:07.685 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.684+0000 7fb89e12c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:07.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.686+0000 7fb74b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:07.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.686+0000 7fb89e12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:07.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.686+0000 7fb89e12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:07.689 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.686+0000 7fb89e12c800 5 note: GC not initialized 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb74a7fc640 20 reqs_thread_entry: start 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 20 Filter name: none 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb6bbfff640 20 reqs_thread_entry: start 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:07.690 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : miss 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.687+0000 7fb89e12c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.688+0000 7fb89e12c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.688+0000 7fb89e12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.688+0000 7fb89e12c800 10 adding default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.688+0000 7fb89e12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.688+0000 7fb89e12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.691 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.688+0000 7fb89e12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:01:07.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb89e12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb89e12c800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb89e12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.694 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb89e12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb77cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595140 cookie 93871005456304 notifier 8691 bl.length()=905 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb77cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb77cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.693+0000 7fb77cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.694+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.694+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.694+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:01:07.695 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.694+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.0 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.0 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.1 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.1 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.2 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.2 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.3 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.3 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.4 2024-09-19T14:01:07.701 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.4 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.5 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.5 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.6 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.6 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.7 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.7 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.8 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.8 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.10 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.10 2024-09-19T14:01:07.702 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.11 2024-09-19T14:01:07.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.11 2024-09-19T14:01:07.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.12 2024-09-19T14:01:07.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.12 2024-09-19T14:01:07.703 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.13 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.13 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.14 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.14 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.15 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.15 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.16 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.16 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:07.704 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.699+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:07.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.700+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:07.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.700+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:07.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.701+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:07.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.701+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:07.706 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.701+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.701+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.702+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.702+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.702+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.702+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.703+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.703+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.703+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.703+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.704+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.704+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.704+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.704+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:07.707 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.705+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:07.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.705+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:07.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.706+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:07.708 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.706+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:07.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.708+0000 7fb89e12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:01:07.709 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.708+0000 7fb89e12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb77cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595141 cookie 93871005456304 notifier 8691 bl.length()=905 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb77cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb77cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.710 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb77cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:01:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:01:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:01:07.711 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.709+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:01:07.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.712+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:07.713 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.712+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.0 2024-09-19T14:01:07.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.712+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:07.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.712+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.1 2024-09-19T14:01:07.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.713+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:07.714 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.713+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.2 2024-09-19T14:01:07.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.713+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:07.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.713+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.3 2024-09-19T14:01:07.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.713+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:07.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.713+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.4 2024-09-19T14:01:07.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.714+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:07.715 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.714+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.5 2024-09-19T14:01:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.714+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.714+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.6 2024-09-19T14:01:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.714+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.714+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.7 2024-09-19T14:01:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.715+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:07.716 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.715+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.8 2024-09-19T14:01:07.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.715+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:07.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.715+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.9 2024-09-19T14:01:07.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.715+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:07.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.715+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.10 2024-09-19T14:01:07.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.716+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:07.717 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.716+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.11 2024-09-19T14:01:07.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.716+0000 7fb89e12c800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:07.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.716+0000 7fb89e12c800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.2.12 2024-09-19T14:01:07.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.716+0000 7fb89e12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:01:07.718 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.716+0000 7fb89e12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 10 moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19, ofs0, ns] 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb77cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595142 cookie 93871005456304 notifier 8691 bl.length()=873 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb77cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:07.719 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb77cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:07.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb77cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:07.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_sources= new_sources= 2024-09-19T14:01:07.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential sources added=[] removed=[] 2024-09-19T14:01:07.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): orig_dests= new_dests= 2024-09-19T14:01:07.720 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.718+0000 7fb89e12c800 20 handle_bi_update(): bucket=:myver[ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19]): potential dests added=[] removed=[] 2024-09-19T14:01:07.722 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.721+0000 7fb89e12c800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-19T14:01:07.723 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.723+0000 7fb74b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:07.728 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.725+0000 7fb89e12c800 20 remove_watcher() i=0 2024-09-19T14:01:07.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.725+0000 7fb89e12c800 2 removed watcher, disabling cache 2024-09-19T14:01:07.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.726+0000 7fb89e12c800 20 remove_watcher() i=1 2024-09-19T14:01:07.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.727+0000 7fb89e12c800 20 remove_watcher() i=2 2024-09-19T14:01:07.729 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.728+0000 7fb89e12c800 20 remove_watcher() i=3 2024-09-19T14:01:07.730 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.729+0000 7fb89e12c800 20 remove_watcher() i=4 2024-09-19T14:01:07.731 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.730+0000 7fb89e12c800 20 remove_watcher() i=5 2024-09-19T14:01:07.732 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.731+0000 7fb89e12c800 20 remove_watcher() i=6 2024-09-19T14:01:07.733 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.732+0000 7fb89e12c800 20 remove_watcher() i=7 2024-09-19T14:01:07.744 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T14:01:07.779 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:07.780 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:07.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.815+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 realm 2024-09-19T14:01:07.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:07.818 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:07.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.817+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.818+0000 7fbb2ff3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:07.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.818+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:07.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.818+0000 7fbb2ff3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:07.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.818+0000 7fbb2ff3a800 20 searching for the correct realm 2024-09-19T14:01:07.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.821+0000 7fbb2b4ba640 0 -- 172.21.15.94:0/2915192051 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fbb1c02f070 msgr2=0x7fbb1c078a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:07.825 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:07.824+0000 7fbb2bcbb640 0 -- 172.21.15.94:0/2915192051 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fbb140b2370 msgr2=0x7fbb14079970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:08.033 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.031+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:08.034 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 zone default found 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 4 Realm: () 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 zonegroup default 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.032+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.035 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.033+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.033+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.033+0000 7fbb2ff3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.033+0000 7fbb2ff3a800 20 started sync module instance, tier type = 2024-09-19T14:01:08.036 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.033+0000 7fbb2ff3a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:08.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=0 2024-09-19T14:01:08.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=1 2024-09-19T14:01:08.043 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=2 2024-09-19T14:01:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=3 2024-09-19T14:01:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=4 2024-09-19T14:01:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=5 2024-09-19T14:01:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.042+0000 7fbb2ff3a800 20 add_watcher() i=6 2024-09-19T14:01:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.043+0000 7fbb2ff3a800 20 add_watcher() i=7 2024-09-19T14:01:08.044 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.043+0000 7fbb2ff3a800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:08.046 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fb9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fbb2ff3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fbb2ff3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fbb2ff3a800 5 note: GC not initialized 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fb9e0fe1640 20 reqs_thread_entry: start 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fbb2ff3a800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.045+0000 7fbb2ff3a800 20 Filter name: none 2024-09-19T14:01:08.047 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fb95a7fc640 20 reqs_thread_entry: start 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 : miss 2024-09-19T14:01:08.048 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:08.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 info.flags=0x17 2024-09-19T14:01:08.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 adding default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 to cache LRU end 2024-09-19T14:01:08.049 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.0 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.046+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.0 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.047+0000 7fbb2ff3a800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.047+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.1 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.047+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.1 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.048+0000 7fbb2ff3a800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.048+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.2 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.048+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.2 2024-09-19T14:01:08.050 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.048+0000 7fbb2ff3a800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T14:01:08.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.048+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.3 2024-09-19T14:01:08.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.048+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.3 2024-09-19T14:01:08.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.049+0000 7fbb2ff3a800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T14:01:08.051 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.049+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.4 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.049+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.4 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.049+0000 7fbb2ff3a800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.049+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.5 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.049+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.5 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.050+0000 7fbb2ff3a800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.050+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.6 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.050+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.6 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.050+0000 7fbb2ff3a800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.050+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.7 2024-09-19T14:01:08.052 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.050+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.7 2024-09-19T14:01:08.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.051+0000 7fbb2ff3a800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T14:01:08.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.051+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.8 2024-09-19T14:01:08.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.051+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.8 2024-09-19T14:01:08.053 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.10 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.10 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.11 2024-09-19T14:01:08.054 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.052+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.11 2024-09-19T14:01:08.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.053+0000 7fbb2ff3a800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-19T14:01:08.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.053+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.12 2024-09-19T14:01:08.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.053+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.12 2024-09-19T14:01:08.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.053+0000 7fbb2ff3a800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-19T14:01:08.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.053+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.13 2024-09-19T14:01:08.055 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.053+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.13 2024-09-19T14:01:08.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-19T14:01:08.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.14 2024-09-19T14:01:08.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.14 2024-09-19T14:01:08.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-19T14:01:08.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.15 2024-09-19T14:01:08.056 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.15 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 10 bucket_obj is .dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.16 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.054+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.16 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.055+0000 7fbb2ff3a800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.055+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.055+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:x state=0x5622aff520e8 s->prefetch_data=0 2024-09-19T14:01:08.057 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.055+0000 7fbb2ff3a800 20 get_obj_state: setting s->obj_tag to munxpp9iheidt7z2gq7262av4j2lqsm1 2024-09-19T14:01:08.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.055+0000 7fbb2ff3a800 20 get_obj_state_impl: setting s->olh_tag to fbfesmp5c5ab825ulm38u0zlghzhwi4x 2024-09-19T14:01:08.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.055+0000 7fbb2ff3a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fbfesmp5c5ab825ulm38u0zlghzhwi4x 2024-09-19T14:01:08.058 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.057+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.059 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.058+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.058+0000 7fbb2ff3a800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-19T14:01:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.058+0000 7fbb2ff3a800 20 olh_log_entry: epoch=2 op=3 key=x[AEAipi66SoKNb.kBIiQwhPbQZTwU--3] 2024-09-19T14:01:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.058+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:_:AEAipi66SoKNb.kBIiQwhPbQZTwU--3_x state=0x5622aff4f398 s->prefetch_data=0 2024-09-19T14:01:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.059+0000 7fbb2ff3a800 10 manifest: total_size = 12 2024-09-19T14:01:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.059+0000 7fbb2ff3a800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5664975904361009520 2024-09-19T14:01:08.060 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.059+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:_:AEAipi66SoKNb.kBIiQwhPbQZTwU--3_x state=0x5622aff4f398 s->prefetch_data=0 2024-09-19T14:01:08.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.059+0000 7fbb2ff3a800 20 prepare_atomic_modification: state is not atomic. state=0x5622aff4f398 2024-09-19T14:01:08.061 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.059+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.063+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:x state=0x5622aff520e8 s->prefetch_data=0 2024-09-19T14:01:08.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.063+0000 7fbb2ff3a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fbfesmp5c5ab825ulm38u0zlghzhwi4x 2024-09-19T14:01:08.064 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.063+0000 7fba0a7fc640 20 handle_completion(): completion ok for obj=x[AEAipi66SoKNb.kBIiQwhPbQZTwU--3] 2024-09-19T14:01:08.066 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.065+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.066+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.066+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.067 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.066+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:y state=0x5622aff8f108 s->prefetch_data=0 2024-09-19T14:01:08.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.067+0000 7fbb2ff3a800 20 get_obj_state: setting s->obj_tag to 29zrxpu0a5f8w5uxrwe7e6a5s60owyc2 2024-09-19T14:01:08.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.067+0000 7fbb2ff3a800 20 get_obj_state_impl: setting s->olh_tag to oi2vezbil4dwzpa28e9spqgbu3f61gar 2024-09-19T14:01:08.068 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.067+0000 7fbb2ff3a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oi2vezbil4dwzpa28e9spqgbu3f61gar 2024-09-19T14:01:08.070 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.069+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.071 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.070+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-19T14:01:08.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 olh_log_entry: epoch=2 op=3 key=y[9wmIcIqP9tRt76NkZOSwosJiGH1kIrc] 2024-09-19T14:01:08.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:_:9wmIcIqP9tRt76NkZOSwosJiGH1kIrc_y state=0x5622aff91238 s->prefetch_data=0 2024-09-19T14:01:08.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 10 manifest: total_size = 22 2024-09-19T14:01:08.072 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14655312337569442552 2024-09-19T14:01:08.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:_:9wmIcIqP9tRt76NkZOSwosJiGH1kIrc_y state=0x5622aff91238 s->prefetch_data=0 2024-09-19T14:01:08.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 prepare_atomic_modification: state is not atomic. state=0x5622aff91238 2024-09-19T14:01:08.073 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.071+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.076 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.075+0000 7fba0a7fc640 20 handle_completion(): completion ok for obj=y[9wmIcIqP9tRt76NkZOSwosJiGH1kIrc] 2024-09-19T14:01:08.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.076+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:y state=0x5622aff8f108 s->prefetch_data=0 2024-09-19T14:01:08.077 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.076+0000 7fbb2ff3a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oi2vezbil4dwzpa28e9spqgbu3f61gar 2024-09-19T14:01:08.079 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.078+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.079+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.080 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.079+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.080+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:z state=0x5622aff8f108 s->prefetch_data=0 2024-09-19T14:01:08.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.080+0000 7fbb2ff3a800 20 get_obj_state: setting s->obj_tag to 6gjo3we057d3oga8cxzz7bok1mim2hf6 2024-09-19T14:01:08.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.080+0000 7fbb2ff3a800 20 get_obj_state_impl: setting s->olh_tag to dtea76xgz04b6ojxrvj3wy1a59quainc 2024-09-19T14:01:08.081 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.080+0000 7fbb2ff3a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dtea76xgz04b6ojxrvj3wy1a59quainc 2024-09-19T14:01:08.082 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.081+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.083 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.082+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-19T14:01:08.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 olh_log_entry: epoch=2 op=3 key=z[fN907UhxLkQuzWkIWDtMiXepNQDWynV] 2024-09-19T14:01:08.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:_:fN907UhxLkQuzWkIWDtMiXepNQDWynV_z state=0x5622aff96ea8 s->prefetch_data=0 2024-09-19T14:01:08.084 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 10 manifest: total_size = 22 2024-09-19T14:01:08.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 get_obj_state: setting s->obj_tag to ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12506734820618135786 2024-09-19T14:01:08.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:_:fN907UhxLkQuzWkIWDtMiXepNQDWynV_z state=0x5622aff96ea8 s->prefetch_data=0 2024-09-19T14:01:08.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 prepare_atomic_modification: state is not atomic. state=0x5622aff96ea8 2024-09-19T14:01:08.085 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.083+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.086+0000 7fbb2ff3a800 20 get_obj_state: octx=0x5622afc87f20 obj=myver:z state=0x5622aff8f108 s->prefetch_data=0 2024-09-19T14:01:08.087 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.086+0000 7fbb2ff3a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dtea76xgz04b6ojxrvj3wy1a59quainc 2024-09-19T14:01:08.088 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.086+0000 7fba0a7fc640 20 handle_completion(): completion ok for obj=z[fN907UhxLkQuzWkIWDtMiXepNQDWynV] 2024-09-19T14:01:08.089 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.088+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.090 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.090+0000 7fbb2ff3a800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.19.3.9 2024-09-19T14:01:08.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.090+0000 7fbb2ff3a800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-19T14:01:08.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.090+0000 7fbb2ff3a800 1 NOTICE: finished all shards (3 entries removed) 2024-09-19T14:01:08.091 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.090+0000 7fb9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:08.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.093+0000 7fbb2ff3a800 20 remove_watcher() i=0 2024-09-19T14:01:08.094 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.093+0000 7fbb2ff3a800 2 removed watcher, disabling cache 2024-09-19T14:01:08.095 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.094+0000 7fbb2ff3a800 20 remove_watcher() i=1 2024-09-19T14:01:08.096 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.095+0000 7fbb2ff3a800 20 remove_watcher() i=2 2024-09-19T14:01:08.097 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.096+0000 7fbb2ff3a800 20 remove_watcher() i=3 2024-09-19T14:01:08.098 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.097+0000 7fbb2ff3a800 20 remove_watcher() i=4 2024-09-19T14:01:08.099 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.098+0000 7fbb2ff3a800 20 remove_watcher() i=5 2024-09-19T14:01:08.100 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.099+0000 7fbb2ff3a800 20 remove_watcher() i=6 2024-09-19T14:01:08.101 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.100+0000 7fbb2ff3a800 20 remove_watcher() i=7 2024-09-19T14:01:08.162 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:01:08.190 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:08.190 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:08.226 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.225+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.226+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 20 realm 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.228 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.227+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.228+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:08.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.228+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.228+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:08.229 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.228+0000 7f770580e800 20 searching for the correct realm 2024-09-19T14:01:08.232 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.232+0000 7f77017bd640 0 -- 172.21.15.94:0/3765700676 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x5649dd1df170 msgr2=0x5649dd1e15f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:08.236 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.235+0000 7f76fbfff640 0 -- 172.21.15.94:0/3765700676 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f76f40afba0 msgr2=0x7f76f404f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:08.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:08.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:08.240 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:08.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:08.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:08.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:08.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.241 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.239+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:08.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:08.242 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 zone default found 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 4 Realm: () 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 zonegroup default 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.240+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.241+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.241+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.241+0000 7f770580e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.241+0000 7f770580e800 20 started sync module instance, tier type = 2024-09-19T14:01:08.243 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.241+0000 7f770580e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:08.252 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=0 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=1 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=2 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=3 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=4 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=5 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.251+0000 7f770580e800 20 add_watcher() i=6 2024-09-19T14:01:08.253 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.252+0000 7f770580e800 20 add_watcher() i=7 2024-09-19T14:01:08.254 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.252+0000 7f770580e800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:08.255 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.254+0000 7f75b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:08.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.254+0000 7f770580e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:08.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.254+0000 7f770580e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:08.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.254+0000 7f770580e800 5 note: GC not initialized 2024-09-19T14:01:08.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f75b5fe3640 20 reqs_thread_entry: start 2024-09-19T14:01:08.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f770580e800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:08.256 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f770580e800 20 Filter name: none 2024-09-19T14:01:08.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f75277fe640 20 reqs_thread_entry: start 2024-09-19T14:01:08.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:08.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.257 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.255+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:08.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.256+0000 7f770580e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:01:08.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.256+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.256+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:01:08.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.256+0000 7f770580e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:08.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.256+0000 7f770580e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:01:08.258 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.256+0000 7f770580e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:01:08.259 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.258+0000 7f75b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:08.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.260+0000 7f770580e800 20 remove_watcher() i=0 2024-09-19T14:01:08.261 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.260+0000 7f770580e800 2 removed watcher, disabling cache 2024-09-19T14:01:08.263 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.262+0000 7f770580e800 20 remove_watcher() i=1 2024-09-19T14:01:08.264 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.263+0000 7f770580e800 20 remove_watcher() i=2 2024-09-19T14:01:08.265 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.264+0000 7f770580e800 20 remove_watcher() i=3 2024-09-19T14:01:08.266 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.265+0000 7f770580e800 20 remove_watcher() i=4 2024-09-19T14:01:08.267 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.266+0000 7f770580e800 20 remove_watcher() i=5 2024-09-19T14:01:08.269 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.268+0000 7f770580e800 20 remove_watcher() i=6 2024-09-19T14:01:08.270 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:01:08.269+0000 7f770580e800 20 remove_watcher() i=7 2024-09-19T14:01:08.280 INFO:tasks.workunit.client.0.smithi094.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-19T14:01:08.280 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket a-bucket 2024-09-19T14:01:08.299 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket myver 2024-09-19T14:01:08.378 INFO:tasks.workunit.client.0.smithi094.stderr:Completed resharding tests 2024-09-19T14:01:08.378 INFO:tasks.workunit.client.0.smithi094.stdout:connected to http://localhost:80 2024-09-19T14:01:08.453 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-19T14:01:08.454 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-19T14:01:08.455 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-19T14:01:08.456 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T14:01:08.456 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T14:01:08.536 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-19T14:01:08.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T14:01:08.927 DEBUG:teuthology.parallel:result is None 2024-09-19T14:01:08.927 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:01:08.965 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:01:08.965 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:01:09.034 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:01:09.034 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-19T14:01:09.063 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-19T14:01:09.064 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-19T14:01:09.064 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-19T14:01:09.064 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-19T14:01:09.102 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-19T14:01:13.508 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-19T14:01:13.509 DEBUG:teuthology.orchestra.run.smithi094:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-19T14:01:15.393 INFO:teuthology.orchestra.run.smithi094.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-19T14:01:15.980 INFO:teuthology.orchestra.run.smithi094.stdout:Last metadata expiration check: 0:28:32 ago on Thu 19 Sep 2024 01:32:43 PM UTC. 2024-09-19T14:01:16.120 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-09-19T14:01:16.121 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-19T14:01:16.121 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-09-19T14:01:16.121 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-19T14:01:16.121 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-09-19T14:01:16.121 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout:Installing weak dependencies: 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout:Install 5 Packages 2024-09-19T14:01:16.122 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:16.123 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 46 M 2024-09-19T14:01:16.123 INFO:teuthology.orchestra.run.smithi094.stdout:Installed size: 166 M 2024-09-19T14:01:16.123 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-09-19T14:01:16.552 INFO:teuthology.orchestra.run.smithi094.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.7 MB/s | 426 kB 00:00 2024-09-19T14:01:17.219 INFO:teuthology.orchestra.run.smithi094.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 4.3 MB/s | 3.5 MB 00:00 2024-09-19T14:01:17.261 INFO:teuthology.orchestra.run.smithi094.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 622 kB/s | 26 kB 00:00 2024-09-19T14:01:18.403 INFO:teuthology.orchestra.run.smithi094.stdout:(4/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 17 MB/s | 32 MB 00:01 2024-09-19T14:01:18.728 INFO:teuthology.orchestra.run.smithi094.stdout:(5/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 4.0 MB/s | 9.3 MB 00:02 2024-09-19T14:01:18.728 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-09-19T14:01:18.729 INFO:teuthology.orchestra.run.smithi094.stdout:Total 17 MB/s | 46 MB 00:02 2024-09-19T14:01:19.152 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-09-19T14:01:19.173 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-09-19T14:01:19.173 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-09-19T14:01:19.649 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-09-19T14:01:19.650 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-09-19T14:01:20.177 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-19T14:01:20.322 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-09-19T14:01:20.514 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-19T14:01:21.124 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-19T14:01:21.165 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-19T14:01:21.405 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-19T14:01:21.441 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-19T14:01:21.672 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-19T14:01:21.712 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-19T14:01:21.720 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-19T14:01:21.729 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-19T14:01:21.764 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-19T14:01:24.543 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-19T14:01:24.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-19T14:01:24.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-19T14:01:24.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-19T14:01:24.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-19T14:01:24.942 INFO:teuthology.orchestra.run.smithi094.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-19T14:01:24.943 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:24.943 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-09-19T14:01:25.382 INFO:teuthology.orchestra.run.smithi094.stdout: Gradle will be installed under /opt/gradle 2024-09-19T14:01:25.456 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-19 14:01:25-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-19T14:01:26.169 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-19T14:01:26.177 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-19T14:01:26.251 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-19T14:01:26.251 INFO:teuthology.orchestra.run.smithi094.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-19T14:01:26.251 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-19 14:01:26-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-19T14:01:26.251 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-09-19T14:01:26.261 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-09-19T14:01:26.401 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-19T14:01:26.401 INFO:teuthology.orchestra.run.smithi094.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240919%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240919T140126Z&X-Amz-Expires=300&X-Amz-Signature=2a8b92e1ce50ff1d1ede853428411694546b6db5f1709693a557f05dadd75909&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-19T14:01:26.401 INFO:teuthology.orchestra.run.smithi094.stderr:--2024-09-19 14:01:26-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240919%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240919T140126Z&X-Amz-Expires=300&X-Amz-Signature=2a8b92e1ce50ff1d1ede853428411694546b6db5f1709693a557f05dadd75909&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-19T14:01:26.402 INFO:teuthology.orchestra.run.smithi094.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.108.133, ... 2024-09-19T14:01:26.414 INFO:teuthology.orchestra.run.smithi094.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-19T14:01:26.491 INFO:teuthology.orchestra.run.smithi094.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T14:01:26.491 INFO:teuthology.orchestra.run.smithi094.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-19T14:01:26.492 INFO:teuthology.orchestra.run.smithi094.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-19T14:01:26.492 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:01:26.505 INFO:teuthology.orchestra.run.smithi094.stderr: 0K .......... .......... .......... .......... .......... 0% 3.43M 26s 2024-09-19T14:01:26.518 INFO:teuthology.orchestra.run.smithi094.stderr: 50K .......... .......... .......... .......... .......... 0% 3.90M 25s 2024-09-19T14:01:26.527 INFO:teuthology.orchestra.run.smithi094.stderr: 100K .......... .......... .......... .......... .......... 0% 5.40M 22s 2024-09-19T14:01:26.529 INFO:teuthology.orchestra.run.smithi094.stderr: 150K .......... .......... .......... .......... .......... 0% 23.4M 18s 2024-09-19T14:01:26.531 INFO:teuthology.orchestra.run.smithi094.stderr: 200K .......... .......... .......... .......... .......... 0% 25.8M 15s 2024-09-19T14:01:26.533 INFO:teuthology.orchestra.run.smithi094.stderr: 250K .......... .......... .......... .......... .......... 0% 21.3M 13s 2024-09-19T14:01:26.539 INFO:teuthology.orchestra.run.smithi094.stderr: 300K .......... .......... .......... .......... .......... 0% 8.35M 13s 2024-09-19T14:01:26.541 INFO:teuthology.orchestra.run.smithi094.stderr: 350K .......... .......... .......... .......... .......... 0% 31.4M 11s 2024-09-19T14:01:26.542 INFO:teuthology.orchestra.run.smithi094.stderr: 400K .......... .......... .......... .......... .......... 0% 28.9M 11s 2024-09-19T14:01:26.543 INFO:teuthology.orchestra.run.smithi094.stderr: 450K .......... .......... .......... .......... .......... 0% 94.7M 10s 2024-09-19T14:01:26.545 INFO:teuthology.orchestra.run.smithi094.stderr: 500K .......... .......... .......... .......... .......... 0% 38.8M 9s 2024-09-19T14:01:26.545 INFO:teuthology.orchestra.run.smithi094.stderr: 550K .......... .......... .......... .......... .......... 0% 73.2M 8s 2024-09-19T14:01:26.549 INFO:teuthology.orchestra.run.smithi094.stderr: 600K .......... .......... .......... .......... .......... 0% 10.2M 8s 2024-09-19T14:01:26.550 INFO:teuthology.orchestra.run.smithi094.stderr: 650K .......... .......... .......... .......... .......... 0% 50.1M 8s 2024-09-19T14:01:26.551 INFO:teuthology.orchestra.run.smithi094.stderr: 700K .......... .......... .......... .......... .......... 0% 58.6M 7s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 750K .......... .......... .......... .......... .......... 0% 46.3M 7s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 800K .......... .......... .......... .......... .......... 0% 88.7M 7s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 850K .......... .......... .......... .......... .......... 0% 55.2M 6s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 900K .......... .......... .......... .......... .......... 1% 288M 6s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 950K .......... .......... .......... .......... .......... 1% 177M 6s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 1000K .......... .......... .......... .......... .......... 1% 43.3M 6s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 1050K .......... .......... .......... .......... .......... 1% 155M 5s 2024-09-19T14:01:26.559 INFO:teuthology.orchestra.run.smithi094.stderr: 1100K .......... .......... .......... .......... .......... 1% 323M 5s 2024-09-19T14:01:26.560 INFO:teuthology.orchestra.run.smithi094.stderr: 1150K .......... .......... .......... .......... .......... 1% 92.8M 5s 2024-09-19T14:01:26.560 INFO:teuthology.orchestra.run.smithi094.stderr: 1200K .......... .......... .......... .......... .......... 1% 86.4M 5s 2024-09-19T14:01:28.017 INFO:teuthology.orchestra.run.smithi094.stderr: 1250K .......... .......... .......... .......... .......... 1% 11.2M 5s 2024-09-19T14:01:28.017 INFO:teuthology.orchestra.run.smithi094.stderr: 1300K .......... .......... .......... .......... .......... 1% 91.7M 5s 2024-09-19T14:01:28.017 INFO:teuthology.orchestra.run.smithi094.stderr: 1350K .......... .......... .......... .......... .......... 1% 253M 5s 2024-09-19T14:01:28.017 INFO:teuthology.orchestra.run.smithi094.stderr: 1400K .......... .......... .......... .......... .......... 1% 54.4M 5s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1450K .......... .......... .......... .......... .......... 1% 300M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1500K .......... .......... .......... .......... .......... 1% 64.3M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1550K .......... .......... .......... .......... .......... 1% 250M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1600K .......... .......... .......... .......... .......... 1% 391M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1650K .......... .......... .......... .......... .......... 1% 117M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1700K .......... .......... .......... .......... .......... 1% 114M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1750K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1800K .......... .......... .......... .......... .......... 1% 295M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1850K .......... .......... .......... .......... .......... 2% 120M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1900K .......... .......... .......... .......... .......... 2% 167M 4s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 1950K .......... .......... .......... .......... .......... 2% 111M 3s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 2000K .......... .......... .......... .......... .......... 2% 112M 3s 2024-09-19T14:01:28.018 INFO:teuthology.orchestra.run.smithi094.stderr: 2050K .......... .......... .......... .......... .......... 2% 287M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2100K .......... .......... .......... .......... .......... 2% 406M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2150K .......... .......... .......... .......... .......... 2% 160M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2200K .......... .......... .......... .......... .......... 2% 169M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2250K .......... .......... .......... .......... .......... 2% 174M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2300K .......... .......... .......... .......... .......... 2% 407M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2350K .......... .......... .......... .......... .......... 2% 152M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2400K .......... .......... .......... .......... .......... 2% 225M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2450K .......... .......... .......... .......... .......... 2% 190M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2500K .......... .......... .......... .......... .......... 2% 13.9M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2550K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2600K .......... .......... .......... .......... .......... 2% 426M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2650K .......... .......... .......... .......... .......... 2% 101M 3s 2024-09-19T14:01:28.019 INFO:teuthology.orchestra.run.smithi094.stderr: 2700K .......... .......... .......... .......... .......... 2% 388M 3s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 2750K .......... .......... .......... .......... .......... 3% 87.4M 3s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 2800K .......... .......... .......... .......... .......... 3% 315M 3s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 2850K .......... .......... .......... .......... .......... 3% 353M 3s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 2900K .......... .......... .......... .......... .......... 3% 333M 3s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 2950K .......... .......... .......... .......... .......... 3% 230M 3s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3000K .......... .......... .......... .......... .......... 3% 399M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3050K .......... .......... .......... .......... .......... 3% 137M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3100K .......... .......... .......... .......... .......... 3% 416M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3150K .......... .......... .......... .......... .......... 3% 239M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3200K .......... .......... .......... .......... .......... 3% 353M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3250K .......... .......... .......... .......... .......... 3% 211M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3300K .......... .......... .......... .......... .......... 3% 285M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3350K .......... .......... .......... .......... .......... 3% 321M 2s 2024-09-19T14:01:28.020 INFO:teuthology.orchestra.run.smithi094.stderr: 3400K .......... .......... .......... .......... .......... 3% 411M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3450K .......... .......... .......... .......... .......... 3% 422M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3500K .......... .......... .......... .......... .......... 3% 251M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3550K .......... .......... .......... .......... .......... 3% 253M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3600K .......... .......... .......... .......... .......... 3% 235M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3650K .......... .......... .......... .......... .......... 3% 416M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3700K .......... .......... .......... .......... .......... 4% 333M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3750K .......... .......... .......... .......... .......... 4% 349M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3800K .......... .......... .......... .......... .......... 4% 207M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3850K .......... .......... .......... .......... .......... 4% 311M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3900K .......... .......... .......... .......... .......... 4% 452M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 3950K .......... .......... .......... .......... .......... 4% 227M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 4000K .......... .......... .......... .......... .......... 4% 315M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 4050K .......... .......... .......... .......... .......... 4% 192M 2s 2024-09-19T14:01:28.021 INFO:teuthology.orchestra.run.smithi094.stderr: 4100K .......... .......... .......... .......... .......... 4% 368M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4150K .......... .......... .......... .......... .......... 4% 321M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4200K .......... .......... .......... .......... .......... 4% 341M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4250K .......... .......... .......... .......... .......... 4% 378M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4300K .......... .......... .......... .......... .......... 4% 401M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4350K .......... .......... .......... .......... .......... 4% 324M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4400K .......... .......... .......... .......... .......... 4% 427M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4450K .......... .......... .......... .......... .......... 4% 432M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4500K .......... .......... .......... .......... .......... 4% 414M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4550K .......... .......... .......... .......... .......... 4% 371M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4600K .......... .......... .......... .......... .......... 5% 428M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4650K .......... .......... .......... .......... .......... 5% 374M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4700K .......... .......... .......... .......... .......... 5% 278M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4750K .......... .......... .......... .......... .......... 5% 363M 2s 2024-09-19T14:01:28.022 INFO:teuthology.orchestra.run.smithi094.stderr: 4800K .......... .......... .......... .......... .......... 5% 435M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 4850K .......... .......... .......... .......... .......... 5% 429M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 4900K .......... .......... .......... .......... .......... 5% 326M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 4950K .......... .......... .......... .......... .......... 5% 362M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5000K .......... .......... .......... .......... .......... 5% 289M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5050K .......... .......... .......... .......... .......... 5% 16.3M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5100K .......... .......... .......... .......... .......... 5% 226M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5150K .......... .......... .......... .......... .......... 5% 293M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5200K .......... .......... .......... .......... .......... 5% 387M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5250K .......... .......... .......... .......... .......... 5% 374M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5300K .......... .......... .......... .......... .......... 5% 159M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5350K .......... .......... .......... .......... .......... 5% 210M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5400K .......... .......... .......... .......... .......... 5% 380M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5450K .......... .......... .......... .......... .......... 5% 415M 2s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5500K .......... .......... .......... .......... .......... 5% 387M 1s 2024-09-19T14:01:28.023 INFO:teuthology.orchestra.run.smithi094.stderr: 5550K .......... .......... .......... .......... .......... 6% 275M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5600K .......... .......... .......... .......... .......... 6% 369M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5650K .......... .......... .......... .......... .......... 6% 331M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5700K .......... .......... .......... .......... .......... 6% 357M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5750K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5800K .......... .......... .......... .......... .......... 6% 362M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5850K .......... .......... .......... .......... .......... 6% 355M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5900K .......... .......... .......... .......... .......... 6% 349M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 5950K .......... .......... .......... .......... .......... 6% 331M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 6000K .......... .......... .......... .......... .......... 6% 361M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 6050K .......... .......... .......... .......... .......... 6% 370M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 6100K .......... .......... .......... .......... .......... 6% 406M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 6150K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-19T14:01:28.024 INFO:teuthology.orchestra.run.smithi094.stderr: 6200K .......... .......... .......... .......... .......... 6% 379M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6250K .......... .......... .......... .......... .......... 6% 345M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6300K .......... .......... .......... .......... .......... 6% 405M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6350K .......... .......... .......... .......... .......... 6% 332M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6400K .......... .......... .......... .......... .......... 6% 390M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6450K .......... .......... .......... .......... .......... 6% 399M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6500K .......... .......... .......... .......... .......... 7% 385M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6550K .......... .......... .......... .......... .......... 7% 324M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6600K .......... .......... .......... .......... .......... 7% 370M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6650K .......... .......... .......... .......... .......... 7% 382M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6700K .......... .......... .......... .......... .......... 7% 375M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6750K .......... .......... .......... .......... .......... 7% 297M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6800K .......... .......... .......... .......... .......... 7% 385M 1s 2024-09-19T14:01:28.025 INFO:teuthology.orchestra.run.smithi094.stderr: 6850K .......... .......... .......... .......... .......... 7% 371M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 6900K .......... .......... .......... .......... .......... 7% 272M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 6950K .......... .......... .......... .......... .......... 7% 276M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7000K .......... .......... .......... .......... .......... 7% 372M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7050K .......... .......... .......... .......... .......... 7% 279M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7100K .......... .......... .......... .......... .......... 7% 353M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7150K .......... .......... .......... .......... .......... 7% 175M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7200K .......... .......... .......... .......... .......... 7% 235M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7250K .......... .......... .......... .......... .......... 7% 365M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7300K .......... .......... .......... .......... .......... 7% 385M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7350K .......... .......... .......... .......... .......... 7% 314M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7400K .......... .......... .......... .......... .......... 8% 366M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7450K .......... .......... .......... .......... .......... 8% 348M 1s 2024-09-19T14:01:28.026 INFO:teuthology.orchestra.run.smithi094.stderr: 7500K .......... .......... .......... .......... .......... 8% 371M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7550K .......... .......... .......... .......... .......... 8% 261M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7600K .......... .......... .......... .......... .......... 8% 334M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7650K .......... .......... .......... .......... .......... 8% 366M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7700K .......... .......... .......... .......... .......... 8% 397M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7750K .......... .......... .......... .......... .......... 8% 342M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7800K .......... .......... .......... .......... .......... 8% 386M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7850K .......... .......... .......... .......... .......... 8% 344M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7900K .......... .......... .......... .......... .......... 8% 373M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 7950K .......... .......... .......... .......... .......... 8% 344M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 8000K .......... .......... .......... .......... .......... 8% 375M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 8050K .......... .......... .......... .......... .......... 8% 404M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 8100K .......... .......... .......... .......... .......... 8% 405M 1s 2024-09-19T14:01:28.027 INFO:teuthology.orchestra.run.smithi094.stderr: 8150K .......... .......... .......... .......... .......... 8% 19.2M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8200K .......... .......... .......... .......... .......... 8% 63.8M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8250K .......... .......... .......... .......... .......... 8% 302M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8300K .......... .......... .......... .......... .......... 8% 371M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8350K .......... .......... .......... .......... .......... 9% 301M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8400K .......... .......... .......... .......... .......... 9% 366M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8450K .......... .......... .......... .......... .......... 9% 249M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8500K .......... .......... .......... .......... .......... 9% 386M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8550K .......... .......... .......... .......... .......... 9% 317M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8600K .......... .......... .......... .......... .......... 9% 378M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8650K .......... .......... .......... .......... .......... 9% 373M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8700K .......... .......... .......... .......... .......... 9% 376M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8750K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-19T14:01:28.028 INFO:teuthology.orchestra.run.smithi094.stderr: 8800K .......... .......... .......... .......... .......... 9% 377M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 8850K .......... .......... .......... .......... .......... 9% 372M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 8900K .......... .......... .......... .......... .......... 9% 359M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 8950K .......... .......... .......... .......... .......... 9% 307M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9000K .......... .......... .......... .......... .......... 9% 385M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9050K .......... .......... .......... .......... .......... 9% 374M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9100K .......... .......... .......... .......... .......... 9% 381M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9150K .......... .......... .......... .......... .......... 9% 283M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9200K .......... .......... .......... .......... .......... 9% 368M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9250K .......... .......... .......... .......... .......... 10% 294M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9300K .......... .......... .......... .......... .......... 10% 370M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9350K .......... .......... .......... .......... .......... 10% 347M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9400K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9450K .......... .......... .......... .......... .......... 10% 355M 1s 2024-09-19T14:01:28.029 INFO:teuthology.orchestra.run.smithi094.stderr: 9500K .......... .......... .......... .......... .......... 10% 394M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9550K .......... .......... .......... .......... .......... 10% 324M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9600K .......... .......... .......... .......... .......... 10% 370M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9650K .......... .......... .......... .......... .......... 10% 408M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9700K .......... .......... .......... .......... .......... 10% 371M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9750K .......... .......... .......... .......... .......... 10% 334M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9800K .......... .......... .......... .......... .......... 10% 405M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9850K .......... .......... .......... .......... .......... 10% 322M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9900K .......... .......... .......... .......... .......... 10% 389M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 9950K .......... .......... .......... .......... .......... 10% 417M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 10000K .......... .......... .......... .......... .......... 10% 341M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 10050K .......... .......... .......... .......... .......... 10% 362M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 10100K .......... .......... .......... .......... .......... 10% 426M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 10150K .......... .......... .......... .......... .......... 10% 351M 1s 2024-09-19T14:01:28.030 INFO:teuthology.orchestra.run.smithi094.stderr: 10200K .......... .......... .......... .......... .......... 11% 173M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10250K .......... .......... .......... .......... .......... 11% 408M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10300K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10350K .......... .......... .......... .......... .......... 11% 294M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10400K .......... .......... .......... .......... .......... 11% 262M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10450K .......... .......... .......... .......... .......... 11% 197M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10500K .......... .......... .......... .......... .......... 11% 307M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10550K .......... .......... .......... .......... .......... 11% 290M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10600K .......... .......... .......... .......... .......... 11% 378M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10650K .......... .......... .......... .......... .......... 11% 223M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10700K .......... .......... .......... .......... .......... 11% 283M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10750K .......... .......... .......... .......... .......... 11% 289M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10800K .......... .......... .......... .......... .......... 11% 358M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10850K .......... .......... .......... .......... .......... 11% 370M 1s 2024-09-19T14:01:28.031 INFO:teuthology.orchestra.run.smithi094.stderr: 10900K .......... .......... .......... .......... .......... 11% 367M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 10950K .......... .......... .......... .......... .......... 11% 311M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11000K .......... .......... .......... .......... .......... 11% 332M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11050K .......... .......... .......... .......... .......... 11% 315M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11100K .......... .......... .......... .......... .......... 12% 357M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11150K .......... .......... .......... .......... .......... 12% 97.0M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11200K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11250K .......... .......... .......... .......... .......... 12% 23.3M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11300K .......... .......... .......... .......... .......... 12% 263M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11350K .......... .......... .......... .......... .......... 12% 242M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11400K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11450K .......... .......... .......... .......... .......... 12% 359M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11500K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11550K .......... .......... .......... .......... .......... 12% 270M 1s 2024-09-19T14:01:28.032 INFO:teuthology.orchestra.run.smithi094.stderr: 11600K .......... .......... .......... .......... .......... 12% 328M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11650K .......... .......... .......... .......... .......... 12% 318M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11700K .......... .......... .......... .......... .......... 12% 382M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11750K .......... .......... .......... .......... .......... 12% 156M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11800K .......... .......... .......... .......... .......... 12% 361M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11850K .......... .......... .......... .......... .......... 12% 428M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11900K .......... .......... .......... .......... .......... 12% 278M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 11950K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12000K .......... .......... .......... .......... .......... 12% 371M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12050K .......... .......... .......... .......... .......... 13% 384M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12100K .......... .......... .......... .......... .......... 13% 309M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12150K .......... .......... .......... .......... .......... 13% 256M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12200K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12250K .......... .......... .......... .......... .......... 13% 333M 1s 2024-09-19T14:01:28.033 INFO:teuthology.orchestra.run.smithi094.stderr: 12300K .......... .......... .......... .......... .......... 13% 287M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12350K .......... .......... .......... .......... .......... 13% 119M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12400K .......... .......... .......... .......... .......... 13% 365M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12450K .......... .......... .......... .......... .......... 13% 309M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12500K .......... .......... .......... .......... .......... 13% 371M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12550K .......... .......... .......... .......... .......... 13% 345M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12600K .......... .......... .......... .......... .......... 13% 387M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12650K .......... .......... .......... .......... .......... 13% 360M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12700K .......... .......... .......... .......... .......... 13% 425M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12750K .......... .......... .......... .......... .......... 13% 327M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12800K .......... .......... .......... .......... .......... 13% 427M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12850K .......... .......... .......... .......... .......... 13% 406M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12900K .......... .......... .......... .......... .......... 13% 372M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 12950K .......... .......... .......... .......... .......... 13% 347M 1s 2024-09-19T14:01:28.034 INFO:teuthology.orchestra.run.smithi094.stderr: 13000K .......... .......... .......... .......... .......... 14% 380M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13050K .......... .......... .......... .......... .......... 14% 351M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13100K .......... .......... .......... .......... .......... 14% 362M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13150K .......... .......... .......... .......... .......... 14% 281M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13200K .......... .......... .......... .......... .......... 14% 343M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13250K .......... .......... .......... .......... .......... 14% 368M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13300K .......... .......... .......... .......... .......... 14% 379M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13350K .......... .......... .......... .......... .......... 14% 301M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13400K .......... .......... .......... .......... .......... 14% 383M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13450K .......... .......... .......... .......... .......... 14% 380M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13500K .......... .......... .......... .......... .......... 14% 395M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13550K .......... .......... .......... .......... .......... 14% 335M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13600K .......... .......... .......... .......... .......... 14% 312M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13650K .......... .......... .......... .......... .......... 14% 78.1M 1s 2024-09-19T14:01:28.035 INFO:teuthology.orchestra.run.smithi094.stderr: 13700K .......... .......... .......... .......... .......... 14% 367M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 13750K .......... .......... .......... .......... .......... 14% 315M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 13800K .......... .......... .......... .......... .......... 14% 396M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 13850K .......... .......... .......... .......... .......... 14% 287M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 13900K .......... .......... .......... .......... .......... 15% 237M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 13950K .......... .......... .......... .......... .......... 15% 342M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14000K .......... .......... .......... .......... .......... 15% 369M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14050K .......... .......... .......... .......... .......... 15% 377M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14100K .......... .......... .......... .......... .......... 15% 446M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14150K .......... .......... .......... .......... .......... 15% 273M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14200K .......... .......... .......... .......... .......... 15% 198M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14250K .......... .......... .......... .......... .......... 15% 379M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14300K .......... .......... .......... .......... .......... 15% 44.4M 1s 2024-09-19T14:01:28.036 INFO:teuthology.orchestra.run.smithi094.stderr: 14350K .......... .......... .......... .......... .......... 15% 51.0M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14400K .......... .......... .......... .......... .......... 15% 356M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14450K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14500K .......... .......... .......... .......... .......... 15% 294M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14550K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14600K .......... .......... .......... .......... .......... 15% 239M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14650K .......... .......... .......... .......... .......... 15% 428M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14700K .......... .......... .......... .......... .......... 15% 249M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14750K .......... .......... .......... .......... .......... 15% 135M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14800K .......... .......... .......... .......... .......... 15% 423M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14850K .......... .......... .......... .......... .......... 16% 290M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14900K .......... .......... .......... .......... .......... 16% 411M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 14950K .......... .......... .......... .......... .......... 16% 386M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 15000K .......... .......... .......... .......... .......... 16% 178M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 15050K .......... .......... .......... .......... .......... 16% 191M 1s 2024-09-19T14:01:28.037 INFO:teuthology.orchestra.run.smithi094.stderr: 15100K .......... .......... .......... .......... .......... 16% 367M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15150K .......... .......... .......... .......... .......... 16% 323M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15200K .......... .......... .......... .......... .......... 16% 436M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15250K .......... .......... .......... .......... .......... 16% 316M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15300K .......... .......... .......... .......... .......... 16% 139M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15350K .......... .......... .......... .......... .......... 16% 256M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15400K .......... .......... .......... .......... .......... 16% 123M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15450K .......... .......... .......... .......... .......... 16% 127M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15500K .......... .......... .......... .......... .......... 16% 287M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15550K .......... .......... .......... .......... .......... 16% 234M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15600K .......... .......... .......... .......... .......... 16% 421M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15650K .......... .......... .......... .......... .......... 16% 446M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15700K .......... .......... .......... .......... .......... 16% 439M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15750K .......... .......... .......... .......... .......... 17% 386M 1s 2024-09-19T14:01:28.038 INFO:teuthology.orchestra.run.smithi094.stderr: 15800K .......... .......... .......... .......... .......... 17% 430M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 15850K .......... .......... .......... .......... .......... 17% 385M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 15900K .......... .......... .......... .......... .......... 17% 388M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 15950K .......... .......... .......... .......... .......... 17% 329M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16000K .......... .......... .......... .......... .......... 17% 401M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16050K .......... .......... .......... .......... .......... 17% 451M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16100K .......... .......... .......... .......... .......... 17% 431M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16150K .......... .......... .......... .......... .......... 17% 399M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16200K .......... .......... .......... .......... .......... 17% 415M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16250K .......... .......... .......... .......... .......... 17% 384M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16300K .......... .......... .......... .......... .......... 17% 448M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16350K .......... .......... .......... .......... .......... 17% 363M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16400K .......... .......... .......... .......... .......... 17% 394M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16450K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-19T14:01:28.039 INFO:teuthology.orchestra.run.smithi094.stderr: 16500K .......... .......... .......... .......... .......... 17% 320M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16550K .......... .......... .......... .......... .......... 17% 390M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16600K .......... .......... .......... .......... .......... 17% 444M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16650K .......... .......... .......... .......... .......... 17% 432M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16700K .......... .......... .......... .......... .......... 18% 131M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16750K .......... .......... .......... .......... .......... 18% 134M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16800K .......... .......... .......... .......... .......... 18% 417M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16850K .......... .......... .......... .......... .......... 18% 440M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16900K .......... .......... .......... .......... .......... 18% 310M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 16950K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 17000K .......... .......... .......... .......... .......... 18% 295M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 17050K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 17100K .......... .......... .......... .......... .......... 18% 443M 1s 2024-09-19T14:01:28.040 INFO:teuthology.orchestra.run.smithi094.stderr: 17150K .......... .......... .......... .......... .......... 18% 444M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17200K .......... .......... .......... .......... .......... 18% 440M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17250K .......... .......... .......... .......... .......... 18% 400M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17300K .......... .......... .......... .......... .......... 18% 47.1M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17350K .......... .......... .......... .......... .......... 18% 423M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17400K .......... .......... .......... .......... .......... 18% 59.8M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17450K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17500K .......... .......... .......... .......... .......... 18% 318M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17550K .......... .......... .......... .......... .......... 18% 279M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17600K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17650K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17700K .......... .......... .......... .......... .......... 19% 340M 1s 2024-09-19T14:01:28.041 INFO:teuthology.orchestra.run.smithi094.stderr: 17750K .......... .......... .......... .......... .......... 19% 181M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 17800K .......... .......... .......... .......... .......... 19% 258M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 17850K .......... .......... .......... .......... .......... 19% 179M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 17900K .......... .......... .......... .......... .......... 19% 280M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 17950K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18000K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18050K .......... .......... .......... .......... .......... 19% 376M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18100K .......... .......... .......... .......... .......... 19% 105M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18150K .......... .......... .......... .......... .......... 19% 213M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18200K .......... .......... .......... .......... .......... 19% 248M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18250K .......... .......... .......... .......... .......... 19% 364M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18300K .......... .......... .......... .......... .......... 19% 430M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18350K .......... .......... .......... .......... .......... 19% 219M 1s 2024-09-19T14:01:28.042 INFO:teuthology.orchestra.run.smithi094.stderr: 18400K .......... .......... .......... .......... .......... 19% 457M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18450K .......... .......... .......... .......... .......... 19% 167M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18500K .......... .......... .......... .......... .......... 19% 78.9M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18550K .......... .......... .......... .......... .......... 20% 174M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18600K .......... .......... .......... .......... .......... 20% 415M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18650K .......... .......... .......... .......... .......... 20% 429M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18700K .......... .......... .......... .......... .......... 20% 376M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18750K .......... .......... .......... .......... .......... 20% 396M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18800K .......... .......... .......... .......... .......... 20% 435M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18850K .......... .......... .......... .......... .......... 20% 449M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18900K .......... .......... .......... .......... .......... 20% 184M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 18950K .......... .......... .......... .......... .......... 20% 367M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 19000K .......... .......... .......... .......... .......... 20% 427M 1s 2024-09-19T14:01:28.043 INFO:teuthology.orchestra.run.smithi094.stderr: 19050K .......... .......... .......... .......... .......... 20% 122M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19100K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19150K .......... .......... .......... .......... .......... 20% 364M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19200K .......... .......... .......... .......... .......... 20% 421M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19250K .......... .......... .......... .......... .......... 20% 444M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19300K .......... .......... .......... .......... .......... 20% 427M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19350K .......... .......... .......... .......... .......... 20% 192M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19400K .......... .......... .......... .......... .......... 20% 246M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19450K .......... .......... .......... .......... .......... 20% 259M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19500K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19550K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19600K .......... .......... .......... .......... .......... 21% 227M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19650K .......... .......... .......... .......... .......... 21% 223M 1s 2024-09-19T14:01:28.044 INFO:teuthology.orchestra.run.smithi094.stderr: 19700K .......... .......... .......... .......... .......... 21% 239M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 19750K .......... .......... .......... .......... .......... 21% 208M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 19800K .......... .......... .......... .......... .......... 21% 220M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 19850K .......... .......... .......... .......... .......... 21% 182M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 19900K .......... .......... .......... .......... .......... 21% 213M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 19950K .......... .......... .......... .......... .......... 21% 248M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20000K .......... .......... .......... .......... .......... 21% 294M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20050K .......... .......... .......... .......... .......... 21% 276M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20100K .......... .......... .......... .......... .......... 21% 279M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20150K .......... .......... .......... .......... .......... 21% 161M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20200K .......... .......... .......... .......... .......... 21% 292M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20250K .......... .......... .......... .......... .......... 21% 292M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20300K .......... .......... .......... .......... .......... 21% 267M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20350K .......... .......... .......... .......... .......... 21% 219M 1s 2024-09-19T14:01:28.045 INFO:teuthology.orchestra.run.smithi094.stderr: 20400K .......... .......... .......... .......... .......... 22% 290M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20450K .......... .......... .......... .......... .......... 22% 232M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20500K .......... .......... .......... .......... .......... 22% 273M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20550K .......... .......... .......... .......... .......... 22% 236M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20600K .......... .......... .......... .......... .......... 22% 239M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20650K .......... .......... .......... .......... .......... 22% 199M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20700K .......... .......... .......... .......... .......... 22% 293M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20750K .......... .......... .......... .......... .......... 22% 193M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20800K .......... .......... .......... .......... .......... 22% 233M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20850K .......... .......... .......... .......... .......... 22% 226M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20900K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 20950K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 21000K .......... .......... .......... .......... .......... 22% 238M 1s 2024-09-19T14:01:28.046 INFO:teuthology.orchestra.run.smithi094.stderr: 21050K .......... .......... .......... .......... .......... 22% 294M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21100K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21150K .......... .......... .......... .......... .......... 22% 237M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21200K .......... .......... .......... .......... .......... 22% 296M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21250K .......... .......... .......... .......... .......... 22% 235M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21300K .......... .......... .......... .......... .......... 22% 246M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21350K .......... .......... .......... .......... .......... 23% 209M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21400K .......... .......... .......... .......... .......... 23% 276M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21450K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21500K .......... .......... .......... .......... .......... 23% 316M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21550K .......... .......... .......... .......... .......... 23% 193M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21600K .......... .......... .......... .......... .......... 23% 144M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21650K .......... .......... .......... .......... .......... 23% 246M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21700K .......... .......... .......... .......... .......... 23% 239M 1s 2024-09-19T14:01:28.047 INFO:teuthology.orchestra.run.smithi094.stderr: 21750K .......... .......... .......... .......... .......... 23% 242M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 21800K .......... .......... .......... .......... .......... 23% 195M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 21850K .......... .......... .......... .......... .......... 23% 231M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 21900K .......... .......... .......... .......... .......... 23% 251M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 21950K .......... .......... .......... .......... .......... 23% 261M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22000K .......... .......... .......... .......... .......... 23% 215M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22050K .......... .......... .......... .......... .......... 23% 234M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22100K .......... .......... .......... .......... .......... 23% 296M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22150K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22200K .......... .......... .......... .......... .......... 23% 221M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22250K .......... .......... .......... .......... .......... 24% 240M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22300K .......... .......... .......... .......... .......... 24% 253M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22350K .......... .......... .......... .......... .......... 24% 209M 1s 2024-09-19T14:01:28.048 INFO:teuthology.orchestra.run.smithi094.stderr: 22400K .......... .......... .......... .......... .......... 24% 244M 1s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22450K .......... .......... .......... .......... .......... 24% 288M 1s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22500K .......... .......... .......... .......... .......... 24% 292M 1s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22550K .......... .......... .......... .......... .......... 24% 218M 1s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22600K .......... .......... .......... .......... .......... 24% 273M 1s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22650K .......... .......... .......... .......... .......... 24% 291M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22700K .......... .......... .......... .......... .......... 24% 296M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22750K .......... .......... .......... .......... .......... 24% 203M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22800K .......... .......... .......... .......... .......... 24% 219M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22850K .......... .......... .......... .......... .......... 24% 297M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22900K .......... .......... .......... .......... .......... 24% 298M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 22950K .......... .......... .......... .......... .......... 24% 258M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 23000K .......... .......... .......... .......... .......... 24% 222M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 23050K .......... .......... .......... .......... .......... 24% 254M 0s 2024-09-19T14:01:28.049 INFO:teuthology.orchestra.run.smithi094.stderr: 23100K .......... .......... .......... .......... .......... 24% 258M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23150K .......... .......... .......... .......... .......... 24% 248M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23200K .......... .......... .......... .......... .......... 25% 300M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23250K .......... .......... .......... .......... .......... 25% 261M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23300K .......... .......... .......... .......... .......... 25% 250M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23350K .......... .......... .......... .......... .......... 25% 199M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23400K .......... .......... .......... .......... .......... 25% 228M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23450K .......... .......... .......... .......... .......... 25% 248M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23500K .......... .......... .......... .......... .......... 25% 268M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23550K .......... .......... .......... .......... .......... 25% 181M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23600K .......... .......... .......... .......... .......... 25% 260M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23650K .......... .......... .......... .......... .......... 25% 305M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23700K .......... .......... .......... .......... .......... 25% 269M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23750K .......... .......... .......... .......... .......... 25% 187M 0s 2024-09-19T14:01:28.050 INFO:teuthology.orchestra.run.smithi094.stderr: 23800K .......... .......... .......... .......... .......... 25% 186M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 23850K .......... .......... .......... .......... .......... 25% 265M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 23900K .......... .......... .......... .......... .......... 25% 256M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 23950K .......... .......... .......... .......... .......... 25% 199M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24000K .......... .......... .......... .......... .......... 25% 290M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24050K .......... .......... .......... .......... .......... 25% 275M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24100K .......... .......... .......... .......... .......... 25% 295M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24150K .......... .......... .......... .......... .......... 26% 204M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24200K .......... .......... .......... .......... .......... 26% 250M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24250K .......... .......... .......... .......... .......... 26% 224M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24300K .......... .......... .......... .......... .......... 26% 258M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24350K .......... .......... .......... .......... .......... 26% 240M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24400K .......... .......... .......... .......... .......... 26% 242M 0s 2024-09-19T14:01:28.051 INFO:teuthology.orchestra.run.smithi094.stderr: 24450K .......... .......... .......... .......... .......... 26% 304M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24500K .......... .......... .......... .......... .......... 26% 232M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24550K .......... .......... .......... .......... .......... 26% 230M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24600K .......... .......... .......... .......... .......... 26% 262M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24650K .......... .......... .......... .......... .......... 26% 252M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24700K .......... .......... .......... .......... .......... 26% 300M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24750K .......... .......... .......... .......... .......... 26% 191M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24800K .......... .......... .......... .......... .......... 26% 241M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24850K .......... .......... .......... .......... .......... 26% 251M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24900K .......... .......... .......... .......... .......... 26% 246M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 24950K .......... .......... .......... .......... .......... 26% 211M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 25000K .......... .......... .......... .......... .......... 26% 348M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 25050K .......... .......... .......... .......... .......... 27% 397M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 25100K .......... .......... .......... .......... .......... 27% 276M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 25150K .......... .......... .......... .......... .......... 27% 275M 0s 2024-09-19T14:01:28.052 INFO:teuthology.orchestra.run.smithi094.stderr: 25200K .......... .......... .......... .......... .......... 27% 415M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25250K .......... .......... .......... .......... .......... 27% 425M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25300K .......... .......... .......... .......... .......... 27% 223M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25350K .......... .......... .......... .......... .......... 27% 266M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25400K .......... .......... .......... .......... .......... 27% 309M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25450K .......... .......... .......... .......... .......... 27% 391M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25500K .......... .......... .......... .......... .......... 27% 407M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25550K .......... .......... .......... .......... .......... 27% 172M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25600K .......... .......... .......... .......... .......... 27% 252M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25650K .......... .......... .......... .......... .......... 27% 286M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25700K .......... .......... .......... .......... .......... 27% 417M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25750K .......... .......... .......... .......... .......... 27% 137M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25800K .......... .......... .......... .......... .......... 27% 374M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25850K .......... .......... .......... .......... .......... 27% 309M 0s 2024-09-19T14:01:28.053 INFO:teuthology.orchestra.run.smithi094.stderr: 25900K .......... .......... .......... .......... .......... 27% 374M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 25950K .......... .......... .......... .......... .......... 27% 107M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26000K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26050K .......... .......... .......... .......... .......... 28% 173M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26100K .......... .......... .......... .......... .......... 28% 328M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26150K .......... .......... .......... .......... .......... 28% 351M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26200K .......... .......... .......... .......... .......... 28% 120M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26250K .......... .......... .......... .......... .......... 28% 271M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26300K .......... .......... .......... .......... .......... 28% 289M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26350K .......... .......... .......... .......... .......... 28% 257M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26400K .......... .......... .......... .......... .......... 28% 413M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26450K .......... .......... .......... .......... .......... 28% 370M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26500K .......... .......... .......... .......... .......... 28% 403M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26550K .......... .......... .......... .......... .......... 28% 335M 0s 2024-09-19T14:01:28.054 INFO:teuthology.orchestra.run.smithi094.stderr: 26600K .......... .......... .......... .......... .......... 28% 376M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26650K .......... .......... .......... .......... .......... 28% 297M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26700K .......... .......... .......... .......... .......... 28% 102M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26750K .......... .......... .......... .......... .......... 28% 314M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26800K .......... .......... .......... .......... .......... 28% 306M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26850K .......... .......... .......... .......... .......... 28% 259M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26900K .......... .......... .......... .......... .......... 29% 345M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 26950K .......... .......... .......... .......... .......... 29% 285M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27000K .......... .......... .......... .......... .......... 29% 385M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27050K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27100K .......... .......... .......... .......... .......... 29% 90.0M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27150K .......... .......... .......... .......... .......... 29% 272M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27200K .......... .......... .......... .......... .......... 29% 376M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27250K .......... .......... .......... .......... .......... 29% 347M 0s 2024-09-19T14:01:28.055 INFO:teuthology.orchestra.run.smithi094.stderr: 27300K .......... .......... .......... .......... .......... 29% 299M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27350K .......... .......... .......... .......... .......... 29% 312M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27400K .......... .......... .......... .......... .......... 29% 300M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27450K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27500K .......... .......... .......... .......... .......... 29% 401M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27550K .......... .......... .......... .......... .......... 29% 175M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27600K .......... .......... .......... .......... .......... 29% 347M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27650K .......... .......... .......... .......... .......... 29% 159M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27700K .......... .......... .......... .......... .......... 29% 239M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27750K .......... .......... .......... .......... .......... 29% 303M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27800K .......... .......... .......... .......... .......... 29% 375M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27850K .......... .......... .......... .......... .......... 30% 128M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27900K .......... .......... .......... .......... .......... 30% 331M 0s 2024-09-19T14:01:28.056 INFO:teuthology.orchestra.run.smithi094.stderr: 27950K .......... .......... .......... .......... .......... 30% 154M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28000K .......... .......... .......... .......... .......... 30% 377M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28050K .......... .......... .......... .......... .......... 30% 167M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28100K .......... .......... .......... .......... .......... 30% 265M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28150K .......... .......... .......... .......... .......... 30% 236M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28200K .......... .......... .......... .......... .......... 30% 373M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28250K .......... .......... .......... .......... .......... 30% 282M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28300K .......... .......... .......... .......... .......... 30% 311M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28350K .......... .......... .......... .......... .......... 30% 306M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28400K .......... .......... .......... .......... .......... 30% 313M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28450K .......... .......... .......... .......... .......... 30% 381M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28500K .......... .......... .......... .......... .......... 30% 347M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28550K .......... .......... .......... .......... .......... 30% 289M 0s 2024-09-19T14:01:28.057 INFO:teuthology.orchestra.run.smithi094.stderr: 28600K .......... .......... .......... .......... .......... 30% 389M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28650K .......... .......... .......... .......... .......... 30% 331M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28700K .......... .......... .......... .......... .......... 30% 291M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28750K .......... .......... .......... .......... .......... 31% 134M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28800K .......... .......... .......... .......... .......... 31% 337M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28850K .......... .......... .......... .......... .......... 31% 230M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28900K .......... .......... .......... .......... .......... 31% 331M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 28950K .......... .......... .......... .......... .......... 31% 342M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29000K .......... .......... .......... .......... .......... 31% 103M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29050K .......... .......... .......... .......... .......... 31% 210M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29100K .......... .......... .......... .......... .......... 31% 355M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29150K .......... .......... .......... .......... .......... 31% 80.8M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29200K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29250K .......... .......... .......... .......... .......... 31% 319M 0s 2024-09-19T14:01:28.058 INFO:teuthology.orchestra.run.smithi094.stderr: 29300K .......... .......... .......... .......... .......... 31% 307M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29350K .......... .......... .......... .......... .......... 31% 291M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29400K .......... .......... .......... .......... .......... 31% 334M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29450K .......... .......... .......... .......... .......... 31% 337M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29500K .......... .......... .......... .......... .......... 31% 369M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29550K .......... .......... .......... .......... .......... 31% 284M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29600K .......... .......... .......... .......... .......... 31% 350M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29650K .......... .......... .......... .......... .......... 31% 362M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29700K .......... .......... .......... .......... .......... 32% 375M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29750K .......... .......... .......... .......... .......... 32% 320M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29800K .......... .......... .......... .......... .......... 32% 281M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29850K .......... .......... .......... .......... .......... 32% 322M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29900K .......... .......... .......... .......... .......... 32% 378M 0s 2024-09-19T14:01:28.059 INFO:teuthology.orchestra.run.smithi094.stderr: 29950K .......... .......... .......... .......... .......... 32% 193M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30000K .......... .......... .......... .......... .......... 32% 322M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30050K .......... .......... .......... .......... .......... 32% 342M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30100K .......... .......... .......... .......... .......... 32% 401M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30150K .......... .......... .......... .......... .......... 32% 75.6M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30200K .......... .......... .......... .......... .......... 32% 322M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30250K .......... .......... .......... .......... .......... 32% 338M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30300K .......... .......... .......... .......... .......... 32% 381M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30350K .......... .......... .......... .......... .......... 32% 183M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30400K .......... .......... .......... .......... .......... 32% 331M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30450K .......... .......... .......... .......... .......... 32% 311M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30500K .......... .......... .......... .......... .......... 32% 330M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30550K .......... .......... .......... .......... .......... 32% 329M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30600K .......... .......... .......... .......... .......... 32% 348M 0s 2024-09-19T14:01:28.060 INFO:teuthology.orchestra.run.smithi094.stderr: 30650K .......... .......... .......... .......... .......... 33% 378M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 30700K .......... .......... .......... .......... .......... 33% 165M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 30750K .......... .......... .......... .......... .......... 33% 156M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 30800K .......... .......... .......... .......... .......... 33% 320M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 30850K .......... .......... .......... .......... .......... 33% 399M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 30900K .......... .......... .......... .......... .......... 33% 139M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 30950K .......... .......... .......... .......... .......... 33% 233M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31000K .......... .......... .......... .......... .......... 33% 316M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31050K .......... .......... .......... .......... .......... 33% 368M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31100K .......... .......... .......... .......... .......... 33% 169M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31150K .......... .......... .......... .......... .......... 33% 162M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31200K .......... .......... .......... .......... .......... 33% 323M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31250K .......... .......... .......... .......... .......... 33% 359M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31300K .......... .......... .......... .......... .......... 33% 315M 0s 2024-09-19T14:01:28.061 INFO:teuthology.orchestra.run.smithi094.stderr: 31350K .......... .......... .......... .......... .......... 33% 350M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31400K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31450K .......... .......... .......... .......... .......... 33% 338M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31500K .......... .......... .......... .......... .......... 33% 267M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31550K .......... .......... .......... .......... .......... 34% 328M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31600K .......... .......... .......... .......... .......... 34% 353M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31650K .......... .......... .......... .......... .......... 34% 351M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31700K .......... .......... .......... .......... .......... 34% 300M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31750K .......... .......... .......... .......... .......... 34% 362M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31800K .......... .......... .......... .......... .......... 34% 122M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31850K .......... .......... .......... .......... .......... 34% 295M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31900K .......... .......... .......... .......... .......... 34% 272M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 31950K .......... .......... .......... .......... .......... 34% 144M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 32000K .......... .......... .......... .......... .......... 34% 197M 0s 2024-09-19T14:01:28.062 INFO:teuthology.orchestra.run.smithi094.stderr: 32050K .......... .......... .......... .......... .......... 34% 381M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32100K .......... .......... .......... .......... .......... 34% 259M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32150K .......... .......... .......... .......... .......... 34% 60.6M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32200K .......... .......... .......... .......... .......... 34% 320M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32250K .......... .......... .......... .......... .......... 34% 344M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32300K .......... .......... .......... .......... .......... 34% 289M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32350K .......... .......... .......... .......... .......... 34% 391M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32400K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32450K .......... .......... .......... .......... .......... 34% 293M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32500K .......... .......... .......... .......... .......... 35% 336M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32550K .......... .......... .......... .......... .......... 35% 331M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32600K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32650K .......... .......... .......... .......... .......... 35% 321M 0s 2024-09-19T14:01:28.063 INFO:teuthology.orchestra.run.smithi094.stderr: 32700K .......... .......... .......... .......... .......... 35% 245M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 32750K .......... .......... .......... .......... .......... 35% 365M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 32800K .......... .......... .......... .......... .......... 35% 210M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 32850K .......... .......... .......... .......... .......... 35% 204M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 32900K .......... .......... .......... .......... .......... 35% 268M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 32950K .......... .......... .......... .......... .......... 35% 371M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33000K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33050K .......... .......... .......... .......... .......... 35% 375M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33100K .......... .......... .......... .......... .......... 35% 121M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33150K .......... .......... .......... .......... .......... 35% 259M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33200K .......... .......... .......... .......... .......... 35% 338M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33250K .......... .......... .......... .......... .......... 35% 311M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33300K .......... .......... .......... .......... .......... 35% 351M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33350K .......... .......... .......... .......... .......... 35% 404M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33400K .......... .......... .......... .......... .......... 36% 173M 0s 2024-09-19T14:01:28.064 INFO:teuthology.orchestra.run.smithi094.stderr: 33450K .......... .......... .......... .......... .......... 36% 340M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33500K .......... .......... .......... .......... .......... 36% 283M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33550K .......... .......... .......... .......... .......... 36% 314M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33600K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33650K .......... .......... .......... .......... .......... 36% 352M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33700K .......... .......... .......... .......... .......... 36% 295M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33750K .......... .......... .......... .......... .......... 36% 340M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33800K .......... .......... .......... .......... .......... 36% 372M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33850K .......... .......... .......... .......... .......... 36% 143M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33900K .......... .......... .......... .......... .......... 36% 85.9M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 33950K .......... .......... .......... .......... .......... 36% 324M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 34000K .......... .......... .......... .......... .......... 36% 328M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 34050K .......... .......... .......... .......... .......... 36% 328M 0s 2024-09-19T14:01:28.065 INFO:teuthology.orchestra.run.smithi094.stderr: 34100K .......... .......... .......... .......... .......... 36% 276M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34150K .......... .......... .......... .......... .......... 36% 345M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34200K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34250K .......... .......... .......... .......... .......... 36% 366M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34300K .......... .......... .......... .......... .......... 36% 178M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34350K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34400K .......... .......... .......... .......... .......... 37% 321M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34450K .......... .......... .......... .......... .......... 37% 338M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34500K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34550K .......... .......... .......... .......... .......... 37% 326M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34600K .......... .......... .......... .......... .......... 37% 314M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34650K .......... .......... .......... .......... .......... 37% 351M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34700K .......... .......... .......... .......... .......... 37% 296M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34750K .......... .......... .......... .......... .......... 37% 313M 0s 2024-09-19T14:01:28.066 INFO:teuthology.orchestra.run.smithi094.stderr: 34800K .......... .......... .......... .......... .......... 37% 383M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 34850K .......... .......... .......... .......... .......... 37% 80.3M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 34900K .......... .......... .......... .......... .......... 37% 302M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 34950K .......... .......... .......... .......... .......... 37% 325M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35000K .......... .......... .......... .......... .......... 37% 384M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35050K .......... .......... .......... .......... .......... 37% 350M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35100K .......... .......... .......... .......... .......... 37% 130M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35150K .......... .......... .......... .......... .......... 37% 351M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35200K .......... .......... .......... .......... .......... 37% 58.1M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35250K .......... .......... .......... .......... .......... 37% 258M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35300K .......... .......... .......... .......... .......... 38% 266M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35350K .......... .......... .......... .......... .......... 38% 368M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35400K .......... .......... .......... .......... .......... 38% 354M 0s 2024-09-19T14:01:28.067 INFO:teuthology.orchestra.run.smithi094.stderr: 35450K .......... .......... .......... .......... .......... 38% 397M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35500K .......... .......... .......... .......... .......... 38% 339M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35550K .......... .......... .......... .......... .......... 38% 179M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35600K .......... .......... .......... .......... .......... 38% 287M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35650K .......... .......... .......... .......... .......... 38% 328M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35700K .......... .......... .......... .......... .......... 38% 338M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35750K .......... .......... .......... .......... .......... 38% 398M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35800K .......... .......... .......... .......... .......... 38% 208M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35850K .......... .......... .......... .......... .......... 38% 367M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35900K .......... .......... .......... .......... .......... 38% 173M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 35950K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 36000K .......... .......... .......... .......... .......... 38% 359M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 36050K .......... .......... .......... .......... .......... 38% 376M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 36100K .......... .......... .......... .......... .......... 38% 173M 0s 2024-09-19T14:01:28.068 INFO:teuthology.orchestra.run.smithi094.stderr: 36150K .......... .......... .......... .......... .......... 38% 299M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36200K .......... .......... .......... .......... .......... 39% 314M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36250K .......... .......... .......... .......... .......... 39% 321M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36300K .......... .......... .......... .......... .......... 39% 271M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36350K .......... .......... .......... .......... .......... 39% 233M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36400K .......... .......... .......... .......... .......... 39% 253M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36450K .......... .......... .......... .......... .......... 39% 303M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36500K .......... .......... .......... .......... .......... 39% 306M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36550K .......... .......... .......... .......... .......... 39% 327M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36600K .......... .......... .......... .......... .......... 39% 374M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36650K .......... .......... .......... .......... .......... 39% 347M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36700K .......... .......... .......... .......... .......... 39% 224M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36750K .......... .......... .......... .......... .......... 39% 300M 0s 2024-09-19T14:01:28.069 INFO:teuthology.orchestra.run.smithi094.stderr: 36800K .......... .......... .......... .......... .......... 39% 348M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 36850K .......... .......... .......... .......... .......... 39% 351M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 36900K .......... .......... .......... .......... .......... 39% 375M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 36950K .......... .......... .......... .......... .......... 39% 71.9M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37000K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37050K .......... .......... .......... .......... .......... 39% 361M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37100K .......... .......... .......... .......... .......... 39% 203M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37150K .......... .......... .......... .......... .......... 40% 314M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37200K .......... .......... .......... .......... .......... 40% 299M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37250K .......... .......... .......... .......... .......... 40% 316M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37300K .......... .......... .......... .......... .......... 40% 321M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37350K .......... .......... .......... .......... .......... 40% 307M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37400K .......... .......... .......... .......... .......... 40% 382M 0s 2024-09-19T14:01:28.070 INFO:teuthology.orchestra.run.smithi094.stderr: 37450K .......... .......... .......... .......... .......... 40% 263M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37500K .......... .......... .......... .......... .......... 40% 285M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37550K .......... .......... .......... .......... .......... 40% 313M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37600K .......... .......... .......... .......... .......... 40% 369M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37650K .......... .......... .......... .......... .......... 40% 356M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37700K .......... .......... .......... .......... .......... 40% 257M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37750K .......... .......... .......... .......... .......... 40% 308M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37800K .......... .......... .......... .......... .......... 40% 414M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37850K .......... .......... .......... .......... .......... 40% 81.6M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37900K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 37950K .......... .......... .......... .......... .......... 40% 312M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 38000K .......... .......... .......... .......... .......... 40% 348M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 38050K .......... .......... .......... .......... .......... 41% 360M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 38100K .......... .......... .......... .......... .......... 41% 333M 0s 2024-09-19T14:01:28.071 INFO:teuthology.orchestra.run.smithi094.stderr: 38150K .......... .......... .......... .......... .......... 41% 275M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38200K .......... .......... .......... .......... .......... 41% 49.1M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38250K .......... .......... .......... .......... .......... 41% 211M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38300K .......... .......... .......... .......... .......... 41% 224M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38350K .......... .......... .......... .......... .......... 41% 247M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38400K .......... .......... .......... .......... .......... 41% 341M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38450K .......... .......... .......... .......... .......... 41% 409M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38500K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38550K .......... .......... .......... .......... .......... 41% 218M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38600K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38650K .......... .......... .......... .......... .......... 41% 306M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38700K .......... .......... .......... .......... .......... 41% 280M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38750K .......... .......... .......... .......... .......... 41% 361M 0s 2024-09-19T14:01:28.072 INFO:teuthology.orchestra.run.smithi094.stderr: 38800K .......... .......... .......... .......... .......... 41% 358M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 38850K .......... .......... .......... .......... .......... 41% 346M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 38900K .......... .......... .......... .......... .......... 41% 238M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 38950K .......... .......... .......... .......... .......... 41% 255M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39000K .......... .......... .......... .......... .......... 42% 323M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39050K .......... .......... .......... .......... .......... 42% 307M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39100K .......... .......... .......... .......... .......... 42% 255M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39150K .......... .......... .......... .......... .......... 42% 308M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39200K .......... .......... .......... .......... .......... 42% 293M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39250K .......... .......... .......... .......... .......... 42% 329M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39300K .......... .......... .......... .......... .......... 42% 270M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39350K .......... .......... .......... .......... .......... 42% 355M 0s 2024-09-19T14:01:28.073 INFO:teuthology.orchestra.run.smithi094.stderr: 39400K .......... .......... .......... .......... .......... 42% 406M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39450K .......... .......... .......... .......... .......... 42% 231M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39500K .......... .......... .......... .......... .......... 42% 174M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39550K .......... .......... .......... .......... .......... 42% 185M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39600K .......... .......... .......... .......... .......... 42% 306M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39650K .......... .......... .......... .......... .......... 42% 280M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39700K .......... .......... .......... .......... .......... 42% 264M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39750K .......... .......... .......... .......... .......... 42% 373M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39800K .......... .......... .......... .......... .......... 42% 284M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39850K .......... .......... .......... .......... .......... 42% 295M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39900K .......... .......... .......... .......... .......... 43% 121M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 39950K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 40000K .......... .......... .......... .......... .......... 43% 203M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 40050K .......... .......... .......... .......... .......... 43% 290M 0s 2024-09-19T14:01:28.074 INFO:teuthology.orchestra.run.smithi094.stderr: 40100K .......... .......... .......... .......... .......... 43% 333M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40150K .......... .......... .......... .......... .......... 43% 345M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40200K .......... .......... .......... .......... .......... 43% 344M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40250K .......... .......... .......... .......... .......... 43% 325M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40300K .......... .......... .......... .......... .......... 43% 291M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40350K .......... .......... .......... .......... .......... 43% 342M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40400K .......... .......... .......... .......... .......... 43% 276M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40450K .......... .......... .......... .......... .......... 43% 207M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40500K .......... .......... .......... .......... .......... 43% 345M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40550K .......... .......... .......... .......... .......... 43% 271M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40600K .......... .......... .......... .......... .......... 43% 355M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40650K .......... .......... .......... .......... .......... 43% 303M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40700K .......... .......... .......... .......... .......... 43% 314M 0s 2024-09-19T14:01:28.075 INFO:teuthology.orchestra.run.smithi094.stderr: 40750K .......... .......... .......... .......... .......... 43% 348M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 40800K .......... .......... .......... .......... .......... 43% 80.7M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 40850K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 40900K .......... .......... .......... .......... .......... 44% 305M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 40950K .......... .......... .......... .......... .......... 44% 408M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41000K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41050K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41100K .......... .......... .......... .......... .......... 44% 244M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41150K .......... .......... .......... .......... .......... 44% 314M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41200K .......... .......... .......... .......... .......... 44% 409M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41250K .......... .......... .......... .......... .......... 44% 55.5M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41300K .......... .......... .......... .......... .......... 44% 266M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41350K .......... .......... .......... .......... .......... 44% 139M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41400K .......... .......... .......... .......... .......... 44% 365M 0s 2024-09-19T14:01:28.076 INFO:teuthology.orchestra.run.smithi094.stderr: 41450K .......... .......... .......... .......... .......... 44% 293M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41500K .......... .......... .......... .......... .......... 44% 132M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41550K .......... .......... .......... .......... .......... 44% 325M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41600K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41650K .......... .......... .......... .......... .......... 44% 127M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41700K .......... .......... .......... .......... .......... 44% 313M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41750K .......... .......... .......... .......... .......... 44% 288M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41800K .......... .......... .......... .......... .......... 45% 350M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41850K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41900K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 41950K .......... .......... .......... .......... .......... 45% 420M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 42000K .......... .......... .......... .......... .......... 45% 16.1M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 42050K .......... .......... .......... .......... .......... 45% 27.8M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 42100K .......... .......... .......... .......... .......... 45% 194M 0s 2024-09-19T14:01:28.077 INFO:teuthology.orchestra.run.smithi094.stderr: 42150K .......... .......... .......... .......... .......... 45% 285M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42200K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42250K .......... .......... .......... .......... .......... 45% 362M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42300K .......... .......... .......... .......... .......... 45% 283M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42350K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42400K .......... .......... .......... .......... .......... 45% 326M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42450K .......... .......... .......... .......... .......... 45% 316M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42500K .......... .......... .......... .......... .......... 45% 304M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42550K .......... .......... .......... .......... .......... 45% 348M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42600K .......... .......... .......... .......... .......... 45% 347M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42650K .......... .......... .......... .......... .......... 45% 346M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42700K .......... .......... .......... .......... .......... 46% 274M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42750K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42800K .......... .......... .......... .......... .......... 46% 359M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42850K .......... .......... .......... .......... .......... 46% 325M 0s 2024-09-19T14:01:28.078 INFO:teuthology.orchestra.run.smithi094.stderr: 42900K .......... .......... .......... .......... .......... 46% 328M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 42950K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43000K .......... .......... .......... .......... .......... 46% 354M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43050K .......... .......... .......... .......... .......... 46% 345M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43100K .......... .......... .......... .......... .......... 46% 278M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43150K .......... .......... .......... .......... .......... 46% 351M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43200K .......... .......... .......... .......... .......... 46% 358M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43250K .......... .......... .......... .......... .......... 46% 364M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43300K .......... .......... .......... .......... .......... 46% 355M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43350K .......... .......... .......... .......... .......... 46% 285M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43400K .......... .......... .......... .......... .......... 46% 302M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43450K .......... .......... .......... .......... .......... 46% 312M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43500K .......... .......... .......... .......... .......... 46% 247M 0s 2024-09-19T14:01:28.079 INFO:teuthology.orchestra.run.smithi094.stderr: 43550K .......... .......... .......... .......... .......... 46% 358M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43600K .......... .......... .......... .......... .......... 46% 304M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43650K .......... .......... .......... .......... .......... 47% 328M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43700K .......... .......... .......... .......... .......... 47% 290M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43750K .......... .......... .......... .......... .......... 47% 407M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43800K .......... .......... .......... .......... .......... 47% 399M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43850K .......... .......... .......... .......... .......... 47% 400M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43900K .......... .......... .......... .......... .......... 47% 296M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 43950K .......... .......... .......... .......... .......... 47% 180M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 44000K .......... .......... .......... .......... .......... 47% 311M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 44050K .......... .......... .......... .......... .......... 47% 382M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 44100K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 44150K .......... .......... .......... .......... .......... 47% 360M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 44200K .......... .......... .......... .......... .......... 47% 358M 0s 2024-09-19T14:01:28.080 INFO:teuthology.orchestra.run.smithi094.stderr: 44250K .......... .......... .......... .......... .......... 47% 304M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44300K .......... .......... .......... .......... .......... 47% 265M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44350K .......... .......... .......... .......... .......... 47% 307M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44400K .......... .......... .......... .......... .......... 47% 286M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44450K .......... .......... .......... .......... .......... 47% 335M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44500K .......... .......... .......... .......... .......... 47% 234M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44550K .......... .......... .......... .......... .......... 48% 331M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44600K .......... .......... .......... .......... .......... 48% 416M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44650K .......... .......... .......... .......... .......... 48% 323M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44700K .......... .......... .......... .......... .......... 48% 351M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44750K .......... .......... .......... .......... .......... 48% 397M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44800K .......... .......... .......... .......... .......... 48% 417M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44850K .......... .......... .......... .......... .......... 48% 416M 0s 2024-09-19T14:01:28.081 INFO:teuthology.orchestra.run.smithi094.stderr: 44900K .......... .......... .......... .......... .......... 48% 30.5M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 44950K .......... .......... .......... .......... .......... 48% 42.6M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45000K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45050K .......... .......... .......... .......... .......... 48% 432M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45100K .......... .......... .......... .......... .......... 48% 30.7M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45150K .......... .......... .......... .......... .......... 48% 39.7M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45200K .......... .......... .......... .......... .......... 48% 329M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45250K .......... .......... .......... .......... .......... 48% 330M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45300K .......... .......... .......... .......... .......... 48% 225M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45350K .......... .......... .......... .......... .......... 48% 324M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45400K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45450K .......... .......... .......... .......... .......... 48% 353M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45500K .......... .......... .......... .......... .......... 49% 272M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45550K .......... .......... .......... .......... .......... 49% 343M 0s 2024-09-19T14:01:28.082 INFO:teuthology.orchestra.run.smithi094.stderr: 45600K .......... .......... .......... .......... .......... 49% 284M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45650K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45700K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45750K .......... .......... .......... .......... .......... 49% 406M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45800K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45850K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45900K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 45950K .......... .......... .......... .......... .......... 49% 356M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 46000K .......... .......... .......... .......... .......... 49% 345M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 46050K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 46100K .......... .......... .......... .......... .......... 49% 294M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 46150K .......... .......... .......... .......... .......... 49% 304M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 46200K .......... .......... .......... .......... .......... 49% 319M 0s 2024-09-19T14:01:28.083 INFO:teuthology.orchestra.run.smithi094.stderr: 46250K .......... .......... .......... .......... .......... 49% 378M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46300K .......... .......... .......... .......... .......... 49% 288M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46350K .......... .......... .......... .......... .......... 49% 287M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46400K .......... .......... .......... .......... .......... 49% 288M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46450K .......... .......... .......... .......... .......... 50% 320M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46500K .......... .......... .......... .......... .......... 50% 243M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46550K .......... .......... .......... .......... .......... 50% 312M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46600K .......... .......... .......... .......... .......... 50% 319M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46650K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46700K .......... .......... .......... .......... .......... 50% 273M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46750K .......... .......... .......... .......... .......... 50% 326M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46800K .......... .......... .......... .......... .......... 50% 347M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46850K .......... .......... .......... .......... .......... 50% 361M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46900K .......... .......... .......... .......... .......... 50% 331M 0s 2024-09-19T14:01:28.084 INFO:teuthology.orchestra.run.smithi094.stderr: 46950K .......... .......... .......... .......... .......... 50% 321M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47000K .......... .......... .......... .......... .......... 50% 332M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47050K .......... .......... .......... .......... .......... 50% 301M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47100K .......... .......... .......... .......... .......... 50% 273M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47150K .......... .......... .......... .......... .......... 50% 339M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47200K .......... .......... .......... .......... .......... 50% 316M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47250K .......... .......... .......... .......... .......... 50% 328M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47300K .......... .......... .......... .......... .......... 50% 325M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47350K .......... .......... .......... .......... .......... 51% 367M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47400K .......... .......... .......... .......... .......... 51% 381M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47450K .......... .......... .......... .......... .......... 51% 379M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47500K .......... .......... .......... .......... .......... 51% 275M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47550K .......... .......... .......... .......... .......... 51% 338M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47600K .......... .......... .......... .......... .......... 51% 399M 0s 2024-09-19T14:01:28.085 INFO:teuthology.orchestra.run.smithi094.stderr: 47650K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 47700K .......... .......... .......... .......... .......... 51% 275M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 47750K .......... .......... .......... .......... .......... 51% 376M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 47800K .......... .......... .......... .......... .......... 51% 385M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 47850K .......... .......... .......... .......... .......... 51% 358M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 47900K .......... .......... .......... .......... .......... 51% 300M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 47950K .......... .......... .......... .......... .......... 51% 349M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48000K .......... .......... .......... .......... .......... 51% 344M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48050K .......... .......... .......... .......... .......... 51% 36.6M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48100K .......... .......... .......... .......... .......... 51% 207M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48150K .......... .......... .......... .......... .......... 51% 402M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48200K .......... .......... .......... .......... .......... 51% 32.0M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48250K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48300K .......... .......... .......... .......... .......... 52% 305M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48350K .......... .......... .......... .......... .......... 52% 385M 0s 2024-09-19T14:01:28.086 INFO:teuthology.orchestra.run.smithi094.stderr: 48400K .......... .......... .......... .......... .......... 52% 185M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48450K .......... .......... .......... .......... .......... 52% 325M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48500K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48550K .......... .......... .......... .......... .......... 52% 303M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48600K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48650K .......... .......... .......... .......... .......... 52% 400M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48700K .......... .......... .......... .......... .......... 52% 259M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48750K .......... .......... .......... .......... .......... 52% 299M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48800K .......... .......... .......... .......... .......... 52% 309M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48850K .......... .......... .......... .......... .......... 52% 272M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48900K .......... .......... .......... .......... .......... 52% 351M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 48950K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 49000K .......... .......... .......... .......... .......... 52% 348M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 49050K .......... .......... .......... .......... .......... 52% 336M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 49100K .......... .......... .......... .......... .......... 52% 240M 0s 2024-09-19T14:01:28.087 INFO:teuthology.orchestra.run.smithi094.stderr: 49150K .......... .......... .......... .......... .......... 52% 296M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49200K .......... .......... .......... .......... .......... 53% 377M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49250K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49300K .......... .......... .......... .......... .......... 53% 300M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49350K .......... .......... .......... .......... .......... 53% 334M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49400K .......... .......... .......... .......... .......... 53% 374M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49450K .......... .......... .......... .......... .......... 53% 375M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49500K .......... .......... .......... .......... .......... 53% 244M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49550K .......... .......... .......... .......... .......... 53% 322M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49600K .......... .......... .......... .......... .......... 53% 291M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49650K .......... .......... .......... .......... .......... 53% 162M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49700K .......... .......... .......... .......... .......... 53% 266M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49750K .......... .......... .......... .......... .......... 53% 335M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49800K .......... .......... .......... .......... .......... 53% 326M 0s 2024-09-19T14:01:28.088 INFO:teuthology.orchestra.run.smithi094.stderr: 49850K .......... .......... .......... .......... .......... 53% 314M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 49900K .......... .......... .......... .......... .......... 53% 279M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 49950K .......... .......... .......... .......... .......... 53% 330M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50000K .......... .......... .......... .......... .......... 53% 325M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50050K .......... .......... .......... .......... .......... 53% 373M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50100K .......... .......... .......... .......... .......... 53% 123M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50150K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50200K .......... .......... .......... .......... .......... 54% 321M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50250K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50300K .......... .......... .......... .......... .......... 54% 285M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50350K .......... .......... .......... .......... .......... 54% 349M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50400K .......... .......... .......... .......... .......... 54% 345M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50450K .......... .......... .......... .......... .......... 54% 355M 0s 2024-09-19T14:01:28.089 INFO:teuthology.orchestra.run.smithi094.stderr: 50500K .......... .......... .......... .......... .......... 54% 302M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50550K .......... .......... .......... .......... .......... 54% 267M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50600K .......... .......... .......... .......... .......... 54% 266M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50650K .......... .......... .......... .......... .......... 54% 349M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50700K .......... .......... .......... .......... .......... 54% 299M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50750K .......... .......... .......... .......... .......... 54% 291M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50800K .......... .......... .......... .......... .......... 54% 343M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50850K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50900K .......... .......... .......... .......... .......... 54% 337M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 50950K .......... .......... .......... .......... .......... 54% 390M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 51000K .......... .......... .......... .......... .......... 54% 405M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 51050K .......... .......... .......... .......... .......... 55% 85.4M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 51100K .......... .......... .......... .......... .......... 55% 244M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 51150K .......... .......... .......... .......... .......... 55% 348M 0s 2024-09-19T14:01:28.090 INFO:teuthology.orchestra.run.smithi094.stderr: 51200K .......... .......... .......... .......... .......... 55% 343M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51250K .......... .......... .......... .......... .......... 55% 32.2M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51300K .......... .......... .......... .......... .......... 55% 273M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51350K .......... .......... .......... .......... .......... 55% 358M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51400K .......... .......... .......... .......... .......... 55% 133M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51450K .......... .......... .......... .......... .......... 55% 359M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51500K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51550K .......... .......... .......... .......... .......... 55% 226M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51600K .......... .......... .......... .......... .......... 55% 297M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51650K .......... .......... .......... .......... .......... 55% 371M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51700K .......... .......... .......... .......... .......... 55% 265M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51750K .......... .......... .......... .......... .......... 55% 369M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51800K .......... .......... .......... .......... .......... 55% 406M 0s 2024-09-19T14:01:28.091 INFO:teuthology.orchestra.run.smithi094.stderr: 51850K .......... .......... .......... .......... .......... 55% 167M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 51900K .......... .......... .......... .......... .......... 55% 264M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 51950K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52000K .......... .......... .......... .......... .......... 56% 367M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52050K .......... .......... .......... .......... .......... 56% 205M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52100K .......... .......... .......... .......... .......... 56% 294M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52150K .......... .......... .......... .......... .......... 56% 318M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52200K .......... .......... .......... .......... .......... 56% 337M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52250K .......... .......... .......... .......... .......... 56% 359M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52300K .......... .......... .......... .......... .......... 56% 279M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52350K .......... .......... .......... .......... .......... 56% 385M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52400K .......... .......... .......... .......... .......... 56% 332M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52450K .......... .......... .......... .......... .......... 56% 336M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52500K .......... .......... .......... .......... .......... 56% 323M 0s 2024-09-19T14:01:28.092 INFO:teuthology.orchestra.run.smithi094.stderr: 52550K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52600K .......... .......... .......... .......... .......... 56% 341M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52650K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52700K .......... .......... .......... .......... .......... 56% 303M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52750K .......... .......... .......... .......... .......... 56% 345M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52800K .......... .......... .......... .......... .......... 56% 205M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52850K .......... .......... .......... .......... .......... 56% 232M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52900K .......... .......... .......... .......... .......... 56% 269M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 52950K .......... .......... .......... .......... .......... 57% 329M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 53000K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 53050K .......... .......... .......... .......... .......... 57% 366M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 53100K .......... .......... .......... .......... .......... 57% 197M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 53150K .......... .......... .......... .......... .......... 57% 296M 0s 2024-09-19T14:01:28.093 INFO:teuthology.orchestra.run.smithi094.stderr: 53200K .......... .......... .......... .......... .......... 57% 392M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53250K .......... .......... .......... .......... .......... 57% 230M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53300K .......... .......... .......... .......... .......... 57% 261M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53350K .......... .......... .......... .......... .......... 57% 280M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53400K .......... .......... .......... .......... .......... 57% 358M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53450K .......... .......... .......... .......... .......... 57% 377M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53500K .......... .......... .......... .......... .......... 57% 283M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53550K .......... .......... .......... .......... .......... 57% 484M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53600K .......... .......... .......... .......... .......... 57% 284M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53650K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53700K .......... .......... .......... .......... .......... 57% 315M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53750K .......... .......... .......... .......... .......... 57% 325M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53800K .......... .......... .......... .......... .......... 57% 151M 0s 2024-09-19T14:01:28.094 INFO:teuthology.orchestra.run.smithi094.stderr: 53850K .......... .......... .......... .......... .......... 58% 257M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 53900K .......... .......... .......... .......... .......... 58% 74.2M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 53950K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54000K .......... .......... .......... .......... .......... 58% 352M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54050K .......... .......... .......... .......... .......... 58% 305M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54100K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54150K .......... .......... .......... .......... .......... 58% 346M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54200K .......... .......... .......... .......... .......... 58% 378M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54250K .......... .......... .......... .......... .......... 58% 43.4M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54300K .......... .......... .......... .......... .......... 58% 212M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54350K .......... .......... .......... .......... .......... 58% 354M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54400K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54450K .......... .......... .......... .......... .......... 58% 145M 0s 2024-09-19T14:01:28.095 INFO:teuthology.orchestra.run.smithi094.stderr: 54500K .......... .......... .......... .......... .......... 58% 273M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54550K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54600K .......... .......... .......... .......... .......... 58% 354M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54650K .......... .......... .......... .......... .......... 58% 288M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54700K .......... .......... .......... .......... .......... 58% 250M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54750K .......... .......... .......... .......... .......... 58% 352M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54800K .......... .......... .......... .......... .......... 59% 176M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54850K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54900K .......... .......... .......... .......... .......... 59% 289M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 54950K .......... .......... .......... .......... .......... 59% 287M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 55000K .......... .......... .......... .......... .......... 59% 318M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 55050K .......... .......... .......... .......... .......... 59% 309M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 55100K .......... .......... .......... .......... .......... 59% 319M 0s 2024-09-19T14:01:28.096 INFO:teuthology.orchestra.run.smithi094.stderr: 55150K .......... .......... .......... .......... .......... 59% 88.0M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55200K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55250K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55300K .......... .......... .......... .......... .......... 59% 315M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55350K .......... .......... .......... .......... .......... 59% 341M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55400K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55450K .......... .......... .......... .......... .......... 59% 340M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55500K .......... .......... .......... .......... .......... 59% 274M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55550K .......... .......... .......... .......... .......... 59% 323M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55600K .......... .......... .......... .......... .......... 59% 330M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55650K .......... .......... .......... .......... .......... 59% 360M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55700K .......... .......... .......... .......... .......... 60% 306M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55750K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55800K .......... .......... .......... .......... .......... 60% 260M 0s 2024-09-19T14:01:28.097 INFO:teuthology.orchestra.run.smithi094.stderr: 55850K .......... .......... .......... .......... .......... 60% 323M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 55900K .......... .......... .......... .......... .......... 60% 299M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 55950K .......... .......... .......... .......... .......... 60% 369M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56000K .......... .......... .......... .......... .......... 60% 387M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56050K .......... .......... .......... .......... .......... 60% 282M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56100K .......... .......... .......... .......... .......... 60% 316M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56150K .......... .......... .......... .......... .......... 60% 353M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56200K .......... .......... .......... .......... .......... 60% 382M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56250K .......... .......... .......... .......... .......... 60% 266M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56300K .......... .......... .......... .......... .......... 60% 257M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56350K .......... .......... .......... .......... .......... 60% 268M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56400K .......... .......... .......... .......... .......... 60% 333M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56450K .......... .......... .......... .......... .......... 60% 351M 0s 2024-09-19T14:01:28.098 INFO:teuthology.orchestra.run.smithi094.stderr: 56500K .......... .......... .......... .......... .......... 60% 308M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56550K .......... .......... .......... .......... .......... 60% 341M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56600K .......... .......... .......... .......... .......... 60% 351M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56650K .......... .......... .......... .......... .......... 61% 345M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56700K .......... .......... .......... .......... .......... 61% 250M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56750K .......... .......... .......... .......... .......... 61% 352M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56800K .......... .......... .......... .......... .......... 61% 350M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56850K .......... .......... .......... .......... .......... 61% 352M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56900K .......... .......... .......... .......... .......... 61% 61.4M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 56950K .......... .......... .......... .......... .......... 61% 274M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 57000K .......... .......... .......... .......... .......... 61% 336M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 57050K .......... .......... .......... .......... .......... 61% 310M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 57100K .......... .......... .......... .......... .......... 61% 319M 0s 2024-09-19T14:01:28.099 INFO:teuthology.orchestra.run.smithi094.stderr: 57150K .......... .......... .......... .......... .......... 61% 40.2M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57200K .......... .......... .......... .......... .......... 61% 273M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57250K .......... .......... .......... .......... .......... 61% 291M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57300K .......... .......... .......... .......... .......... 61% 274M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57350K .......... .......... .......... .......... .......... 61% 329M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57400K .......... .......... .......... .......... .......... 61% 274M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57450K .......... .......... .......... .......... .......... 61% 369M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57500K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57550K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57600K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57650K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57700K .......... .......... .......... .......... .......... 62% 289M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57750K .......... .......... .......... .......... .......... 62% 233M 0s 2024-09-19T14:01:28.100 INFO:teuthology.orchestra.run.smithi094.stderr: 57800K .......... .......... .......... .......... .......... 62% 270M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 57850K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 57900K .......... .......... .......... .......... .......... 62% 376M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 57950K .......... .......... .......... .......... .......... 62% 296M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58000K .......... .......... .......... .......... .......... 62% 95.0M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58050K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58100K .......... .......... .......... .......... .......... 62% 157M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58150K .......... .......... .......... .......... .......... 62% 329M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58200K .......... .......... .......... .......... .......... 62% 278M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58250K .......... .......... .......... .......... .......... 62% 195M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58300K .......... .......... .......... .......... .......... 62% 267M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58350K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58400K .......... .......... .......... .......... .......... 62% 270M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58450K .......... .......... .......... .......... .......... 62% 336M 0s 2024-09-19T14:01:28.101 INFO:teuthology.orchestra.run.smithi094.stderr: 58500K .......... .......... .......... .......... .......... 63% 302M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58550K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58600K .......... .......... .......... .......... .......... 63% 317M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58650K .......... .......... .......... .......... .......... 63% 334M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58700K .......... .......... .......... .......... .......... 63% 285M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58750K .......... .......... .......... .......... .......... 63% 282M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58800K .......... .......... .......... .......... .......... 63% 235M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58850K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58900K .......... .......... .......... .......... .......... 63% 392M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 58950K .......... .......... .......... .......... .......... 63% 398M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 59000K .......... .......... .......... .......... .......... 63% 295M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 59050K .......... .......... .......... .......... .......... 63% 292M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 59100K .......... .......... .......... .......... .......... 63% 353M 0s 2024-09-19T14:01:28.102 INFO:teuthology.orchestra.run.smithi094.stderr: 59150K .......... .......... .......... .......... .......... 63% 310M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59200K .......... .......... .......... .......... .......... 63% 262M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59250K .......... .......... .......... .......... .......... 63% 344M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59300K .......... .......... .......... .......... .......... 63% 349M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59350K .......... .......... .......... .......... .......... 63% 337M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59400K .......... .......... .......... .......... .......... 63% 275M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59450K .......... .......... .......... .......... .......... 64% 301M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59500K .......... .......... .......... .......... .......... 64% 263M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59550K .......... .......... .......... .......... .......... 64% 316M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59600K .......... .......... .......... .......... .......... 64% 253M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59650K .......... .......... .......... .......... .......... 64% 410M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59700K .......... .......... .......... .......... .......... 64% 291M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59750K .......... .......... .......... .......... .......... 64% 251M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59800K .......... .......... .......... .......... .......... 64% 312M 0s 2024-09-19T14:01:28.103 INFO:teuthology.orchestra.run.smithi094.stderr: 59850K .......... .......... .......... .......... .......... 64% 401M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 59900K .......... .......... .......... .......... .......... 64% 106M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 59950K .......... .......... .......... .......... .......... 64% 327M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60000K .......... .......... .......... .......... .......... 64% 244M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60050K .......... .......... .......... .......... .......... 64% 318M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60100K .......... .......... .......... .......... .......... 64% 195M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60150K .......... .......... .......... .......... .......... 64% 32.7M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60200K .......... .......... .......... .......... .......... 64% 273M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60250K .......... .......... .......... .......... .......... 64% 282M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60300K .......... .......... .......... .......... .......... 64% 290M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60350K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60400K .......... .......... .......... .......... .......... 65% 255M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60450K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60500K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-19T14:01:28.104 INFO:teuthology.orchestra.run.smithi094.stderr: 60550K .......... .......... .......... .......... .......... 65% 271M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60600K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60650K .......... .......... .......... .......... .......... 65% 311M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60700K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60750K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60800K .......... .......... .......... .......... .......... 65% 342M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60850K .......... .......... .......... .......... .......... 65% 408M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60900K .......... .......... .......... .......... .......... 65% 298M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 60950K .......... .......... .......... .......... .......... 65% 330M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 61000K .......... .......... .......... .......... .......... 65% 342M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 61050K .......... .......... .......... .......... .......... 65% 345M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 61100K .......... .......... .......... .......... .......... 65% 352M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 61150K .......... .......... .......... .......... .......... 65% 347M 0s 2024-09-19T14:01:28.105 INFO:teuthology.orchestra.run.smithi094.stderr: 61200K .......... .......... .......... .......... .......... 65% 201M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61250K .......... .......... .......... .......... .......... 65% 215M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61300K .......... .......... .......... .......... .......... 66% 108M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61350K .......... .......... .......... .......... .......... 66% 264M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61400K .......... .......... .......... .......... .......... 66% 295M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61450K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61500K .......... .......... .......... .......... .......... 66% 388M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61550K .......... .......... .......... .......... .......... 66% 379M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61600K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61650K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61700K .......... .......... .......... .......... .......... 66% 376M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61750K .......... .......... .......... .......... .......... 66% 283M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61800K .......... .......... .......... .......... .......... 66% 100M 0s 2024-09-19T14:01:28.106 INFO:teuthology.orchestra.run.smithi094.stderr: 61850K .......... .......... .......... .......... .......... 66% 292M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 61900K .......... .......... .......... .......... .......... 66% 237M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 61950K .......... .......... .......... .......... .......... 66% 241M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62000K .......... .......... .......... .......... .......... 66% 296M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62050K .......... .......... .......... .......... .......... 66% 304M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62100K .......... .......... .......... .......... .......... 66% 306M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62150K .......... .......... .......... .......... .......... 66% 297M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62200K .......... .......... .......... .......... .......... 67% 361M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62250K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62300K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62350K .......... .......... .......... .......... .......... 67% 277M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62400K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62450K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62500K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-19T14:01:28.107 INFO:teuthology.orchestra.run.smithi094.stderr: 62550K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62600K .......... .......... .......... .......... .......... 67% 286M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62650K .......... .......... .......... .......... .......... 67% 340M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62700K .......... .......... .......... .......... .......... 67% 297M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62750K .......... .......... .......... .......... .......... 67% 287M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62800K .......... .......... .......... .......... .......... 67% 377M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62850K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62900K .......... .......... .......... .......... .......... 67% 220M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 62950K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 63000K .......... .......... .......... .......... .......... 67% 257M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 63050K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 63100K .......... .......... .......... .......... .......... 67% 389M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 63150K .......... .......... .......... .......... .......... 68% 31.9M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 63200K .......... .......... .......... .......... .......... 68% 254M 0s 2024-09-19T14:01:28.108 INFO:teuthology.orchestra.run.smithi094.stderr: 63250K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63300K .......... .......... .......... .......... .......... 68% 141M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63350K .......... .......... .......... .......... .......... 68% 253M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63400K .......... .......... .......... .......... .......... 68% 262M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63450K .......... .......... .......... .......... .......... 68% 355M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63500K .......... .......... .......... .......... .......... 68% 388M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63550K .......... .......... .......... .......... .......... 68% 377M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63600K .......... .......... .......... .......... .......... 68% 97.0M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63650K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63700K .......... .......... .......... .......... .......... 68% 375M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63750K .......... .......... .......... .......... .......... 68% 341M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63800K .......... .......... .......... .......... .......... 68% 413M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63850K .......... .......... .......... .......... .......... 68% 384M 0s 2024-09-19T14:01:28.109 INFO:teuthology.orchestra.run.smithi094.stderr: 63900K .......... .......... .......... .......... .......... 68% 413M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 63950K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64000K .......... .......... .......... .......... .......... 68% 382M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64050K .......... .......... .......... .......... .......... 68% 423M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64100K .......... .......... .......... .......... .......... 69% 394M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64150K .......... .......... .......... .......... .......... 69% 365M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64200K .......... .......... .......... .......... .......... 69% 340M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64250K .......... .......... .......... .......... .......... 69% 428M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64300K .......... .......... .......... .......... .......... 69% 370M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64350K .......... .......... .......... .......... .......... 69% 255M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64400K .......... .......... .......... .......... .......... 69% 106M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64450K .......... .......... .......... .......... .......... 69% 347M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64500K .......... .......... .......... .......... .......... 69% 348M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64550K .......... .......... .......... .......... .......... 69% 314M 0s 2024-09-19T14:01:28.110 INFO:teuthology.orchestra.run.smithi094.stderr: 64600K .......... .......... .......... .......... .......... 69% 358M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64650K .......... .......... .......... .......... .......... 69% 422M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64700K .......... .......... .......... .......... .......... 69% 356M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64750K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64800K .......... .......... .......... .......... .......... 69% 462M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64850K .......... .......... .......... .......... .......... 69% 175M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64900K .......... .......... .......... .......... .......... 69% 399M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 64950K .......... .......... .......... .......... .......... 69% 104M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65000K .......... .......... .......... .......... .......... 70% 233M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65050K .......... .......... .......... .......... .......... 70% 205M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65100K .......... .......... .......... .......... .......... 70% 281M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65150K .......... .......... .......... .......... .......... 70% 329M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65200K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65250K .......... .......... .......... .......... .......... 70% 358M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65300K .......... .......... .......... .......... .......... 70% 451M 0s 2024-09-19T14:01:28.111 INFO:teuthology.orchestra.run.smithi094.stderr: 65350K .......... .......... .......... .......... .......... 70% 419M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65400K .......... .......... .......... .......... .......... 70% 80.6M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65450K .......... .......... .......... .......... .......... 70% 330M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65500K .......... .......... .......... .......... .......... 70% 380M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65550K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65600K .......... .......... .......... .......... .......... 70% 397M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65650K .......... .......... .......... .......... .......... 70% 416M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65700K .......... .......... .......... .......... .......... 70% 459M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65750K .......... .......... .......... .......... .......... 70% 388M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65800K .......... .......... .......... .......... .......... 70% 471M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65850K .......... .......... .......... .......... .......... 70% 200M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65900K .......... .......... .......... .......... .......... 70% 398M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 65950K .......... .......... .......... .......... .......... 71% 349M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 66000K .......... .......... .......... .......... .......... 71% 149M 0s 2024-09-19T14:01:28.112 INFO:teuthology.orchestra.run.smithi094.stderr: 66050K .......... .......... .......... .......... .......... 71% 352M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66100K .......... .......... .......... .......... .......... 71% 432M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66150K .......... .......... .......... .......... .......... 71% 58.7M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66200K .......... .......... .......... .......... .......... 71% 132M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66250K .......... .......... .......... .......... .......... 71% 237M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66300K .......... .......... .......... .......... .......... 71% 378M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66350K .......... .......... .......... .......... .......... 71% 76.2M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66400K .......... .......... .......... .......... .......... 71% 299M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66450K .......... .......... .......... .......... .......... 71% 348M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66500K .......... .......... .......... .......... .......... 71% 280M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66550K .......... .......... .......... .......... .......... 71% 419M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66600K .......... .......... .......... .......... .......... 71% 103M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66650K .......... .......... .......... .......... .......... 71% 319M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66700K .......... .......... .......... .......... .......... 71% 392M 0s 2024-09-19T14:01:28.113 INFO:teuthology.orchestra.run.smithi094.stderr: 66750K .......... .......... .......... .......... .......... 71% 455M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 66800K .......... .......... .......... .......... .......... 71% 254M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 66850K .......... .......... .......... .......... .......... 72% 217M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 66900K .......... .......... .......... .......... .......... 72% 267M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 66950K .......... .......... .......... .......... .......... 72% 243M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67000K .......... .......... .......... .......... .......... 72% 362M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67050K .......... .......... .......... .......... .......... 72% 296M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67100K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67150K .......... .......... .......... .......... .......... 72% 362M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67200K .......... .......... .......... .......... .......... 72% 364M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67250K .......... .......... .......... .......... .......... 72% 303M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67300K .......... .......... .......... .......... .......... 72% 320M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67350K .......... .......... .......... .......... .......... 72% 393M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67400K .......... .......... .......... .......... .......... 72% 458M 0s 2024-09-19T14:01:28.114 INFO:teuthology.orchestra.run.smithi094.stderr: 67450K .......... .......... .......... .......... .......... 72% 309M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67500K .......... .......... .......... .......... .......... 72% 377M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67550K .......... .......... .......... .......... .......... 72% 391M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67600K .......... .......... .......... .......... .......... 72% 364M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67650K .......... .......... .......... .......... .......... 72% 341M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67700K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67750K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67800K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67850K .......... .......... .......... .......... .......... 73% 241M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67900K .......... .......... .......... .......... .......... 73% 338M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 67950K .......... .......... .......... .......... .......... 73% 463M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 68000K .......... .......... .......... .......... .......... 73% 171M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 68050K .......... .......... .......... .......... .......... 73% 108M 0s 2024-09-19T14:01:28.115 INFO:teuthology.orchestra.run.smithi094.stderr: 68100K .......... .......... .......... .......... .......... 73% 163M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68150K .......... .......... .......... .......... .......... 73% 172M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68200K .......... .......... .......... .......... .......... 73% 396M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68250K .......... .......... .......... .......... .......... 73% 275M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68300K .......... .......... .......... .......... .......... 73% 453M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68350K .......... .......... .......... .......... .......... 73% 114M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68400K .......... .......... .......... .......... .......... 73% 307M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68450K .......... .......... .......... .......... .......... 73% 357M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68500K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68550K .......... .......... .......... .......... .......... 73% 115M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68600K .......... .......... .......... .......... .......... 73% 324M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68650K .......... .......... .......... .......... .......... 73% 331M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68700K .......... .......... .......... .......... .......... 74% 433M 0s 2024-09-19T14:01:28.116 INFO:teuthology.orchestra.run.smithi094.stderr: 68750K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 68800K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 68850K .......... .......... .......... .......... .......... 74% 330M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 68900K .......... .......... .......... .......... .......... 74% 393M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 68950K .......... .......... .......... .......... .......... 74% 416M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69000K .......... .......... .......... .......... .......... 74% 200M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69050K .......... .......... .......... .......... .......... 74% 315M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69100K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69150K .......... .......... .......... .......... .......... 74% 441M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69200K .......... .......... .......... .......... .......... 74% 112M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69250K .......... .......... .......... .......... .......... 74% 115M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69300K .......... .......... .......... .......... .......... 74% 405M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69350K .......... .......... .......... .......... .......... 74% 169M 0s 2024-09-19T14:01:28.117 INFO:teuthology.orchestra.run.smithi094.stderr: 69400K .......... .......... .......... .......... .......... 74% 114M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69450K .......... .......... .......... .......... .......... 74% 146M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69500K .......... .......... .......... .......... .......... 74% 105M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69550K .......... .......... .......... .......... .......... 74% 377M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69600K .......... .......... .......... .......... .......... 74% 416M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69650K .......... .......... .......... .......... .......... 75% 174M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69700K .......... .......... .......... .......... .......... 75% 265M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69750K .......... .......... .......... .......... .......... 75% 336M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69800K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69850K .......... .......... .......... .......... .......... 75% 377M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69900K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 69950K .......... .......... .......... .......... .......... 75% 128M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 70000K .......... .......... .......... .......... .......... 75% 310M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 70050K .......... .......... .......... .......... .......... 75% 412M 0s 2024-09-19T14:01:28.118 INFO:teuthology.orchestra.run.smithi094.stderr: 70100K .......... .......... .......... .......... .......... 75% 178M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70150K .......... .......... .......... .......... .......... 75% 249M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70200K .......... .......... .......... .......... .......... 75% 403M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70250K .......... .......... .......... .......... .......... 75% 322M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70300K .......... .......... .......... .......... .......... 75% 364M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70350K .......... .......... .......... .......... .......... 75% 404M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70400K .......... .......... .......... .......... .......... 75% 368M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70450K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70500K .......... .......... .......... .......... .......... 75% 400M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70550K .......... .......... .......... .......... .......... 75% 394M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70600K .......... .......... .......... .......... .......... 76% 390M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70650K .......... .......... .......... .......... .......... 76% 343M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70700K .......... .......... .......... .......... .......... 76% 425M 0s 2024-09-19T14:01:28.119 INFO:teuthology.orchestra.run.smithi094.stderr: 70750K .......... .......... .......... .......... .......... 76% 421M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 70800K .......... .......... .......... .......... .......... 76% 359M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 70850K .......... .......... .......... .......... .......... 76% 395M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 70900K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 70950K .......... .......... .......... .......... .......... 76% 383M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71000K .......... .......... .......... .......... .......... 76% 408M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71050K .......... .......... .......... .......... .......... 76% 148M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71100K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71150K .......... .......... .......... .......... .......... 76% 140M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71200K .......... .......... .......... .......... .......... 76% 341M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71250K .......... .......... .......... .......... .......... 76% 177M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71300K .......... .......... .......... .......... .......... 76% 253M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71350K .......... .......... .......... .......... .......... 76% 103M 0s 2024-09-19T14:01:28.120 INFO:teuthology.orchestra.run.smithi094.stderr: 71400K .......... .......... .......... .......... .......... 76% 303M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71450K .......... .......... .......... .......... .......... 76% 299M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71500K .......... .......... .......... .......... .......... 77% 470M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71550K .......... .......... .......... .......... .......... 77% 387M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71600K .......... .......... .......... .......... .......... 77% 140M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71650K .......... .......... .......... .......... .......... 77% 280M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71700K .......... .......... .......... .......... .......... 77% 368M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71750K .......... .......... .......... .......... .......... 77% 212M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71800K .......... .......... .......... .......... .......... 77% 360M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71850K .......... .......... .......... .......... .......... 77% 329M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71900K .......... .......... .......... .......... .......... 77% 272M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 71950K .......... .......... .......... .......... .......... 77% 431M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 72000K .......... .......... .......... .......... .......... 77% 327M 0s 2024-09-19T14:01:28.121 INFO:teuthology.orchestra.run.smithi094.stderr: 72050K .......... .......... .......... .......... .......... 77% 383M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72100K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72150K .......... .......... .......... .......... .......... 77% 289M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72200K .......... .......... .......... .......... .......... 77% 359M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72250K .......... .......... .......... .......... .......... 77% 192M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72300K .......... .......... .......... .......... .......... 77% 82.0M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72350K .......... .......... .......... .......... .......... 77% 276M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72400K .......... .......... .......... .......... .......... 77% 364M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72450K .......... .......... .......... .......... .......... 78% 145M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72500K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72550K .......... .......... .......... .......... .......... 78% 64.2M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72600K .......... .......... .......... .......... .......... 78% 263M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72650K .......... .......... .......... .......... .......... 78% 341M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72700K .......... .......... .......... .......... .......... 78% 333M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72750K .......... .......... .......... .......... .......... 78% 398M 0s 2024-09-19T14:01:28.122 INFO:teuthology.orchestra.run.smithi094.stderr: 72800K .......... .......... .......... .......... .......... 78% 208M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 72850K .......... .......... .......... .......... .......... 78% 203M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 72900K .......... .......... .......... .......... .......... 78% 347M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 72950K .......... .......... .......... .......... .......... 78% 408M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73000K .......... .......... .......... .......... .......... 78% 197M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73050K .......... .......... .......... .......... .......... 78% 269M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73100K .......... .......... .......... .......... .......... 78% 181M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73150K .......... .......... .......... .......... .......... 78% 257M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73200K .......... .......... .......... .......... .......... 78% 264M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73250K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73300K .......... .......... .......... .......... .......... 78% 305M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73350K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73400K .......... .......... .......... .......... .......... 79% 452M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73450K .......... .......... .......... .......... .......... 79% 294M 0s 2024-09-19T14:01:28.123 INFO:teuthology.orchestra.run.smithi094.stderr: 73500K .......... .......... .......... .......... .......... 79% 244M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73550K .......... .......... .......... .......... .......... 79% 378M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73600K .......... .......... .......... .......... .......... 79% 367M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73650K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73700K .......... .......... .......... .......... .......... 79% 325M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73750K .......... .......... .......... .......... .......... 79% 396M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73800K .......... .......... .......... .......... .......... 79% 443M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73850K .......... .......... .......... .......... .......... 79% 322M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73900K .......... .......... .......... .......... .......... 79% 329M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 73950K .......... .......... .......... .......... .......... 79% 271M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 74000K .......... .......... .......... .......... .......... 79% 398M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 74050K .......... .......... .......... .......... .......... 79% 392M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 74100K .......... .......... .......... .......... .......... 79% 339M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 74150K .......... .......... .......... .......... .......... 79% 402M 0s 2024-09-19T14:01:28.124 INFO:teuthology.orchestra.run.smithi094.stderr: 74200K .......... .......... .......... .......... .......... 79% 401M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74250K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74300K .......... .......... .......... .......... .......... 80% 114M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74350K .......... .......... .......... .......... .......... 80% 222M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74400K .......... .......... .......... .......... .......... 80% 127M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74450K .......... .......... .......... .......... .......... 80% 290M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74500K .......... .......... .......... .......... .......... 80% 332M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74550K .......... .......... .......... .......... .......... 80% 365M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74600K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74650K .......... .......... .......... .......... .......... 80% 421M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74700K .......... .......... .......... .......... .......... 80% 199M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74750K .......... .......... .......... .......... .......... 80% 367M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74800K .......... .......... .......... .......... .......... 80% 204M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74850K .......... .......... .......... .......... .......... 80% 95.4M 0s 2024-09-19T14:01:28.125 INFO:teuthology.orchestra.run.smithi094.stderr: 74900K .......... .......... .......... .......... .......... 80% 277M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 74950K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75000K .......... .......... .......... .......... .......... 80% 399M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75050K .......... .......... .......... .......... .......... 80% 322M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75100K .......... .......... .......... .......... .......... 80% 370M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75150K .......... .......... .......... .......... .......... 80% 402M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75200K .......... .......... .......... .......... .......... 81% 399M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75250K .......... .......... .......... .......... .......... 81% 382M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75300K .......... .......... .......... .......... .......... 81% 341M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75350K .......... .......... .......... .......... .......... 81% 65.9M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75400K .......... .......... .......... .......... .......... 81% 365M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75450K .......... .......... .......... .......... .......... 81% 373M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75500K .......... .......... .......... .......... .......... 81% 319M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75550K .......... .......... .......... .......... .......... 81% 130M 0s 2024-09-19T14:01:28.126 INFO:teuthology.orchestra.run.smithi094.stderr: 75600K .......... .......... .......... .......... .......... 81% 89.4M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75650K .......... .......... .......... .......... .......... 81% 329M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75700K .......... .......... .......... .......... .......... 81% 219M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75750K .......... .......... .......... .......... .......... 81% 252M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75800K .......... .......... .......... .......... .......... 81% 349M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75850K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75900K .......... .......... .......... .......... .......... 81% 266M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 75950K .......... .......... .......... .......... .......... 81% 123M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76000K .......... .......... .......... .......... .......... 81% 405M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76050K .......... .......... .......... .......... .......... 81% 358M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76100K .......... .......... .......... .......... .......... 81% 370M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76150K .......... .......... .......... .......... .......... 82% 149M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76200K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76250K .......... .......... .......... .......... .......... 82% 150M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76300K .......... .......... .......... .......... .......... 82% 345M 0s 2024-09-19T14:01:28.127 INFO:teuthology.orchestra.run.smithi094.stderr: 76350K .......... .......... .......... .......... .......... 82% 432M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76400K .......... .......... .......... .......... .......... 82% 392M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76450K .......... .......... .......... .......... .......... 82% 250M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76500K .......... .......... .......... .......... .......... 82% 371M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76550K .......... .......... .......... .......... .......... 82% 429M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76600K .......... .......... .......... .......... .......... 82% 195M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76650K .......... .......... .......... .......... .......... 82% 395M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76700K .......... .......... .......... .......... .......... 82% 136M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76750K .......... .......... .......... .......... .......... 82% 418M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76800K .......... .......... .......... .......... .......... 82% 411M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76850K .......... .......... .......... .......... .......... 82% 434M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76900K .......... .......... .......... .......... .......... 82% 389M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 76950K .......... .......... .......... .......... .......... 82% 429M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 77000K .......... .......... .......... .......... .......... 82% 421M 0s 2024-09-19T14:01:28.128 INFO:teuthology.orchestra.run.smithi094.stderr: 77050K .......... .......... .......... .......... .......... 82% 401M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77100K .......... .......... .......... .......... .......... 83% 230M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77150K .......... .......... .......... .......... .......... 83% 417M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77200K .......... .......... .......... .......... .......... 83% 416M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77250K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77300K .......... .......... .......... .......... .......... 83% 307M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77350K .......... .......... .......... .......... .......... 83% 118M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77400K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77450K .......... .......... .......... .......... .......... 83% 441M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77500K .......... .......... .......... .......... .......... 83% 176M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77550K .......... .......... .......... .......... .......... 83% 189M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77600K .......... .......... .......... .......... .......... 83% 417M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77650K .......... .......... .......... .......... .......... 83% 310M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77700K .......... .......... .......... .......... .......... 83% 384M 0s 2024-09-19T14:01:28.129 INFO:teuthology.orchestra.run.smithi094.stderr: 77750K .......... .......... .......... .......... .......... 83% 218M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 77800K .......... .......... .......... .......... .......... 83% 175M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 77850K .......... .......... .......... .......... .......... 83% 231M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 77900K .......... .......... .......... .......... .......... 83% 119M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 77950K .......... .......... .......... .......... .......... 83% 272M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78000K .......... .......... .......... .......... .......... 84% 426M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78050K .......... .......... .......... .......... .......... 84% 159M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78100K .......... .......... .......... .......... .......... 84% 324M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78150K .......... .......... .......... .......... .......... 84% 439M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78200K .......... .......... .......... .......... .......... 84% 440M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78250K .......... .......... .......... .......... .......... 84% 176M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78300K .......... .......... .......... .......... .......... 84% 350M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78350K .......... .......... .......... .......... .......... 84% 411M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78400K .......... .......... .......... .......... .......... 84% 121M 0s 2024-09-19T14:01:28.130 INFO:teuthology.orchestra.run.smithi094.stderr: 78450K .......... .......... .......... .......... .......... 84% 417M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78500K .......... .......... .......... .......... .......... 84% 281M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78550K .......... .......... .......... .......... .......... 84% 406M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78600K .......... .......... .......... .......... .......... 84% 212M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78650K .......... .......... .......... .......... .......... 84% 414M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78700K .......... .......... .......... .......... .......... 84% 68.4M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78750K .......... .......... .......... .......... .......... 84% 387M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78800K .......... .......... .......... .......... .......... 84% 211M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78850K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78900K .......... .......... .......... .......... .......... 84% 385M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 78950K .......... .......... .......... .......... .......... 85% 149M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 79000K .......... .......... .......... .......... .......... 85% 191M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 79050K .......... .......... .......... .......... .......... 85% 232M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 79100K .......... .......... .......... .......... .......... 85% 288M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 79150K .......... .......... .......... .......... .......... 85% 419M 0s 2024-09-19T14:01:28.131 INFO:teuthology.orchestra.run.smithi094.stderr: 79200K .......... .......... .......... .......... .......... 85% 188M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79250K .......... .......... .......... .......... .......... 85% 410M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79300K .......... .......... .......... .......... .......... 85% 148M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79350K .......... .......... .......... .......... .......... 85% 184M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79400K .......... .......... .......... .......... .......... 85% 130M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79450K .......... .......... .......... .......... .......... 85% 398M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79500K .......... .......... .......... .......... .......... 85% 350M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79550K .......... .......... .......... .......... .......... 85% 431M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79600K .......... .......... .......... .......... .......... 85% 434M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79650K .......... .......... .......... .......... .......... 85% 336M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79700K .......... .......... .......... .......... .......... 85% 379M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79750K .......... .......... .......... .......... .......... 85% 210M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79800K .......... .......... .......... .......... .......... 85% 405M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79850K .......... .......... .......... .......... .......... 86% 237M 0s 2024-09-19T14:01:28.132 INFO:teuthology.orchestra.run.smithi094.stderr: 79900K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 79950K .......... .......... .......... .......... .......... 86% 386M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80000K .......... .......... .......... .......... .......... 86% 367M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80050K .......... .......... .......... .......... .......... 86% 421M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80100K .......... .......... .......... .......... .......... 86% 396M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80150K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80200K .......... .......... .......... .......... .......... 86% 185M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80250K .......... .......... .......... .......... .......... 86% 422M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80300K .......... .......... .......... .......... .......... 86% 333M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80350K .......... .......... .......... .......... .......... 86% 418M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80400K .......... .......... .......... .......... .......... 86% 136M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80450K .......... .......... .......... .......... .......... 86% 415M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80500K .......... .......... .......... .......... .......... 86% 208M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80550K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-19T14:01:28.133 INFO:teuthology.orchestra.run.smithi094.stderr: 80600K .......... .......... .......... .......... .......... 86% 433M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80650K .......... .......... .......... .......... .......... 86% 174M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80700K .......... .......... .......... .......... .......... 86% 219M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80750K .......... .......... .......... .......... .......... 86% 412M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80800K .......... .......... .......... .......... .......... 87% 444M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80850K .......... .......... .......... .......... .......... 87% 77.0M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80900K .......... .......... .......... .......... .......... 87% 383M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 80950K .......... .......... .......... .......... .......... 87% 442M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81000K .......... .......... .......... .......... .......... 87% 382M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81050K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81100K .......... .......... .......... .......... .......... 87% 149M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81150K .......... .......... .......... .......... .......... 87% 250M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81200K .......... .......... .......... .......... .......... 87% 410M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81250K .......... .......... .......... .......... .......... 87% 444M 0s 2024-09-19T14:01:28.134 INFO:teuthology.orchestra.run.smithi094.stderr: 81300K .......... .......... .......... .......... .......... 87% 254M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81350K .......... .......... .......... .......... .......... 87% 200M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81400K .......... .......... .......... .......... .......... 87% 416M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81450K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81500K .......... .......... .......... .......... .......... 87% 81.6M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81550K .......... .......... .......... .......... .......... 87% 434M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81600K .......... .......... .......... .......... .......... 87% 415M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81650K .......... .......... .......... .......... .......... 87% 429M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81700K .......... .......... .......... .......... .......... 87% 341M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81750K .......... .......... .......... .......... .......... 88% 186M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81800K .......... .......... .......... .......... .......... 88% 126M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81850K .......... .......... .......... .......... .......... 88% 173M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81900K .......... .......... .......... .......... .......... 88% 398M 0s 2024-09-19T14:01:28.135 INFO:teuthology.orchestra.run.smithi094.stderr: 81950K .......... .......... .......... .......... .......... 88% 397M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82000K .......... .......... .......... .......... .......... 88% 146M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82050K .......... .......... .......... .......... .......... 88% 284M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82100K .......... .......... .......... .......... .......... 88% 120M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82150K .......... .......... .......... .......... .......... 88% 433M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82200K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82250K .......... .......... .......... .......... .......... 88% 430M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82300K .......... .......... .......... .......... .......... 88% 241M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82350K .......... .......... .......... .......... .......... 88% 137M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82400K .......... .......... .......... .......... .......... 88% 409M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82450K .......... .......... .......... .......... .......... 88% 106M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82500K .......... .......... .......... .......... .......... 88% 185M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82550K .......... .......... .......... .......... .......... 88% 394M 0s 2024-09-19T14:01:28.136 INFO:teuthology.orchestra.run.smithi094.stderr: 82600K .......... .......... .......... .......... .......... 88% 436M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82650K .......... .......... .......... .......... .......... 89% 326M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82700K .......... .......... .......... .......... .......... 89% 278M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82750K .......... .......... .......... .......... .......... 89% 432M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82800K .......... .......... .......... .......... .......... 89% 391M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82850K .......... .......... .......... .......... .......... 89% 411M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82900K .......... .......... .......... .......... .......... 89% 385M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 82950K .......... .......... .......... .......... .......... 89% 144M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83000K .......... .......... .......... .......... .......... 89% 346M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83050K .......... .......... .......... .......... .......... 89% 420M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83100K .......... .......... .......... .......... .......... 89% 360M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83150K .......... .......... .......... .......... .......... 89% 445M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83200K .......... .......... .......... .......... .......... 89% 427M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83250K .......... .......... .......... .......... .......... 89% 324M 0s 2024-09-19T14:01:28.137 INFO:teuthology.orchestra.run.smithi094.stderr: 83300K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83350K .......... .......... .......... .......... .......... 89% 425M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83400K .......... .......... .......... .......... .......... 89% 437M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83450K .......... .......... .......... .......... .......... 89% 221M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83500K .......... .......... .......... .......... .......... 89% 158M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83550K .......... .......... .......... .......... .......... 89% 181M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83600K .......... .......... .......... .......... .......... 90% 426M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83650K .......... .......... .......... .......... .......... 90% 366M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83700K .......... .......... .......... .......... .......... 90% 340M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83750K .......... .......... .......... .......... .......... 90% 150M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83800K .......... .......... .......... .......... .......... 90% 410M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83850K .......... .......... .......... .......... .......... 90% 443M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83900K .......... .......... .......... .......... .......... 90% 58.5M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 83950K .......... .......... .......... .......... .......... 90% 410M 0s 2024-09-19T14:01:28.138 INFO:teuthology.orchestra.run.smithi094.stderr: 84000K .......... .......... .......... .......... .......... 90% 432M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84050K .......... .......... .......... .......... .......... 90% 392M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84100K .......... .......... .......... .......... .......... 90% 377M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84150K .......... .......... .......... .......... .......... 90% 432M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84200K .......... .......... .......... .......... .......... 90% 388M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84250K .......... .......... .......... .......... .......... 90% 420M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84300K .......... .......... .......... .......... .......... 90% 222M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84350K .......... .......... .......... .......... .......... 90% 445M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84400K .......... .......... .......... .......... .......... 90% 86.2M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84450K .......... .......... .......... .......... .......... 90% 174M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84500K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84550K .......... .......... .......... .......... .......... 91% 426M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84600K .......... .......... .......... .......... .......... 91% 126M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84650K .......... .......... .......... .......... .......... 91% 337M 0s 2024-09-19T14:01:28.139 INFO:teuthology.orchestra.run.smithi094.stderr: 84700K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 84750K .......... .......... .......... .......... .......... 91% 290M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 84800K .......... .......... .......... .......... .......... 91% 437M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 84850K .......... .......... .......... .......... .......... 91% 434M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 84900K .......... .......... .......... .......... .......... 91% 216M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 84950K .......... .......... .......... .......... .......... 91% 422M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85000K .......... .......... .......... .......... .......... 91% 272M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85050K .......... .......... .......... .......... .......... 91% 200M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85100K .......... .......... .......... .......... .......... 91% 162M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85150K .......... .......... .......... .......... .......... 91% 129M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85200K .......... .......... .......... .......... .......... 91% 405M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85250K .......... .......... .......... .......... .......... 91% 153M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85300K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85350K .......... .......... .......... .......... .......... 91% 417M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85400K .......... .......... .......... .......... .......... 91% 409M 0s 2024-09-19T14:01:28.140 INFO:teuthology.orchestra.run.smithi094.stderr: 85450K .......... .......... .......... .......... .......... 92% 270M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85500K .......... .......... .......... .......... .......... 92% 109M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85550K .......... .......... .......... .......... .......... 92% 127M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85600K .......... .......... .......... .......... .......... 92% 422M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85650K .......... .......... .......... .......... .......... 92% 295M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85700K .......... .......... .......... .......... .......... 92% 380M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85750K .......... .......... .......... .......... .......... 92% 282M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85800K .......... .......... .......... .......... .......... 92% 430M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85850K .......... .......... .......... .......... .......... 92% 364M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85900K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 85950K .......... .......... .......... .......... .......... 92% 296M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 86000K .......... .......... .......... .......... .......... 92% 398M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 86050K .......... .......... .......... .......... .......... 92% 161M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 86100K .......... .......... .......... .......... .......... 92% 377M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 86150K .......... .......... .......... .......... .......... 92% 416M 0s 2024-09-19T14:01:28.141 INFO:teuthology.orchestra.run.smithi094.stderr: 86200K .......... .......... .......... .......... .......... 92% 440M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86250K .......... .......... .......... .......... .......... 92% 437M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86300K .......... .......... .......... .......... .......... 92% 356M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86350K .......... .......... .......... .......... .......... 93% 421M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86400K .......... .......... .......... .......... .......... 93% 441M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86450K .......... .......... .......... .......... .......... 93% 270M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86500K .......... .......... .......... .......... .......... 93% 385M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86550K .......... .......... .......... .......... .......... 93% 337M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86600K .......... .......... .......... .......... .......... 93% 419M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86650K .......... .......... .......... .......... .......... 93% 125M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86700K .......... .......... .......... .......... .......... 93% 345M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86750K .......... .......... .......... .......... .......... 93% 254M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86800K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86850K .......... .......... .......... .......... .......... 93% 372M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86900K .......... .......... .......... .......... .......... 93% 252M 0s 2024-09-19T14:01:28.142 INFO:teuthology.orchestra.run.smithi094.stderr: 86950K .......... .......... .......... .......... .......... 93% 50.4M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87000K .......... .......... .......... .......... .......... 93% 399M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87050K .......... .......... .......... .......... .......... 93% 429M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87100K .......... .......... .......... .......... .......... 93% 305M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87150K .......... .......... .......... .......... .......... 93% 419M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87200K .......... .......... .......... .......... .......... 93% 428M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87250K .......... .......... .......... .......... .......... 93% 437M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87300K .......... .......... .......... .......... .......... 94% 395M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87350K .......... .......... .......... .......... .......... 94% 290M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87400K .......... .......... .......... .......... .......... 94% 147M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87450K .......... .......... .......... .......... .......... 94% 105M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87500K .......... .......... .......... .......... .......... 94% 184M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87550K .......... .......... .......... .......... .......... 94% 216M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87600K .......... .......... .......... .......... .......... 94% 291M 0s 2024-09-19T14:01:28.143 INFO:teuthology.orchestra.run.smithi094.stderr: 87650K .......... .......... .......... .......... .......... 94% 243M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 87700K .......... .......... .......... .......... .......... 94% 102M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 87750K .......... .......... .......... .......... .......... 94% 224M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 87800K .......... .......... .......... .......... .......... 94% 233M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 87850K .......... .......... .......... .......... .......... 94% 285M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 87900K .......... .......... .......... .......... .......... 94% 230M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 87950K .......... .......... .......... .......... .......... 94% 260M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88000K .......... .......... .......... .......... .......... 94% 284M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88050K .......... .......... .......... .......... .......... 94% 284M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88100K .......... .......... .......... .......... .......... 94% 253M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88150K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88200K .......... .......... .......... .......... .......... 94% 291M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88250K .......... .......... .......... .......... .......... 95% 275M 0s 2024-09-19T14:01:28.144 INFO:teuthology.orchestra.run.smithi094.stderr: 88300K .......... .......... .......... .......... .......... 95% 238M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88350K .......... .......... .......... .......... .......... 95% 255M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88400K .......... .......... .......... .......... .......... 95% 254M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88450K .......... .......... .......... .......... .......... 95% 290M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88500K .......... .......... .......... .......... .......... 95% 249M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88550K .......... .......... .......... .......... .......... 95% 292M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88600K .......... .......... .......... .......... .......... 95% 163M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88650K .......... .......... .......... .......... .......... 95% 218M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88700K .......... .......... .......... .......... .......... 95% 231M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88750K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88800K .......... .......... .......... .......... .......... 95% 272M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88850K .......... .......... .......... .......... .......... 95% 252M 0s 2024-09-19T14:01:28.145 INFO:teuthology.orchestra.run.smithi094.stderr: 88900K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 88950K .......... .......... .......... .......... .......... 95% 282M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89000K .......... .......... .......... .......... .......... 95% 277M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89050K .......... .......... .......... .......... .......... 95% 278M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89100K .......... .......... .......... .......... .......... 95% 234M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89150K .......... .......... .......... .......... .......... 96% 284M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89200K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89250K .......... .......... .......... .......... .......... 96% 274M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89300K .......... .......... .......... .......... .......... 96% 250M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89350K .......... .......... .......... .......... .......... 96% 291M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89400K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89450K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89500K .......... .......... .......... .......... .......... 96% 244M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89550K .......... .......... .......... .......... .......... 96% 274M 0s 2024-09-19T14:01:28.146 INFO:teuthology.orchestra.run.smithi094.stderr: 89600K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89650K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89700K .......... .......... .......... .......... .......... 96% 256M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89750K .......... .......... .......... .......... .......... 96% 280M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89800K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89850K .......... .......... .......... .......... .......... 96% 281M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89900K .......... .......... .......... .......... .......... 96% 206M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 89950K .......... .......... .......... .......... .......... 96% 292M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 90000K .......... .......... .......... .......... .......... 96% 146M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 90050K .......... .......... .......... .......... .......... 96% 216M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 90100K .......... .......... .......... .......... .......... 97% 262M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 90150K .......... .......... .......... .......... .......... 97% 276M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 90200K .......... .......... .......... .......... .......... 97% 243M 0s 2024-09-19T14:01:28.147 INFO:teuthology.orchestra.run.smithi094.stderr: 90250K .......... .......... .......... .......... .......... 97% 233M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90300K .......... .......... .......... .......... .......... 97% 195M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90350K .......... .......... .......... .......... .......... 97% 281M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90400K .......... .......... .......... .......... .......... 97% 240M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90450K .......... .......... .......... .......... .......... 97% 290M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90500K .......... .......... .......... .......... .......... 97% 235M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90550K .......... .......... .......... .......... .......... 97% 232M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90600K .......... .......... .......... .......... .......... 97% 286M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90650K .......... .......... .......... .......... .......... 97% 286M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90700K .......... .......... .......... .......... .......... 97% 246M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90750K .......... .......... .......... .......... .......... 97% 276M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90800K .......... .......... .......... .......... .......... 97% 279M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90850K .......... .......... .......... .......... .......... 97% 190M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90900K .......... .......... .......... .......... .......... 97% 256M 0s 2024-09-19T14:01:28.148 INFO:teuthology.orchestra.run.smithi094.stderr: 90950K .......... .......... .......... .......... .......... 97% 285M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91000K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91050K .......... .......... .......... .......... .......... 98% 275M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91100K .......... .......... .......... .......... .......... 98% 221M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91150K .......... .......... .......... .......... .......... 98% 274M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91200K .......... .......... .......... .......... .......... 98% 281M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91250K .......... .......... .......... .......... .......... 98% 278M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91300K .......... .......... .......... .......... .......... 98% 267M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91350K .......... .......... .......... .......... .......... 98% 151M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91400K .......... .......... .......... .......... .......... 98% 275M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91450K .......... .......... .......... .......... .......... 98% 278M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91500K .......... .......... .......... .......... .......... 98% 240M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91550K .......... .......... .......... .......... .......... 98% 292M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91600K .......... .......... .......... .......... .......... 98% 127M 0s 2024-09-19T14:01:28.149 INFO:teuthology.orchestra.run.smithi094.stderr: 91650K .......... .......... .......... .......... .......... 98% 281M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 91700K .......... .......... .......... .......... .......... 98% 256M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 91750K .......... .......... .......... .......... .......... 98% 296M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 91800K .......... .......... .......... .......... .......... 98% 136M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 91850K .......... .......... .......... .......... .......... 98% 236M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 91900K .......... .......... .......... .......... .......... 98% 168M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 91950K .......... .......... .......... .......... .......... 99% 280M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92000K .......... .......... .......... .......... .......... 99% 274M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92050K .......... .......... .......... .......... .......... 99% 276M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92100K .......... .......... .......... .......... .......... 99% 260M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92150K .......... .......... .......... .......... .......... 99% 296M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92200K .......... .......... .......... .......... .......... 99% 260M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92250K .......... .......... .......... .......... .......... 99% 271M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92300K .......... .......... .......... .......... .......... 99% 280M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92350K .......... .......... .......... .......... .......... 99% 234M 0s 2024-09-19T14:01:28.150 INFO:teuthology.orchestra.run.smithi094.stderr: 92400K .......... .......... .......... .......... .......... 99% 289M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92450K .......... .......... .......... .......... .......... 99% 268M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92500K .......... .......... .......... .......... .......... 99% 283M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92550K .......... .......... .......... .......... .......... 99% 246M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92600K .......... .......... .......... .......... .......... 99% 286M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92650K .......... .......... .......... .......... .......... 99% 280M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92700K .......... .......... .......... .......... .......... 99% 287M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92750K .......... .......... .......... .......... .......... 99% 247M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92800K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92850K .......... .......... .......... .......... .......... 99% 289M 0s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 92900K 100% 134G=0.4s 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19 14:01:26 (205 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-19T14:01:28.151 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:01:28.188 INFO:teuthology.orchestra.run.smithi094.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-19T14:01:28.188 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-19T14:01:28.189 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-19T14:01:28.190 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-19T14:01:28.191 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-19T14:01:28.192 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-19T14:01:28.193 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-19T14:01:28.194 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-19T14:01:28.195 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-19T14:01:28.196 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-19T14:01:28.197 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-19T14:01:28.198 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-19T14:01:28.199 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-19T14:01:28.200 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-19T14:01:28.201 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-19T14:01:28.202 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-19T14:01:28.203 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-19T14:01:28.204 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout:Welcome to Gradle 6.0.1! 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.205 INFO:teuthology.orchestra.run.smithi094.stdout:Here are the highlights of this release: 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Substantial improvements in dependency management, including 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Advanced control of transitive versions 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for optional features and dependencies 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Rules to tweak published metadata 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for Java 13 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Faster incremental Java and Groovy compilation 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - New Zinc compiler for Scala 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - VS2019 support 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.206 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:------------------------------------------------------------ 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:Gradle 6.0.1 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:------------------------------------------------------------ 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:Kotlin: 1.3.50 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:Groovy: 2.5.8 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout:OS: Linux 5.14.0-508.el9.x86_64 amd64 2024-09-19T14:01:28.207 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:28.208 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-19T14:01:28.208 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-19T14:01:28.208 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T14:01:28.208 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-19T14:01:28.208 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T14:01:28.208 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-19T14:01:28.587 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-19T14:01:28.587 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-19T14:01:28.588 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'SSPLTYERYOXLIWRYAZOF', 'access_secret': 'g8wfNKiUF9We7YmZXuRRnCtOu0n6e+hZ5JvpKY20/jbfZX7M3vJHKQ==', 'region': 'mexico', 'endpoint': 'smithi094.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi094.front.sepia.ceph.com'} 2024-09-19T14:01:28.588 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-19T14:01:28.588 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'SSPLTYERYOXLIWRYAZOF', '--secret', 'g8wfNKiUF9We7YmZXuRRnCtOu0n6e+hZ5JvpKY20/jbfZX7M3vJHKQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-19T14:01:28.588 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key SSPLTYERYOXLIWRYAZOF --secret g8wfNKiUF9We7YmZXuRRnCtOu0n6e+hZ5JvpKY20/jbfZX7M3vJHKQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-19T14:01:28.653 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:28.653 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:28.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.684+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:28.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:28.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 realm 2024-09-19T14:01:28.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:28.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:28.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:28.688 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:28.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:28.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.686+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:28.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.688+0000 7fea7410c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:28.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.688+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:28.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.688+0000 7fea7410c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:28.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.688+0000 7fea7410c800 20 searching for the correct realm 2024-09-19T14:01:28.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.690+0000 7fea693fc640 0 -- 172.21.15.94:0/677747476 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fea6406b020 msgr2=0x7fea640a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:01:28.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:28.897+0000 7fea71bfd640 0 -- 172.21.15.94:0/677747476 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fea5c0a5ba0 msgr2=0x7fea5c075860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:01:29.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:29.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:29.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:29.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:29.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:29.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 zone default found 2024-09-19T14:01:29.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 4 Realm: () 2024-09-19T14:01:29.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:29.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 zonegroup default 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.104+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 started sync module instance, tier type = 2024-09-19T14:01:29.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.105+0000 7fea7410c800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=0 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=1 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=2 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=3 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=4 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=5 2024-09-19T14:01:29.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.116+0000 7fea7410c800 20 add_watcher() i=6 2024-09-19T14:01:29.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.117+0000 7fea7410c800 20 add_watcher() i=7 2024-09-19T14:01:29.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.117+0000 7fea7410c800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.118+0000 7fe923fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.118+0000 7fea7410c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.118+0000 7fea7410c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.118+0000 7fea7410c800 5 note: GC not initialized 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.118+0000 7fe922ffd640 20 reqs_thread_entry: start 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 20 Filter name: none 2024-09-19T14:01:29.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fe920ff9640 20 reqs_thread_entry: start 2024-09-19T14:01:29.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-19T14:01:29.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.119+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 cache get: name=default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF : miss 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 cache put: name=default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF info.flags=0x0 2024-09-19T14:01:29.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 adding default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF to cache LRU end 2024-09-19T14:01:29.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 cache get: name=default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF : hit (negative entry) 2024-09-19T14:01:29.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.120+0000 7fea7410c800 10 cache get: name=default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF : hit (negative entry) 2024-09-19T14:01:29.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.121+0000 7fea7410c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-19T14:01:29.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.121+0000 7fea7410c800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:01:29.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.121+0000 7fea7410c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-19T14:01:29.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.122+0000 7fe9557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595144 cookie 94566989731392 notifier 8745 bl.length()=670 2024-09-19T14:01:29.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.122+0000 7fe9557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-19T14:01:29.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.122+0000 7fe9557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:01:29.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.123+0000 7fea7410c800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-19T14:01:29.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.123+0000 7fea7410c800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-19T14:01:29.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.123+0000 7fea7410c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-19T14:01:29.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.124+0000 7fe9557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94566989714672 notifier 8745 bl.length()=200 2024-09-19T14:01:29.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.124+0000 7fe9557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-19T14:01:29.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.124+0000 7fe9557fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-19T14:01:29.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.125+0000 7fea7410c800 10 cache put: name=default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF info.flags=0x7 2024-09-19T14:01:29.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.125+0000 7fea7410c800 10 moving default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF to cache LRU end 2024-09-19T14:01:29.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.125+0000 7fea7410c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:SSPLTYERYOXLIWRYAZOF, ofs0, ns] 2024-09-19T14:01:29.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.126+0000 7fe954ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595145 cookie 94566989727856 notifier 8745 bl.length()=189 2024-09-19T14:01:29.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.126+0000 7fe954ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF info.flags=0x7 2024-09-19T14:01:29.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.126+0000 7fe954ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SSPLTYERYOXLIWRYAZOF to cache LRU end 2024-09-19T14:01:29.128 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "tester.client.0", 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Ms. tester.client.0", 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "tester.client.0_test@test.test", 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "tester.client.0", 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "SSPLTYERYOXLIWRYAZOF", 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "g8wfNKiUF9We7YmZXuRRnCtOu0n6e+hZ5JvpKY20/jbfZX7M3vJHKQ==", 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:01:29.129 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:01:29.121664Z" 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:01:29.130 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:01:29.131 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:01:29.121653Z", 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:29.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.127+0000 7fe923fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.129+0000 7fea7410c800 20 remove_watcher() i=0 2024-09-19T14:01:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.129+0000 7fea7410c800 2 removed watcher, disabling cache 2024-09-19T14:01:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.130+0000 7fea7410c800 20 remove_watcher() i=1 2024-09-19T14:01:29.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.131+0000 7fea7410c800 20 remove_watcher() i=2 2024-09-19T14:01:29.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.133+0000 7fea7410c800 20 remove_watcher() i=3 2024-09-19T14:01:29.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.134+0000 7fea7410c800 20 remove_watcher() i=4 2024-09-19T14:01:29.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.135+0000 7fea7410c800 20 remove_watcher() i=5 2024-09-19T14:01:29.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.136+0000 7fea7410c800 20 remove_watcher() i=6 2024-09-19T14:01:29.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.137+0000 7fea7410c800 20 remove_watcher() i=7 2024-09-19T14:01:29.151 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T14:01:29.151 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-19T14:01:29.181 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-19T14:01:29.182 DEBUG:teuthology.orchestra.run.smithi094:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-19T14:01:29.248 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:01:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:29.340 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:29.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.376+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 realm 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.378+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.379+0000 7fe82ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:29.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.379+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.380+0000 7fe82ed2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:29.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.380+0000 7fe82ed2e800 20 searching for the correct realm 2024-09-19T14:01:29.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.384+0000 7fe822163640 0 -- 172.21.15.94:0/442013425 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fe81c03d070 msgr2=0x7fe81c03e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:29.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.387+0000 7fe82b165640 0 -- 172.21.15.94:0/442013425 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fe81402a060 msgr2=0x7fe814048920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:01:29.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:29.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:29.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:29.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.392+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:29.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:29.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 zone default found 2024-09-19T14:01:29.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 4 Realm: () 2024-09-19T14:01:29.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:29.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:29.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 zonegroup default 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.393+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.394+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.394+0000 7fe82ed2e800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.394+0000 7fe82ed2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.394+0000 7fe82ed2e800 20 started sync module instance, tier type = 2024-09-19T14:01:29.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.394+0000 7fe82ed2e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=0 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=1 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=2 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=3 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=4 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=5 2024-09-19T14:01:29.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.403+0000 7fe82ed2e800 20 add_watcher() i=6 2024-09-19T14:01:29.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.404+0000 7fe82ed2e800 20 add_watcher() i=7 2024-09-19T14:01:29.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.404+0000 7fe82ed2e800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:29.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.406+0000 7fe6e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:29.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.406+0000 7fe82ed2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:29.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.406+0000 7fe82ed2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:29.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.441+0000 7fe65bfff640 20 reqs_thread_entry: start 2024-09-19T14:01:29.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.442+0000 7fe82ed2e800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:29.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.442+0000 7fe82ed2e800 20 Filter name: none 2024-09-19T14:01:29.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.442+0000 7fe659ffb640 20 reqs_thread_entry: start 2024-09-19T14:01:29.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.442+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:01:29.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.443+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.443+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.444+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.444+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:01:29.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.446+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.447+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.447+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.448+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:01:29.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.449+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.449+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10372120100355539126', time=2024-09-19T15:52:58.019892+0000, chain.objs.size()=4 2024-09-19T14:01:29.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.1 2024-09-19T14:01:29.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.2 2024-09-19T14:01:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.3 2024-09-19T14:01:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10__multipart_foo.2~15cmzO3aH1R9exl96P2_oLEtDqgr7pM.4 2024-09-19T14:01:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11962411664658680868', time=2024-09-19T15:52:58.134628+0000, chain.objs.size()=3 2024-09-19T14:01:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.1 2024-09-19T14:01:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.2 2024-09-19T14:01:29.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.450+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.3 2024-09-19T14:01:29.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.451+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.453+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:01:29.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.455+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.455+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.456+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.456+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_L-VekVF6gSX7QA3O8K10tcB-XOmWk2j', time=2024-09-19T15:52:58.043592+0000, chain.objs.size()=1 2024-09-19T14:01:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.456+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.zHDTV1cpVkc0LZvtN004okSdIM2pOej_1 2024-09-19T14:01:29.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.457+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.459+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:01:29.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.460+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_fTsc9-dCQ83A3xz8siESBXLLro80ITt', time=2024-09-19T15:52:58.138216+0000, chain.objs.size()=1 2024-09-19T14:01:29.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.Dfig3OgGYEJyaBHH1L2ya3CqWG0FtCk_0 2024-09-19T14:01:29.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15330635729167985165', time=2024-09-19T15:52:58.188452+0000, chain.objs.size()=2 2024-09-19T14:01:29.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.R4wiPcq4PlgZtk7ERzGrM_W2Um5PF28_0 2024-09-19T14:01:29.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.461+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.R4wiPcq4PlgZtk7ERzGrM_W2Um5PF28_1 2024-09-19T14:01:29.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.464+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.467+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:01:29.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.468+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.469+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.469+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.470+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:01:29.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.471+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14352301157512827912', time=2024-09-19T15:52:58.164237+0000, chain.objs.size()=3 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-STANDARD.2~1qF1VHLUBA5fOzMMQMM0Pndjzsn7YFs.1 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-STANDARD.2~1qF1VHLUBA5fOzMMQMM0Pndjzsn7YFs.2 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-STANDARD.2~1qF1VHLUBA5fOzMMQMM0Pndjzsn7YFs.3 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10350445801339671693', time=2024-09-19T15:52:58.168858+0000, chain.objs.size()=3 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-LUKEWARM.2~-zF-2eHqwguIFqelL_jjgxixyYSpz5t.1 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-LUKEWARM.2~-zF-2eHqwguIFqelL_jjgxixyYSpz5t.2 2024-09-19T14:01:29.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.472+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-LUKEWARM.2~-zF-2eHqwguIFqelL_jjgxixyYSpz5t.3 2024-09-19T14:01:29.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.476+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.479+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:01:29.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.480+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.480+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.481+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.481+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15900940591159676587', time=2024-09-19T15:52:58.142208+0000, chain.objs.size()=3 2024-09-19T14:01:29.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.481+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.1 2024-09-19T14:01:29.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.481+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.2 2024-09-19T14:01:29.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.481+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.3 2024-09-19T14:01:29.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.482+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.485+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:01:29.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.486+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.486+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.487+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.487+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_GsFP6vp8amFsJktGHr9ZeP_iLaDHntD', time=2024-09-19T15:52:58.051368+0000, chain.objs.size()=1 2024-09-19T14:01:29.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.487+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.5LxH_b84LqsynuSsA9WSrgN4ovdTxaC_0 2024-09-19T14:01:29.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.489+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.491+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:01:29.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.492+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.493+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.493+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.493+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14116827651221924344', time=2024-09-19T15:52:58.078849+0000, chain.objs.size()=1 2024-09-19T14:01:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.493+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.1S-eL4MofIXHatP2TcGRbnumrJ7GYP7_0 2024-09-19T14:01:29.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.494+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.496+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:01:29.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.497+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.498+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.498+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.499+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:01:29.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.501+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.501+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.502+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.503+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:01:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.504+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.504+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.505+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.505+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:01:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.507+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.507+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.507+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.508+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:01:29.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.510+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.510+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.510+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.510+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_5koifZir7H_Vl6y3tpii__rSm2ZAYsP', time=2024-09-19T15:52:58.114702+0000, chain.objs.size()=2 2024-09-19T14:01:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.510+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.2REKJabVDUfPnESbqTHC4PmMVlhYvk8_0 2024-09-19T14:01:29.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.510+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.2REKJabVDUfPnESbqTHC4PmMVlhYvk8_1 2024-09-19T14:01:29.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.513+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.515+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:01:29.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.516+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.517+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.517+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.518+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:01:29.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.519+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.519+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.520+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.521+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:01:29.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.522+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_v5VcC_qDolr43-DAT4wbNNfOa8oYZTO', time=2024-09-19T15:52:58.103182+0000, chain.objs.size()=2 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.vg5vPbZ9pXqPFFMcTFYG2zZ1VsvLQoL_1 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.vg5vPbZ9pXqPFFMcTFYG2zZ1VsvLQoL_2 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_Ingtq7PbPqxNttB1pBdbn8KLXogaHkG', time=2024-09-19T15:52:58.123377+0000, chain.objs.size()=2 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.S4gkouREHCF6qd8QaQdxEcMZB_8Orz2_1 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.S4gkouREHCF6qd8QaQdxEcMZB_8Orz2_2 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11011647298678443696', time=2024-09-19T15:52:58.130878+0000, chain.objs.size()=3 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.1 2024-09-19T14:01:29.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.2 2024-09-19T14:01:29.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.523+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.3 2024-09-19T14:01:29.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.526+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.528+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:01:29.532 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.530+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14276244405284523020', time=2024-09-19T15:52:57.974218+0000, chain.objs.size()=4 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.1 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.2 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.3 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13__multipart_foo.2~7G4osvqqPWr3LxxPKeqIFntieVHx_t-.4 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_3xb7ywYbSq4cXSy6zARJ4fK8pFt-HIS', time=2024-09-19T15:52:58.055128+0000, chain.objs.size()=1 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.rJ2KjFuwoOVNUhiJj-x5eH-bampMQZi_0 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3555879556170395542', time=2024-09-19T15:52:58.107079+0000, chain.objs.size()=3 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.1 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.2 2024-09-19T14:01:29.534 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.531+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-FROZEN.2~hZaqKjVdhSJNMagQNdCaq1FhuLxFToN.3 2024-09-19T14:01:29.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.534+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.538 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.536+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:01:29.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.537+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.539 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.538+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.538+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.541 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.539+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:01:29.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.540+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.540+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.541+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.542+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:01:29.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.543+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.543+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17983851643832591495', time=2024-09-19T15:52:57.955512+0000, chain.objs.size()=4 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.1 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.2 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.3 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12__multipart_foo.2~8Fic2Gw3y6uHXeYqSltncYaDhtljklo.4 2024-09-19T14:01:29.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7468057247646171623', time=2024-09-19T15:52:58.194733+0000, chain.objs.size()=2 2024-09-19T14:01:29.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.PBHe--_ZWbL2kC0gH7BqFmoEsgd1KBE_0 2024-09-19T14:01:29.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.544+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14__shadow_.PBHe--_ZWbL2kC0gH7BqFmoEsgd1KBE_1 2024-09-19T14:01:29.550 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.548+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.550+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:01:29.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.551+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.552+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17823109519062831232', time=2024-09-19T15:52:58.065717+0000, chain.objs.size()=1 2024-09-19T14:01:29.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.5cm_GYJWeKbSQsjNOV087hXIulTn67O_0 2024-09-19T14:01:29.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16637810149587228229', time=2024-09-19T15:52:58.126906+0000, chain.objs.size()=3 2024-09-19T14:01:29.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.1 2024-09-19T14:01:29.555 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.2 2024-09-19T14:01:29.556 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.553+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-LUKEWARM.2~3rfZ3aSw2Xjh_iDe296HJ8jy8T6Z-A4.3 2024-09-19T14:01:29.557 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.555+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.559 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.557+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:01:29.560 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.558+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_Qe_uFToxGVaV611J5b_GfdJU52EgHiy', time=2024-09-19T15:52:58.098737+0000, chain.objs.size()=1 2024-09-19T14:01:29.561 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.qC5YQbewVh8sLY8oeENLBdNa4WWFy5X_0 2024-09-19T14:01:29.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7097248307896449016', time=2024-09-19T15:52:58.118829+0000, chain.objs.size()=3 2024-09-19T14:01:29.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.1 2024-09-19T14:01:29.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.2 2024-09-19T14:01:29.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.559+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__multipart_foo-STANDARD.2~L83I7w6EZFn__A8cJoTpq5WdvgMwdu7.3 2024-09-19T14:01:29.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.560+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.564 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.562+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:01:29.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.564+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.566 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.564+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_QMBN4X6KshiLPQwn37EBRSyyANCvY1h', time=2024-09-19T15:52:58.075021+0000, chain.objs.size()=1 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.YZFkf7X17a62kx6FFy6iVhjIpzEKdkT_0 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10126325535086859496', time=2024-09-19T15:52:58.160356+0000, chain.objs.size()=3 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-FROZEN.2~zpL2xvXz8yR84Q4EVgXkwGwV18tTrq6.1 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-FROZEN.2~zpL2xvXz8yR84Q4EVgXkwGwV18tTrq6.2 2024-09-19T14:01:29.567 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.565+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15__multipart_foo-FROZEN.2~zpL2xvXz8yR84Q4EVgXkwGwV18tTrq6.3 2024-09-19T14:01:29.569 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.567+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.571 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.569+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:01:29.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.570+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.572 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.570+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.571+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.573 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.571+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:01:29.574 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.573+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.573+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.575 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.573+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.576 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.574+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:01:29.577 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.576+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.576+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.576+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.576+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.271034142389335688', time=2024-09-19T15:52:58.047138+0000, chain.objs.size()=1 2024-09-19T14:01:29.578 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.576+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.1S-eL4MofIXHatP2TcGRbnumrJ7GYP7_0 2024-09-19T14:01:29.580 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.578+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.582 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.581+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:01:29.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.582+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.584 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.582+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:01:29.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18114709180214060987', time=2024-09-19T15:52:57.997772+0000, chain.objs.size()=4 2024-09-19T14:01:29.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.1 2024-09-19T14:01:29.585 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.2 2024-09-19T14:01:29.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.3 2024-09-19T14:01:29.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11__multipart_foo.2~Yh9LHUTwbNkpd0oO_G_8avWr2ICs49W.4 2024-09-19T14:01:29.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_iyr_tFwWR-KjkzmoM0e7AtxEN8u78bp', time=2024-09-19T15:52:58.062269+0000, chain.objs.size()=1 2024-09-19T14:01:29.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.XwCtx0ss6vxMklymHFdZe7Lq7kAVCoo_1 2024-09-19T14:01:29.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17744116815885040236', time=2024-09-19T15:52:58.071594+0000, chain.objs.size()=1 2024-09-19T14:01:29.586 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.583+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.5cm_GYJWeKbSQsjNOV087hXIulTn67O_0 2024-09-19T14:01:29.587 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.585+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.587+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:01:29.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.588+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.589+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.589+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.589+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_mNXzqmdDA1_4I1jf7Qsa_0qJ69hKkq0', time=2024-09-19T15:52:58.039130+0000, chain.objs.size()=1 2024-09-19T14:01:29.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.589+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16__shadow_.Nvxx-1WqvK7ScqceayxVFCLghfZynt6_0 2024-09-19T14:01:29.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.590+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.593+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:01:29.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.594+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.594+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.595+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.595+0000 7fe82ed2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:01:29.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.597+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.597+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.598+0000 7fe82ed2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:01:29.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.598+0000 7fe82ed2e800 20 garbage collection: RGWGC::process iterating over entry tag='_hrueVRvGngP2rAnE1biUeNKbZNns6XW', time=2024-09-19T15:52:58.111175+0000, chain.objs.size()=2 2024-09-19T14:01:29.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.598+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.zKDfxi23r32Eh0SlK-vWCvM8rSE9C5b_0 2024-09-19T14:01:29.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.598+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17__shadow_.zKDfxi23r32Eh0SlK-vWCvM8rSE9C5b_1 2024-09-19T14:01:29.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.600+0000 7fe82ed2e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:01:29.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.603+0000 7fe6e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:29.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.605+0000 7fe82ed2e800 20 remove_watcher() i=0 2024-09-19T14:01:29.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.605+0000 7fe82ed2e800 2 removed watcher, disabling cache 2024-09-19T14:01:29.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.606+0000 7fe82ed2e800 20 remove_watcher() i=1 2024-09-19T14:01:29.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.607+0000 7fe82ed2e800 20 remove_watcher() i=2 2024-09-19T14:01:29.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.608+0000 7fe82ed2e800 20 remove_watcher() i=3 2024-09-19T14:01:29.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.609+0000 7fe82ed2e800 20 remove_watcher() i=4 2024-09-19T14:01:29.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.610+0000 7fe82ed2e800 20 remove_watcher() i=5 2024-09-19T14:01:29.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.611+0000 7fe82ed2e800 20 remove_watcher() i=6 2024-09-19T14:01:29.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.612+0000 7fe82ed2e800 20 remove_watcher() i=7 2024-09-19T14:01:29.624 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:01:29.676 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:29.676 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.712+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 realm 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.713+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.714+0000 7f66c6f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:29.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.714+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.714+0000 7f66c6f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:29.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.714+0000 7f66c6f2a800 20 searching for the correct realm 2024-09-19T14:01:29.719 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.717+0000 7f66ba44e640 0 -- 172.21.15.94:0/2627755090 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f66b407c070 msgr2=0x7f66b408c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:29.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.721+0000 7f66c2c4f640 0 -- 172.21.15.94:0/2627755090 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f66ac020950 msgr2=0x7f66ac04b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:01:29.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.927+0000 7f66c6f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:29.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 zone default found 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 4 Realm: () 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 zonegroup default 2024-09-19T14:01:29.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.928+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.929+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.929+0000 7f66c6f2a800 20 rados->read ofs=0 len=0 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.929+0000 7f66c6f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.929+0000 7f66c6f2a800 20 started sync module instance, tier type = 2024-09-19T14:01:29.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.929+0000 7f66c6f2a800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:01:29.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=0 2024-09-19T14:01:29.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=1 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=2 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=3 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=4 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=5 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.937+0000 7f66c6f2a800 20 add_watcher() i=6 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.938+0000 7f66c6f2a800 20 add_watcher() i=7 2024-09-19T14:01:29.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.938+0000 7f66c6f2a800 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:29.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.940+0000 7f65797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:29.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.940+0000 7f66c6f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:29.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.940+0000 7f66c6f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:29.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.973+0000 7f64f3fff640 20 reqs_thread_entry: start 2024-09-19T14:01:29.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.973+0000 7f66c6f2a800 20 init_complete bucket index max shards: 11 2024-09-19T14:01:29.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.973+0000 7f66c6f2a800 20 Filter name: none 2024-09-19T14:01:29.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.973+0000 7f64f1ffb640 20 reqs_thread_entry: start 2024-09-19T14:01:29.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.973+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:01:29.976 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.975+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.975+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.975+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.976+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:01:29.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.978+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.978+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.979+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.980+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:01:29.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.981+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.981+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.982+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.983+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:01:29.986 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.984+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.985+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.985+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.986+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:01:29.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.987+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.988+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.988+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.989+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:01:29.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.990+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.991+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.991+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.992+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:01:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.993+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.993+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.994+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.994+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:01:29.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.996+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:29.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.997+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:29.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.997+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:29.998+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:01:30.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.000+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.000+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.000+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.001+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:01:30.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.003+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.003+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.003+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.005+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:01:30.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.006+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.006+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.006+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.007+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:01:30.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.008+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.009+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.010+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.011+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:01:30.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.012+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.013+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.013+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.014+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:01:30.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.015+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.016+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.016+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.017+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:01:30.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.018+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.019+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.019+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.020+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:01:30.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.021+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.022+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.022+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.023+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:01:30.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.025+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.025+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.025+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.026+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:01:30.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.027+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.028+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.030 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.028+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.029+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:01:30.032 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.030+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.031+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.031+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.032+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:01:30.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.033+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.034+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.034+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.035+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:01:30.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.036+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.037+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.037+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.038+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:01:30.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.039+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.040+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.040+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.041+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:01:30.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.042+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.042+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.043+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.044+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:01:30.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.045+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.045+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.046+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.046+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:01:30.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.048+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.049+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.049+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.050+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:01:30.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.051+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.052+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.052+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.053+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:01:30.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.054+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.055+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.055+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.056+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:01:30.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.057+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.058+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.058+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.059+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:01:30.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.060+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.061+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.061+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.062+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:01:30.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.064+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.064+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.065+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.066+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:01:30.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.067+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.068+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.068+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.069+0000 7f66c6f2a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:01:30.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.070+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.070+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:01:30.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.070+0000 7f66c6f2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:01:30.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.072+0000 7f65797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:30.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.074+0000 7f66c6f2a800 20 remove_watcher() i=0 2024-09-19T14:01:30.076 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.074+0000 7f66c6f2a800 2 removed watcher, disabling cache 2024-09-19T14:01:30.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.075+0000 7f66c6f2a800 20 remove_watcher() i=1 2024-09-19T14:01:30.078 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.076+0000 7f66c6f2a800 20 remove_watcher() i=2 2024-09-19T14:01:30.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.077+0000 7f66c6f2a800 20 remove_watcher() i=3 2024-09-19T14:01:30.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.078+0000 7f66c6f2a800 20 remove_watcher() i=4 2024-09-19T14:01:30.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.079+0000 7f66c6f2a800 20 remove_watcher() i=5 2024-09-19T14:01:30.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.080+0000 7f66c6f2a800 20 remove_watcher() i=6 2024-09-19T14:01:30.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:01:30.081+0000 7f66c6f2a800 20 remove_watcher() i=7 2024-09-19T14:01:30.093 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-19T14:01:30.576 INFO:teuthology.orchestra.run.smithi094.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-19T14:01:34.076 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean UP-TO-DATE 2024-09-19T14:01:51.376 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-19T14:01:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-19T14:01:51.377 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-19T14:01:52.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:52.075 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-19T14:01:52.075 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-19T14:01:52.075 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-19T14:01:52.076 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:52.076 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-19T14:01:52.076 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-19T14:01:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:57.675 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-19T14:01:57.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:57.675 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-19T14:01:58.175 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:58.175 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-19T14:01:58.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:58.375 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-19T14:01:58.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:58.475 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-19T14:01:58.674 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:58.675 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-19T14:01:59.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:59.075 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-19T14:01:59.275 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:59.275 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-19T14:01:59.275 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:59.275 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-19T14:01:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:59.375 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-19T14:01:59.375 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:59.375 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-19T14:01:59.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:01:59.575 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-19T14:02:00.074 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:00.075 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-19T14:02:00.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:00.475 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-19T14:02:00.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:00.575 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-19T14:02:00.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19 14:02:00,550 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-19T14:02:05.375 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:05.375 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-19T14:02:05.774 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:05.775 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-19T14:02:05.775 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:05.775 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-19T14:02:05.975 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:05.975 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-19T14:02:05.975 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:05.975 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-19T14:02:06.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:06.275 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-19T14:02:06.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:06.675 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-19T14:02:06.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:06.875 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-19T14:02:06.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:06.875 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-19T14:02:06.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:06.975 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-19T14:02:09.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:09.275 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-19T14:02:09.474 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:09.475 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-19T14:02:09.874 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:09.875 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-19T14:02:10.175 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:10.175 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-19T14:02:10.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:10.575 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-19T14:02:10.774 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:10.775 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-19T14:02:16.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:16.875 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-19T14:02:17.074 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:17.075 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-19T14:02:17.974 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:17.975 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-19T14:02:18.175 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:18.175 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-19T14:02:19.175 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:19.175 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-19T14:02:19.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:19.475 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-19T14:02:19.775 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:19.775 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-19T14:02:19.976 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:19.976 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-19T14:02:19.977 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:19.977 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-19T14:02:20.174 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.175 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-19T14:02:20.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.275 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-19T14:02:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.475 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-19T14:02:20.475 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.476 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-19T14:02:20.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.675 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-19T14:02:20.675 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.675 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-19T14:02:20.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.875 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-19T14:02:20.875 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:20.875 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-19T14:02:21.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:21.075 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-19T14:02:21.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:21.075 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-19T14:02:21.274 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:21.275 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-19T14:02:21.374 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:21.374 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-19T14:02:21.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:21.575 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-19T14:02:22.074 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-19T14:02:22.364 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-19T14:02:22.365 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-19T14:02:22.365 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:22.365 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 52s 2024-09-19T14:02:22.365 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-19T14:02:22.681 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:22.733 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:22.734 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:22.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.768+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 realm 2024-09-19T14:02:22.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:22.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.773 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.770+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.771+0000 7f2f33c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:22.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.771+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.771+0000 7f2f33c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:22.774 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.771+0000 7f2f33c20800 20 searching for the correct realm 2024-09-19T14:02:22.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.774+0000 7f2f31f12640 0 -- 172.21.15.94:0/965984112 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f2f2801a040 msgr2=0x7f2f2806ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:22.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.778+0000 7f2f31711640 0 -- 172.21.15.94:0/965984112 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f2f2806e3e0 msgr2=0x7f2f280908f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:22.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:22.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:22.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:22.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:22.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:22.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.984+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:22.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 zone default found 2024-09-19T14:02:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 4 Realm: () 2024-09-19T14:02:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:22.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 zonegroup default 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.985+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 rados->read ofs=0 len=0 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 started sync module instance, tier type = 2024-09-19T14:02:22.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.986+0000 7f2f33c20800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=0 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=1 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=2 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=3 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=4 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=5 2024-09-19T14:02:22.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.995+0000 7f2f33c20800 20 add_watcher() i=6 2024-09-19T14:02:22.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.996+0000 7f2f33c20800 20 add_watcher() i=7 2024-09-19T14:02:22.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.996+0000 7f2f33c20800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:22.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.997+0000 7f2de7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:23.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.998+0000 7f2f33c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:23.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:22.998+0000 7f2f33c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.030+0000 7f2de6fe5640 20 reqs_thread_entry: start 2024-09-19T14:02:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.030+0000 7f2f33c20800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.030+0000 7f2f33c20800 20 Filter name: none 2024-09-19T14:02:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.031+0000 7f2de4fe1640 20 reqs_thread_entry: start 2024-09-19T14:02:23.033 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.031+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:23.034 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.032+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.033+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.033+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.033+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5285375404848731900', time=2024-09-19T16:02:09.946126+0000, chain.objs.size()=5 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.033+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file2.mpg.2~Z9yBjwfoJhdNvOCU0gWsb5VyZUyYK98.1 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.033+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file2.mpg.2~Z9yBjwfoJhdNvOCU0gWsb5VyZUyYK98.2 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file2.mpg.2~Z9yBjwfoJhdNvOCU0gWsb5VyZUyYK98.3 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file2.mpg.2~Z9yBjwfoJhdNvOCU0gWsb5VyZUyYK98.4 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file2.mpg.2~Z9yBjwfoJhdNvOCU0gWsb5VyZUyYK98.5 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='2~djALKPeJjchJxCFTjU0i-DHweSVoqlz', time=2024-09-19T16:02:19.877078+0000, chain.objs.size()=92 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.1 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.2 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.3 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.4 2024-09-19T14:02:23.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.5 2024-09-19T14:02:23.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.6 2024-09-19T14:02:23.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.034+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.7 2024-09-19T14:02:23.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.037+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.8 2024-09-19T14:02:23.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.037+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.9 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.10 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.11 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.12 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.13 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.14 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.15 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.16 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.17 2024-09-19T14:02:23.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.038+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.18 2024-09-19T14:02:23.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.039+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.19 2024-09-19T14:02:23.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.039+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.20 2024-09-19T14:02:23.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.039+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.21 2024-09-19T14:02:23.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.039+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.22 2024-09-19T14:02:23.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.039+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.23 2024-09-19T14:02:23.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.040+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.24 2024-09-19T14:02:23.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.040+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.25 2024-09-19T14:02:23.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.040+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.26 2024-09-19T14:02:23.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.041+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.27 2024-09-19T14:02:23.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.041+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.28 2024-09-19T14:02:23.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.041+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.29 2024-09-19T14:02:23.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.041+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.30 2024-09-19T14:02:23.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.042+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.31 2024-09-19T14:02:23.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.042+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.32 2024-09-19T14:02:23.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.042+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.33 2024-09-19T14:02:23.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.042+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.34 2024-09-19T14:02:23.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.042+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.35 2024-09-19T14:02:23.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.36 2024-09-19T14:02:23.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.37 2024-09-19T14:02:23.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.38 2024-09-19T14:02:23.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.39 2024-09-19T14:02:23.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.40 2024-09-19T14:02:23.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.41 2024-09-19T14:02:23.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.043+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.42 2024-09-19T14:02:23.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.43 2024-09-19T14:02:23.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.44 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.45 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.46 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.47 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.48 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.49 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.044+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.50 2024-09-19T14:02:23.047 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.045+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.51 2024-09-19T14:02:23.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.046+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.52 2024-09-19T14:02:23.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.046+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.53 2024-09-19T14:02:23.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.046+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.54 2024-09-19T14:02:23.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.55 2024-09-19T14:02:23.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.56 2024-09-19T14:02:23.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.57 2024-09-19T14:02:23.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.58 2024-09-19T14:02:23.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.59 2024-09-19T14:02:23.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.60 2024-09-19T14:02:23.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.61 2024-09-19T14:02:23.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.62 2024-09-19T14:02:23.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.047+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.63 2024-09-19T14:02:23.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.048+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.64 2024-09-19T14:02:23.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.048+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.65 2024-09-19T14:02:23.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.049+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.66 2024-09-19T14:02:23.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.051+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.67 2024-09-19T14:02:23.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.051+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.68 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.053+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.69 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.053+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.70 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.053+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.71 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.053+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.72 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.054+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.73 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.054+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.74 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.054+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.75 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.054+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.76 2024-09-19T14:02:23.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.054+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.77 2024-09-19T14:02:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.056+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.78 2024-09-19T14:02:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.056+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.79 2024-09-19T14:02:23.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.056+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.80 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.81 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.82 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.83 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.84 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.85 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.86 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.87 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.88 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.89 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.90 2024-09-19T14:02:23.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.059+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.91 2024-09-19T14:02:23.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.061+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.59__multipart_key1.2~djALKPeJjchJxCFTjU0i-DHweSVoqlz.92 2024-09-19T14:02:23.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.063+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.065+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:23.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.066+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3019873368815850384', time=2024-09-19T16:02:12.484523+0000, chain.objs.size()=11 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.1 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.2 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.3 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.4 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.5 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.6 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.7 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.8 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.9 2024-09-19T14:02:23.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.10 2024-09-19T14:02:23.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.067+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~8d2jTbMi0Ox56O90dbfw1bhE_dJ3eSw.11 2024-09-19T14:02:23.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.072+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.075+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:23.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.077+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.077+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.077+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8608860530140417875', time=2024-09-19T16:02:02.342657+0000, chain.objs.size()=5 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~P_Ze2Dd2oxkfaYbh4RdX4EholUBdeM0.1 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~P_Ze2Dd2oxkfaYbh4RdX4EholUBdeM0.2 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~P_Ze2Dd2oxkfaYbh4RdX4EholUBdeM0.3 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~P_Ze2Dd2oxkfaYbh4RdX4EholUBdeM0.4 2024-09-19T14:02:23.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~P_Ze2Dd2oxkfaYbh4RdX4EholUBdeM0.5 2024-09-19T14:02:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16978811375022409718', time=2024-09-19T16:02:05.449735+0000, chain.objs.size()=4 2024-09-19T14:02:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.47__shadow_.5Xe5nRXYB7E9mQVwZrv9QYkD2SXjXFz_1 2024-09-19T14:02:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.47__shadow_.5Xe5nRXYB7E9mQVwZrv9QYkD2SXjXFz_2 2024-09-19T14:02:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.47__shadow_.5Xe5nRXYB7E9mQVwZrv9QYkD2SXjXFz_3 2024-09-19T14:02:23.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.078+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.47__shadow_.5Xe5nRXYB7E9mQVwZrv9QYkD2SXjXFz_4 2024-09-19T14:02:23.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.082+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.084+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:23.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.085+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9378698736717005703', time=2024-09-19T16:02:16.916684+0000, chain.objs.size()=11 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.1 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.1_1 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.2 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.2_1 2024-09-19T14:02:23.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.3 2024-09-19T14:02:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.3_1 2024-09-19T14:02:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.4 2024-09-19T14:02:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.4_1 2024-09-19T14:02:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.5 2024-09-19T14:02:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.5_1 2024-09-19T14:02:23.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.086+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~yUSfxykw6sCN73M4vHyoWjkBl8PzJ1v.6 2024-09-19T14:02:23.092 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.090+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.092+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:23.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.094+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.094+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4132331019729055538', time=2024-09-19T16:02:05.571377+0000, chain.objs.size()=5 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~lF0VND0guaOMZL0yn-789e0blg39aAX.1 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__shadow_key1.2~lF0VND0guaOMZL0yn-789e0blg39aAX.1_1 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~lF0VND0guaOMZL0yn-789e0blg39aAX.2 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__shadow_key1.2~lF0VND0guaOMZL0yn-789e0blg39aAX.2_1 2024-09-19T14:02:23.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~lF0VND0guaOMZL0yn-789e0blg39aAX.3 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='2~bLYeQ2HlHbARrompni_ecQtUxoxG1OR', time=2024-09-19T16:02:10.681201+0000, chain.objs.size()=3 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.55__multipart_key1.2~bLYeQ2HlHbARrompni_ecQtUxoxG1OR.7 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.55__multipart_key1.2~bLYeQ2HlHbARrompni_ecQtUxoxG1OR.10 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.55__multipart_key1.2~bLYeQ2HlHbARrompni_ecQtUxoxG1OR.13 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11026933037251286239', time=2024-09-19T16:02:18.045884+0000, chain.objs.size()=5 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.57__multipart_key1.2~uNXb-XVZp6XZZHzN3eFOdCQckbhdjgQ.1 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.095+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.57__multipart_key1.2~uNXb-XVZp6XZZHzN3eFOdCQckbhdjgQ.2 2024-09-19T14:02:23.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.096+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.57__multipart_key1.2~uNXb-XVZp6XZZHzN3eFOdCQckbhdjgQ.3 2024-09-19T14:02:23.099 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.096+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.57__multipart_key1.2~uNXb-XVZp6XZZHzN3eFOdCQckbhdjgQ.4 2024-09-19T14:02:23.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.098+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.57__multipart_key1.2~uNXb-XVZp6XZZHzN3eFOdCQckbhdjgQ.5 2024-09-19T14:02:23.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.100+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.102+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:23.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.103+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17436208434992593281', time=2024-09-19T16:02:13.288707+0000, chain.objs.size()=11 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.1 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.2 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.3 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.4 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.5 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.6 2024-09-19T14:02:23.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.7 2024-09-19T14:02:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.8 2024-09-19T14:02:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.9 2024-09-19T14:02:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.10 2024-09-19T14:02:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~KQz7U7eX5WiJCtdg0Vz3FWAnMjmzNBq.11 2024-09-19T14:02:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14010679036009139186', time=2024-09-19T16:02:14.011673+0000, chain.objs.size()=10 2024-09-19T14:02:23.108 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.104+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.1 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.2 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.3 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.4 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.5 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.6 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.7 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.8 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.9 2024-09-19T14:02:23.111 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.108+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~QOc0gVh4gv53iYKjzwWFY4xFbMhbaC3.10 2024-09-19T14:02:23.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.113+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.115+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:23.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.116+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9066646680685194143', time=2024-09-19T16:02:09.935914+0000, chain.objs.size()=5 2024-09-19T14:02:23.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file.mpg.2~FvpN--YEkhGcIUmu3jP1WfV1U4GTc5l.1 2024-09-19T14:02:23.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file.mpg.2~FvpN--YEkhGcIUmu3jP1WfV1U4GTc5l.2 2024-09-19T14:02:23.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file.mpg.2~FvpN--YEkhGcIUmu3jP1WfV1U4GTc5l.3 2024-09-19T14:02:23.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file.mpg.2~FvpN--YEkhGcIUmu3jP1WfV1U4GTc5l.4 2024-09-19T14:02:23.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.117+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.54__multipart_file.mpg.2~FvpN--YEkhGcIUmu3jP1WfV1U4GTc5l.5 2024-09-19T14:02:23.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.119+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.121+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:23.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.123+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.123+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.123+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.123+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.443582850985333787', time=2024-09-19T16:02:09.298377+0000, chain.objs.size()=5 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.123+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.53__multipart_key1.2~zbH_-4B_5ssUSbkvbPxqL73ohu4sV2Y.1 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.124+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.53__multipart_key1.2~zbH_-4B_5ssUSbkvbPxqL73ohu4sV2Y.2 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.124+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.53__multipart_key1.2~zbH_-4B_5ssUSbkvbPxqL73ohu4sV2Y.3 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.124+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.53__multipart_key1.2~zbH_-4B_5ssUSbkvbPxqL73ohu4sV2Y.4 2024-09-19T14:02:23.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.124+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.53__multipart_key1.2~zbH_-4B_5ssUSbkvbPxqL73ohu4sV2Y.5 2024-09-19T14:02:23.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.127+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.130+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:23.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.131+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.131+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2313535614610648718', time=2024-09-19T16:02:05.308702+0000, chain.objs.size()=5 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~EgSpVEYR5knfs0aJxLxcShr5tsG-IQ3.1 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__shadow_key1.2~EgSpVEYR5knfs0aJxLxcShr5tsG-IQ3.1_1 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~EgSpVEYR5knfs0aJxLxcShr5tsG-IQ3.2 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__shadow_key1.2~EgSpVEYR5knfs0aJxLxcShr5tsG-IQ3.2_1 2024-09-19T14:02:23.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.132+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~EgSpVEYR5knfs0aJxLxcShr5tsG-IQ3.3 2024-09-19T14:02:23.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.135+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.137+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:23.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.138+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.138+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6592772748699999082', time=2024-09-19T16:02:22.115373+0000, chain.objs.size()=11 2024-09-19T14:02:23.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.1 2024-09-19T14:02:23.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.2 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.3 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.4 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.5 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.6 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.7 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.8 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.9 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.10 2024-09-19T14:02:23.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.139+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.67__multipart_key1.2~YBiFy55FVSwpmo-VgFRwh_cY1P9af26.11 2024-09-19T14:02:23.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.143+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.145+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:23.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='2~BMQB1vqHOeysQKBK0_P0vL9vEk0QE7o', time=2024-09-19T16:01:58.097363+0000, chain.objs.size()=5 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.41__multipart_key1.2~BMQB1vqHOeysQKBK0_P0vL9vEk0QE7o.1 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.41__multipart_key1.2~BMQB1vqHOeysQKBK0_P0vL9vEk0QE7o.2 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.41__multipart_key1.2~BMQB1vqHOeysQKBK0_P0vL9vEk0QE7o.3 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.41__multipart_key1.2~BMQB1vqHOeysQKBK0_P0vL9vEk0QE7o.4 2024-09-19T14:02:23.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.147+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.41__multipart_key1.2~BMQB1vqHOeysQKBK0_P0vL9vEk0QE7o.5 2024-09-19T14:02:23.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.151+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.153+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:23.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.154+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.154+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.154+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.155+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:23.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.156+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.157+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.157+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.158+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:23.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.159+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.160+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.160+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.161+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:23.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.162+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18318893115272735387', time=2024-09-19T16:02:14.746472+0000, chain.objs.size()=11 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.1 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.1_1 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.2 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.2_1 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.3 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.3_1 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.4 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.4_1 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.5 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.5_1 2024-09-19T14:02:23.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.163+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~C6TKSzYQNnCPwTawe7AKNEXfV9YxkeM.6 2024-09-19T14:02:23.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.168+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.170+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.171+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.171+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.172+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.173+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.174+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.174+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10517284585405848756', time=2024-09-19T16:02:04.348413+0000, chain.objs.size()=5 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~w17UVvtW0MlwRXoR9Zy7cTY63Jl-5GE.1 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__shadow_key1.2~w17UVvtW0MlwRXoR9Zy7cTY63Jl-5GE.1_1 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~w17UVvtW0MlwRXoR9Zy7cTY63Jl-5GE.2 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__shadow_key1.2~w17UVvtW0MlwRXoR9Zy7cTY63Jl-5GE.2_1 2024-09-19T14:02:23.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.175+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~w17UVvtW0MlwRXoR9Zy7cTY63Jl-5GE.3 2024-09-19T14:02:23.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.177+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.179+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:23.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.180+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7126937849556062450', time=2024-09-19T16:02:06.674468+0000, chain.objs.size()=5 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.52__multipart_key1.2~QoIe330MQzPZ6rDDl3kkctLpO8Yk82L.1 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.52__multipart_key1.2~QoIe330MQzPZ6rDDl3kkctLpO8Yk82L.2 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.52__multipart_key1.2~QoIe330MQzPZ6rDDl3kkctLpO8Yk82L.3 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.52__multipart_key1.2~QoIe330MQzPZ6rDDl3kkctLpO8Yk82L.4 2024-09-19T14:02:23.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.181+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.52__multipart_key1.2~QoIe330MQzPZ6rDDl3kkctLpO8Yk82L.5 2024-09-19T14:02:23.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.183+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.185+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:23.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3438895729568810291', time=2024-09-19T16:02:16.777166+0000, chain.objs.size()=11 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.1 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.1_1 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.2 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.2_1 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.3 2024-09-19T14:02:23.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.3_1 2024-09-19T14:02:23.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.4 2024-09-19T14:02:23.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.4_1 2024-09-19T14:02:23.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.5 2024-09-19T14:02:23.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__shadow_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.5_1 2024-09-19T14:02:23.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.187+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.56__multipart_key1.2~83DSiB-dQmHct6CsPSn2VQqOE7FBzT7.6 2024-09-19T14:02:23.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.192+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.194+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:23.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.195+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.195+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12877545162685654202', time=2024-09-19T16:01:59.090713+0000, chain.objs.size()=5 2024-09-19T14:02:23.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.43__multipart_key1.2~wHfBmjwksk-WKUfzCnGy0-Qkkjjvxku.1 2024-09-19T14:02:23.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.43__multipart_key1.2~wHfBmjwksk-WKUfzCnGy0-Qkkjjvxku.2 2024-09-19T14:02:23.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.43__multipart_key1.2~wHfBmjwksk-WKUfzCnGy0-Qkkjjvxku.3 2024-09-19T14:02:23.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.43__multipart_key1.2~wHfBmjwksk-WKUfzCnGy0-Qkkjjvxku.4 2024-09-19T14:02:23.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.196+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.43__multipart_key1.2~wHfBmjwksk-WKUfzCnGy0-Qkkjjvxku.5 2024-09-19T14:02:23.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.198+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.200+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:23.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:02:23.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1611743803182150357', time=2024-09-19T16:02:00.153659+0000, chain.objs.size()=5 2024-09-19T14:02:23.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.1 2024-09-19T14:02:23.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.2 2024-09-19T14:02:23.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.3 2024-09-19T14:02:23.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.4 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.5 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17858032429131705954', time=2024-09-19T16:02:03.893630+0000, chain.objs.size()=5 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~TO5ODfa1i9hU8zN-Xzd8iLjsyNxCuWd.1 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~TO5ODfa1i9hU8zN-Xzd8iLjsyNxCuWd.2 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~TO5ODfa1i9hU8zN-Xzd8iLjsyNxCuWd.3 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~TO5ODfa1i9hU8zN-Xzd8iLjsyNxCuWd.4 2024-09-19T14:02:23.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.202+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~TO5ODfa1i9hU8zN-Xzd8iLjsyNxCuWd.5 2024-09-19T14:02:23.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.205+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.207+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:23.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.209+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.209+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.209+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.210+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:23.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.212+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.212+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.212+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.214+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:23.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.215+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.215+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.216+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.217+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:23.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.218+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17295019078508544132', time=2024-09-19T16:02:00.272918+0000, chain.objs.size()=5 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.1 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.2 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.3 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.4 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.45__multipart_key1.2~np55bdYB40m48BZeY6lNDCjr1W4DIKr.5 2024-09-19T14:02:23.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11953806398412923152', time=2024-09-19T16:02:02.920245+0000, chain.objs.size()=5 2024-09-19T14:02:23.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~cTe_sRh0K3aewc-psBqCtptQCl7ovHt.1 2024-09-19T14:02:23.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~cTe_sRh0K3aewc-psBqCtptQCl7ovHt.2 2024-09-19T14:02:23.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~cTe_sRh0K3aewc-psBqCtptQCl7ovHt.3 2024-09-19T14:02:23.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~cTe_sRh0K3aewc-psBqCtptQCl7ovHt.4 2024-09-19T14:02:23.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.219+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.48__multipart_key1.2~cTe_sRh0K3aewc-psBqCtptQCl7ovHt.5 2024-09-19T14:02:23.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.225+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.227+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:23.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.228+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.229+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.229+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.230+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:23.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.231+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.231+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.232+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.233+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:23.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.234+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.235+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.237 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.235+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.238 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.236+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:23.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.237+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.239 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.238+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.240 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.238+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.241 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.239+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:23.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.240+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.240+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.241+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.243 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.242+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:23.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.243+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.243+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11451052816749829816', time=2024-09-19T16:02:19.256546+0000, chain.objs.size()=5 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.58__multipart_key1.2~ZSzwL6qD_tDF4YYf9XSt-qHzfAgp4n3.1 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.58__multipart_key1.2~ZSzwL6qD_tDF4YYf9XSt-qHzfAgp4n3.2 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.58__multipart_key1.2~ZSzwL6qD_tDF4YYf9XSt-qHzfAgp4n3.3 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.58__multipart_key1.2~ZSzwL6qD_tDF4YYf9XSt-qHzfAgp4n3.4 2024-09-19T14:02:23.246 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.244+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.58__multipart_key1.2~ZSzwL6qD_tDF4YYf9XSt-qHzfAgp4n3.5 2024-09-19T14:02:23.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.246+0000 7f2f33c20800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:02:23.250 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.248+0000 7f2f33c20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:23.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.249+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.250+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.250+0000 7f2f33c20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.252+0000 7f2de7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:23.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.254+0000 7f2f33c20800 20 remove_watcher() i=0 2024-09-19T14:02:23.255 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.254+0000 7f2f33c20800 2 removed watcher, disabling cache 2024-09-19T14:02:23.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.254+0000 7f2f33c20800 20 remove_watcher() i=1 2024-09-19T14:02:23.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.255+0000 7f2f33c20800 20 remove_watcher() i=2 2024-09-19T14:02:23.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.256+0000 7f2f33c20800 20 remove_watcher() i=3 2024-09-19T14:02:23.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.257+0000 7f2f33c20800 20 remove_watcher() i=4 2024-09-19T14:02:23.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.258+0000 7f2f33c20800 20 remove_watcher() i=5 2024-09-19T14:02:23.261 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.259+0000 7f2f33c20800 20 remove_watcher() i=6 2024-09-19T14:02:23.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.260+0000 7f2f33c20800 20 remove_watcher() i=7 2024-09-19T14:02:23.273 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:23.324 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:23.325 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:23.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.358+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 realm 2024-09-19T14:02:23.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:23.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.360+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.361+0000 7f731f922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:23.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.361+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.361+0000 7f731f922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:23.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.361+0000 7f731f922800 20 searching for the correct realm 2024-09-19T14:02:23.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.365+0000 7f731ad01640 0 -- 172.21.15.94:0/3130072022 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5557dec291a0 msgr2=0x5557dec2b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:23.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.368+0000 7f731b502640 0 -- 172.21.15.94:0/3130072022 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f731007d940 msgr2=0x7f731008f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:23.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:23.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:23.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:23.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:23.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:23.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:23.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.372+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 zone default found 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 4 Realm: () 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 zonegroup default 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.373+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.374+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.374+0000 7f731f922800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.374+0000 7f731f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.374+0000 7f731f922800 20 started sync module instance, tier type = 2024-09-19T14:02:23.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.374+0000 7f731f922800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=0 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=1 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=2 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=3 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=4 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=5 2024-09-19T14:02:23.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.382+0000 7f731f922800 20 add_watcher() i=6 2024-09-19T14:02:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.383+0000 7f731f922800 20 add_watcher() i=7 2024-09-19T14:02:23.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.383+0000 7f731f922800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.384+0000 7f71d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.384+0000 7f731f922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:23.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.384+0000 7f731f922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:23.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.418+0000 7f71d17e2640 20 reqs_thread_entry: start 2024-09-19T14:02:23.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.418+0000 7f731f922800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:23.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.418+0000 7f731f922800 20 Filter name: none 2024-09-19T14:02:23.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.418+0000 7f71ca7fc640 20 reqs_thread_entry: start 2024-09-19T14:02:23.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.418+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:23.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.419+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.420+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.420+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.421+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:23.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.422+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.423+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.423+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.424+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:23.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.425+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.426+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.426+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.427+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:23.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.428+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.429+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.429+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.430+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:23.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.431+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.432+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.432+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.433+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:23.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.434+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.435+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.435+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.436+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:23.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.438+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.438+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.438+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.439+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:23.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.440+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.441+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.441+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.442+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:23.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.443+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.444+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.444+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.445+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.446+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.448 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.447+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.447+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.448+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:23.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.449+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.450+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.450+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.451+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:23.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.453+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.453+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.453+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.454+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:23.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.456+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.456+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.456+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.457+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:23.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.459+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.459+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.459+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.461+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:23.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.462+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.463+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.463+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.465+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:23.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.466+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.466+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.467+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.468+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:23.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.469+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.470+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.470+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.471+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:23.474 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.472+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.473+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.473+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.474+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:23.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.475+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.476+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.476+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.477+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:23.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.478+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.478+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.479+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.480+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:23.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.481+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.482+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.482+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.483+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:23.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.484+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.485+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.485+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.486+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:23.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.487+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.488+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.488+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.489+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:23.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.490+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.491+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.491+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.492+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:23.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.493+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.493+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.494+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.495+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:23.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.496+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.496+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.496+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.497+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:23.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.499+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.499+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.499+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.501+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:23.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.502+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.502+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.502+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.504+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:23.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.506+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.507+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.507+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.508+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:23.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.509+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.510+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.510+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.511+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:23.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.512+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.513+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.513+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.514+0000 7f731f922800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:23.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.515+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.515+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.516+0000 7f731f922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.517+0000 7f71d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.519+0000 7f731f922800 20 remove_watcher() i=0 2024-09-19T14:02:23.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.519+0000 7f731f922800 2 removed watcher, disabling cache 2024-09-19T14:02:23.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.520+0000 7f731f922800 20 remove_watcher() i=1 2024-09-19T14:02:23.523 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.521+0000 7f731f922800 20 remove_watcher() i=2 2024-09-19T14:02:23.524 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.522+0000 7f731f922800 20 remove_watcher() i=3 2024-09-19T14:02:23.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.523+0000 7f731f922800 20 remove_watcher() i=4 2024-09-19T14:02:23.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.524+0000 7f731f922800 20 remove_watcher() i=5 2024-09-19T14:02:23.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.525+0000 7f731f922800 20 remove_watcher() i=6 2024-09-19T14:02:23.528 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.526+0000 7f731f922800 20 remove_watcher() i=7 2024-09-19T14:02:23.538 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:23.592 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:23.628 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.626+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 realm 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.628+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.629+0000 7f868840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.629+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.629+0000 7f868840e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:23.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.629+0000 7f868840e800 20 searching for the correct realm 2024-09-19T14:02:23.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.632+0000 7f86833bb640 0 -- 172.21.15.94:0/712189661 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f867409a050 msgr2=0x7f867405fee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:23.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.635+0000 7f8683bbc640 0 -- 172.21.15.94:0/712189661 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f8678068a90 msgr2=0x7f8678080730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.840+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 zone default found 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 4 Realm: () 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 zonegroup default 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.841+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.842+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.842+0000 7f868840e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:23.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.842+0000 7f868840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:23.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.842+0000 7f868840e800 20 started sync module instance, tier type = 2024-09-19T14:02:23.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.842+0000 7f868840e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:23.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=0 2024-09-19T14:02:23.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=1 2024-09-19T14:02:23.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=2 2024-09-19T14:02:23.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=3 2024-09-19T14:02:23.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=4 2024-09-19T14:02:23.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=5 2024-09-19T14:02:23.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.852+0000 7f868840e800 20 add_watcher() i=6 2024-09-19T14:02:23.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.853+0000 7f868840e800 20 add_watcher() i=7 2024-09-19T14:02:23.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.853+0000 7f868840e800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:23.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.854+0000 7f8539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:23.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.854+0000 7f868840e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:23.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.854+0000 7f868840e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.890+0000 7f8538fe1640 20 reqs_thread_entry: start 2024-09-19T14:02:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.890+0000 7f868840e800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.890+0000 7f868840e800 20 Filter name: none 2024-09-19T14:02:23.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.890+0000 7f84b27fc640 20 reqs_thread_entry: start 2024-09-19T14:02:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.890+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.891+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.893 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.892+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.892+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.893+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:23.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.894+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.896 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.894+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.895+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.896+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:23.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.898+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.898+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.898+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.899+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:23.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.900+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.902 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.901+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.901+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.902+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:23.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.903+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.904+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.904+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.905+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:23.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.906+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.907+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.907+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.908+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.909+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.909+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.910+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.911+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:23.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.912+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.913+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.913+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.914+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:23.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.915+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.916+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.916+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.917+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:23.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.918+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.919+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.919+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.922 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.920+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:23.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.921+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.921+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.922+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.923+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:23.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.924+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.924+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.924+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.925+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:23.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.927+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.927+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.927+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.928+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.929+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.930+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.930+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.931+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:23.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.932+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.933+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.933+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.934+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:23.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.935+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.935+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.935+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.936+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:23.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.938+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.938+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.938+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.939+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:23.942 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.940+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.941+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.941+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.942+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:23.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.943+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.944+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.944+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.945+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:23.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.946+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.946+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.947+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.947+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:23.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.949+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.949+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.950+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.951+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:23.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.952+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.952+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.953+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.953+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:23.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.955+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.955+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.955+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.956+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:23.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.958+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.958+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.959+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.959+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:23.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.961+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.961+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.962+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.963+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:23.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.964+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.964+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.964+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.965+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:23.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.966+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.967+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.967+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.968+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:23.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.969+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.970+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.972 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.970+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.973 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.971+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:23.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.972+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.973+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.973+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.974+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:23.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.975+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.975+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.976+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.977+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:23.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.978+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.978+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.979+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.980+0000 7f868840e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:23.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.981+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.981+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:23.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.982+0000 7f868840e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:23.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.983+0000 7f8539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:23.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.986+0000 7f868840e800 20 remove_watcher() i=0 2024-09-19T14:02:23.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.986+0000 7f868840e800 2 removed watcher, disabling cache 2024-09-19T14:02:23.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.986+0000 7f868840e800 20 remove_watcher() i=1 2024-09-19T14:02:23.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.987+0000 7f868840e800 20 remove_watcher() i=2 2024-09-19T14:02:23.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.989+0000 7f868840e800 20 remove_watcher() i=3 2024-09-19T14:02:23.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.990+0000 7f868840e800 20 remove_watcher() i=4 2024-09-19T14:02:23.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.990+0000 7f868840e800 20 remove_watcher() i=5 2024-09-19T14:02:23.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.991+0000 7f868840e800 20 remove_watcher() i=6 2024-09-19T14:02:23.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:23.992+0000 7f868840e800 20 remove_watcher() i=7 2024-09-19T14:02:24.005 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:24.060 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:24.060 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:24.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.092+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 realm 2024-09-19T14:02:24.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:24.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.093+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.094+0000 7fa585740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:24.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.094+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.095+0000 7fa585740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:24.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.095+0000 7fa585740800 20 searching for the correct realm 2024-09-19T14:02:24.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.299+0000 7fa578cbf640 0 -- 172.21.15.94:0/3216851730 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fa57400b040 msgr2=0x7fa574075d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:02:24.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.506+0000 7fa5814c0640 0 -- 172.21.15.94:0/3216851730 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa56c06b030 msgr2=0x7fa56c04d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:24.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:24.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.713+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 zone default found 2024-09-19T14:02:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 4 Realm: () 2024-09-19T14:02:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:24.717 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 zonegroup default 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.714+0000 7fa585740800 20 rados->read ofs=0 len=0 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.715+0000 7fa585740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.715+0000 7fa585740800 20 started sync module instance, tier type = 2024-09-19T14:02:24.718 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.715+0000 7fa585740800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:24.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=0 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=1 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=2 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=3 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=4 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=5 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.723+0000 7fa585740800 20 add_watcher() i=6 2024-09-19T14:02:24.726 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.724+0000 7fa585740800 20 add_watcher() i=7 2024-09-19T14:02:24.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.724+0000 7fa585740800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.726+0000 7fa437fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.726+0000 7fa585740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:24.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.726+0000 7fa585740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.773+0000 7fa436fe5640 20 reqs_thread_entry: start 2024-09-19T14:02:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.773+0000 7fa585740800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.773+0000 7fa585740800 20 Filter name: none 2024-09-19T14:02:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.773+0000 7fa434fe1640 20 reqs_thread_entry: start 2024-09-19T14:02:24.775 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.773+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:24.776 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.775+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.775+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.777 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.775+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.777+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:24.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.780+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.781+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.783 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.781+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.785 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.783+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:24.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.784+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.784+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.786 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.785+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.787 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.785+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:24.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.787+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.787+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.789 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.788+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.790 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.789+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:24.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.790+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.790+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.792 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.790+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.791+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:24.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.793+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.793+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.796 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.794+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.795+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:24.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.796+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.796+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.797+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.798+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:24.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.799+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.799+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.799+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.802 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.800+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:24.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.802+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.802+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.804 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.803+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.804+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:24.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.805+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.805+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.807 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.805+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.808 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.806+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:24.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.808+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.808+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.809+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.810+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:24.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.811+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.811+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.812+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.814 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.813+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:24.816 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.814+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.815+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.815+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.816+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:24.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.819+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.820+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.820+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.822+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:24.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.823+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.824+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.824+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.827 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.825+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:24.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.826+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.826+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.827+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.828+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:24.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.829+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.829+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.829+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.831+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:24.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.835+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.835+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.835+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.837+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.838+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.838+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.839+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.840+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:24.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.841+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.843 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.841+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.841+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.842+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:24.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.844+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.844+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.845+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.846+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:24.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.848+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.848+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.848+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.849+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:24.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.851+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.851+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.851+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.852+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:24.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.853+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.854+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.854+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.855+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:24.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.856+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.857+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.857+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.859+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:24.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.860+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.861+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.861+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.862+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:24.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.863+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.863+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.864+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.865+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:24.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.866+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.866+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.866+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.868+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:24.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.869+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.869+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.871 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.869+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.871+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:24.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.872+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.873+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.873+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.874+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:24.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.875+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.875+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.876+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.876+0000 7fa585740800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:24.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.878+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.878+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:24.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.878+0000 7fa585740800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:24.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.880+0000 7fa437fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:24.884 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.883+0000 7fa585740800 20 remove_watcher() i=0 2024-09-19T14:02:24.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.883+0000 7fa585740800 2 removed watcher, disabling cache 2024-09-19T14:02:24.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.884+0000 7fa585740800 20 remove_watcher() i=1 2024-09-19T14:02:24.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.884+0000 7fa585740800 20 remove_watcher() i=2 2024-09-19T14:02:24.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.886+0000 7fa585740800 20 remove_watcher() i=3 2024-09-19T14:02:24.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.887+0000 7fa585740800 20 remove_watcher() i=4 2024-09-19T14:02:24.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.888+0000 7fa585740800 20 remove_watcher() i=5 2024-09-19T14:02:24.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.889+0000 7fa585740800 20 remove_watcher() i=6 2024-09-19T14:02:24.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:24.890+0000 7fa585740800 20 remove_watcher() i=7 2024-09-19T14:02:24.902 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-19T14:02:25.390 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean 2024-09-19T14:02:26.186 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-19T14:02:26.186 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-19T14:02:26.186 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-19T14:02:26.686 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:26.686 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-19T14:02:26.687 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-19T14:02:26.687 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-19T14:02:26.688 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:26.688 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-19T14:02:26.688 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-19T14:02:28.688 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.688 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-19T14:02:28.688 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.688 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests STANDARD_OUT 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19 14:02:27,984 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.689 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-19T14:02:28.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.786 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-19T14:02:28.886 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.886 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-19T14:02:28.986 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.987 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-19T14:02:28.987 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:28.987 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-19T14:02:29.286 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.286 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-19T14:02:29.286 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.287 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-19T14:02:29.386 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.386 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-19T14:02:29.486 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.486 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-19T14:02:29.786 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.786 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-19T14:02:29.787 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.787 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-19T14:02:29.986 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:29.986 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-19T14:02:30.086 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:30.086 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------- 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------- 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-19T14:02:30.151 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-19T14:02:30.152 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:30.152 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 5s 2024-09-19T14:02:30.152 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 5 executed 2024-09-19T14:02:30.155 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:30.206 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:30.206 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:30.242 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.240+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 realm 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.242+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.243+0000 7fc2b8126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:30.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.243+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.243+0000 7fc2b8126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:30.245 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.243+0000 7fc2b8126800 20 searching for the correct realm 2024-09-19T14:02:30.248 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.246+0000 7fc2ab508640 0 -- 172.21.15.94:0/2564845096 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5638e5deb850 msgr2=0x5638e5dedc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:30.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.250+0000 7fc2b3d09640 0 -- 172.21.15.94:0/2564845096 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fc29c069900 msgr2=0x7fc29c06a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 zone default found 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 4 Realm: () 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 zonegroup default 2024-09-19T14:02:30.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.254+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 started sync module instance, tier type = 2024-09-19T14:02:30.259 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.255+0000 7fc2b8126800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=0 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=1 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=2 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=3 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=4 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=5 2024-09-19T14:02:30.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.264+0000 7fc2b8126800 20 add_watcher() i=6 2024-09-19T14:02:30.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.265+0000 7fc2b8126800 20 add_watcher() i=7 2024-09-19T14:02:30.267 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.265+0000 7fc2b8126800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:30.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.267+0000 7fc169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:30.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.267+0000 7fc2b8126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:30.269 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.267+0000 7fc2b8126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.312+0000 7fc168fe1640 20 reqs_thread_entry: start 2024-09-19T14:02:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.312+0000 7fc2b8126800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.312+0000 7fc2b8126800 20 Filter name: none 2024-09-19T14:02:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.313+0000 7fc0e27fc640 20 reqs_thread_entry: start 2024-09-19T14:02:30.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.313+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:30.316 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.314+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.315+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.315+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.318 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.316+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:30.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.317+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.318+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.320 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.318+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.319+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:30.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.320+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.321+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.321+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.323+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:30.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.324+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.324+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.326 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.325+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.325+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:30.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.327+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.327+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.327+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.328+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:30.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.330+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.330+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.330+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.331+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:30.334 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.332+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.333+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.333+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.334+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.335+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.336+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.336+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.337+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:30.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.339+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.339+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.341 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.339+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.340+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.342+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.342+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.342+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.344+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:30.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.347+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.348+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.348+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.352 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.350+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:30.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.351+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.351+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.352+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.353+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:30.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.354+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.355+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.355+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.356+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:30.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.358+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.359+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.359+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.360+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:30.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.361+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.362+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.362+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.364+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:30.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.367+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.367+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.367+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.368+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:30.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.370+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.370+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.370+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.373 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.371+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:30.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.372+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.373+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.375 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.373+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.374+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:30.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.375+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.375+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.376+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.377+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:30.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.378+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.378+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.379+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.380+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:30.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.381+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.381+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.381+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.382+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:30.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.384+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.384+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.384+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.385+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:30.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.387+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.387+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.387+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.388+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:30.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.389+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.390+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.390+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.391+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:30.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.392+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.393+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.393+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.394+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:30.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.395+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.396+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.396+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.397+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:30.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.399+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.399+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.399+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.400+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:30.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.402+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.402+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.402+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.405 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.403+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:30.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.405+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.405+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.406+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.407+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:30.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.408+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.409+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.409+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.410+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:30.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.412+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.412+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.412+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.414+0000 7fc2b8126800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:30.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.415+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.415+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.415+0000 7fc2b8126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.417+0000 7fc169fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:30.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.419+0000 7fc2b8126800 20 remove_watcher() i=0 2024-09-19T14:02:30.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.419+0000 7fc2b8126800 2 removed watcher, disabling cache 2024-09-19T14:02:30.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.420+0000 7fc2b8126800 20 remove_watcher() i=1 2024-09-19T14:02:30.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.421+0000 7fc2b8126800 20 remove_watcher() i=2 2024-09-19T14:02:30.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.423+0000 7fc2b8126800 20 remove_watcher() i=3 2024-09-19T14:02:30.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.423+0000 7fc2b8126800 20 remove_watcher() i=4 2024-09-19T14:02:30.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.424+0000 7fc2b8126800 20 remove_watcher() i=5 2024-09-19T14:02:30.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.425+0000 7fc2b8126800 20 remove_watcher() i=6 2024-09-19T14:02:30.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.426+0000 7fc2b8126800 20 remove_watcher() i=7 2024-09-19T14:02:30.439 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:30.490 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:30.491 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:30.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.525+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 realm 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.527+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.528+0000 7f612e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:30.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.528+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.528+0000 7f612e420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:30.530 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.528+0000 7f612e420800 20 searching for the correct realm 2024-09-19T14:02:30.533 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.531+0000 7f612c712640 0 -- 172.21.15.94:0/754112644 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f6114019410 msgr2=0x7f6114019830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:30.536 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.534+0000 7f612bf11640 0 -- 172.21.15.94:0/754112644 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f6114018410 msgr2=0x7f6114018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:30.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.538+0000 7f612e420800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:30.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:30.542 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.543 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 zone default found 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 4 Realm: () 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 zonegroup default 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.539+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.544 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.540+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.540+0000 7f612e420800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.540+0000 7f612e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.540+0000 7f612e420800 20 started sync module instance, tier type = 2024-09-19T14:02:30.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.540+0000 7f612e420800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=0 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=1 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=2 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=3 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=4 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=5 2024-09-19T14:02:30.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.549+0000 7f612e420800 20 add_watcher() i=6 2024-09-19T14:02:30.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.550+0000 7f612e420800 20 add_watcher() i=7 2024-09-19T14:02:30.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.550+0000 7f612e420800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:30.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.551+0000 7f5fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:30.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.552+0000 7f612e420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:30.554 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.552+0000 7f612e420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:30.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.585+0000 7f5fe0fe1640 20 reqs_thread_entry: start 2024-09-19T14:02:30.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.585+0000 7f612e420800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:30.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.585+0000 7f612e420800 20 Filter name: none 2024-09-19T14:02:30.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.586+0000 7f5f5a7fc640 20 reqs_thread_entry: start 2024-09-19T14:02:30.588 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.586+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:30.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.587+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.589 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.588+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.590 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.588+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.591 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.589+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:30.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.590+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.592 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.591+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.593 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.591+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.594 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.592+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:30.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.593+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.595 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.594+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.596 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.594+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.597 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.595+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:30.598 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.596+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.597+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.599 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.597+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.600 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.598+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:30.601 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.599+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.600+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.602 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.600+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.603 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.601+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:30.604 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.602+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.603+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.605 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.603+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.606 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.604+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:30.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.606+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.606+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.608 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.606+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.609 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.607+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:30.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.609+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.609+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.612 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.610+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.611+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:30.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.612+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.612+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.613+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.614+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:30.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.616+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.616+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.616+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.617+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:30.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.619+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.619+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.619+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.621+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:30.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.622+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.623+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.623+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.624+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:30.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.625+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.626+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.626+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.627+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:30.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.628+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.629+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.629+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.630+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:30.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.631+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.633 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.632+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.634 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.632+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.635 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.633+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:30.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.634+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.636 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.634+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.635+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.635+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:30.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.637+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.638+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.638+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.641 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.639+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:30.642 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.641+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.641+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.643 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.641+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.644 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.642+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:30.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.644+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.646 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.644+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.645+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.646+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.647+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.649 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.647+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.648+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.649+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:30.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.650+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.650+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.650+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.651+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:30.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.652+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.653+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.653+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.654+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:30.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.655+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.656+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.656+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.657+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:30.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.658+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.658+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.660 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.659+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.661 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.659+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:30.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.661+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.661+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.661+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.663+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:30.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.664+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.664+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.664+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.665+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:30.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.667+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.667+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.669 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.667+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.670 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.668+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:30.671 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.670+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.670+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.672 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.670+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.673 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.671+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:30.674 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.672+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.673+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.675 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.673+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.677 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.675+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:30.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.677+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.677+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.679 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.677+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.680 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.678+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:30.681 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.680+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.680+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.682 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.680+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.683 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.681+0000 7f612e420800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:30.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.683+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.685 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.683+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.686 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.684+0000 7f612e420800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.687 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.686+0000 7f5fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:30.689 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.688+0000 7f612e420800 20 remove_watcher() i=0 2024-09-19T14:02:30.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.688+0000 7f612e420800 2 removed watcher, disabling cache 2024-09-19T14:02:30.690 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.688+0000 7f612e420800 20 remove_watcher() i=1 2024-09-19T14:02:30.691 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.689+0000 7f612e420800 20 remove_watcher() i=2 2024-09-19T14:02:30.692 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.690+0000 7f612e420800 20 remove_watcher() i=3 2024-09-19T14:02:30.693 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.691+0000 7f612e420800 20 remove_watcher() i=4 2024-09-19T14:02:30.694 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.692+0000 7f612e420800 20 remove_watcher() i=5 2024-09-19T14:02:30.695 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.693+0000 7f612e420800 20 remove_watcher() i=6 2024-09-19T14:02:30.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.694+0000 7f612e420800 20 remove_watcher() i=7 2024-09-19T14:02:30.707 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:30.758 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:30.758 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:30.795 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.793+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.794+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.794+0000 7fcad1b2e800 20 realm 2024-09-19T14:02:30.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.794+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.795+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.797 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.795+0000 7fcad1b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:30.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.795+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.795+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.795+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.798 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.796+0000 7fcad1b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:30.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.796+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.796+0000 7fcad1b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:30.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.796+0000 7fcad1b2e800 20 searching for the correct realm 2024-09-19T14:02:30.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.799+0000 7fcac7fff640 0 -- 172.21.15.94:0/3780864480 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x555af3ffa040 msgr2=0x555af3ffc500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:30.805 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.803+0000 7fcacd764640 0 -- 172.21.15.94:0/3780864480 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fcab8075a90 msgr2=0x7fcab805a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:30.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:30.810 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.807+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.811 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 zone default found 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 4 Realm: () 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 zonegroup default 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.812 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados->read ofs=0 len=0 2024-09-19T14:02:30.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:30.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 started sync module instance, tier type = 2024-09-19T14:02:30.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.808+0000 7fcad1b2e800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:30.818 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=0 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=1 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=2 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=3 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=4 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=5 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=6 2024-09-19T14:02:30.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 20 add_watcher() i=7 2024-09-19T14:02:30.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.817+0000 7fcad1b2e800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:30.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.819+0000 7fc9837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:30.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.819+0000 7fcad1b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:30.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.819+0000 7fcad1b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:30.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.860+0000 7fc9827e4640 20 reqs_thread_entry: start 2024-09-19T14:02:30.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.860+0000 7fcad1b2e800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:30.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.860+0000 7fcad1b2e800 20 Filter name: none 2024-09-19T14:02:30.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.860+0000 7fc8f3fff640 20 reqs_thread_entry: start 2024-09-19T14:02:30.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.860+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:30.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.861+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.862+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.862+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.865 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.863+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:30.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.864+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.866 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.865+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.867 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.865+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.868 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.866+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:30.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.867+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.867+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.869 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.868+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.870 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.869+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:30.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.870+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.872 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.870+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.871+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.873 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.872+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:30.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.873+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.875 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.873+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.876 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.874+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.877 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.875+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:30.878 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.876+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.877+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.879 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.877+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.880 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.878+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:30.881 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.879+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.880+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.882 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.880+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.883 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.881+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:30.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.882+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.883+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.885 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.883+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.886 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.884+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:30.887 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.886+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.886+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.888 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.886+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.889 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.887+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:30.890 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.889+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.889+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.891 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.889+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.892 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.890+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:30.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.892+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.892+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.894 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.892+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.895 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.893+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:30.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.895+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.895+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.897 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.896+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.899 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.897+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:30.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.898+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.900 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.898+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.899+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.901 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.900+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:30.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.901+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.901+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.903 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.902+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.904 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.902+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:30.905 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.903+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.904+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.906 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.904+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.907 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.905+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:30.908 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.906+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.907+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.909 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.907+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.908+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:30.911 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.909+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.910+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.912 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.910+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.913 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.911+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:30.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.912+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.914 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.912+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.913+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.914+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:30.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.915+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.916+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.916+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.917+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:30.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.918+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.918+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.920 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.919+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.921 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.920+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:30.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.921+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.921+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.923 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.922+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.924 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.923+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:30.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.924+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.924+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.924+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.925+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:30.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.927+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.927+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.929 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.927+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.928+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:30.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.930+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.930+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.930+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.931+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:30.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.932+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.933+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.933+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.934+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:30.937 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.935+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.936+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.938 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.936+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.939 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.937+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:30.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.938+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.939+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.939+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.940+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:30.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.941+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.941+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.942+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.942+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:30.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.944+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.944+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.944+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.947 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.945+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:30.948 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.946+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.947+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.949 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.947+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.948+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:30.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.950+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.950+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.950+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.953 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.951+0000 7fcad1b2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:30.954 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.953+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.953+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:30.955 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.953+0000 7fcad1b2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:30.957 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.955+0000 7fc9837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.957+0000 7fcad1b2e800 20 remove_watcher() i=0 2024-09-19T14:02:30.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.957+0000 7fcad1b2e800 2 removed watcher, disabling cache 2024-09-19T14:02:30.960 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.958+0000 7fcad1b2e800 20 remove_watcher() i=1 2024-09-19T14:02:30.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.959+0000 7fcad1b2e800 20 remove_watcher() i=2 2024-09-19T14:02:30.962 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.960+0000 7fcad1b2e800 20 remove_watcher() i=3 2024-09-19T14:02:30.963 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.961+0000 7fcad1b2e800 20 remove_watcher() i=4 2024-09-19T14:02:30.964 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.962+0000 7fcad1b2e800 20 remove_watcher() i=5 2024-09-19T14:02:30.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.963+0000 7fcad1b2e800 20 remove_watcher() i=6 2024-09-19T14:02:30.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:30.964+0000 7fcad1b2e800 20 remove_watcher() i=7 2024-09-19T14:02:30.977 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:02:31.028 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:02:31.029 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:02:31.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.063+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.064+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.064+0000 7f67f6326800 20 realm 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.064+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:31.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.065+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.066+0000 7f67f6326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:02:31.068 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.066+0000 7f67f6326800 20 searching for the correct realm 2024-09-19T14:02:31.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.069+0000 7f67f17d8640 0 -- 172.21.15.94:0/463108622 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x562f3015a010 msgr2=0x562f3015c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:02:31.074 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.072+0000 7f67f1fd9640 0 -- 172.21.15.94:0/463108622 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f67e8043a70 msgr2=0x7f67e8069890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:02:31.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:02:31.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:02:31.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:02:31.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.077+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 zone default found 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 4 Realm: () 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:02:31.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 zonegroup default 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados->read ofs=0 len=0 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 started sync module instance, tier type = 2024-09-19T14:02:31.082 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.078+0000 7f67f6326800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=0 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=1 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=2 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=3 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=4 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=5 2024-09-19T14:02:31.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=6 2024-09-19T14:02:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 20 add_watcher() i=7 2024-09-19T14:02:31.090 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.087+0000 7f67f6326800 2 all 8 watchers are set, enabling cache 2024-09-19T14:02:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.089+0000 7f66a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.089+0000 7f67f6326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:02:31.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.089+0000 7f67f6326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:02:31.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.124+0000 7f66a27fc640 20 reqs_thread_entry: start 2024-09-19T14:02:31.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.125+0000 7f67f6326800 20 init_complete bucket index max shards: 11 2024-09-19T14:02:31.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.125+0000 7f67f6326800 20 Filter name: none 2024-09-19T14:02:31.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.125+0000 7f6617fff640 20 reqs_thread_entry: start 2024-09-19T14:02:31.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.125+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:02:31.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.126+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.127+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.127+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.128+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:02:31.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.129+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.130+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.130+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.131+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:02:31.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.132+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.132+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.133+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.134+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:02:31.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.135+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.135+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.136+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.136+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:02:31.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.138+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.138+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.138+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.139+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:02:31.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.141+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.141+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.141+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.142+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:02:31.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.144+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.145+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.145+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.146+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:02:31.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.147+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.149 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.148+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.148+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.149+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:02:31.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.150+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.150+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.151+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.152+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:02:31.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.153+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.153+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.154+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.154+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:02:31.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.156+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.156+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.156+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.157+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:02:31.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.158+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.159+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.159+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.160+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:02:31.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.161+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.162+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.162+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.163+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:02:31.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.164+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.165+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.165+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.166+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:02:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.167+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.167+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.168+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.169+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:02:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.170+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.170+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.171+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.172+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:02:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.173+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.173+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.173+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.174+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:02:31.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.176+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.176+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.176+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.178+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:02:31.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.179+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.179+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.179+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.180+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:02:31.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.181+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.182+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.182+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.183+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:02:31.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.184+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.185+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.185+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.186+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:02:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.187+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.187+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.188+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.189+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:02:31.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.190+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.190+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.192 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.191+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.194 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.192+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:02:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.193+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.193+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.194+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.195+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:02:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.196+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.196+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.198 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.197+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.197+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:02:31.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.199+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.199+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.199+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.202 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.200+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:02:31.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.202+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.202+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.203+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.205 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.204+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:02:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.205+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.205+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.207 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.206+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.207+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:02:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.208+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.208+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.209+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.210+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:02:31.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.214+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.214+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.214+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.216+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:02:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.219+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.220+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.221+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.222+0000 7f67f6326800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:02:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.223+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.225 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.223+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:02:31.226 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.224+0000 7f67f6326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:02:31.227 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.225+0000 7f66a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:02:31.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.227+0000 7f67f6326800 20 remove_watcher() i=0 2024-09-19T14:02:31.229 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.227+0000 7f67f6326800 2 removed watcher, disabling cache 2024-09-19T14:02:31.230 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.228+0000 7f67f6326800 20 remove_watcher() i=1 2024-09-19T14:02:31.231 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.229+0000 7f67f6326800 20 remove_watcher() i=2 2024-09-19T14:02:31.232 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.230+0000 7f67f6326800 20 remove_watcher() i=3 2024-09-19T14:02:31.233 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.231+0000 7f67f6326800 20 remove_watcher() i=4 2024-09-19T14:02:31.234 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.232+0000 7f67f6326800 20 remove_watcher() i=5 2024-09-19T14:02:31.235 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.233+0000 7f67f6326800 20 remove_watcher() i=6 2024-09-19T14:02:31.236 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:02:31.234+0000 7f67f6326800 20 remove_watcher() i=7 2024-09-19T14:02:31.246 DEBUG:teuthology.orchestra.run.smithi094:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-19T14:02:31.830 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :clean 2024-09-19T14:02:32.528 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileJava 2024-09-19T14:02:32.528 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processResources 2024-09-19T14:02:32.528 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :classes 2024-09-19T14:02:33.028 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:33.028 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :compileTestJava 2024-09-19T14:02:33.028 INFO:teuthology.orchestra.run.smithi094.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-19T14:02:33.029 INFO:teuthology.orchestra.run.smithi094.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-19T14:02:33.029 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:33.030 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :processTestResources NO-SOURCE 2024-09-19T14:02:33.030 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :testClasses 2024-09-19T14:02:35.029 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.029 INFO:teuthology.orchestra.run.smithi094.stdout:> Task :test 2024-09-19T14:02:35.029 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests STANDARD_OUT 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19 14:02:34,273 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.030 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-19T14:02:35.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-19T14:02:35.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-19T14:02:35.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-19T14:02:35.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-19T14:02:35.928 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-19T14:02:35.928 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:35.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-19T14:02:36.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-19T14:02:36.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.228 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-19T14:02:36.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-19T14:02:36.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-19T14:02:36.528 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.528 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-19T14:02:36.528 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.528 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-19T14:02:36.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-19T14:02:36.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:36.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-19T14:02:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-19T14:02:37.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-19T14:02:37.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-19T14:02:37.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-19T14:02:37.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.528 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-19T14:02:37.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-19T14:02:37.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-19T14:02:37.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:37.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-19T14:02:38.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.028 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-19T14:02:38.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-19T14:02:38.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-19T14:02:38.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-19T14:02:38.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.528 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-19T14:02:38.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-19T14:02:38.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:38.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-19T14:02:39.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:39.228 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-19T14:02:39.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:39.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-19T14:02:44.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:44.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-19T14:02:44.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:44.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-19T14:02:44.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:44.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-19T14:02:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:44.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-19T14:02:44.928 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:44.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-19T14:02:45.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:45.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-19T14:02:45.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:45.627 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-19T14:02:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:45.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-19T14:02:45.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:45.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-19T14:02:45.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:45.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-19T14:02:46.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:46.627 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-19T14:02:46.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:46.827 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-19T14:02:47.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:47.327 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-19T14:02:47.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:47.550 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-19T14:02:47.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:47.927 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-19T14:02:48.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:48.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-19T14:02:50.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:50.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-19T14:02:50.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:50.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-19T14:02:51.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:51.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-19T14:02:51.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:51.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-19T14:02:52.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:52.228 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-19T14:02:52.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:52.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-19T14:02:52.928 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:52.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-19T14:02:53.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:53.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-19T14:02:53.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:53.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-19T14:02:53.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:53.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-19T14:02:53.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:53.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-19T14:02:53.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:53.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-19T14:02:53.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:53.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-19T14:02:54.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.028 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-19T14:02:54.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-19T14:02:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-19T14:02:54.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-19T14:02:54.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.528 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-19T14:02:54.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-19T14:02:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-19T14:02:54.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:54.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-19T14:02:55.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.028 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-19T14:02:55.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-19T14:02:55.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.327 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-19T14:02:55.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-19T14:02:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-19T14:02:55.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-19T14:02:55.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-19T14:02:55.928 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:55.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-19T14:02:56.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:56.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-19T14:02:56.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:56.227 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-19T14:02:56.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:56.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-19T14:02:56.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:56.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-19T14:02:56.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:56.727 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-19T14:02:56.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:56.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-19T14:02:57.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.027 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-19T14:02:57.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-19T14:02:57.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-19T14:02:57.328 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-19T14:02:57.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-19T14:02:57.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.628 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-19T14:02:57.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.827 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-19T14:02:57.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:57.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-19T14:02:58.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-19T14:02:58.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.227 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-19T14:02:58.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-19T14:02:58.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-19T14:02:58.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.727 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-19T14:02:58.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-19T14:02:58.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:58.927 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-19T14:02:59.028 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.028 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-19T14:02:59.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.227 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-19T14:02:59.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.328 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-19T14:02:59.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-19T14:02:59.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.627 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-19T14:02:59.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.827 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-19T14:02:59.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:02:59.927 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-19T14:03:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-19T14:03:00.128 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.128 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-19T14:03:00.327 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.327 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-19T14:03:00.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-19T14:03:00.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.627 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-19T14:03:00.727 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.727 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-19T14:03:00.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:00.927 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-19T14:03:01.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.027 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-19T14:03:01.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.228 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-19T14:03:01.228 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.228 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-19T14:03:01.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-19T14:03:01.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-19T14:03:01.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-19T14:03:01.728 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.728 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-19T14:03:01.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.827 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-19T14:03:01.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:01.927 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-19T14:03:02.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.027 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-19T14:03:02.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.227 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-19T14:03:02.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-19T14:03:02.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-19T14:03:02.527 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.527 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-19T14:03:02.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.627 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-19T14:03:02.827 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-19T14:03:02.828 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:02.828 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-19T14:03:03.027 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:03.027 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-19T14:03:03.227 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:03.227 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-19T14:03:03.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:03.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-19T14:03:03.428 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:03.428 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-19T14:03:03.627 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:03.627 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-19T14:03:03.927 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:03.928 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-19T14:03:04.127 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:04.127 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-19T14:03:04.427 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:04.427 INFO:teuthology.orchestra.run.smithi094.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-19T14:03:04.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:04.628 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-19T14:03:04.628 INFO:teuthology.orchestra.run.smithi094.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-19T14:03:04.628 INFO:teuthology.orchestra.run.smithi094.stdout:---------------------------------------------------------------------- 2024-09-19T14:03:04.628 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-19T14:03:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-19T14:03:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-19T14:03:04.629 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:BUILD SUCCESSFUL in 33s 2024-09-19T14:03:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:5 actionable tasks: 5 executed 2024-09-19T14:03:04.646 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:03:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:04.697 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:04.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.732+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 realm 2024-09-19T14:03:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:04.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.734+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.735+0000 7fabec540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:04.736 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.735+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.735+0000 7fabec540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:04.737 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.735+0000 7fabec540800 20 searching for the correct realm 2024-09-19T14:03:04.739 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.738+0000 7fabe8ac1640 0 -- 172.21.15.94:0/4270851980 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fabd006abe0 msgr2=0x7fabd0068630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:04.742 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.741+0000 7fabe82c0640 0 -- 172.21.15.94:0/4270851980 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fabd0072db0 msgr2=0x7fabd00a20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:04.950 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.947+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 zone default found 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 4 Realm: () 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:04.951 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 zonegroup default 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.948+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.949+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.949+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.949+0000 7fabec540800 20 rados->read ofs=0 len=0 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.949+0000 7fabec540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.949+0000 7fabec540800 20 started sync module instance, tier type = 2024-09-19T14:03:04.952 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.949+0000 7fabec540800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:04.958 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=0 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=1 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=2 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=3 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=4 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=5 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.957+0000 7fabec540800 20 add_watcher() i=6 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.958+0000 7fabec540800 20 add_watcher() i=7 2024-09-19T14:03:04.959 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.958+0000 7fabec540800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:04.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.960+0000 7faa9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:04.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.960+0000 7fabec540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:04.961 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.960+0000 7fabec540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.994+0000 7faa9dfdb640 20 reqs_thread_entry: start 2024-09-19T14:03:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.994+0000 7fabec540800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.994+0000 7fabec540800 20 Filter name: none 2024-09-19T14:03:04.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.994+0000 7faa0f7fe640 20 reqs_thread_entry: start 2024-09-19T14:03:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.994+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:03:04.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.996+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.996+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:04.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.996+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:04.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.997+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:03:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.999+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.999+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:04.999+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.000+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:03:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10750495152356750055', time=2024-09-19T16:02:46.622743+0000, chain.objs.size()=5 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.100__multipart_key1.2~JwUxx-O7Pjn32YGoSm0DJwY96IwBjYq.1 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.100__multipart_key1.2~JwUxx-O7Pjn32YGoSm0DJwY96IwBjYq.2 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.100__multipart_key1.2~JwUxx-O7Pjn32YGoSm0DJwY96IwBjYq.3 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.100__multipart_key1.2~JwUxx-O7Pjn32YGoSm0DJwY96IwBjYq.4 2024-09-19T14:03:05.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.002+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.100__multipart_key1.2~JwUxx-O7Pjn32YGoSm0DJwY96IwBjYq.5 2024-09-19T14:03:05.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.005+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.007+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:03:05.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.008+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.009+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.009+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.010+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:03:05.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.011+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.012+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.012+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.013+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:03:05.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.014+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.015+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.015+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.016+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:03:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.017+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7383470739583071013', time=2024-09-19T16:02:48.744507+0000, chain.objs.size()=5 2024-09-19T14:03:05.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~ePsQ0FVaVqi3e712JZ0PaNNC6-BKLnQ.1 2024-09-19T14:03:05.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~ePsQ0FVaVqi3e712JZ0PaNNC6-BKLnQ.2 2024-09-19T14:03:05.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~ePsQ0FVaVqi3e712JZ0PaNNC6-BKLnQ.3 2024-09-19T14:03:05.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~ePsQ0FVaVqi3e712JZ0PaNNC6-BKLnQ.4 2024-09-19T14:03:05.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.018+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~ePsQ0FVaVqi3e712JZ0PaNNC6-BKLnQ.5 2024-09-19T14:03:05.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.022+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.024+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:03:05.026 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.025+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:03:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18419348915091825366', time=2024-09-19T16:02:51.149055+0000, chain.objs.size()=5 2024-09-19T14:03:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.104__multipart_key1.2~IMqWQtTsSjldYwK1eJCxKKqaPYmIw5l.1 2024-09-19T14:03:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.104__multipart_key1.2~IMqWQtTsSjldYwK1eJCxKKqaPYmIw5l.2 2024-09-19T14:03:05.028 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.104__multipart_key1.2~IMqWQtTsSjldYwK1eJCxKKqaPYmIw5l.3 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.104__multipart_key1.2~IMqWQtTsSjldYwK1eJCxKKqaPYmIw5l.4 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.104__multipart_key1.2~IMqWQtTsSjldYwK1eJCxKKqaPYmIw5l.5 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5581469161673244987', time=2024-09-19T16:03:03.959098+0000, chain.objs.size()=5 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.144__multipart_key1.2~tOTzvf0YYjNox6YsKMVbfOEg3i8OlV2.1 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.026+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.144__multipart_key1.2~tOTzvf0YYjNox6YsKMVbfOEg3i8OlV2.2 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.027+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.144__multipart_key1.2~tOTzvf0YYjNox6YsKMVbfOEg3i8OlV2.3 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.027+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.144__multipart_key1.2~tOTzvf0YYjNox6YsKMVbfOEg3i8OlV2.4 2024-09-19T14:03:05.029 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.027+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.144__multipart_key1.2~tOTzvf0YYjNox6YsKMVbfOEg3i8OlV2.5 2024-09-19T14:03:05.031 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.031+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.035 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.034+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:03:05.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.035+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.035+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.036+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.036+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:03:05.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.038+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.038+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.038+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.038+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2765774457949923728', time=2024-09-19T16:02:36.936515+0000, chain.objs.size()=2 2024-09-19T14:03:05.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.038+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.84__shadow_.R9BnPdV-9Zx92u-Nz-5tLbK0lWK2JEj_1 2024-09-19T14:03:05.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.039+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.84__shadow_.R9BnPdV-9Zx92u-Nz-5tLbK0lWK2JEj_2 2024-09-19T14:03:05.041 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.041+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.042+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:03:05.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.043+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18329880479216114177', time=2024-09-19T16:02:39.277032+0000, chain.objs.size()=5 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.1 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.2 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.3 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.4 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.044+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.5 2024-09-19T14:03:05.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.046+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.048+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:03:05.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.049+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.049+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.049+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.049+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8524709255994143581', time=2024-09-19T16:02:47.331936+0000, chain.objs.size()=5 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.049+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file.mpg.2~lpiKu1KOWXcGSq_h2AlsVYjt7wmyVdR.1 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.050+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file.mpg.2~lpiKu1KOWXcGSq_h2AlsVYjt7wmyVdR.2 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.050+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file.mpg.2~lpiKu1KOWXcGSq_h2AlsVYjt7wmyVdR.3 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.050+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file.mpg.2~lpiKu1KOWXcGSq_h2AlsVYjt7wmyVdR.4 2024-09-19T14:03:05.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.050+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file.mpg.2~lpiKu1KOWXcGSq_h2AlsVYjt7wmyVdR.5 2024-09-19T14:03:05.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.052+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.055+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:03:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.056+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.056+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:03:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2207515600314991012', time=2024-09-19T16:02:43.413497+0000, chain.objs.size()=5 2024-09-19T14:03:05.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~1TRi9sxGmZ_yw7TngxB8wCVgQO-UX5x.1 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~1TRi9sxGmZ_yw7TngxB8wCVgQO-UX5x.2 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~1TRi9sxGmZ_yw7TngxB8wCVgQO-UX5x.3 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~1TRi9sxGmZ_yw7TngxB8wCVgQO-UX5x.4 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~1TRi9sxGmZ_yw7TngxB8wCVgQO-UX5x.5 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6848774501734934449', time=2024-09-19T16:02:43.864635+0000, chain.objs.size()=5 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~-CglgRZDZbCBWpOfiFPWOnTnVSr8xxf.1 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__shadow_key1.2~-CglgRZDZbCBWpOfiFPWOnTnVSr8xxf.1_1 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~-CglgRZDZbCBWpOfiFPWOnTnVSr8xxf.2 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__shadow_key1.2~-CglgRZDZbCBWpOfiFPWOnTnVSr8xxf.2_1 2024-09-19T14:03:05.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.057+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~-CglgRZDZbCBWpOfiFPWOnTnVSr8xxf.3 2024-09-19T14:03:05.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.060+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.062+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:03:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.063+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18264108205442885751', time=2024-09-19T16:02:41.890941+0000, chain.objs.size()=5 2024-09-19T14:03:05.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~Rqd5I4lXAHVMceiRDZRvCss5FKd8lSW.1 2024-09-19T14:03:05.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~Rqd5I4lXAHVMceiRDZRvCss5FKd8lSW.2 2024-09-19T14:03:05.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~Rqd5I4lXAHVMceiRDZRvCss5FKd8lSW.3 2024-09-19T14:03:05.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~Rqd5I4lXAHVMceiRDZRvCss5FKd8lSW.4 2024-09-19T14:03:05.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.064+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~Rqd5I4lXAHVMceiRDZRvCss5FKd8lSW.5 2024-09-19T14:03:05.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.066+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.068+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:03:05.070 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.069+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.071 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12539067319002913463', time=2024-09-19T16:02:42.972831+0000, chain.objs.size()=5 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~VQm01bxiu6FihKWDLZhBgJsjWAzpQvS.1 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~VQm01bxiu6FihKWDLZhBgJsjWAzpQvS.2 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~VQm01bxiu6FihKWDLZhBgJsjWAzpQvS.3 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~VQm01bxiu6FihKWDLZhBgJsjWAzpQvS.4 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~VQm01bxiu6FihKWDLZhBgJsjWAzpQvS.5 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~E7WzXoDJnxxMeTqrlnJuyrVGY2_hJIQ', time=2024-09-19T16:02:47.982847+0000, chain.objs.size()=5 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.102__multipart_key1.2~E7WzXoDJnxxMeTqrlnJuyrVGY2_hJIQ.7 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.102__multipart_key1.2~E7WzXoDJnxxMeTqrlnJuyrVGY2_hJIQ.8 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.102__multipart_key1.2~E7WzXoDJnxxMeTqrlnJuyrVGY2_hJIQ.9 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.102__multipart_key1.2~E7WzXoDJnxxMeTqrlnJuyrVGY2_hJIQ.10 2024-09-19T14:03:05.072 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.070+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.102__multipart_key1.2~E7WzXoDJnxxMeTqrlnJuyrVGY2_hJIQ.11 2024-09-19T14:03:05.075 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.075+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.077 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.077+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:03:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.078+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.079 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.078+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:03:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5827717893222744581', time=2024-09-19T16:02:47.340825+0000, chain.objs.size()=5 2024-09-19T14:03:05.080 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file2.mpg.2~Bh8bBmC9arF3Pgs_mtTRpymXrLf1y1N.1 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file2.mpg.2~Bh8bBmC9arF3Pgs_mtTRpymXrLf1y1N.2 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file2.mpg.2~Bh8bBmC9arF3Pgs_mtTRpymXrLf1y1N.3 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file2.mpg.2~Bh8bBmC9arF3Pgs_mtTRpymXrLf1y1N.4 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.101__multipart_file2.mpg.2~Bh8bBmC9arF3Pgs_mtTRpymXrLf1y1N.5 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16453780753243754568', time=2024-09-19T16:02:50.116720+0000, chain.objs.size()=5 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~B5kYhXCJ5zdfVSVSiTU8LHn__C8naw9.1 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__shadow_key1.2~B5kYhXCJ5zdfVSVSiTU8LHn__C8naw9.1_1 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~B5kYhXCJ5zdfVSVSiTU8LHn__C8naw9.2 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__shadow_key1.2~B5kYhXCJ5zdfVSVSiTU8LHn__C8naw9.2_1 2024-09-19T14:03:05.081 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.079+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~B5kYhXCJ5zdfVSVSiTU8LHn__C8naw9.3 2024-09-19T14:03:05.084 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.083+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.086 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.085+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:03:05.087 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.086+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.088 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7501104685439327925', time=2024-09-19T16:02:39.400477+0000, chain.objs.size()=5 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.1 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.2 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.3 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.4 2024-09-19T14:03:05.089 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.087+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.92__multipart_key1.2~-J0VcIhubGsUUwoGifZaK6NaVqNg_fI.5 2024-09-19T14:03:05.091 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.090+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.093 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.092+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:03:05.094 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.093+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.095 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8492479968628637537', time=2024-09-19T16:02:44.552040+0000, chain.objs.size()=5 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~_jZTK7xeK7gLikZyjPkaWJWRmhT2G1B.1 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__shadow_key1.2~_jZTK7xeK7gLikZyjPkaWJWRmhT2G1B.1_1 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~_jZTK7xeK7gLikZyjPkaWJWRmhT2G1B.2 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__shadow_key1.2~_jZTK7xeK7gLikZyjPkaWJWRmhT2G1B.2_1 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~_jZTK7xeK7gLikZyjPkaWJWRmhT2G1B.3 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2524625286203942639', time=2024-09-19T16:02:49.384712+0000, chain.objs.size()=5 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~EeH3zTWihYDs9FvzpiP3Aq_5QYjxF6T.1 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~EeH3zTWihYDs9FvzpiP3Aq_5QYjxF6T.2 2024-09-19T14:03:05.096 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~EeH3zTWihYDs9FvzpiP3Aq_5QYjxF6T.3 2024-09-19T14:03:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~EeH3zTWihYDs9FvzpiP3Aq_5QYjxF6T.4 2024-09-19T14:03:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~EeH3zTWihYDs9FvzpiP3Aq_5QYjxF6T.5 2024-09-19T14:03:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5277961859619443316', time=2024-09-19T16:02:49.674301+0000, chain.objs.size()=5 2024-09-19T14:03:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~xuvIHCDDUjKnyrqU11JuR1g7frEzE5R.1 2024-09-19T14:03:05.097 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.094+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__shadow_key1.2~xuvIHCDDUjKnyrqU11JuR1g7frEzE5R.1_1 2024-09-19T14:03:05.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.097+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~xuvIHCDDUjKnyrqU11JuR1g7frEzE5R.2 2024-09-19T14:03:05.098 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.097+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__shadow_key1.2~xuvIHCDDUjKnyrqU11JuR1g7frEzE5R.2_1 2024-09-19T14:03:05.100 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.099+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~xuvIHCDDUjKnyrqU11JuR1g7frEzE5R.3 2024-09-19T14:03:05.102 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.101+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.104 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.103+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:03:05.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.105+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.105+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.106 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.105+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.107 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.107+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:03:05.109 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.108+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.108+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.109+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.110 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.110+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:03:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.111+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.111+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14540902210803429100', time=2024-09-19T16:02:45.631192+0000, chain.objs.size()=5 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.99__multipart_key1.2~QU_H98trtHg4WMArQ9eU5tnA01s3bNF.1 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.99__multipart_key1.2~QU_H98trtHg4WMArQ9eU5tnA01s3bNF.2 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.99__multipart_key1.2~QU_H98trtHg4WMArQ9eU5tnA01s3bNF.3 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.99__multipart_key1.2~QU_H98trtHg4WMArQ9eU5tnA01s3bNF.4 2024-09-19T14:03:05.113 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.112+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.99__multipart_key1.2~QU_H98trtHg4WMArQ9eU5tnA01s3bNF.5 2024-09-19T14:03:05.115 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.114+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.117 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.116+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:03:05.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.117+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.118+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.118+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.119+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:03:05.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.120+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.121+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.122 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.121+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.122+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:03:05.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.123+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.124+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.124+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.125+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:03:05.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.126+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.128 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~9k_rSz1OjVb3xnuVvYm8pDCUOK761jk', time=2024-09-19T16:02:35.634346+0000, chain.objs.size()=5 2024-09-19T14:03:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.80__multipart_key1.2~9k_rSz1OjVb3xnuVvYm8pDCUOK761jk.1 2024-09-19T14:03:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.80__multipart_key1.2~9k_rSz1OjVb3xnuVvYm8pDCUOK761jk.2 2024-09-19T14:03:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.80__multipart_key1.2~9k_rSz1OjVb3xnuVvYm8pDCUOK761jk.3 2024-09-19T14:03:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.80__multipart_key1.2~9k_rSz1OjVb3xnuVvYm8pDCUOK761jk.4 2024-09-19T14:03:05.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.127+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.80__multipart_key1.2~9k_rSz1OjVb3xnuVvYm8pDCUOK761jk.5 2024-09-19T14:03:05.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.130+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.132+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:03:05.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.134+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.134+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.135 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.134+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.136 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.135+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:03:05.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.136+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11228360588905853036', time=2024-09-19T16:02:44.290224+0000, chain.objs.size()=5 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~KWVZTk0m89vAVXKe_qMOGYbXk-GtTlp.1 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__shadow_key1.2~KWVZTk0m89vAVXKe_qMOGYbXk-GtTlp.1_1 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~KWVZTk0m89vAVXKe_qMOGYbXk-GtTlp.2 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__shadow_key1.2~KWVZTk0m89vAVXKe_qMOGYbXk-GtTlp.2_1 2024-09-19T14:03:05.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.137+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.95__multipart_key1.2~KWVZTk0m89vAVXKe_qMOGYbXk-GtTlp.3 2024-09-19T14:03:05.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.140+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.142+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:03:05.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.143+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.144+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-19T14:03:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17002246291547267772', time=2024-09-19T16:02:44.429939+0000, chain.objs.size()=4 2024-09-19T14:03:05.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.94__shadow_.fYsDd9pwK3Zs4Ue2QeDjV3wEJu0mwx1_1 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.94__shadow_.fYsDd9pwK3Zs4Ue2QeDjV3wEJu0mwx1_2 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.94__shadow_.fYsDd9pwK3Zs4Ue2QeDjV3wEJu0mwx1_3 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.94__shadow_.fYsDd9pwK3Zs4Ue2QeDjV3wEJu0mwx1_4 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12305225509326322373', time=2024-09-19T16:02:49.083375+0000, chain.objs.size()=5 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~3D8-0frb_ieHOPrlxveJoiGTbCxJxcf.1 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~3D8-0frb_ieHOPrlxveJoiGTbCxJxcf.2 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~3D8-0frb_ieHOPrlxveJoiGTbCxJxcf.3 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~3D8-0frb_ieHOPrlxveJoiGTbCxJxcf.4 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~3D8-0frb_ieHOPrlxveJoiGTbCxJxcf.5 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.101704+0000, chain.objs.size()=126 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.1 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.2 2024-09-19T14:03:05.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.145+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.3 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.4 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.5 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.6 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.7 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.8 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.9 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.148+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.10 2024-09-19T14:03:05.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.149+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.11 2024-09-19T14:03:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.149+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.12 2024-09-19T14:03:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.149+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.13 2024-09-19T14:03:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.149+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.14 2024-09-19T14:03:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.150+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.15 2024-09-19T14:03:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.150+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.16 2024-09-19T14:03:05.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.150+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.17 2024-09-19T14:03:05.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.150+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.18 2024-09-19T14:03:05.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.150+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.19 2024-09-19T14:03:05.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.151+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.20 2024-09-19T14:03:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.151+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.21 2024-09-19T14:03:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.151+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.22 2024-09-19T14:03:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.151+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.23 2024-09-19T14:03:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.151+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.24 2024-09-19T14:03:05.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.151+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.25 2024-09-19T14:03:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.26 2024-09-19T14:03:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.27 2024-09-19T14:03:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.28 2024-09-19T14:03:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.29 2024-09-19T14:03:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.30 2024-09-19T14:03:05.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.31 2024-09-19T14:03:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.32 2024-09-19T14:03:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.153+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.33 2024-09-19T14:03:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.154+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.34 2024-09-19T14:03:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.154+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.35 2024-09-19T14:03:05.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.154+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.36 2024-09-19T14:03:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.154+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.37 2024-09-19T14:03:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.154+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.38 2024-09-19T14:03:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.155+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.39 2024-09-19T14:03:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.155+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.40 2024-09-19T14:03:05.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.155+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.41 2024-09-19T14:03:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.155+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.42 2024-09-19T14:03:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.155+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.43 2024-09-19T14:03:05.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.155+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.44 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.156+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.45 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.46 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.47 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.48 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.49 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.50 2024-09-19T14:03:05.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.51 2024-09-19T14:03:05.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.157+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.52 2024-09-19T14:03:05.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.158+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.53 2024-09-19T14:03:05.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.158+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.54 2024-09-19T14:03:05.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.158+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.55 2024-09-19T14:03:05.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.158+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.56 2024-09-19T14:03:05.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.158+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.57 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.58 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.59 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.60 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.61 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.62 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.63 2024-09-19T14:03:05.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.64 2024-09-19T14:03:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.65 2024-09-19T14:03:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.160+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.66 2024-09-19T14:03:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.161+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.67 2024-09-19T14:03:05.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.161+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.68 2024-09-19T14:03:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.69 2024-09-19T14:03:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.70 2024-09-19T14:03:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.71 2024-09-19T14:03:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.72 2024-09-19T14:03:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.73 2024-09-19T14:03:05.164 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.74 2024-09-19T14:03:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.75 2024-09-19T14:03:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.76 2024-09-19T14:03:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.77 2024-09-19T14:03:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.78 2024-09-19T14:03:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.163+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.79 2024-09-19T14:03:05.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.164+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.80 2024-09-19T14:03:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.165+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.81 2024-09-19T14:03:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.165+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.82 2024-09-19T14:03:05.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.165+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.83 2024-09-19T14:03:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.165+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.84 2024-09-19T14:03:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.165+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.85 2024-09-19T14:03:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.166+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.86 2024-09-19T14:03:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.166+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.87 2024-09-19T14:03:05.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.166+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.88 2024-09-19T14:03:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.166+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.89 2024-09-19T14:03:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.166+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.90 2024-09-19T14:03:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.166+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.91 2024-09-19T14:03:05.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.167+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.92 2024-09-19T14:03:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.167+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.93 2024-09-19T14:03:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.167+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.94 2024-09-19T14:03:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.167+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.95 2024-09-19T14:03:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.167+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.96 2024-09-19T14:03:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.168+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.97 2024-09-19T14:03:05.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.168+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.98 2024-09-19T14:03:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.168+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.99 2024-09-19T14:03:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.168+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.100 2024-09-19T14:03:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.168+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.101 2024-09-19T14:03:05.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.168+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.102 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.169+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.103 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.169+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.104 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.105 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.106 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.107 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.108 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.109 2024-09-19T14:03:05.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.110 2024-09-19T14:03:05.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.111 2024-09-19T14:03:05.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.112 2024-09-19T14:03:05.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.170+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.113 2024-09-19T14:03:05.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.171+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.114 2024-09-19T14:03:05.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.171+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.115 2024-09-19T14:03:05.172 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.116 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.117 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.118 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.119 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.120 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.121 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.122 2024-09-19T14:03:05.173 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.123 2024-09-19T14:03:05.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.172+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.124 2024-09-19T14:03:05.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.173+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.125 2024-09-19T14:03:05.174 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.173+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.126 2024-09-19T14:03:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.122711+0000, chain.objs.size()=11 2024-09-19T14:03:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.127 2024-09-19T14:03:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.128 2024-09-19T14:03:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.129 2024-09-19T14:03:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.130 2024-09-19T14:03:05.175 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.131 2024-09-19T14:03:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.132 2024-09-19T14:03:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.133 2024-09-19T14:03:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.134 2024-09-19T14:03:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.135 2024-09-19T14:03:05.176 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.174+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.136 2024-09-19T14:03:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.137 2024-09-19T14:03:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.136716+0000, chain.objs.size()=4 2024-09-19T14:03:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.138 2024-09-19T14:03:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.139 2024-09-19T14:03:05.177 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.140 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.141 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.159857+0000, chain.objs.size()=8 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.176+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.142 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.177+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.143 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.177+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.144 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.177+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.145 2024-09-19T14:03:05.178 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.177+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.146 2024-09-19T14:03:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.178+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.147 2024-09-19T14:03:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.178+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.148 2024-09-19T14:03:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.178+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.149 2024-09-19T14:03:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.178+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.190724+0000, chain.objs.size()=12 2024-09-19T14:03:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.178+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.150 2024-09-19T14:03:05.179 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.178+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.151 2024-09-19T14:03:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.152 2024-09-19T14:03:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.153 2024-09-19T14:03:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.154 2024-09-19T14:03:05.180 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.155 2024-09-19T14:03:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.156 2024-09-19T14:03:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.157 2024-09-19T14:03:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.158 2024-09-19T14:03:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.159 2024-09-19T14:03:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.160 2024-09-19T14:03:05.181 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.161 2024-09-19T14:03:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.209621+0000, chain.objs.size()=7 2024-09-19T14:03:05.182 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.179+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.162 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.163 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.164 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.166 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.167 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.168 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.169 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.234350+0000, chain.objs.size()=8 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.165 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.170 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.171 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.173 2024-09-19T14:03:05.183 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.181+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.174 2024-09-19T14:03:05.184 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.182+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.175 2024-09-19T14:03:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.176 2024-09-19T14:03:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.178 2024-09-19T14:03:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.257564+0000, chain.objs.size()=8 2024-09-19T14:03:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.172 2024-09-19T14:03:05.185 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.177 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.179 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.180 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.181 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.182 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.183 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.184 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.287705+0000, chain.objs.size()=10 2024-09-19T14:03:05.186 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.184+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.185 2024-09-19T14:03:05.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.185+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.186 2024-09-19T14:03:05.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.186+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.187 2024-09-19T14:03:05.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.186+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.188 2024-09-19T14:03:05.187 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.186+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.189 2024-09-19T14:03:05.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.190 2024-09-19T14:03:05.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.191 2024-09-19T14:03:05.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.192 2024-09-19T14:03:05.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.193 2024-09-19T14:03:05.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.194 2024-09-19T14:03:05.188 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.312994+0000, chain.objs.size()=10 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.195 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.196 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.197 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.187+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.198 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.188+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.199 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.188+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.200 2024-09-19T14:03:05.189 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.188+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.201 2024-09-19T14:03:05.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.202 2024-09-19T14:03:05.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.203 2024-09-19T14:03:05.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.204 2024-09-19T14:03:05.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.330752+0000, chain.objs.size()=7 2024-09-19T14:03:05.190 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.205 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.206 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.207 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.208 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.209 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.210 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.189+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.211 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.190+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv', time=2024-09-19T16:02:53.342555+0000, chain.objs.size()=1 2024-09-19T14:03:05.191 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.190+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.106__multipart_key1.2~ERRZhdN1om48neFZYK9C6xRe7rXxUkv.212 2024-09-19T14:03:05.193 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.192+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.195 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.194+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:03:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.195+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.196 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.195+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.196+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.197 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.197+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:03:05.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.198+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.199 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.198+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:03:05.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14415264612363371028', time=2024-09-19T16:02:49.980379+0000, chain.objs.size()=5 2024-09-19T14:03:05.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~iVOZ40qLldKaLAGvlB7bm8NyYWNP1Xj.1 2024-09-19T14:03:05.200 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__shadow_key1.2~iVOZ40qLldKaLAGvlB7bm8NyYWNP1Xj.1_1 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~iVOZ40qLldKaLAGvlB7bm8NyYWNP1Xj.2 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__shadow_key1.2~iVOZ40qLldKaLAGvlB7bm8NyYWNP1Xj.2_1 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.103__multipart_key1.2~iVOZ40qLldKaLAGvlB7bm8NyYWNP1Xj.3 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14069827318864663526', time=2024-09-19T16:02:52.297645+0000, chain.objs.size()=5 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.105__multipart_key1.2~I8i0_xuFfB6p7MR_3pBm_B_r3GD-jJ2.1 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.105__multipart_key1.2~I8i0_xuFfB6p7MR_3pBm_B_r3GD-jJ2.2 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.105__multipart_key1.2~I8i0_xuFfB6p7MR_3pBm_B_r3GD-jJ2.3 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.105__multipart_key1.2~I8i0_xuFfB6p7MR_3pBm_B_r3GD-jJ2.4 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.105__multipart_key1.2~I8i0_xuFfB6p7MR_3pBm_B_r3GD-jJ2.5 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16249978918645731970', time=2024-09-19T16:03:04.464463+0000, chain.objs.size()=5 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.145__multipart_key1/data/file.mpg.2~PAHof3Z5TXFRLJG8c94FP6GzqLUz9PE.1 2024-09-19T14:03:05.201 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.199+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.145__multipart_key1/data/file.mpg.2~PAHof3Z5TXFRLJG8c94FP6GzqLUz9PE.2 2024-09-19T14:03:05.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.202+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.145__multipart_key1/data/file.mpg.2~PAHof3Z5TXFRLJG8c94FP6GzqLUz9PE.3 2024-09-19T14:03:05.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.202+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.145__multipart_key1/data/file.mpg.2~PAHof3Z5TXFRLJG8c94FP6GzqLUz9PE.4 2024-09-19T14:03:05.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.203+0000 7fabec540800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.145__multipart_key1/data/file.mpg.2~PAHof3Z5TXFRLJG8c94FP6GzqLUz9PE.5 2024-09-19T14:03:05.206 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.205+0000 7fabec540800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:03:05.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.207+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:03:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.208+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.209+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.209+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.211 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.210+0000 7fabec540800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:03:05.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.211+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.212 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.211+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.213 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.212+0000 7fabec540800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.213+0000 7faa9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:05.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.215+0000 7fabec540800 20 remove_watcher() i=0 2024-09-19T14:03:05.216 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.215+0000 7fabec540800 2 removed watcher, disabling cache 2024-09-19T14:03:05.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.216+0000 7fabec540800 20 remove_watcher() i=1 2024-09-19T14:03:05.218 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.217+0000 7fabec540800 20 remove_watcher() i=2 2024-09-19T14:03:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.218+0000 7fabec540800 20 remove_watcher() i=3 2024-09-19T14:03:05.219 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.219+0000 7fabec540800 20 remove_watcher() i=4 2024-09-19T14:03:05.220 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.220+0000 7fabec540800 20 remove_watcher() i=5 2024-09-19T14:03:05.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.221+0000 7fabec540800 20 remove_watcher() i=6 2024-09-19T14:03:05.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.221+0000 7fabec540800 20 remove_watcher() i=7 2024-09-19T14:03:05.233 DEBUG:teuthology.orchestra.run.smithi094:> radosgw-admin gc process --include-all 2024-09-19T14:03:05.286 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:05.286 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:05.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.321+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.322+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.322+0000 7f3808fad800 20 realm 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.322+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.322+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.322+0000 7f3808fad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.322+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.323+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.323+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.323+0000 7f3808fad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:05.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.323+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.324+0000 7f3808fad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:05.325 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.324+0000 7f3808fad800 20 searching for the correct realm 2024-09-19T14:03:05.328 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.327+0000 7f37fffff640 0 -- 172.21.15.94:0/3780827947 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x5601d5e14910 msgr2=0x5601d5e16dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:05.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.331+0000 7f3806a97640 0 -- 172.21.15.94:0/3780827947 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f37f006e900 msgr2=0x7f37f0072870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:05.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.335+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:05.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 zone default found 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 4 Realm: () 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 zonegroup default 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.336+0000 7f3808fad800 20 rados->read ofs=0 len=0 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.337+0000 7f3808fad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.337+0000 7f3808fad800 20 started sync module instance, tier type = 2024-09-19T14:03:05.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.337+0000 7f3808fad800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=0 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=1 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=2 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=3 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=4 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=5 2024-09-19T14:03:05.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.345+0000 7f3808fad800 20 add_watcher() i=6 2024-09-19T14:03:05.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.346+0000 7f3808fad800 20 add_watcher() i=7 2024-09-19T14:03:05.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.346+0000 7f3808fad800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:05.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.347+0000 7f36bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:05.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.348+0000 7f3808fad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:05.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.348+0000 7f3808fad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.380+0000 7f36bcfe1640 20 reqs_thread_entry: start 2024-09-19T14:03:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.381+0000 7f3808fad800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.381+0000 7f3808fad800 20 Filter name: none 2024-09-19T14:03:05.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.381+0000 7f36b5ffb640 20 reqs_thread_entry: start 2024-09-19T14:03:05.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.381+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:03:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.382+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.382+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.384 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.383+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.384+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:03:05.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.385+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.386 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.385+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.386+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.387+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:03:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.388+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.388+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.389+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.390+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:03:05.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.391+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.391+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.392+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.393+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:03:05.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.394+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.395 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.395+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.395+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.397+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:03:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.399+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.399+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.400+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.401+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:03:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.402+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.402+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.402+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.404+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:03:05.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.405+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.405+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.406+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.406+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:03:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.408+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.408+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.409 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.408+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.409+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:03:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.411+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.411+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.412 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.411+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.413 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.412+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:03:05.414 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.414+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.414+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.415 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.414+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.416 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.415+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:03:05.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.416+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.417+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.417+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.418+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:03:05.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.419+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.420+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.420+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.421+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:03:05.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.422+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.422+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.423+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.424+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:03:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.425+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.425+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.426+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.426+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:03:05.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.428+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.428+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.429+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.430+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:03:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.431+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.431+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.431+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.433+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:03:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.434+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.434+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.435+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.435+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:03:05.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.437+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.437+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.438 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.437+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.438+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:03:05.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.440+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.440+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.441+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.442+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:03:05.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.443+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.444 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.443+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.444+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.445+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:03:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.446+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.446+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.447 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.447+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.447+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:03:05.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.449+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.449+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.450+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.451+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:03:05.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.452+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.452+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.453+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.454+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:03:05.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.455+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.455+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.456+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.456+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:03:05.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.458+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.458+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.458+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.459+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:03:05.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.460+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.462 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.461+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.462+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.463+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:03:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.464+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.464+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.464+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.466+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:03:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.467+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.468 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.467+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.468+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.469+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:03:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.470+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.471+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.471+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.472+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:03:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.474+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.474+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.474+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.476+0000 7f3808fad800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:03:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.477+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.478+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:03:05.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.478+0000 7f3808fad800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:03:05.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.480+0000 7f36bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.482+0000 7f3808fad800 20 remove_watcher() i=0 2024-09-19T14:03:05.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.482+0000 7f3808fad800 2 removed watcher, disabling cache 2024-09-19T14:03:05.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.483+0000 7f3808fad800 20 remove_watcher() i=1 2024-09-19T14:03:05.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.484+0000 7f3808fad800 20 remove_watcher() i=2 2024-09-19T14:03:05.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.485+0000 7f3808fad800 20 remove_watcher() i=3 2024-09-19T14:03:05.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.486+0000 7f3808fad800 20 remove_watcher() i=4 2024-09-19T14:03:05.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.487+0000 7f3808fad800 20 remove_watcher() i=5 2024-09-19T14:03:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.488+0000 7f3808fad800 20 remove_watcher() i=6 2024-09-19T14:03:05.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:05.489+0000 7f3808fad800 20 remove_watcher() i=7 2024-09-19T14:03:05.501 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-19T14:03:05.533 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-19T14:03:05.533 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-19T14:03:05.533 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-19T14:03:05.534 DEBUG:teuthology.orchestra.run.smithi094:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-19T14:03:05.562 INFO:teuthology.orchestra.run.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-19T14:03:06.511 INFO:tasks.s3tests:Creating rgw users... 2024-09-19T14:03:06.512 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-19T14:03:06.512 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key GEGVNERMDUMVUDMJFJRC --secret YmLINrYpn7zUyS0cNNLRljCF9liNrxerLxBIdwhj5x/X/ow4P8vxaA== --cluster ceph 2024-09-19T14:03:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:06.616 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:06.697 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.696+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.697+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.697+0000 7fec98146800 20 realm 2024-09-19T14:03:06.698 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.697+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.697+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.697+0000 7fec98146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.697+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.698+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.698+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.699 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.698+0000 7fec98146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:06.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.698+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.699+0000 7fec98146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:06.700 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.699+0000 7fec98146800 20 searching for the correct realm 2024-09-19T14:03:06.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.702+0000 7fec96438640 0 -- 172.21.15.94:0/687238395 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fec80040060 msgr2=0x7fec8006b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:06.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.706+0000 7fec95c37640 0 -- 172.21.15.94:0/687238395 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fec80075f80 msgr2=0x7fec8008d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:06.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:06.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:06.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:06.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:06.915 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:06.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:06.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.916 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:06.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.914+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:06.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 zone default found 2024-09-19T14:03:06.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 4 Realm: () 2024-09-19T14:03:06.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 zonegroup default 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.915+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.916+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.916+0000 7fec98146800 20 started sync module instance, tier type = 2024-09-19T14:03:06.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.916+0000 7fec98146800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=0 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=1 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=2 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=3 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=4 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=5 2024-09-19T14:03:06.926 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.925+0000 7fec98146800 20 add_watcher() i=6 2024-09-19T14:03:06.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.926+0000 7fec98146800 20 add_watcher() i=7 2024-09-19T14:03:06.927 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.926+0000 7fec98146800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:06.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.927+0000 7feb477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:06.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:06.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:06.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 5 note: GC not initialized 2024-09-19T14:03:06.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7feb467fc640 20 reqs_thread_entry: start 2024-09-19T14:03:06.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 Filter name: none 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7feab7fff640 20 reqs_thread_entry: start 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.928+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 cache get: name=default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC : miss 2024-09-19T14:03:06.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 20 rados->read ofs=0 len=0 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 cache put: name=default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC info.flags=0x0 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 adding default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC to cache LRU end 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 cache get: name=default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC : hit (negative entry) 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.929+0000 7fec98146800 10 cache get: name=default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC : hit (negative entry) 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.930+0000 7fec98146800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:03:06.932 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.930+0000 7fec98146800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:03:06.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.930+0000 7fec98146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-19T14:03:06.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.930+0000 7feb797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595297 cookie 94038927313424 notifier 8444 bl.length()=645 2024-09-19T14:03:06.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.931+0000 7feb797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:03:06.933 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.931+0000 7feb797fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:03:06.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.932+0000 7fec98146800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-19T14:03:06.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.932+0000 7fec98146800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-19T14:03:06.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.932+0000 7fec98146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-19T14:03:06.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.933+0000 7feb797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595298 cookie 94038927330960 notifier 8444 bl.length()=185 2024-09-19T14:03:06.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.933+0000 7feb797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-19T14:03:06.934 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.933+0000 7feb797fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-19T14:03:06.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.934+0000 7fec98146800 10 cache put: name=default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC info.flags=0x7 2024-09-19T14:03:06.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.934+0000 7fec98146800 10 moving default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC to cache LRU end 2024-09-19T14:03:06.935 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.934+0000 7fec98146800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:GEGVNERMDUMVUDMJFJRC, ofs0, ns] 2024-09-19T14:03:06.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.935+0000 7feb797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595221 cookie 94038927322240 notifier 8444 bl.length()=186 2024-09-19T14:03:06.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.935+0000 7feb797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC info.flags=0x7 2024-09-19T14:03:06.936 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.935+0000 7feb797fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GEGVNERMDUMVUDMJFJRC to cache LRU end 2024-09-19T14:03:06.936 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:06.936 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foo.client.0", 2024-09-19T14:03:06.936 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foo.client.0", 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foo+test@test.test", 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foo.client.0", 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "GEGVNERMDUMVUDMJFJRC", 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "YmLINrYpn7zUyS0cNNLRljCF9liNrxerLxBIdwhj5x/X/ow4P8vxaA==", 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:06.929840Z" 2024-09-19T14:03:06.937 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:06.938 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:06.939 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:06.929827Z", 2024-09-19T14:03:06.940 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:06.940 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:06.940 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:06.940 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:06.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.936+0000 7feb477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:06.940 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.938+0000 7fec98146800 20 remove_watcher() i=0 2024-09-19T14:03:06.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.938+0000 7fec98146800 2 removed watcher, disabling cache 2024-09-19T14:03:06.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.940+0000 7fec98146800 20 remove_watcher() i=1 2024-09-19T14:03:06.941 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.941+0000 7fec98146800 20 remove_watcher() i=2 2024-09-19T14:03:06.943 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.942+0000 7fec98146800 20 remove_watcher() i=3 2024-09-19T14:03:06.944 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.943+0000 7fec98146800 20 remove_watcher() i=4 2024-09-19T14:03:06.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.944+0000 7fec98146800 20 remove_watcher() i=5 2024-09-19T14:03:06.945 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.945+0000 7fec98146800 20 remove_watcher() i=6 2024-09-19T14:03:06.946 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:06.945+0000 7fec98146800 20 remove_watcher() i=7 2024-09-19T14:03:06.957 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5192061251 --totp-seed YE2YBJL5CQ46QLHRSNUY7VZCVBFHE5ZYLGN6E3TJCBJ5C32JMA6EM2UCJCEJBRJE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:03:07.023 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:07.023 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:07.056 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.055+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.056+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.056+0000 7feffe935800 20 realm 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.057+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.057+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.057+0000 7feffe935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.057+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.057+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.058 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.057+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.058+0000 7feffe935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:07.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.058+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.058+0000 7feffe935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:07.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.058+0000 7feffe935800 20 searching for the correct realm 2024-09-19T14:03:07.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.060+0000 7feff3fff640 0 -- 172.21.15.94:0/2927539958 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fefec093040 msgr2=0x7fefec061d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:07.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.267+0000 7feffa67d640 0 -- 172.21.15.94:0/2927539958 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fefe4095930 msgr2=0x7fefe4064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.473+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:07.476 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 zone default found 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 4 Realm: () 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 zonegroup default 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.474+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:07.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 started sync module instance, tier type = 2024-09-19T14:03:07.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.475+0000 7feffe935800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:07.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=0 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=1 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=2 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=3 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=4 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=5 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=6 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 20 add_watcher() i=7 2024-09-19T14:03:07.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.485+0000 7feffe935800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:07.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.487+0000 7feeb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:07.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.487+0000 7feffe935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:07.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.487+0000 7feffe935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:07.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.487+0000 7feffe935800 5 note: GC not initialized 2024-09-19T14:03:07.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7fee2b7fe640 20 reqs_thread_entry: start 2024-09-19T14:03:07.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:07.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 20 Filter name: none 2024-09-19T14:03:07.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7fee297fa640 20 reqs_thread_entry: start 2024-09-19T14:03:07.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-19T14:03:07.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 20 rados->read ofs=0 len=0 2024-09-19T14:03:07.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T14:03:07.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-19T14:03:07.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:03:07.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:07.488+0000 7feffe935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:08.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.843+0000 7feffe935800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:03:08.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.843+0000 7feffe935800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:03:08.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.843+0000 7feffe935800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-19T14:03:08.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.843+0000 7feedd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529891 cookie 94544551081360 notifier 8462 bl.length()=659 2024-09-19T14:03:08.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.843+0000 7feedd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:03:08.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.843+0000 7feedd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:03:08.846 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.845+0000 7feeb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:08.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.847+0000 7feffe935800 20 remove_watcher() i=0 2024-09-19T14:03:08.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.847+0000 7feffe935800 2 removed watcher, disabling cache 2024-09-19T14:03:08.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.849+0000 7feffe935800 20 remove_watcher() i=1 2024-09-19T14:03:08.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.850+0000 7feffe935800 20 remove_watcher() i=2 2024-09-19T14:03:08.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.851+0000 7feffe935800 20 remove_watcher() i=3 2024-09-19T14:03:08.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.852+0000 7feffe935800 20 remove_watcher() i=4 2024-09-19T14:03:08.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.853+0000 7feffe935800 20 remove_watcher() i=5 2024-09-19T14:03:08.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.854+0000 7feffe935800 20 remove_watcher() i=6 2024-09-19T14:03:08.856 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.855+0000 7feffe935800 20 remove_watcher() i=7 2024-09-19T14:03:08.867 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-19T14:03:08.868 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key IYESXKAVTCMROWJXEKKO --secret wdp4glKRWG01jM+Wewsor6z0LbhDqwA1e+OVQZNZ8DVJxECcw9cZ/w== --cluster ceph 2024-09-19T14:03:08.932 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:08.933 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:08.966 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.965+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 realm 2024-09-19T14:03:08.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:08.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.967+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.969 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.968+0000 7f8409d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:08.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.968+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.968+0000 7f8409d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:08.970 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.968+0000 7f8409d25800 20 searching for the correct realm 2024-09-19T14:03:08.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.970+0000 7f8405aa2640 0 -- 172.21.15.94:0/4004503337 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f8400070890 msgr2=0x7f840006f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:08.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.974+0000 7f84062a3640 0 -- 172.21.15.94:0/4004503337 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f83f001e040 msgr2=0x7f83f001e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:08.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.979+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:08.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 zone default found 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 4 Realm: () 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 zonegroup default 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.980+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.981+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.981+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.981+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.981+0000 7f8409d25800 20 started sync module instance, tier type = 2024-09-19T14:03:08.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.981+0000 7f8409d25800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=0 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=1 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=2 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=3 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=4 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=5 2024-09-19T14:03:08.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.990+0000 7f8409d25800 20 add_watcher() i=6 2024-09-19T14:03:08.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.991+0000 7f8409d25800 20 add_watcher() i=7 2024-09-19T14:03:08.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.991+0000 7f8409d25800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f82b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 5 note: GC not initialized 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f82b27fc640 20 reqs_thread_entry: start 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 20 Filter name: none 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8223fff640 20 reqs_thread_entry: start 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.993+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-19T14:03:08.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache get: name=default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO : miss 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache put: name=default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO info.flags=0x0 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 adding default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO to cache LRU end 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache get: name=default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO : hit (negative entry) 2024-09-19T14:03:08.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.994+0000 7f8409d25800 10 cache get: name=default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO : hit (negative entry) 2024-09-19T14:03:08.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.996+0000 7f8409d25800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:03:08.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.996+0000 7f8409d25800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:03:08.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.996+0000 7f8409d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-19T14:03:08.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.996+0000 7f82e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529814 cookie 94122531125136 notifier 9021 bl.length()=645 2024-09-19T14:03:08.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.996+0000 7f82e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:03:08.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.996+0000 7f82e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:03:08.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.998+0000 7f8409d25800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-19T14:03:08.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.998+0000 7f8409d25800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-19T14:03:08.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.998+0000 7f8409d25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-19T14:03:08.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.998+0000 7f82e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529818 cookie 94122531135568 notifier 9021 bl.length()=185 2024-09-19T14:03:08.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.998+0000 7f82e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-19T14:03:08.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:08.998+0000 7f82e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-19T14:03:09.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.000+0000 7f8409d25800 10 cache put: name=default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO info.flags=0x7 2024-09-19T14:03:09.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.000+0000 7f8409d25800 10 moving default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO to cache LRU end 2024-09-19T14:03:09.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.000+0000 7f8409d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:IYESXKAVTCMROWJXEKKO, ofs0, ns] 2024-09-19T14:03:09.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.000+0000 7f82e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529815 cookie 94122531125136 notifier 9021 bl.length()=186 2024-09-19T14:03:09.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.000+0000 7f82e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO info.flags=0x7 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.000+0000 7f82e17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IYESXKAVTCMROWJXEKKO to cache LRU end 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "bar.client.0", 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.bar.client.0", 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "bar+test@test.test", 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:09.002 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "bar.client.0", 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "IYESXKAVTCMROWJXEKKO", 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "wdp4glKRWG01jM+Wewsor6z0LbhDqwA1e+OVQZNZ8DVJxECcw9cZ/w==", 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:08.995101Z" 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:09.003 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:09.004 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:08.995091Z", 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:09.005 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:09.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.002+0000 7f82b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.004+0000 7f8409d25800 20 remove_watcher() i=0 2024-09-19T14:03:09.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.004+0000 7f8409d25800 2 removed watcher, disabling cache 2024-09-19T14:03:09.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.005+0000 7f8409d25800 20 remove_watcher() i=1 2024-09-19T14:03:09.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.006+0000 7f8409d25800 20 remove_watcher() i=2 2024-09-19T14:03:09.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.007+0000 7f8409d25800 20 remove_watcher() i=3 2024-09-19T14:03:09.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.008+0000 7f8409d25800 20 remove_watcher() i=4 2024-09-19T14:03:09.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.009+0000 7f8409d25800 20 remove_watcher() i=5 2024-09-19T14:03:09.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.010+0000 7f8409d25800 20 remove_watcher() i=6 2024-09-19T14:03:09.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.011+0000 7f8409d25800 20 remove_watcher() i=7 2024-09-19T14:03:09.022 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 1230619312 --totp-seed FUGYJ6MLBMARA7QMEXFV5V7ADHELS5XJG5DMUCFAYIVOYWDLEF2BDHNNVLZ7X5IB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:03:09.088 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:09.088 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:09.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.120+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 realm 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.123 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.122+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.123+0000 7f24b5240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.123+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.123+0000 7f24b5240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:09.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.123+0000 7f24b5240800 20 searching for the correct realm 2024-09-19T14:03:09.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.126+0000 7f24b352b640 0 -- 172.21.15.94:0/4288676782 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f24a801b040 msgr2=0x7f24a8069420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.129+0000 7f24b2d2a640 0 -- 172.21.15.94:0/4288676782 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f24a8073ba0 msgr2=0x7f24a806b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:09.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.337 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.335+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 zone default found 2024-09-19T14:03:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 4 Realm: () 2024-09-19T14:03:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:09.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 zonegroup default 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.336+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.337+0000 7f24b5240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.337+0000 7f24b5240800 20 started sync module instance, tier type = 2024-09-19T14:03:09.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.337+0000 7f24b5240800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:09.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=0 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=1 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=2 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=3 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=4 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=5 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.345+0000 7f24b5240800 20 add_watcher() i=6 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.346+0000 7f24b5240800 20 add_watcher() i=7 2024-09-19T14:03:09.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.346+0000 7f24b5240800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:09.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f23697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f24b5240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f24b5240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f24b5240800 5 note: GC not initialized 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f22e3fff640 20 reqs_thread_entry: start 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f24b5240800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.348+0000 7f24b5240800 20 Filter name: none 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f22e1ffb640 20 reqs_thread_entry: start 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f24b5240800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-19T14:03:09.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f24b5240800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f24b5240800 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T14:03:09.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f24b5240800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-19T14:03:09.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f24b5240800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:03:09.351 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.349+0000 7f24b5240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.352+0000 7f24b5240800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:03:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.352+0000 7f24b5240800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:03:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.352+0000 7f24b5240800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-19T14:03:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.352+0000 7f23967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529816 cookie 93848663560880 notifier 8498 bl.length()=659 2024-09-19T14:03:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.352+0000 7f23967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:03:09.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.352+0000 7f23967fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:03:09.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.354+0000 7f23697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.356+0000 7f24b5240800 20 remove_watcher() i=0 2024-09-19T14:03:09.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.356+0000 7f24b5240800 2 removed watcher, disabling cache 2024-09-19T14:03:09.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.357+0000 7f24b5240800 20 remove_watcher() i=1 2024-09-19T14:03:09.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.358+0000 7f24b5240800 20 remove_watcher() i=2 2024-09-19T14:03:09.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.359+0000 7f24b5240800 20 remove_watcher() i=3 2024-09-19T14:03:09.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.359+0000 7f24b5240800 20 remove_watcher() i=4 2024-09-19T14:03:09.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.360+0000 7f24b5240800 20 remove_watcher() i=5 2024-09-19T14:03:09.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.361+0000 7f24b5240800 20 remove_watcher() i=6 2024-09-19T14:03:09.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.362+0000 7f24b5240800 20 remove_watcher() i=7 2024-09-19T14:03:09.374 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-19T14:03:09.436 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:09.436 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:09.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.468+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 realm 2024-09-19T14:03:09.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:09.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.470+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.471+0000 7efe19144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.471+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.471+0000 7efe19144800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:09.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.471+0000 7efe19144800 20 searching for the correct realm 2024-09-19T14:03:09.475 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.475+0000 7efe1642d640 0 -- 172.21.15.94:0/588756393 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x55c030d18940 msgr2=0x55c030d1ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.478+0000 7efe16c2e640 0 -- 172.21.15.94:0/588756393 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7efe00021950 msgr2=0x7efe00008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.482+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 zone default found 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 4 Realm: () 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 zonegroup default 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.483+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.484+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.484+0000 7efe19144800 20 started sync module instance, tier type = 2024-09-19T14:03:09.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.484+0000 7efe19144800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=0 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=1 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=2 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=3 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=4 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=5 2024-09-19T14:03:09.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.492+0000 7efe19144800 20 add_watcher() i=6 2024-09-19T14:03:09.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.493+0000 7efe19144800 20 add_watcher() i=7 2024-09-19T14:03:09.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.493+0000 7efe19144800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.494+0000 7efccd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.494+0000 7efe19144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.494+0000 7efe19144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.494+0000 7efe19144800 5 note: GC not initialized 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efc47fff640 20 reqs_thread_entry: start 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 20 Filter name: none 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efc45ffb640 20 reqs_thread_entry: start 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-19T14:03:09.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.495+0000 7efe19144800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.496+0000 7efe19144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.496+0000 7efe19144800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.496+0000 7efe19144800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.496+0000 7efe19144800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.497+0000 7efe19144800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-19T14:03:09.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.497+0000 7efe19144800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-19T14:03:09.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.497+0000 7efe19144800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-19T14:03:09.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.497+0000 7efcfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529817 cookie 94283941127264 notifier 8513 bl.length()=389 2024-09-19T14:03:09.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.497+0000 7efcfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-19T14:03:09.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.497+0000 7efcfa7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-19T14:03:09.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.499+0000 7efe19144800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-19T14:03:09.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.499+0000 7efe19144800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-19T14:03:09.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.499+0000 7efe19144800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-19T14:03:09.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.499+0000 7efcfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529892 cookie 94283941134336 notifier 8513 bl.length()=230 2024-09-19T14:03:09.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.499+0000 7efcfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-19T14:03:09.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.499+0000 7efcfa7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-19T14:03:09.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.501+0000 7efe19144800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-19T14:03:09.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.501+0000 7efe19144800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-19T14:03:09.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.501+0000 7efe19144800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-19T14:03:09.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.501+0000 7efcfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529768 cookie 94283941140016 notifier 8513 bl.length()=234 2024-09-19T14:03:09.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.501+0000 7efcfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-19T14:03:09.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.501+0000 7efcfa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-19T14:03:09.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.502+0000 7efccd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.504+0000 7efe19144800 20 remove_watcher() i=0 2024-09-19T14:03:09.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.504+0000 7efe19144800 2 removed watcher, disabling cache 2024-09-19T14:03:09.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.505+0000 7efe19144800 20 remove_watcher() i=1 2024-09-19T14:03:09.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.506+0000 7efe19144800 20 remove_watcher() i=2 2024-09-19T14:03:09.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.507+0000 7efe19144800 20 remove_watcher() i=3 2024-09-19T14:03:09.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.508+0000 7efe19144800 20 remove_watcher() i=4 2024-09-19T14:03:09.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.509+0000 7efe19144800 20 remove_watcher() i=5 2024-09-19T14:03:09.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.510+0000 7efe19144800 20 remove_watcher() i=6 2024-09-19T14:03:09.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.511+0000 7efe19144800 20 remove_watcher() i=7 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW33333333333333333", 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "testx", 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW33333333333333333", 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:09.521 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:09.522 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-19T14:03:09.523 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:09.523 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-19T14:03:09.524 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key HUXBMKVYEFICXINHZCFI --secret ZfTb38Qf63g6CPF2KxLfgJogq9EoVjVnqBx/OO9zjodOM6sTNc24pg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-19T14:03:09.590 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:09.590 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:09.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.622+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.623+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.623+0000 7f7495b40800 20 realm 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.623+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.624+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.624+0000 7f7495b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.624+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.624+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.624+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.625+0000 7f7495b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.625+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.625+0000 7f7495b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:09.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.625+0000 7f7495b40800 20 searching for the correct realm 2024-09-19T14:03:09.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.628+0000 7f74920c1640 0 -- 172.21.15.94:0/2212406929 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x563be4db2840 msgr2=0x563be4db4d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.632+0000 7f74890bf640 0 -- 172.21.15.94:0/2212406929 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f748401a040 msgr2=0x7f748406a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:09.637 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:09.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.638 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.636+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 zone default found 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 4 Realm: () 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:09.639 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 zonegroup default 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.637+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.638+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.638+0000 7f7495b40800 20 started sync module instance, tier type = 2024-09-19T14:03:09.640 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.638+0000 7f7495b40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=0 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=1 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=2 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=3 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=4 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=5 2024-09-19T14:03:09.647 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.646+0000 7f7495b40800 20 add_watcher() i=6 2024-09-19T14:03:09.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.647+0000 7f7495b40800 20 add_watcher() i=7 2024-09-19T14:03:09.648 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.647+0000 7f7495b40800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.648+0000 7f73437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.648+0000 7f7495b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:09.650 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.648+0000 7f7495b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.648+0000 7f7495b40800 5 note: GC not initialized 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f73427fc640 20 reqs_thread_entry: start 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 Filter name: none 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f72b3fff640 20 reqs_thread_entry: start 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-19T14:03:09.651 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-19T14:03:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 10 cache get: name=default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI : miss 2024-09-19T14:03:09.652 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.649+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 cache put: name=default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI info.flags=0x0 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 adding default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI to cache LRU end 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-19T14:03:09.653 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 cache get: name=default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI : hit (negative entry) 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.650+0000 7f7495b40800 10 cache get: name=default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI : hit (negative entry) 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.652+0000 7f7495b40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.652+0000 7f7495b40800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.652+0000 7f7495b40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.652+0000 7f73757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529819 cookie 94815242689968 notifier 8528 bl.length()=732 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.652+0000 7f73757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:03:09.654 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.652+0000 7f73757fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:03:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.654+0000 7f7495b40800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-19T14:03:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.654+0000 7f7495b40800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-19T14:03:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.654+0000 7f7495b40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-19T14:03:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.654+0000 7f73757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529785 cookie 94815242686256 notifier 8528 bl.length()=215 2024-09-19T14:03:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.654+0000 7f73757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-19T14:03:09.655 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.654+0000 7f73757fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-19T14:03:09.656 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.655+0000 7f7495b40800 10 cache put: name=default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI info.flags=0x7 2024-09-19T14:03:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.655+0000 7f7495b40800 10 moving default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI to cache LRU end 2024-09-19T14:03:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.655+0000 7f7495b40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:HUXBMKVYEFICXINHZCFI, ofs0, ns] 2024-09-19T14:03:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.656+0000 7f7374ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529786 cookie 94815242686256 notifier 8528 bl.length()=201 2024-09-19T14:03:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.656+0000 7f7374ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI info.flags=0x7 2024-09-19T14:03:09.657 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.656+0000 7f7374ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HUXBMKVYEFICXINHZCFI to cache LRU end 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.657+0000 7f7495b40800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:09.658 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "testx$tenanteduser.client.0", 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "HUXBMKVYEFICXINHZCFI", 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "ZfTb38Qf63g6CPF2KxLfgJogq9EoVjVnqBx/OO9zjodOM6sTNc24pg==", 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:09.651189Z" 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:09.659 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:09.660 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW33333333333333333", 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:09.651179Z", 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:09.661 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:09.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.658+0000 7f73437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:09.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.660+0000 7f7495b40800 20 remove_watcher() i=0 2024-09-19T14:03:09.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.660+0000 7f7495b40800 2 removed watcher, disabling cache 2024-09-19T14:03:09.662 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.661+0000 7f7495b40800 20 remove_watcher() i=1 2024-09-19T14:03:09.663 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.662+0000 7f7495b40800 20 remove_watcher() i=2 2024-09-19T14:03:09.664 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.663+0000 7f7495b40800 20 remove_watcher() i=3 2024-09-19T14:03:09.665 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.664+0000 7f7495b40800 20 remove_watcher() i=4 2024-09-19T14:03:09.666 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.665+0000 7f7495b40800 20 remove_watcher() i=5 2024-09-19T14:03:09.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.666+0000 7f7495b40800 20 remove_watcher() i=6 2024-09-19T14:03:09.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.667+0000 7f7495b40800 20 remove_watcher() i=7 2024-09-19T14:03:09.679 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 6858484165 --totp-seed IFFKLBPH5L3MV5F3E3UTN2B42RPFZ3ISIXTZLQP7MKQ4PIV6KRW7J6KOBJTIR2NW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:03:09.744 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:09.744 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:09.778 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.777+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 realm 2024-09-19T14:03:09.779 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:09.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.780 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.778+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.779+0000 7f348d51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.779+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.779+0000 7f348d51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:09.781 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.779+0000 7f348d51f800 20 searching for the correct realm 2024-09-19T14:03:09.782 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.781+0000 7f348918b640 0 -- 172.21.15.94:0/2783035523 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f3478003cb0 msgr2=0x7f3484061440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.987+0000 7f348918b640 0 -- 172.21.15.94:0/2783035523 >> [v2:172.21.15.94:6800/943812970,v1:172.21.15.94:6801/943812970] conn(0x7f3478003cb0 msgr2=0x7f3484061440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:09.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.992+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 zone default found 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 4 Realm: () 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 zonegroup default 2024-09-19T14:03:09.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.993+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.994+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.994+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.994+0000 7f348d51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.994+0000 7f348d51f800 20 started sync module instance, tier type = 2024-09-19T14:03:09.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:09.994+0000 7f348d51f800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=0 2024-09-19T14:03:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=1 2024-09-19T14:03:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=2 2024-09-19T14:03:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=3 2024-09-19T14:03:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=4 2024-09-19T14:03:10.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=5 2024-09-19T14:03:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.002+0000 7f348d51f800 20 add_watcher() i=6 2024-09-19T14:03:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.003+0000 7f348d51f800 20 add_watcher() i=7 2024-09-19T14:03:10.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.003+0000 7f348d51f800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f333f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 5 note: GC not initialized 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f333e7e4640 20 reqs_thread_entry: start 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 20 Filter name: none 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f32affff640 20 reqs_thread_entry: start 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-19T14:03:10.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.005+0000 7f348d51f800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.006+0000 7f348d51f800 20 rados_obj.operate() r=0 bl.length=532 2024-09-19T14:03:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.006+0000 7f348d51f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-19T14:03:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.006+0000 7f348d51f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:03:10.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.006+0000 7f348d51f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.008+0000 7f348d51f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:03:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.008+0000 7f348d51f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:03:10.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.008+0000 7f348d51f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-19T14:03:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.009+0000 7f336cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497116 cookie 94707910343840 notifier 8543 bl.length()=746 2024-09-19T14:03:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.009+0000 7f336cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:03:10.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.009+0000 7f336cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:03:10.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.010+0000 7f333f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.012+0000 7f348d51f800 20 remove_watcher() i=0 2024-09-19T14:03:10.013 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.012+0000 7f348d51f800 2 removed watcher, disabling cache 2024-09-19T14:03:10.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.013+0000 7f348d51f800 20 remove_watcher() i=1 2024-09-19T14:03:10.015 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.014+0000 7f348d51f800 20 remove_watcher() i=2 2024-09-19T14:03:10.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.015+0000 7f348d51f800 20 remove_watcher() i=3 2024-09-19T14:03:10.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.016+0000 7f348d51f800 20 remove_watcher() i=4 2024-09-19T14:03:10.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.017+0000 7f348d51f800 20 remove_watcher() i=5 2024-09-19T14:03:10.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.018+0000 7f348d51f800 20 remove_watcher() i=6 2024-09-19T14:03:10.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.019+0000 7f348d51f800 20 remove_watcher() i=7 2024-09-19T14:03:10.030 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-19T14:03:10.030 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key BDGACLIGXQPKTRSBMGDF --secret 8Arj7F2XtsIsev5omgZU7qOyd/txDFt/qTzLr4iMQCc5aLKj/JzhdA== --cluster ceph 2024-09-19T14:03:10.095 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:10.095 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:10.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.126+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 realm 2024-09-19T14:03:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:10.129 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.128+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.129+0000 7f4880487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.129+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.130 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.129+0000 7f4880487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:10.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.129+0000 7f4880487800 20 searching for the correct realm 2024-09-19T14:03:10.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.132+0000 7f487d770640 0 -- 172.21.15.94:0/1087038280 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x555c2b21bd00 msgr2=0x555c2b21e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:10.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.136+0000 7f487df71640 0 -- 172.21.15.94:0/1087038280 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f4874045400 msgr2=0x7f487406a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.140+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:10.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 zone default found 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 4 Realm: () 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 zonegroup default 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.141+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.142+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.142+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.142+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.142+0000 7f4880487800 20 started sync module instance, tier type = 2024-09-19T14:03:10.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.142+0000 7f4880487800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=0 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=1 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=2 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=3 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=4 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=5 2024-09-19T14:03:10.152 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.151+0000 7f4880487800 20 add_watcher() i=6 2024-09-19T14:03:10.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.152+0000 7f4880487800 20 add_watcher() i=7 2024-09-19T14:03:10.153 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.152+0000 7f4880487800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.153+0000 7f4733fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.153+0000 7f4880487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.153+0000 7f4880487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.153+0000 7f4880487800 5 note: GC not initialized 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.153+0000 7f4732fe5640 20 reqs_thread_entry: start 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 Filter name: none 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4730fe1640 20 reqs_thread_entry: start 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 10 cache get: name=default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF : miss 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.154+0000 7f4880487800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.155+0000 7f4880487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.155+0000 7f4880487800 10 cache put: name=default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF info.flags=0x0 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.155+0000 7f4880487800 10 adding default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF to cache LRU end 2024-09-19T14:03:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.155+0000 7f4880487800 10 cache get: name=default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF : hit (negative entry) 2024-09-19T14:03:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.155+0000 7f4880487800 10 cache get: name=default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF : hit (negative entry) 2024-09-19T14:03:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.156+0000 7f4880487800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:03:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.156+0000 7f4880487800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.156+0000 7f4880487800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-19T14:03:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.156+0000 7f47617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 93854349014928 notifier 8558 bl.length()=660 2024-09-19T14:03:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.156+0000 7f47617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:03:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.156+0000 7f47617fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.158+0000 7f4880487800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-19T14:03:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.158+0000 7f4880487800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-19T14:03:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.158+0000 7f4880487800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-19T14:03:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.158+0000 7f47617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497114 cookie 93854348990592 notifier 8558 bl.length()=191 2024-09-19T14:03:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.158+0000 7f47617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-19T14:03:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.158+0000 7f47617fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.160+0000 7f4880487800 10 cache put: name=default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF info.flags=0x7 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.160+0000 7f4880487800 10 moving default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF to cache LRU end 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.160+0000 7f4880487800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:BDGACLIGXQPKTRSBMGDF, ofs0, ns] 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.160+0000 7f4760ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497084 cookie 93854349014928 notifier 8558 bl.length()=189 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.160+0000 7f4760ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF info.flags=0x7 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.160+0000 7f4760ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BDGACLIGXQPKTRSBMGDF to cache LRU end 2024-09-19T14:03:10.161 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foobar.client.0", 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foobar.client.0", 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foobar+test@test.test", 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foobar.client.0", 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "BDGACLIGXQPKTRSBMGDF", 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "8Arj7F2XtsIsev5omgZU7qOyd/txDFt/qTzLr4iMQCc5aLKj/JzhdA==", 2024-09-19T14:03:10.162 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:10.155490Z" 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:10.163 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:03:10.164 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:10.155465Z", 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:10.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.161+0000 7f4733fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.163+0000 7f4880487800 20 remove_watcher() i=0 2024-09-19T14:03:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.163+0000 7f4880487800 2 removed watcher, disabling cache 2024-09-19T14:03:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.164+0000 7f4880487800 20 remove_watcher() i=1 2024-09-19T14:03:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.165+0000 7f4880487800 20 remove_watcher() i=2 2024-09-19T14:03:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.166+0000 7f4880487800 20 remove_watcher() i=3 2024-09-19T14:03:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.167+0000 7f4880487800 20 remove_watcher() i=4 2024-09-19T14:03:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.168+0000 7f4880487800 20 remove_watcher() i=5 2024-09-19T14:03:10.170 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.169+0000 7f4880487800 20 remove_watcher() i=6 2024-09-19T14:03:10.171 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.170+0000 7f4880487800 20 remove_watcher() i=7 2024-09-19T14:03:10.181 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4351687581 --totp-seed TESD6DOVOBY2JUUML4HALJRHY5EYCP4DMYXHL7T56CI3PL232OGKFMGDXDOXIX74 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:03:10.246 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:10.247 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:10.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.278+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 realm 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.279+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.280+0000 7f43a4134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.280+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.281+0000 7f43a4134800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:10.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.281+0000 7f43a4134800 20 searching for the correct realm 2024-09-19T14:03:10.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.283+0000 7f43a06b8640 0 -- 172.21.15.94:0/3988289038 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f4394082040 msgr2=0x7f4394096a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.287+0000 7f439feb7640 0 -- 172.21.15.94:0/3988289038 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f43940ba270 msgr2=0x7f43940e77f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.493+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.496 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 zone default found 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 4 Realm: () 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 zonegroup default 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.494+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.495+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.495+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.495+0000 7f43a4134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.495+0000 7f43a4134800 20 started sync module instance, tier type = 2024-09-19T14:03:10.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.495+0000 7f43a4134800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=0 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=1 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=2 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=3 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=4 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=5 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=6 2024-09-19T14:03:10.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 20 add_watcher() i=7 2024-09-19T14:03:10.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.504+0000 7f43a4134800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:10.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f42567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f43a4134800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f43a4134800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f43a4134800 5 note: GC not initialized 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f42557e2640 20 reqs_thread_entry: start 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f43a4134800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f43a4134800 20 Filter name: none 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f424e7fc640 20 reqs_thread_entry: start 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.506+0000 7f43a4134800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-19T14:03:10.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.507+0000 7f43a4134800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.507+0000 7f43a4134800 20 rados_obj.operate() r=0 bl.length=472 2024-09-19T14:03:10.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.507+0000 7f43a4134800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-19T14:03:10.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.507+0000 7f43a4134800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.507+0000 7f43a4134800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:10.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.510+0000 7f43a4134800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:03:10.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.510+0000 7f43a4134800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.510+0000 7f43a4134800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-19T14:03:10.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.510+0000 7f427effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497085 cookie 94188789455328 notifier 9126 bl.length()=674 2024-09-19T14:03:10.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.510+0000 7f427effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:03:10.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.510+0000 7f427effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.511+0000 7f42567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.513+0000 7f43a4134800 20 remove_watcher() i=0 2024-09-19T14:03:10.514 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.513+0000 7f43a4134800 2 removed watcher, disabling cache 2024-09-19T14:03:10.515 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.514+0000 7f43a4134800 20 remove_watcher() i=1 2024-09-19T14:03:10.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.515+0000 7f43a4134800 20 remove_watcher() i=2 2024-09-19T14:03:10.517 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.516+0000 7f43a4134800 20 remove_watcher() i=3 2024-09-19T14:03:10.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.517+0000 7f43a4134800 20 remove_watcher() i=4 2024-09-19T14:03:10.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.518+0000 7f43a4134800 20 remove_watcher() i=5 2024-09-19T14:03:10.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.519+0000 7f43a4134800 20 remove_watcher() i=6 2024-09-19T14:03:10.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.520+0000 7f43a4134800 20 remove_watcher() i=7 2024-09-19T14:03:10.532 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-19T14:03:10.589 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:10.589 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.620+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 realm 2024-09-19T14:03:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:10.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.622+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.624 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.623+0000 7f2a29d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.623+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.623+0000 7f2a29d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:10.625 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.623+0000 7f2a29d28800 20 searching for the correct realm 2024-09-19T14:03:10.627 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.626+0000 7f2a2515c640 0 -- 172.21.15.94:0/104604236 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f2a1807a070 msgr2=0x7f2a1806e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.629+0000 7f2a2595d640 0 -- 172.21.15.94:0/104604236 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f2a1c027040 msgr2=0x7f2a1c027930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.835+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 zone default found 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 4 Realm: () 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 zonegroup default 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.836+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.837+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.837+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.837+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.837+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.837+0000 7f2a29d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.838+0000 7f2a29d28800 20 started sync module instance, tier type = 2024-09-19T14:03:10.840 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.838+0000 7f2a29d28800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=0 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=1 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=2 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=3 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=4 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=5 2024-09-19T14:03:10.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.846+0000 7f2a29d28800 20 add_watcher() i=6 2024-09-19T14:03:10.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.847+0000 7f2a29d28800 20 add_watcher() i=7 2024-09-19T14:03:10.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.847+0000 7f2a29d28800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.848+0000 7f28d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.848+0000 7f2a29d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.848+0000 7f2a29d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.848+0000 7f2a29d28800 5 note: GC not initialized 2024-09-19T14:03:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f28d67fc640 20 reqs_thread_entry: start 2024-09-19T14:03:10.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 20 Filter name: none 2024-09-19T14:03:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2847fff640 20 reqs_thread_entry: start 2024-09-19T14:03:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-19T14:03:10.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.849+0000 7f2a29d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.851+0000 7f2a29d28800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.851+0000 7f2a29d28800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.851+0000 7f2a29d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-19T14:03:10.852 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.851+0000 7f29097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497086 cookie 93980885006896 notifier 9141 bl.length()=727 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.851+0000 7f29097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.851+0000 7f29097fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "foobar.client.0", 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.foobar.client.0", 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "foobar+test@test.test", 2024-09-19T14:03:10.853 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "foobar.client.0", 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "BDGACLIGXQPKTRSBMGDF", 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "8Arj7F2XtsIsev5omgZU7qOyd/txDFt/qTzLr4iMQCc5aLKj/JzhdA==", 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:10.155490Z" 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [ 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "oidc-provider", 2024-09-19T14:03:10.854 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "roles", 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "user-policy", 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "perm": "*" 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:10.855 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:10.856 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "rgw", 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [ 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "4351687581" 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "", 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:10.155465Z", 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:10.857 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:10.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.852+0000 7f28d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.854+0000 7f2a29d28800 20 remove_watcher() i=0 2024-09-19T14:03:10.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.854+0000 7f2a29d28800 2 removed watcher, disabling cache 2024-09-19T14:03:10.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.855+0000 7f2a29d28800 20 remove_watcher() i=1 2024-09-19T14:03:10.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.856+0000 7f2a29d28800 20 remove_watcher() i=2 2024-09-19T14:03:10.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.857+0000 7f2a29d28800 20 remove_watcher() i=3 2024-09-19T14:03:10.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.858+0000 7f2a29d28800 20 remove_watcher() i=4 2024-09-19T14:03:10.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.859+0000 7f2a29d28800 20 remove_watcher() i=5 2024-09-19T14:03:10.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.860+0000 7f2a29d28800 20 remove_watcher() i=6 2024-09-19T14:03:10.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.861+0000 7f2a29d28800 20 remove_watcher() i=7 2024-09-19T14:03:10.873 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-19T14:03:10.932 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:10.932 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:10.965 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.964+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.965+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.965+0000 7fb5c6f44800 20 realm 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.965+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.966+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.966+0000 7fb5c6f44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.966+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.966+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.967 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.966+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.967+0000 7fb5c6f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.967+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.967+0000 7fb5c6f44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:10.968 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.967+0000 7fb5c6f44800 20 searching for the correct realm 2024-09-19T14:03:10.971 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.970+0000 7fb5c522f640 0 -- 172.21.15.94:0/2799433898 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7fb5b003e990 msgr2=0x7fb5b003c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.974 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.973+0000 7fb5c4a2e640 0 -- 172.21.15.94:0/2799433898 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fb5b003c940 msgr2=0x7fb5b003b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:10.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:10.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:10.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:10.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:10.979 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.977+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 zone default found 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 4 Realm: () 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:10.980 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 zonegroup default 2024-09-19T14:03:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.978+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.979+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.979+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.979+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.979+0000 7fb5c6f44800 20 started sync module instance, tier type = 2024-09-19T14:03:10.982 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.979+0000 7fb5c6f44800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:10.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=0 2024-09-19T14:03:10.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=1 2024-09-19T14:03:10.988 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=2 2024-09-19T14:03:10.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=3 2024-09-19T14:03:10.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=4 2024-09-19T14:03:10.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=5 2024-09-19T14:03:10.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.987+0000 7fb5c6f44800 20 add_watcher() i=6 2024-09-19T14:03:10.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.988+0000 7fb5c6f44800 20 add_watcher() i=7 2024-09-19T14:03:10.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.988+0000 7fb5c6f44800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb479fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 5 note: GC not initialized 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb478fe1640 20 reqs_thread_entry: start 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 Filter name: none 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb3f27fc640 20 reqs_thread_entry: start 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.990+0000 7fb5c6f44800 20 rados->read ofs=0 len=0 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.991+0000 7fb5c6f44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.991+0000 7fb5c6f44800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.991+0000 7fb5c6f44800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-19T14:03:10.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.991+0000 7fb5c6f44800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-19T14:03:10.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.992+0000 7fb5c6f44800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-19T14:03:10.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.992+0000 7fb5c6f44800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-19T14:03:10.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.992+0000 7fb5c6f44800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-19T14:03:10.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.992+0000 7fb4a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497115 cookie 94853718138336 notifier 8609 bl.length()=384 2024-09-19T14:03:10.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.992+0000 7fb4a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-19T14:03:10.994 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.992+0000 7fb4a2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-19T14:03:10.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.994+0000 7fb5c6f44800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-19T14:03:10.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.994+0000 7fb5c6f44800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-19T14:03:10.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.994+0000 7fb5c6f44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-19T14:03:10.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.994+0000 7fb4a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497189 cookie 94853718147184 notifier 8609 bl.length()=225 2024-09-19T14:03:10.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.994+0000 7fb4a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-19T14:03:10.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.994+0000 7fb4a2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-19T14:03:10.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.996+0000 7fb5c6f44800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-19T14:03:10.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.996+0000 7fb5c6f44800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-19T14:03:10.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.996+0000 7fb5c6f44800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-19T14:03:10.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.996+0000 7fb4a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497065 cookie 94853718144512 notifier 8609 bl.length()=234 2024-09-19T14:03:10.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.996+0000 7fb4a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-19T14:03:10.997 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.996+0000 7fb4a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-19T14:03:10.998 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.997+0000 7fb479fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.999+0000 7fb5c6f44800 20 remove_watcher() i=0 2024-09-19T14:03:11.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:10.999+0000 7fb5c6f44800 2 removed watcher, disabling cache 2024-09-19T14:03:11.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.000+0000 7fb5c6f44800 20 remove_watcher() i=1 2024-09-19T14:03:11.002 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.001+0000 7fb5c6f44800 20 remove_watcher() i=2 2024-09-19T14:03:11.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.002+0000 7fb5c6f44800 20 remove_watcher() i=3 2024-09-19T14:03:11.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.003+0000 7fb5c6f44800 20 remove_watcher() i=4 2024-09-19T14:03:11.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.004+0000 7fb5c6f44800 20 remove_watcher() i=5 2024-09-19T14:03:11.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.005+0000 7fb5c6f44800 20 remove_watcher() i=6 2024-09-19T14:03:11.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.006+0000 7fb5c6f44800 20 remove_watcher() i=7 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW88888888888888888", 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW88888888888888888", 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:11.015 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:11.016 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-19T14:03:11.017 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:11.017 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-19T14:03:11.018 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key RBUOJWQCKJTUBDOXTJPM --secret VSj1licug1vmpRHa/wtyJM4SY+kYZNZ6Wgc+VLxsvYhwO5tKyuOgew== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-19T14:03:11.085 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:11.085 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:11.118 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.117+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.119 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 realm 2024-09-19T14:03:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.120 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.118+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.119+0000 7f29bed40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.119+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.119+0000 7f29bed40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:11.121 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.120+0000 7f29bed40800 20 searching for the correct realm 2024-09-19T14:03:11.124 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.123+0000 7f29bb2c1640 0 -- 172.21.15.94:0/3492300693 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x56391827f010 msgr2=0x5639182814a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.127 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.126+0000 7f29b3fff640 0 -- 172.21.15.94:0/3492300693 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f29ac04fbd0 msgr2=0x7f29ac0b3030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 zone default found 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 4 Realm: () 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 zonegroup default 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.130+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.131+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.131+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.131+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.131+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.131+0000 7f29bed40800 20 started sync module instance, tier type = 2024-09-19T14:03:11.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.131+0000 7f29bed40800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=0 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=1 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=2 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=3 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=4 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=5 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.139+0000 7f29bed40800 20 add_watcher() i=6 2024-09-19T14:03:11.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.140+0000 7f29bed40800 20 add_watcher() i=7 2024-09-19T14:03:11.142 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.140+0000 7f29bed40800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f28717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 5 note: GC not initialized 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f27ebfff640 20 reqs_thread_entry: start 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 20 Filter name: none 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f27e9ffb640 20 reqs_thread_entry: start 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.142+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.144 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 cache get: name=default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM : miss 2024-09-19T14:03:11.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.146 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 cache put: name=default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM info.flags=0x0 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 adding default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM to cache LRU end 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.143+0000 7f29bed40800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.144+0000 7f29bed40800 20 rados_obj.operate() r=0 bl.length=184 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.144+0000 7f29bed40800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.144+0000 7f29bed40800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.144+0000 7f29bed40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.144+0000 7f29bed40800 10 cache get: name=default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM : hit (negative entry) 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.144+0000 7f29bed40800 10 cache get: name=default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM : hit (negative entry) 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.145+0000 7f29bed40800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.145+0000 7f29bed40800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.145+0000 7f29bed40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.145+0000 7f289e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497116 cookie 94803218400144 notifier 8624 bl.length()=681 2024-09-19T14:03:11.147 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.145+0000 7f289e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.145+0000 7f289e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.147+0000 7f29bed40800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.147+0000 7f29bed40800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.147+0000 7f29bed40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.147+0000 7f289e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497117 cookie 94803218455840 notifier 8624 bl.length()=189 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.147+0000 7f289e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-19T14:03:11.148 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.147+0000 7f289e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-19T14:03:11.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.149+0000 7f29bed40800 10 cache put: name=default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM info.flags=0x7 2024-09-19T14:03:11.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.149+0000 7f29bed40800 10 moving default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM to cache LRU end 2024-09-19T14:03:11.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.149+0000 7f29bed40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:RBUOJWQCKJTUBDOXTJPM, ofs0, ns] 2024-09-19T14:03:11.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.149+0000 7f289dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497190 cookie 94803218453568 notifier 8624 bl.length()=188 2024-09-19T14:03:11.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.149+0000 7f289dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM info.flags=0x7 2024-09-19T14:03:11.150 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.149+0000 7f289dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RBUOJWQCKJTUBDOXTJPM to cache LRU end 2024-09-19T14:03:11.151 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.150+0000 7f29bed40800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "root1.client.0", 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "root1+test@test.test", 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "root1.client.0", 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "RBUOJWQCKJTUBDOXTJPM", 2024-09-19T14:03:11.152 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "VSj1licug1vmpRHa/wtyJM4SY+kYZNZ6Wgc+VLxsvYhwO5tKyuOgew==", 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:11.144574Z" 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:11.153 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:03:11.154 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW88888888888888888", 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:11.144562Z", 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.151+0000 7f28717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.153+0000 7f29bed40800 20 remove_watcher() i=0 2024-09-19T14:03:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.153+0000 7f29bed40800 2 removed watcher, disabling cache 2024-09-19T14:03:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.154+0000 7f29bed40800 20 remove_watcher() i=1 2024-09-19T14:03:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.155+0000 7f29bed40800 20 remove_watcher() i=2 2024-09-19T14:03:11.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.156+0000 7f29bed40800 20 remove_watcher() i=3 2024-09-19T14:03:11.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.157+0000 7f29bed40800 20 remove_watcher() i=4 2024-09-19T14:03:11.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.158+0000 7f29bed40800 20 remove_watcher() i=5 2024-09-19T14:03:11.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.159+0000 7f29bed40800 20 remove_watcher() i=6 2024-09-19T14:03:11.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.160+0000 7f29bed40800 20 remove_watcher() i=7 2024-09-19T14:03:11.171 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 1264779821 --totp-seed 6UEPFKHLX75GAI2IKCXXOPK6SPFBML6HZG26R7DNMTAL4GZVFUHARLHLFHCXKSLF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:03:11.238 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:11.238 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:11.270 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.269+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.271+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.271+0000 7fa079325800 20 realm 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.271+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.271+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.271+0000 7fa079325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.271+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.272+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.272+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.272+0000 7fa079325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.272+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.273+0000 7fa079325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:11.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.273+0000 7fa079325800 20 searching for the correct realm 2024-09-19T14:03:11.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.275+0000 7fa0748a1640 0 -- 172.21.15.94:0/4022142561 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7fa06806ec20 msgr2=0x7fa0680777e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.279+0000 7fa0750a2640 0 -- 172.21.15.94:0/4022142561 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7fa06c09f810 msgr2=0x7fa06c067100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:11.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.485+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.488 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 zone default found 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 4 Realm: () 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 zonegroup default 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.486+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.487+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.487+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.487+0000 7fa079325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.487+0000 7fa079325800 20 started sync module instance, tier type = 2024-09-19T14:03:11.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.487+0000 7fa079325800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=0 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=1 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=2 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=3 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=4 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=5 2024-09-19T14:03:11.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.496+0000 7fa079325800 20 add_watcher() i=6 2024-09-19T14:03:11.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.497+0000 7fa079325800 20 add_watcher() i=7 2024-09-19T14:03:11.498 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.497+0000 7fa079325800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.498+0000 7f9f2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.498+0000 7fa079325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.498+0000 7fa079325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.498+0000 7fa079325800 5 note: GC not initialized 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.498+0000 7f9f2a7e4640 20 reqs_thread_entry: start 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 20 Filter name: none 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7f9e9bfff640 20 reqs_thread_entry: start 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-19T14:03:11.500 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 20 rados_obj.operate() r=0 bl.length=494 2024-09-19T14:03:11.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-19T14:03:11.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:03:11.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.499+0000 7fa079325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:11.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.501+0000 7fa079325800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:03:11.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.501+0000 7fa079325800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:03:11.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.501+0000 7fa079325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-19T14:03:11.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.502+0000 7f9f58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497117 cookie 94493884223904 notifier 9195 bl.length()=695 2024-09-19T14:03:11.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.502+0000 7f9f58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:03:11.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.502+0000 7f9f58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:03:11.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.503+0000 7f9f2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.505+0000 7fa079325800 20 remove_watcher() i=0 2024-09-19T14:03:11.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.505+0000 7fa079325800 2 removed watcher, disabling cache 2024-09-19T14:03:11.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.506+0000 7fa079325800 20 remove_watcher() i=1 2024-09-19T14:03:11.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.507+0000 7fa079325800 20 remove_watcher() i=2 2024-09-19T14:03:11.509 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.508+0000 7fa079325800 20 remove_watcher() i=3 2024-09-19T14:03:11.510 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.509+0000 7fa079325800 20 remove_watcher() i=4 2024-09-19T14:03:11.511 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.510+0000 7fa079325800 20 remove_watcher() i=5 2024-09-19T14:03:11.512 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.511+0000 7fa079325800 20 remove_watcher() i=6 2024-09-19T14:03:11.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.512+0000 7fa079325800 20 remove_watcher() i=7 2024-09-19T14:03:11.524 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-19T14:03:11.583 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:11.584 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:11.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.616+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.618 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.617+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.617+0000 7ff77cc14800 20 realm 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.617+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.617+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.617+0000 7ff77cc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.617+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.618+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.618+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.618+0000 7ff77cc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.618+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.619+0000 7ff77cc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:11.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.619+0000 7ff77cc14800 20 searching for the correct realm 2024-09-19T14:03:11.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.621+0000 7ff777aca640 0 -- 172.21.15.94:0/1799694683 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7ff768071740 msgr2=0x7ff768066fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.626 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.625+0000 7ff7782cb640 0 -- 172.21.15.94:0/1799694683 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7ff76c0ad6e0 msgr2=0x7ff76c0ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.831+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 zone default found 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 4 Realm: () 2024-09-19T14:03:11.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 zonegroup default 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.832+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.833+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.835 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.833+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.833+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.833+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.833+0000 7ff77cc14800 20 started sync module instance, tier type = 2024-09-19T14:03:11.836 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.833+0000 7ff77cc14800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=0 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=1 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=2 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=3 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=4 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=5 2024-09-19T14:03:11.844 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.843+0000 7ff77cc14800 20 add_watcher() i=6 2024-09-19T14:03:11.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.844+0000 7ff77cc14800 20 add_watcher() i=7 2024-09-19T14:03:11.845 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.844+0000 7ff77cc14800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:11.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.845+0000 7ff62efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.845+0000 7ff77cc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:11.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.845+0000 7ff77cc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:11.847 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.845+0000 7ff77cc14800 5 note: GC not initialized 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff62dfdb640 20 reqs_thread_entry: start 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 20 Filter name: none 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff59f7fe640 20 reqs_thread_entry: start 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-19T14:03:11.848 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.846+0000 7ff77cc14800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.847+0000 7ff77cc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.847+0000 7ff77cc14800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.847+0000 7ff77cc14800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.847+0000 7ff77cc14800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.848+0000 7ff77cc14800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.848+0000 7ff77cc14800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-19T14:03:11.849 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.848+0000 7ff77cc14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-19T14:03:11.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.848+0000 7ff64f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497118 cookie 94011530775184 notifier 8657 bl.length()=384 2024-09-19T14:03:11.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.848+0000 7ff64f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-19T14:03:11.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.848+0000 7ff64f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-19T14:03:11.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.850+0000 7ff77cc14800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-19T14:03:11.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.850+0000 7ff77cc14800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-19T14:03:11.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.850+0000 7ff77cc14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-19T14:03:11.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.850+0000 7ff64effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497191 cookie 94011530772592 notifier 8657 bl.length()=225 2024-09-19T14:03:11.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.850+0000 7ff64effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-19T14:03:11.851 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.850+0000 7ff64effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-19T14:03:11.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.852+0000 7ff77cc14800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-19T14:03:11.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.852+0000 7ff77cc14800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-19T14:03:11.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.852+0000 7ff77cc14800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-19T14:03:11.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.852+0000 7ff64f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497066 cookie 94011530782512 notifier 8657 bl.length()=234 2024-09-19T14:03:11.853 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.852+0000 7ff64f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-19T14:03:11.854 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.852+0000 7ff64f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-19T14:03:11.855 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.854+0000 7ff62efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:11.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.856+0000 7ff77cc14800 20 remove_watcher() i=0 2024-09-19T14:03:11.857 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.856+0000 7ff77cc14800 2 removed watcher, disabling cache 2024-09-19T14:03:11.858 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.857+0000 7ff77cc14800 20 remove_watcher() i=1 2024-09-19T14:03:11.859 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.858+0000 7ff77cc14800 20 remove_watcher() i=2 2024-09-19T14:03:11.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.859+0000 7ff77cc14800 20 remove_watcher() i=3 2024-09-19T14:03:11.861 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.860+0000 7ff77cc14800 20 remove_watcher() i=4 2024-09-19T14:03:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.861+0000 7ff77cc14800 20 remove_watcher() i=5 2024-09-19T14:03:11.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.862+0000 7ff77cc14800 20 remove_watcher() i=6 2024-09-19T14:03:11.864 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.863+0000 7ff77cc14800 20 remove_watcher() i=7 2024-09-19T14:03:11.872 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "RGW99999999999999999", 2024-09-19T14:03:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "tenant": "", 2024-09-19T14:03:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "Mr.RGW99999999999999999", 2024-09-19T14:03:11.872 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "quota": { 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:11.873 INFO:teuthology.orchestra.run.smithi094.stdout: "max_users": 1000, 2024-09-19T14:03:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "max_roles": 1000, 2024-09-19T14:03:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "max_groups": 1000, 2024-09-19T14:03:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:11.874 INFO:teuthology.orchestra.run.smithi094.stdout: "max_access_keys": 4 2024-09-19T14:03:11.874 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:11.875 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-19T14:03:11.875 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key JXMMTYALETMCYSFGAXAK --secret aEGYxCCbXewDmIyhnAWplC/vShienx4fYVFHj2ErOat6r/O8LuqySg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-19T14:03:11.942 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:11.943 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:11.975 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.974+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.975+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.975+0000 7f1f33a10800 20 realm 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.975+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.976+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.976+0000 7f1f33a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.976+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.976+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.977 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.976+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.977+0000 7f1f33a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.977+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.977+0000 7f1f33a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:11.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.977+0000 7f1f33a10800 20 searching for the correct realm 2024-09-19T14:03:11.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.980+0000 7f1f2f9bd640 0 -- 172.21.15.94:0/1790753984 >> [v2:172.21.15.94:6823/4240401748,v1:172.21.15.94:6825/4240401748] conn(0x559add41c400 msgr2=0x559add41e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:11.985 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.984+0000 7f1f2f1bc640 0 -- 172.21.15.94:0/1790753984 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f1f18045030 msgr2=0x7f1f18045760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:11.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.988+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:11.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.991 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 zone default found 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 4 Realm: () 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 zonegroup default 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.989+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.990+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:11.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.990+0000 7f1f33a10800 20 started sync module instance, tier type = 2024-09-19T14:03:11.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.990+0000 7f1f33a10800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=0 2024-09-19T14:03:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=1 2024-09-19T14:03:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=2 2024-09-19T14:03:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=3 2024-09-19T14:03:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=4 2024-09-19T14:03:11.999 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=5 2024-09-19T14:03:12.000 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:11.998+0000 7f1f33a10800 20 add_watcher() i=6 2024-09-19T14:03:12.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.000+0000 7f1f33a10800 20 add_watcher() i=7 2024-09-19T14:03:12.001 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.000+0000 7f1f33a10800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:12.003 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.001+0000 7f1de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.001+0000 7f1f33a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.001+0000 7f1f33a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.001+0000 7f1f33a10800 5 note: GC not initialized 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1de4fe1640 20 reqs_thread_entry: start 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 20 Filter name: none 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1d5e7fc640 20 reqs_thread_entry: start 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-19T14:03:12.004 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.002+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 10 cache get: name=default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK : miss 2024-09-19T14:03:12.005 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK info.flags=0x0 2024-09-19T14:03:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 10 adding default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK to cache LRU end 2024-09-19T14:03:12.006 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.003+0000 7f1f33a10800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.004+0000 7f1f33a10800 20 rados_obj.operate() r=0 bl.length=184 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.004+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.004+0000 7f1f33a10800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.004+0000 7f1f33a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.004+0000 7f1f33a10800 10 cache get: name=default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK : hit (negative entry) 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.004+0000 7f1f33a10800 10 cache get: name=default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK : hit (negative entry) 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.005+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.005+0000 7f1f33a10800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:03:12.007 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.005+0000 7f1f33a10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-19T14:03:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.006+0000 7f1e12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497119 cookie 94123625405120 notifier 9231 bl.length()=681 2024-09-19T14:03:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.006+0000 7f1e12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:03:12.008 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.006+0000 7f1e12ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:03:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.007+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-19T14:03:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.007+0000 7f1f33a10800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-19T14:03:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.007+0000 7f1f33a10800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-19T14:03:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.008+0000 7f1e12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497118 cookie 94123625461104 notifier 9231 bl.length()=189 2024-09-19T14:03:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.008+0000 7f1e12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-19T14:03:12.009 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.008+0000 7f1e12ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-19T14:03:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.009+0000 7f1f33a10800 10 cache put: name=default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK info.flags=0x7 2024-09-19T14:03:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.009+0000 7f1f33a10800 10 moving default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK to cache LRU end 2024-09-19T14:03:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.009+0000 7f1f33a10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:JXMMTYALETMCYSFGAXAK, ofs0, ns] 2024-09-19T14:03:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.009+0000 7f1e127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497119 cookie 94123625463424 notifier 9231 bl.length()=188 2024-09-19T14:03:12.010 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.009+0000 7f1e127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK info.flags=0x7 2024-09-19T14:03:12.011 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.009+0000 7f1e127fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JXMMTYALETMCYSFGAXAK to cache LRU end 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.011+0000 7f1f33a10800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "user_id": "root2.client.0", 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "email": "root2+test@test.test", 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "suspended": 0, 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "max_buckets": 1000, 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "subusers": [], 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: "keys": [ 2024-09-19T14:03:12.012 INFO:teuthology.orchestra.run.smithi094.stdout: { 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "user": "root2.client.0", 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "JXMMTYALETMCYSFGAXAK", 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "aEGYxCCbXewDmIyhnAWplC/vShienx4fYVFHj2ErOat6r/O8LuqySg==", 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "active": true, 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:12.004542Z" 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: } 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "swift_keys": [], 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "caps": [], 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "op_mask": "read, write, delete", 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "default_storage_class": "", 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_tags": [], 2024-09-19T14:03:12.013 INFO:teuthology.orchestra.run.smithi094.stdout: "bucket_quota": { 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "user_quota": { 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "enabled": false, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "check_on_raw": false, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size": -1, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "max_size_kb": 0, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "max_objects": -1 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "temp_url_keys": [], 2024-09-19T14:03:12.014 INFO:teuthology.orchestra.run.smithi094.stdout: "type": "root", 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: "mfa_ids": [], 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: "account_id": "RGW99999999999999999", 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: "path": "/", 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: "create_date": "2024-09-19T14:03:12.004531Z", 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: "tags": [], 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: "group_ids": [] 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:03:12.015 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:03:12.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.011+0000 7f1de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:12.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.013+0000 7f1f33a10800 20 remove_watcher() i=0 2024-09-19T14:03:12.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.013+0000 7f1f33a10800 2 removed watcher, disabling cache 2024-09-19T14:03:12.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.014+0000 7f1f33a10800 20 remove_watcher() i=1 2024-09-19T14:03:12.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.016+0000 7f1f33a10800 20 remove_watcher() i=2 2024-09-19T14:03:12.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.017+0000 7f1f33a10800 20 remove_watcher() i=3 2024-09-19T14:03:12.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.018+0000 7f1f33a10800 20 remove_watcher() i=4 2024-09-19T14:03:12.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.019+0000 7f1f33a10800 20 remove_watcher() i=5 2024-09-19T14:03:12.020 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.020+0000 7f1f33a10800 20 remove_watcher() i=6 2024-09-19T14:03:12.021 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.020+0000 7f1f33a10800 20 remove_watcher() i=7 2024-09-19T14:03:12.032 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4934897552 --totp-seed XAG3CVJOJSNCFXT2JKALZFPQAJUHNTWLHFJCCJB6N6U47Y24KTOIMR4DVWULTO3H --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:03:12.098 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:03:12.098 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:03:12.131 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.130+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.131+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.131+0000 7f80c9d25800 20 realm 2024-09-19T14:03:12.132 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.131+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.131+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.131+0000 7f80c9d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.131+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.132+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.132+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.132+0000 7f80c9d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:12.133 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.132+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.133+0000 7f80c9d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:03:12.134 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.133+0000 7f80c9d25800 20 searching for the correct realm 2024-09-19T14:03:12.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.136+0000 7f80c6134640 0 -- 172.21.15.94:0/64027311 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f80b8020060 msgr2=0x7f80b8042ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:03:12.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.139+0000 7f80c5933640 0 -- 172.21.15.94:0/64027311 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f80b80441e0 msgr2=0x7f80b80747d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:03:12.345 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.344+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 zone default found 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 4 Realm: () 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 zonegroup default 2024-09-19T14:03:12.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.345+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.346+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.346+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.346+0000 7f80c9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.346+0000 7f80c9d25800 20 started sync module instance, tier type = 2024-09-19T14:03:12.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.346+0000 7f80c9d25800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:03:12.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.356+0000 7f80c9d25800 20 add_watcher() i=0 2024-09-19T14:03:12.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.356+0000 7f80c9d25800 20 add_watcher() i=1 2024-09-19T14:03:12.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.356+0000 7f80c9d25800 20 add_watcher() i=2 2024-09-19T14:03:12.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.356+0000 7f80c9d25800 20 add_watcher() i=3 2024-09-19T14:03:12.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.356+0000 7f80c9d25800 20 add_watcher() i=4 2024-09-19T14:03:12.357 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.356+0000 7f80c9d25800 20 add_watcher() i=5 2024-09-19T14:03:12.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.357+0000 7f80c9d25800 20 add_watcher() i=6 2024-09-19T14:03:12.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.357+0000 7f80c9d25800 20 add_watcher() i=7 2024-09-19T14:03:12.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.357+0000 7f80c9d25800 2 all 8 watchers are set, enabling cache 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.358+0000 7f7f777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.358+0000 7f80c9d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.358+0000 7f80c9d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.358+0000 7f80c9d25800 5 note: GC not initialized 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f7f767fc640 20 reqs_thread_entry: start 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 20 init_complete bucket index max shards: 11 2024-09-19T14:03:12.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 20 Filter name: none 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f7ee7fff640 20 reqs_thread_entry: start 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 20 rados->read ofs=0 len=0 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 20 rados_obj.operate() r=0 bl.length=494 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:03:12.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.359+0000 7f80c9d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:03:12.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.362+0000 7f80c9d25800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:03:12.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.362+0000 7f80c9d25800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:03:12.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.362+0000 7f80c9d25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-19T14:03:12.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.362+0000 7f7fa97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497120 cookie 93855798072160 notifier 8690 bl.length()=695 2024-09-19T14:03:12.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.362+0000 7f7fa97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:03:12.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.362+0000 7f7fa97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:03:12.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.363+0000 7f7f777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:03:12.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.365+0000 7f80c9d25800 20 remove_watcher() i=0 2024-09-19T14:03:12.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.365+0000 7f80c9d25800 2 removed watcher, disabling cache 2024-09-19T14:03:12.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.366+0000 7f80c9d25800 20 remove_watcher() i=1 2024-09-19T14:03:12.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.367+0000 7f80c9d25800 20 remove_watcher() i=2 2024-09-19T14:03:12.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.368+0000 7f80c9d25800 20 remove_watcher() i=3 2024-09-19T14:03:12.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.369+0000 7f80c9d25800 20 remove_watcher() i=4 2024-09-19T14:03:12.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.370+0000 7f80c9d25800 20 remove_watcher() i=5 2024-09-19T14:03:12.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.371+0000 7f80c9d25800 20 remove_watcher() i=6 2024-09-19T14:03:12.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:03:12.372+0000 7f80c9d25800 20 remove_watcher() i=7 2024-09-19T14:03:12.383 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-19T14:03:12.384 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T14:03:12.384 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-19T14:03:12.412 INFO:tasks.s3tests:Configuring boto... 2024-09-19T14:03:12.413 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T14:03:12.413 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-19T14:03:12.481 DEBUG:teuthology.orchestra.run.smithi094:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-19T14:03:12.660 INFO:teuthology.orchestra.run.smithi094.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-19T14:03:12.837 INFO:teuthology.orchestra.run.smithi094.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-19T14:03:13.098 INFO:teuthology.orchestra.run.smithi094.stdout:py installdeps: -rrequirements.txt 2024-09-19T14:04:57.021 INFO:teuthology.orchestra.run.smithi094.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-19T14:04:58.426 INFO:teuthology.orchestra.run.smithi094.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.1,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.10,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.6,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.8.0,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=fd3add434651d2a718aa81bb37fca0543448f30ae8fdc3b1a64cc212b9dd5e82,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.20.0,urllib3==1.26.20,virtualenv==20.26.5,zope.event==5.0,zope.interface==7.0.3 2024-09-19T14:04:58.426 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test-pre: PYTHONHASHSEED='3272038679' 2024-09-19T14:04:58.426 INFO:teuthology.orchestra.run.smithi094.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-19T14:04:58.558 INFO:teuthology.orchestra.run.smithi094.stdout:============================= test session starts ============================== 2024-09-19T14:04:58.558 INFO:teuthology.orchestra.run.smithi094.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-19T14:04:58.558 INFO:teuthology.orchestra.run.smithi094.stdout:cachedir: .tox/py/.pytest_cache 2024-09-19T14:04:58.559 INFO:teuthology.orchestra.run.smithi094.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-19T14:04:58.559 INFO:teuthology.orchestra.run.smithi094.stdout:configfile: pytest.ini 2024-09-19T14:05:00.293 INFO:teuthology.orchestra.run.smithi094.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-19T14:05:00.294 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:05:00.427 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-19T14:05:00.550 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-19T14:05:00.718 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-19T14:05:00.886 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-19T14:05:01.010 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-19T14:05:01.136 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-19T14:05:01.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-19T14:05:01.431 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-19T14:05:01.518 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-19T14:05:01.605 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-19T14:05:01.730 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-19T14:05:01.852 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-19T14:05:01.974 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-19T14:05:02.095 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-19T14:05:02.182 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-19T14:05:02.268 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-19T14:05:02.314 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-19T14:05:02.360 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-19T14:05:02.406 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-19T14:05:02.452 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-19T14:05:02.498 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-19T14:05:02.544 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-19T14:05:02.590 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.636 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.682 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.728 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.774 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.820 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.866 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-19T14:05:02.912 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-19T14:05:02.959 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.005 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.051 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.098 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.145 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.191 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.237 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-19T14:05:03.283 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.329 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.375 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.421 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.468 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.516 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.563 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-19T14:05:03.610 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.657 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.704 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.751 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.798 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.845 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.892 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.939 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-19T14:05:03.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-19T14:05:04.267 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-19T14:05:04.788 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-19T14:05:05.760 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-19T14:05:06.629 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-19T14:05:08.217 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-19T14:05:08.652 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-19T14:05:09.228 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-19T14:05:09.438 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-19T14:05:09.521 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-19T14:05:09.676 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-19T14:05:09.836 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-19T14:05:10.016 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-19T14:05:10.155 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-19T14:05:10.238 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-19T14:05:10.238 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-19T14:05:10.239 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-19T14:05:10.240 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-19T14:05:10.241 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-19T14:05:10.241 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-19T14:05:10.243 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-19T14:05:10.244 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-19T14:05:10.245 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.245 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.246 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.247 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.248 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-19T14:05:10.248 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.249 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.250 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:05:10.251 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:05:10.252 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:05:10.252 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:05:10.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:05:10.254 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-19T14:05:10.255 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-19T14:05:10.256 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-19T14:05:10.256 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-19T14:05:10.257 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-19T14:05:10.258 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-19T14:05:10.258 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-19T14:05:10.259 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-19T14:05:10.344 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-19T14:05:10.354 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-19T14:05:10.574 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-19T14:05:19.136 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-19T14:05:19.268 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-19T14:05:19.453 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-19T14:05:19.642 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-19T14:05:19.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-19T14:05:20.009 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-19T14:05:20.135 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-19T14:05:20.350 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-19T14:05:20.521 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-19T14:05:20.693 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-19T14:05:20.821 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-19T14:05:20.940 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-19T14:05:21.060 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-19T14:05:21.098 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-19T14:05:21.223 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-19T14:05:21.403 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-19T14:05:21.615 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-19T14:05:21.741 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-19T14:05:21.868 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-19T14:05:21.995 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-19T14:05:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-19T14:05:22.250 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-19T14:05:22.367 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-19T14:05:22.487 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-19T14:05:22.527 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-19T14:05:22.599 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-19T14:05:22.639 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-19T14:05:22.679 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-19T14:05:22.719 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-19T14:05:22.832 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-19T14:05:22.871 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-19T14:05:22.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-19T14:05:23.064 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-19T14:05:23.203 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-19T14:05:23.242 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-19T14:05:23.437 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-19T14:05:23.574 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-19T14:05:23.807 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-19T14:05:23.902 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-19T14:05:24.040 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-19T14:05:24.178 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-19T14:05:24.507 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-19T14:05:24.666 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-19T14:05:24.849 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-19T14:05:25.007 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:05:25.364 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:05:25.576 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:05:25.888 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:05:26.091 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:05:26.372 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:05:26.557 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-19T14:05:26.833 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-19T14:05:27.011 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-19T14:05:27.726 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-19T14:05:28.170 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-19T14:05:28.758 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-19T14:05:30.180 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-19T14:05:32.173 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-19T14:05:33.167 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-19T14:05:34.077 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-19T14:05:34.727 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-19T14:05:35.045 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-19T14:05:35.809 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-19T14:05:36.300 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-19T14:05:37.019 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-19T14:05:37.461 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-19T14:05:38.445 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-19T14:05:39.047 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-19T14:05:40.195 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-19T14:05:41.262 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-19T14:05:41.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-19T14:05:42.503 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-19T14:05:42.957 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-19T14:05:44.345 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-19T14:05:45.257 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-19T14:05:46.390 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-19T14:05:47.484 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-19T14:05:48.402 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-19T14:05:49.321 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-19T14:05:50.003 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-19T14:05:50.457 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-19T14:05:51.006 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-19T14:05:52.217 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-19T14:05:53.887 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-19T14:05:54.510 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-19T14:05:55.530 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-19T14:05:56.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-19T14:05:57.404 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-19T14:05:58.230 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-19T14:05:59.101 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-19T14:05:59.962 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-19T14:06:00.764 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-19T14:06:01.309 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-19T14:06:01.751 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-19T14:06:02.192 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-19T14:06:02.635 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-19T14:06:03.387 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-19T14:06:04.138 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-19T14:06:04.883 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-19T14:06:05.633 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-19T14:06:06.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-19T14:06:07.133 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-19T14:06:07.918 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-19T14:06:08.669 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-19T14:06:09.419 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-19T14:06:10.167 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-19T14:06:10.914 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-19T14:06:11.708 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-19T14:06:12.083 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-19T14:06:12.456 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-19T14:06:12.793 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-19T14:06:13.121 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-19T14:06:13.313 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-19T14:06:13.664 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-19T14:06:13.895 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-19T14:06:14.131 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-19T14:06:14.365 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-19T14:06:14.562 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-19T14:06:14.754 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-19T14:06:14.950 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-19T14:06:15.184 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-19T14:06:15.430 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-19T14:06:15.678 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-19T14:06:15.862 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-19T14:06:16.039 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-19T14:06:16.273 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-19T14:06:16.467 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-19T14:06:16.713 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-19T14:06:16.963 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-19T14:06:17.162 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-19T14:06:17.358 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-19T14:06:17.592 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-19T14:06:17.789 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-19T14:06:17.985 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-19T14:06:18.180 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-19T14:06:18.377 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-19T14:06:18.573 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-19T14:06:18.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-19T14:06:19.001 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-19T14:06:19.198 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-19T14:06:19.393 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-19T14:06:19.584 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-19T14:06:19.772 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-19T14:06:19.963 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-19T14:06:20.197 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-19T14:06:20.395 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-19T14:06:27.437 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-19T14:06:27.670 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-19T14:06:27.860 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-19T14:06:28.089 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-19T14:06:28.285 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-19T14:06:28.476 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-19T14:06:28.668 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-19T14:06:28.856 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-19T14:06:29.089 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-19T14:06:29.278 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-19T14:06:29.467 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-19T14:06:29.657 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-19T14:06:29.848 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-19T14:06:30.045 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-19T14:06:30.245 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-19T14:06:30.481 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-19T14:06:30.685 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-19T14:06:30.885 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-19T14:06:31.103 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-19T14:06:31.312 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:06:31.512 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:06:31.712 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:06:31.952 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:06:32.192 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-19T14:06:32.431 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-19T14:06:32.627 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-19T14:06:32.826 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-19T14:06:33.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-19T14:06:33.255 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-19T14:06:33.296 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-19T14:06:33.477 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-19T14:06:33.989 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-19T14:06:34.493 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-19T14:06:34.732 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-19T14:06:34.928 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-19T14:06:35.127 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-19T14:06:35.325 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-19T14:06:35.564 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-19T14:06:35.807 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-19T14:06:36.004 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-19T14:06:36.238 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-19T14:06:36.437 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-19T14:06:36.632 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-19T14:06:36.829 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-19T14:06:37.023 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-19T14:06:37.388 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-19T14:06:37.845 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-19T14:06:38.018 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-19T14:06:38.150 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-19T14:06:38.276 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-19T14:06:38.405 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-19T14:06:38.446 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-19T14:06:38.488 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-19T14:06:38.529 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-19T14:06:38.714 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-19T14:06:38.944 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-19T14:06:38.987 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-19T14:06:39.161 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-19T14:06:39.282 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-19T14:06:39.411 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-19T14:06:39.540 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-19T14:06:39.886 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-19T14:06:40.207 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-19T14:06:40.564 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-19T14:06:47.728 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-19T14:06:54.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-19T14:06:55.000 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-19T14:06:55.175 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-19T14:06:55.355 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-19T14:06:55.530 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-19T14:06:55.757 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-19T14:06:55.941 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-19T14:06:56.157 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-19T14:06:56.350 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-19T14:06:56.540 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-19T14:06:56.757 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-19T14:06:56.973 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-19T14:06:57.152 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-19T14:06:57.369 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-19T14:06:57.493 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-19T14:06:57.662 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-19T14:06:57.870 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-19T14:06:58.058 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-19T14:06:58.235 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-19T14:06:58.406 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-19T14:06:58.579 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-19T14:06:58.754 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-19T14:06:58.968 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-19T14:06:59.095 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-19T14:06:59.221 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-19T14:06:59.386 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-19T14:06:59.510 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-19T14:06:59.636 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-19T14:06:59.767 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-19T14:06:59.943 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-19T14:07:00.068 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-19T14:07:00.195 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-19T14:07:00.320 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-19T14:07:00.448 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-19T14:07:00.657 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-19T14:07:00.783 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-19T14:07:00.949 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-19T14:07:01.078 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-19T14:07:01.203 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-19T14:07:01.328 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-19T14:07:01.456 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-19T14:07:01.583 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-19T14:07:01.801 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-19T14:07:01.927 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-19T14:07:02.158 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-19T14:07:02.416 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-19T14:07:02.593 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-19T14:07:02.812 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-19T14:07:03.029 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-19T14:07:04.236 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-19T14:07:04.476 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-19T14:07:04.702 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-19T14:07:04.977 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-19T14:07:05.323 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-19T14:07:05.596 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-19T14:07:05.815 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-19T14:07:06.084 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-19T14:07:06.393 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-19T14:07:06.614 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-19T14:07:06.924 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-19T14:07:07.102 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-19T14:07:07.237 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-19T14:07:07.333 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-19T14:07:07.474 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-19T14:07:07.599 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-19T14:07:07.641 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-19T14:07:07.848 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-19T14:07:08.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-19T14:07:08.202 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-19T14:07:10.636 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-19T14:07:10.862 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-19T14:07:11.039 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-19T14:07:11.218 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-19T14:07:11.395 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-19T14:07:11.531 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-19T14:07:11.709 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-19T14:07:11.886 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-19T14:07:12.064 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-19T14:07:12.239 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-19T14:07:12.455 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-19T14:07:12.630 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-19T14:07:12.812 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-19T14:07:12.996 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-19T14:07:13.172 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-19T14:07:13.347 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-19T14:07:13.521 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-19T14:07:13.697 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-19T14:07:13.738 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-19T14:07:13.819 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-19T14:07:13.860 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-19T14:07:13.981 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-19T14:07:14.103 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-19T14:07:14.228 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-19T14:07:14.349 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-19T14:07:14.512 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-19T14:07:14.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-19T14:07:14.595 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-19T14:07:14.716 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-19T14:07:14.796 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-19T14:07:14.837 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-19T14:07:14.878 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-19T14:07:14.918 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-19T14:07:15.052 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-19T14:07:15.215 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-19T14:07:15.343 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-19T14:07:15.506 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-19T14:07:15.673 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-19T14:07:15.841 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-19T14:07:16.006 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-19T14:07:16.218 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-19T14:07:16.380 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-19T14:07:16.544 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-19T14:07:16.764 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-19T14:07:16.984 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-19T14:07:17.249 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-19T14:07:17.467 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-19T14:07:17.691 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-19T14:07:17.996 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-19T14:07:18.261 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-19T14:07:18.487 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-19T14:07:18.674 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-19T14:07:18.802 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-19T14:07:19.072 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-19T14:07:19.336 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-19T14:07:19.601 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-19T14:07:19.869 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-19T14:07:20.172 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-19T14:07:20.423 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-19T14:07:20.625 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-19T14:07:20.831 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-19T14:07:21.082 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-19T14:07:21.288 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-19T14:07:21.465 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-19T14:07:21.680 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-19T14:07:21.905 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-19T14:07:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-19T14:07:22.216 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-19T14:07:22.482 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-19T14:07:22.820 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-19T14:07:23.205 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-19T14:07:23.545 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-19T14:07:23.889 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-19T14:07:24.234 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-19T14:07:24.575 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-19T14:07:24.959 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-19T14:07:25.304 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-19T14:07:25.649 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-19T14:07:25.951 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-19T14:07:26.257 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-19T14:07:26.564 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-19T14:07:27.095 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-19T14:07:27.582 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-19T14:07:27.620 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-19T14:07:27.661 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-19T14:07:27.701 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-19T14:07:27.836 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-19T14:07:27.970 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-19T14:07:28.090 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-19T14:07:28.210 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-19T14:07:28.460 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-19T14:07:29.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-19T14:07:29.468 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-19T14:07:29.709 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-19T14:07:30.089 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-19T14:07:30.363 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-19T14:07:30.634 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-19T14:07:30.897 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-19T14:07:31.123 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-19T14:07:31.524 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-19T14:07:31.788 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-19T14:07:32.039 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-19T14:07:32.317 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-19T14:07:32.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-19T14:07:33.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-19T14:07:33.381 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-19T14:07:33.549 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-19T14:07:34.484 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-19T14:07:34.775 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-19T14:07:36.087 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-19T14:07:36.226 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-19T14:07:36.433 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-19T14:07:36.944 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-19T14:07:37.179 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-19T14:07:37.652 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-19T14:07:38.918 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-19T14:07:39.780 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-19T14:07:41.668 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-19T14:07:45.965 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-19T14:07:46.965 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-19T14:07:48.711 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-19T14:07:48.954 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-19T14:07:49.419 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-19T14:07:49.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-19T14:07:50.261 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-19T14:07:50.481 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-19T14:07:50.877 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-19T14:07:51.126 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-19T14:07:51.322 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-19T14:07:51.518 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-19T14:08:05.688 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-19T14:08:07.509 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-19T14:08:07.775 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-19T14:08:07.904 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-19T14:08:08.127 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-19T14:08:11.345 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-19T14:08:14.505 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-19T14:08:17.662 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-19T14:08:17.847 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-19T14:08:18.031 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-19T14:08:18.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-19T14:08:18.435 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-19T14:08:18.615 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-19T14:08:18.797 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-19T14:08:19.019 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-19T14:08:19.324 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-19T14:08:19.616 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-19T14:08:20.109 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-19T14:08:20.584 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-19T14:08:20.961 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-19T14:08:21.454 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-19T14:08:21.756 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-19T14:08:22.211 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-19T14:08:22.749 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-19T14:08:23.174 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-19T14:08:23.491 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-19T14:08:23.896 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-19T14:08:24.118 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-19T14:08:28.242 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-19T14:08:28.502 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-19T14:08:28.723 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-19T14:08:28.945 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-19T14:08:29.166 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-19T14:08:29.495 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-19T14:08:35.469 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-19T14:08:35.774 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-19T14:08:36.107 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-19T14:08:36.506 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-19T14:08:36.944 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-19T14:08:39.402 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-19T14:08:39.763 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-19T14:08:42.951 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-19T14:08:55.263 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-19T14:08:56.778 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-19T14:08:57.655 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-19T14:08:58.681 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-19T14:08:59.055 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-19T14:08:59.434 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-19T14:08:59.705 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-19T14:09:00.102 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-19T14:09:00.409 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-19T14:09:00.824 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-19T14:09:00.958 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-19T14:09:01.137 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-19T14:09:01.314 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-19T14:09:01.441 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-19T14:09:01.569 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-19T14:09:01.784 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-19T14:09:01.919 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-19T14:09:02.048 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-19T14:09:02.242 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-19T14:09:02.379 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-19T14:09:02.515 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-19T14:09:02.652 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-19T14:09:02.787 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-19T14:09:02.916 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-19T14:09:03.137 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-19T14:09:03.353 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-19T14:09:03.589 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-19T14:09:03.815 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-19T14:09:04.001 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-19T14:09:04.224 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-19T14:09:04.445 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-19T14:09:04.615 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-19T14:09:04.789 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-19T14:09:04.960 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-19T14:09:05.170 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-19T14:09:06.524 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-19T14:09:07.933 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-19T14:09:08.745 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-19T14:09:08.923 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-19T14:10:09.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-19T14:11:10.324 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-19T14:11:10.513 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-19T14:11:10.773 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-19T14:11:10.945 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-19T14:11:11.072 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-19T14:11:12.157 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-19T14:11:12.796 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-19T14:11:13.442 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-19T14:11:13.618 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-19T14:11:13.838 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-19T14:11:14.101 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-19T14:11:14.297 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-19T14:11:14.516 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-19T14:11:14.738 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-19T14:11:14.923 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-19T14:11:15.110 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-19T14:11:15.308 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-19T14:11:15.550 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-19T14:11:15.732 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-19T14:11:15.915 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-19T14:11:16.286 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-19T14:11:16.659 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-19T14:11:16.989 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-19T14:11:17.247 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-19T14:11:17.586 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-19T14:11:17.903 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-19T14:11:18.199 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-19T14:11:18.527 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-19T14:11:18.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-19T14:11:19.200 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-19T14:11:19.545 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-19T14:11:19.805 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-19T14:11:20.026 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-19T14:11:20.286 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-19T14:11:20.551 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-19T14:11:20.889 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-19T14:11:21.202 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-19T14:11:21.794 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-19T14:11:23.686 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-19T14:11:23.948 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-19T14:11:24.299 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-19T14:11:24.604 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-19T14:11:25.115 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-19T14:11:25.536 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-19T14:11:25.807 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-19T14:11:26.215 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-19T14:11:26.342 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-19T14:11:26.468 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-19T14:11:26.594 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-19T14:11:26.721 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-19T14:11:26.946 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-19T14:11:27.120 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-19T14:11:27.509 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-19T14:11:27.681 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-19T14:11:27.846 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-19T14:11:28.012 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-19T14:11:28.181 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-19T14:11:28.347 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-19T14:11:28.563 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-19T14:11:28.727 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-19T14:11:28.894 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-19T14:11:29.104 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-19T14:11:29.270 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-19T14:11:29.465 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-19T14:11:29.687 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-19T14:11:29.955 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-19T14:11:30.154 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-19T14:11:30.310 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-19T14:11:30.525 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-19T14:11:30.770 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-19T14:11:30.970 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-19T14:11:31.213 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-19T14:11:31.409 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-19T14:11:31.609 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-19T14:11:31.806 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-19T14:11:32.101 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-19T14:11:32.355 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-19T14:11:32.594 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-19T14:11:32.782 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-19T14:11:33.003 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-19T14:11:33.266 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-19T14:11:33.540 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-19T14:11:33.755 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-19T14:11:33.991 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-19T14:11:34.321 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-19T14:11:34.473 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-19T14:11:34.638 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-19T14:11:34.795 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-19T14:11:44.928 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-19T14:11:45.199 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-19T14:11:55.117 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-19T14:11:55.389 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-19T14:11:55.660 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-19T14:11:55.794 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-19T14:11:55.968 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-19T14:11:56.140 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-19T14:11:56.315 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-19T14:11:56.493 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-19T14:11:56.705 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-19T14:11:56.834 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-19T14:11:57.006 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-19T14:11:57.226 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-19T14:11:57.396 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-19T14:11:57.702 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-19T14:11:57.960 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-19T14:11:58.135 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-19T14:11:58.269 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-19T14:11:58.596 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-19T14:11:59.502 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-19T14:11:59.631 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-19T14:11:59.805 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-19T14:11:59.990 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-19T14:12:00.211 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-19T14:12:00.486 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-19T14:12:00.709 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-19T14:12:01.166 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-19T14:12:01.619 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-19T14:12:01.825 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-19T14:12:02.700 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-19T14:12:03.585 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-19T14:12:03.788 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-19T14:12:04.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-19T14:12:04.855 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-19T14:12:05.752 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-19T14:12:06.307 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-19T14:12:06.709 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-19T14:12:07.095 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-19T14:12:07.466 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-19T14:12:07.656 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-19T14:12:08.140 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-19T14:12:08.561 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-19T14:12:09.896 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-19T14:12:10.262 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-19T14:12:10.618 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-19T14:12:10.963 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-19T14:12:11.246 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-19T14:12:11.627 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-19T14:12:11.945 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-19T14:12:12.169 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-19T14:12:12.500 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-19T14:12:12.868 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-19T14:12:13.253 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-19T14:12:13.635 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-19T14:12:13.961 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-19T14:12:13.995 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-19T14:12:14.421 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-19T14:12:14.846 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-19T14:12:15.197 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-19T14:12:15.570 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-19T14:12:15.910 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-19T14:12:26.204 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-19T14:12:26.240 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-19T14:12:26.770 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-19T14:12:27.206 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-19T14:12:27.554 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-19T14:12:28.003 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-19T14:12:28.019 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-19T14:12:28.019 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.019 INFO:teuthology.orchestra.run.smithi094.stdout:=============================== warnings summary =============================== 2024-09-19T14:12:28.019 INFO:teuthology.orchestra.run.smithi094.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: import imp 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py:120 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: if boto_type is 'S3Connection': 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_headers.py:124 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: elif boto_type is 'HTTPRequest': 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.020 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3.py:359 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:176 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: if k is 'BucketName': 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:253 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: @pytest.mark.timeout(10) 2024-09-19T14:12:28.021 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: @pytest.mark.s3website_routing_rules 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-19T14:12:28.022 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.023 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.024 INFO:teuthology.orchestra.run.smithi094.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-19T14:12:28.025 INFO:teuthology.orchestra.run.smithi094.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 449.46s (0:07:29) = 2024-09-19T14:12:28.146 INFO:teuthology.orchestra.run.smithi094.stdout:___________________________________ summary ____________________________________ 2024-09-19T14:12:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: py: commands succeeded 2024-09-19T14:12:28.146 INFO:teuthology.orchestra.run.smithi094.stdout: congratulations :) 2024-09-19T14:12:28.163 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-19T14:12:28.163 DEBUG:teuthology.orchestra.run.smithi094:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-19T14:12:28.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:12:28.279 INFO:tasks.s3tests:Cleaning up boto... 2024-09-19T14:12:28.279 DEBUG:teuthology.orchestra.run.smithi094:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-19T14:12:28.309 INFO:tasks.s3tests:Removing s3-tests... 2024-09-19T14:12:28.309 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-19T14:12:28.497 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T14:12:28.510 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T14:12:28.510 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T14:12:28.510 DEBUG:teuthology.orchestra.run.smithi094:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:12:28.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:12:28.539 INFO:teuthology.orchestra.run.smithi094.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T14:12:28.540 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:12:28.609 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T14:12:28.610 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T14:12:28.677 INFO:tasks.workunit:timeout=3h 2024-09-19T14:12:28.677 INFO:tasks.workunit:cleanup=True 2024-09-19T14:12:28.678 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T14:12:28.748 INFO:tasks.workunit.client.0.smithi094.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T14:13:29.281 INFO:tasks.workunit.client.0.smithi094.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T14:13:29.281 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: git switch -c 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr:Or undo this operation with: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: git switch - 2024-09-19T14:13:29.282 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.283 INFO:tasks.workunit.client.0.smithi094.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T14:13:29.283 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:29.283 INFO:tasks.workunit.client.0.smithi094.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T14:13:29.285 DEBUG:teuthology.orchestra.run.smithi094:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T14:13:29.353 INFO:tasks.workunit.client.0.smithi094.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T14:13:29.356 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T14:13:29.356 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T14:13:29.406 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T14:13:29.457 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T14:13:29.495 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T14:13:29.497 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T14:13:29.497 INFO:tasks.workunit.client.0.smithi094.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T14:13:29.536 INFO:tasks.workunit.client.0.smithi094.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T14:13:29.539 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-19T14:13:29.539 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T14:13:29.609 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-19T14:13:29.610 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-19T14:13:29.611 DEBUG:teuthology.orchestra.run.smithi094:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-19T14:13:29.683 INFO:tasks.workunit.client.0.smithi094.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-19T14:13:29.683 INFO:tasks.workunit.client.0.smithi094.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T14:13:29.683 INFO:tasks.workunit.client.0.smithi094.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T14:13:32.057 INFO:tasks.workunit.client.0.smithi094.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T14:13:32.057 INFO:tasks.workunit.client.0.smithi094.stderr:++ deactivate nondestructive 2024-09-19T14:13:32.057 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T14:13:32.057 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T14:13:32.057 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ unset VIRTUAL_ENV 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ export VIRTUAL_ENV 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PATH 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n '' ']' 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -z '' ']' 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T14:13:32.058 INFO:tasks.workunit.client.0.smithi094.stderr:++ PS1='(rgw) ' 2024-09-19T14:13:32.059 INFO:tasks.workunit.client.0.smithi094.stderr:++ export PS1 2024-09-19T14:13:32.059 INFO:tasks.workunit.client.0.smithi094.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:13:32.059 INFO:tasks.workunit.client.0.smithi094.stderr:++ hash -r 2024-09-19T14:13:32.059 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install pip --upgrade 2024-09-19T14:13:32.284 INFO:tasks.workunit.client.0.smithi094.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-19T14:13:32.486 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting pip 2024-09-19T14:13:32.492 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T14:13:32.536 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: pip 2024-09-19T14:13:32.537 INFO:tasks.workunit.client.0.smithi094.stdout: Attempting uninstall: pip 2024-09-19T14:13:32.537 INFO:tasks.workunit.client.0.smithi094.stdout: Found existing installation: pip 21.3.1 2024-09-19T14:13:32.689 INFO:tasks.workunit.client.0.smithi094.stdout: Uninstalling pip-21.3.1: 2024-09-19T14:13:32.695 INFO:tasks.workunit.client.0.smithi094.stdout: Successfully uninstalled pip-21.3.1 2024-09-19T14:13:33.411 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed pip-24.2 2024-09-19T14:13:33.461 INFO:tasks.workunit.client.0.smithi094.stderr:+ pip install boto3 2024-09-19T14:13:34.231 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting boto3 2024-09-19T14:13:34.232 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T14:13:34.773 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T14:13:34.774 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T14:13:34.825 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T14:13:34.826 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T14:13:34.879 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T14:13:34.880 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T14:13:34.931 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:13:34.932 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T14:13:35.008 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:13:35.009 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-19T14:13:35.161 INFO:tasks.workunit.client.0.smithi094.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:13:35.162 INFO:tasks.workunit.client.0.smithi094.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T14:13:35.166 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T14:13:35.168 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T14:13:35.177 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T14:13:35.179 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T14:13:35.180 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T14:13:35.181 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-19T14:13:35.183 INFO:tasks.workunit.client.0.smithi094.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T14:13:35.255 INFO:tasks.workunit.client.0.smithi094.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T14:13:36.299 INFO:tasks.workunit.client.0.smithi094.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-19T14:13:36.419 INFO:tasks.workunit.client.0.smithi094.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-19T14:13:36.538 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-19T14:13:36.572 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:36.572 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:36.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.608+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.609+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.609+0000 7f9a81ba9800 20 realm 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.609+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.609+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.609+0000 7f9a81ba9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.609+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.610+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.610+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.610+0000 7f9a81ba9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:36.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.610+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.611+0000 7f9a81ba9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:36.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.611+0000 7f9a81ba9800 20 searching for the correct realm 2024-09-19T14:13:36.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.614+0000 7f9a7ee92640 0 -- 172.21.15.94:0/1681143603 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x559d6ee7db10 msgr2=0x559d6ee7ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:36.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.618+0000 7f9a7f693640 0 -- 172.21.15.94:0/1681143603 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f9a7401e3e0 msgr2=0x7f9a7401e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.825+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.829 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 zone default found 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 4 Realm: () 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 zonegroup default 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.826+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.830 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 started sync module instance, tier type = 2024-09-19T14:13:36.831 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.827+0000 7f9a81ba9800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=0 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=1 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=2 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=3 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=4 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=5 2024-09-19T14:13:36.839 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=6 2024-09-19T14:13:36.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 20 add_watcher() i=7 2024-09-19T14:13:36.840 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.837+0000 7f9a81ba9800 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:36.841 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.839+0000 7f9935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:36.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:36.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:36.842 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 5 note: GC not initialized 2024-09-19T14:13:36.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9934fe1640 20 reqs_thread_entry: start 2024-09-19T14:13:36.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 20 init_complete bucket index max shards: 11 2024-09-19T14:13:36.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 20 Filter name: none 2024-09-19T14:13:36.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f98ae7fc640 20 reqs_thread_entry: start 2024-09-19T14:13:36.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-19T14:13:36.843 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.840+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 20 rados->read ofs=0 len=0 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-19T14:13:36.844 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.841+0000 7f9a81ba9800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-19T14:13:36.845 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.842+0000 7f9a81ba9800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-19T14:13:36.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.842+0000 7f9a81ba9800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-19T14:13:36.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.842+0000 7f9a81ba9800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-19T14:13:36.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.843+0000 7f9962ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497238 cookie 94134658945024 notifier 8708 bl.length()=613 2024-09-19T14:13:36.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.843+0000 7f9962ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-19T14:13:36.846 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.843+0000 7f9962ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-19T14:13:36.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.844+0000 7f9a81ba9800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-19T14:13:36.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.844+0000 7f9a81ba9800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-19T14:13:36.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.844+0000 7f9a81ba9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-19T14:13:36.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.845+0000 7f99627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497470 cookie 94134658942256 notifier 8708 bl.length()=191 2024-09-19T14:13:36.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.845+0000 7f99627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-19T14:13:36.847 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.845+0000 7f99627fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-19T14:13:36.848 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.846+0000 7f9935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:36.850 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.848+0000 7f9a81ba9800 20 remove_watcher() i=0 2024-09-19T14:13:36.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.848+0000 7f9a81ba9800 2 removed watcher, disabling cache 2024-09-19T14:13:36.851 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.849+0000 7f9a81ba9800 20 remove_watcher() i=1 2024-09-19T14:13:36.852 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.850+0000 7f9a81ba9800 20 remove_watcher() i=2 2024-09-19T14:13:36.853 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.851+0000 7f9a81ba9800 20 remove_watcher() i=3 2024-09-19T14:13:36.854 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.852+0000 7f9a81ba9800 20 remove_watcher() i=4 2024-09-19T14:13:36.855 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.853+0000 7f9a81ba9800 20 remove_watcher() i=5 2024-09-19T14:13:36.856 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.854+0000 7f9a81ba9800 20 remove_watcher() i=6 2024-09-19T14:13:36.857 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:36.855+0000 7f9a81ba9800 20 remove_watcher() i=7 2024-09-19T14:13:37.034 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-19T14:13:37.034 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:37.065 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-19T14:13:37.093 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:37.093 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:37.129 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.127+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 realm 2024-09-19T14:13:37.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.131 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:37.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.129+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.130+0000 7f1444142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:37.132 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.130+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.130+0000 7f1444142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:37.133 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.130+0000 7f1444142800 20 searching for the correct realm 2024-09-19T14:13:37.135 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.133+0000 7f1437685640 0 -- 172.21.15.94:0/2902736656 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f1430076040 msgr2=0x7f1430062150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:37.139 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.137+0000 7f143fe86640 0 -- 172.21.15.94:0/2902736656 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f1428065ba0 msgr2=0x7f14280ac440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:37.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:13:37.345 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:37.346 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.343+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:37.347 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 zone default found 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 4 Realm: () 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 zonegroup default 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.344+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.345+0000 7f1444142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.345+0000 7f1444142800 20 started sync module instance, tier type = 2024-09-19T14:13:37.348 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.345+0000 7f1444142800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:13:37.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=0 2024-09-19T14:13:37.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=1 2024-09-19T14:13:37.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=2 2024-09-19T14:13:37.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=3 2024-09-19T14:13:37.356 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=4 2024-09-19T14:13:37.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=5 2024-09-19T14:13:37.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.354+0000 7f1444142800 20 add_watcher() i=6 2024-09-19T14:13:37.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.355+0000 7f1444142800 20 add_watcher() i=7 2024-09-19T14:13:37.357 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.355+0000 7f1444142800 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f12f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f1444142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f1444142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f1444142800 5 note: GC not initialized 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f12f4fe1640 20 reqs_thread_entry: start 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f1444142800 20 init_complete bucket index max shards: 11 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f1444142800 20 Filter name: none 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f126e7fc640 20 reqs_thread_entry: start 2024-09-19T14:13:37.360 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.357+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 rados_obj.operate() r=0 bl.length=209 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 rados->read ofs=0 len=0 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 rados_obj.operate() r=0 bl.length=431 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 INFO: main: starting shard=0 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.358+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.0 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.359+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.359+0000 7f1444142800 20 INFO: main: starting shard=1 2024-09-19T14:13:37.362 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.359+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.1 2024-09-19T14:13:37.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.359+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.359+0000 7f1444142800 20 INFO: main: starting shard=2 2024-09-19T14:13:37.363 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.359+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.2 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.360+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.360+0000 7f1444142800 20 INFO: main: starting shard=3 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.360+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.3 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.361+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.361+0000 7f1444142800 20 INFO: main: starting shard=4 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.361+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.4 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.361+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.361+0000 7f1444142800 20 INFO: main: starting shard=5 2024-09-19T14:13:37.364 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.361+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.5 2024-09-19T14:13:37.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.362+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.362+0000 7f1444142800 20 INFO: main: starting shard=6 2024-09-19T14:13:37.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.362+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.6 2024-09-19T14:13:37.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.362+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.365 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.362+0000 7f1444142800 20 INFO: main: starting shard=7 2024-09-19T14:13:37.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.362+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.7 2024-09-19T14:13:37.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.363+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.363+0000 7f1444142800 20 INFO: main: starting shard=8 2024-09-19T14:13:37.366 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.363+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.8 2024-09-19T14:13:37.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.364+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.367 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.364+0000 7f1444142800 20 INFO: main: starting shard=9 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.364+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.9 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.364+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.364+0000 7f1444142800 20 INFO: main: starting shard=10 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.364+0000 7f1444142800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.10 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.365+0000 7f1444142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.365+0000 7f1444142800 20 INFO: main: done 2024-09-19T14:13:37.368 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.365+0000 7f12f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:37.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.368+0000 7f1444142800 20 remove_watcher() i=0 2024-09-19T14:13:37.370 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.368+0000 7f1444142800 2 removed watcher, disabling cache 2024-09-19T14:13:37.371 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.369+0000 7f1444142800 20 remove_watcher() i=1 2024-09-19T14:13:37.372 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.370+0000 7f1444142800 20 remove_watcher() i=2 2024-09-19T14:13:37.373 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.371+0000 7f1444142800 20 remove_watcher() i=3 2024-09-19T14:13:37.374 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.372+0000 7f1444142800 20 remove_watcher() i=4 2024-09-19T14:13:37.375 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.373+0000 7f1444142800 20 remove_watcher() i=5 2024-09-19T14:13:37.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.374+0000 7f1444142800 20 remove_watcher() i=6 2024-09-19T14:13:37.377 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.375+0000 7f1444142800 20 remove_watcher() i=7 2024-09-19T14:13:37.388 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.data ls | grep ca5bce94-c8b1-4674-9667-f1fde0e34ea3 2024-09-19T14:13:37.412 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:37.412 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:37.505 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:37.503+0000 7f9e074c0640 0 -- 172.21.15.94:0/1890161825 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x7f9df0061400 msgr2=0x7f9df0061820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:37.512 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-19T14:13:37.512 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:37.513 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T14:13:38.922 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T14:13:39.312 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-19T14:13:39.340 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:39.340 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:39.376 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.374+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.375+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.375+0000 7f93c153b800 20 realm 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.375+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.375+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.375+0000 7f93c153b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.375+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.376+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.378 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.376+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.376+0000 7f93c153b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:39.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.377+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.377+0000 7f93c153b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:39.379 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.377+0000 7f93c153b800 20 searching for the correct realm 2024-09-19T14:13:39.382 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.380+0000 7f93b7fff640 0 -- 172.21.15.94:0/262951314 >> [v2:172.21.15.149:6826/1468975705,v1:172.21.15.149:6827/1468975705] conn(0x7f93b00c6bd0 msgr2=0x7f93b00ab490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:39.386 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.384+0000 7f93bd225640 0 -- 172.21.15.94:0/262951314 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f93a803d9d0 msgr2=0x7f93a8092940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:39.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:13:39.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:39.592 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.589+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:39.593 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:39.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 zone default found 2024-09-19T14:13:39.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 4 Realm: () 2024-09-19T14:13:39.594 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 zonegroup default 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.590+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 started sync module instance, tier type = 2024-09-19T14:13:39.595 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.591+0000 7f93c153b800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=0 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=1 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=2 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=3 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=4 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=5 2024-09-19T14:13:39.603 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=6 2024-09-19T14:13:39.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 20 add_watcher() i=7 2024-09-19T14:13:39.604 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.601+0000 7f93c153b800 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:39.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.603+0000 7f92737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:39.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f93c153b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:39.606 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f93c153b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:39.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f93c153b800 5 note: GC not initialized 2024-09-19T14:13:39.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f92727e4640 20 reqs_thread_entry: start 2024-09-19T14:13:39.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f93c153b800 20 init_complete bucket index max shards: 11 2024-09-19T14:13:39.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f93c153b800 20 Filter name: none 2024-09-19T14:13:39.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f91e3fff640 20 reqs_thread_entry: start 2024-09-19T14:13:39.607 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.604+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 rados_obj.operate() r=0 bl.length=209 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 rados->read ofs=0 len=0 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 rados_obj.operate() r=0 bl.length=431 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 INFO: main: starting shard=0 2024-09-19T14:13:39.609 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.0 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 INFO: main: starting shard=1 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.605+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.1 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.606+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.606+0000 7f93c153b800 20 INFO: main: starting shard=2 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.606+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.2 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.606+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.606+0000 7f93c153b800 20 INFO: main: starting shard=3 2024-09-19T14:13:39.610 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.606+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.3 2024-09-19T14:13:39.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.607+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.607+0000 7f93c153b800 20 INFO: main: starting shard=4 2024-09-19T14:13:39.611 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.607+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.4 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.608+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.608+0000 7f93c153b800 20 INFO: main: starting shard=5 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.608+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.5 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.608+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.608+0000 7f93c153b800 20 INFO: main: starting shard=6 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.608+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.6 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.609+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.609+0000 7f93c153b800 20 INFO: main: starting shard=7 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.609+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.7 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.609+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.609+0000 7f93c153b800 20 INFO: main: starting shard=8 2024-09-19T14:13:39.612 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.609+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.8 2024-09-19T14:13:39.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 INFO: main: starting shard=9 2024-09-19T14:13:39.613 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.9 2024-09-19T14:13:39.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 INFO: main: starting shard=10 2024-09-19T14:13:39.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.10 2024-09-19T14:13:39.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:39.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.610+0000 7f93c153b800 20 INFO: main: done 2024-09-19T14:13:39.614 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.611+0000 7f92737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.614+0000 7f93c153b800 20 remove_watcher() i=0 2024-09-19T14:13:39.616 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.614+0000 7f93c153b800 2 removed watcher, disabling cache 2024-09-19T14:13:39.617 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.615+0000 7f93c153b800 20 remove_watcher() i=1 2024-09-19T14:13:39.618 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.616+0000 7f93c153b800 20 remove_watcher() i=2 2024-09-19T14:13:39.619 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.617+0000 7f93c153b800 20 remove_watcher() i=3 2024-09-19T14:13:39.620 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.618+0000 7f93c153b800 20 remove_watcher() i=4 2024-09-19T14:13:39.621 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.619+0000 7f93c153b800 20 remove_watcher() i=5 2024-09-19T14:13:39.622 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.620+0000 7f93c153b800 20 remove_watcher() i=6 2024-09-19T14:13:39.623 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.621+0000 7f93c153b800 20 remove_watcher() i=7 2024-09-19T14:13:39.635 INFO:tasks.workunit.client.0.smithi094.stderr:rados -p default.rgw.buckets.data ls | grep a9acbc4d-41fa-4d1c-b827-3e0b1fab105e 2024-09-19T14:13:39.657 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:39.657 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:39.698 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:39.696+0000 7f6d1cb95640 0 -- 172.21.15.94:0/3913409809 >> [v2:172.21.15.94:6816/2406227919,v1:172.21.15.94:6817/2406227919] conn(0x7f6d10011420 msgr2=0x7f6d1000e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:39.704 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-19T14:13:39.704 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:39.740 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T14:13:41.188 INFO:tasks.workunit.client.0.smithi094.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:13:41.189 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T14:13:41.598 INFO:tasks.workunit.client.0.smithi094.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-19T14:13:41.599 INFO:tasks.workunit.client.0.smithi094.stderr: 2024-09-19T14:13:41.698 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-19T14:13:45.109 INFO:tasks.workunit.client.0.smithi094.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-19T14:13:45.510 INFO:tasks.workunit.client.0.smithi094.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-19T14:13:45.540 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:45.540 INFO:tasks.workunit.client.0.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:45.577 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.575+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.576+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.576+0000 7faf3d539800 20 realm 2024-09-19T14:13:45.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.576+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.576+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.579 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.576+0000 7faf3d539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:45.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.576+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.577+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.577+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.580 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.577+0000 7faf3d539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:45.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.578+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.578+0000 7faf3d539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:45.581 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.578+0000 7faf3d539800 20 searching for the correct realm 2024-09-19T14:13:45.583 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.581+0000 7faf399c8640 0 -- 172.21.15.94:0/2240065631 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7faf3006c070 msgr2=0x7faf300b63a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:45.587 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.585+0000 7faf391c7640 0 -- 172.21.15.94:0/2240065631 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7faf300b41c0 msgr2=0x7faf300c7110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.790+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.793 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 zone default found 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 4 Realm: () 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 zonegroup default 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.791+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.795 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.792+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.792+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.792+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.792+0000 7faf3d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:45.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.792+0000 7faf3d539800 20 started sync module instance, tier type = 2024-09-19T14:13:45.796 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.792+0000 7faf3d539800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:13:45.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=0 2024-09-19T14:13:45.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=1 2024-09-19T14:13:45.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=2 2024-09-19T14:13:45.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=3 2024-09-19T14:13:45.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=4 2024-09-19T14:13:45.804 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=5 2024-09-19T14:13:45.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.802+0000 7faf3d539800 20 add_watcher() i=6 2024-09-19T14:13:45.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.803+0000 7faf3d539800 20 add_watcher() i=7 2024-09-19T14:13:45.805 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.803+0000 7faf3d539800 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:45.807 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.804+0000 7fadef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 5 note: GC not initialized 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7fadee7e4640 20 reqs_thread_entry: start 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 20 init_complete bucket index max shards: 11 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 20 Filter name: none 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7fad5ffff640 20 reqs_thread_entry: start 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-19T14:13:45.808 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.805+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 20 rados_obj.operate() r=0 bl.length=209 2024-09-19T14:13:45.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-19T14:13:45.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-19T14:13:45.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783 : miss 2024-09-19T14:13:45.809 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 20 rados->read ofs=0 len=0 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 20 rados_obj.operate() r=0 bl.length=431 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783 info.flags=0x17 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783 to cache LRU end 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.806+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.0 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.807+0000 7faf3d539800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T14:13:45.810 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.807+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.1 2024-09-19T14:13:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.807+0000 7faf3d539800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T14:13:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.807+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.2 2024-09-19T14:13:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.807+0000 7faf3d539800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T14:13:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.807+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.3 2024-09-19T14:13:45.811 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.808+0000 7faf3d539800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.808+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.4 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.809+0000 7faf3d539800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.809+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.5 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.809+0000 7faf3d539800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.809+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.6 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.810+0000 7faf3d539800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T14:13:45.812 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.810+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.7 2024-09-19T14:13:45.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.810+0000 7faf3d539800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T14:13:45.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.810+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.8 2024-09-19T14:13:45.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.810+0000 7faf3d539800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T14:13:45.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.811+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.9 2024-09-19T14:13:45.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.811+0000 7faf3d539800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T14:13:45.813 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.811+0000 7faf3d539800 20 bucket index object: :.dir.ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.783.10 2024-09-19T14:13:45.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.811+0000 7faf3d539800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T14:13:45.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.811+0000 7faf3d539800 1 NOTICE: finished all shards (0 entries found) 2024-09-19T14:13:45.814 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.812+0000 7fadef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:45.816 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.814+0000 7faf3d539800 20 remove_watcher() i=0 2024-09-19T14:13:45.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.814+0000 7faf3d539800 2 removed watcher, disabling cache 2024-09-19T14:13:45.817 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.816+0000 7faf3d539800 20 remove_watcher() i=1 2024-09-19T14:13:45.819 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.817+0000 7faf3d539800 20 remove_watcher() i=2 2024-09-19T14:13:45.820 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.818+0000 7faf3d539800 20 remove_watcher() i=3 2024-09-19T14:13:45.821 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.819+0000 7faf3d539800 20 remove_watcher() i=4 2024-09-19T14:13:45.822 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.820+0000 7faf3d539800 20 remove_watcher() i=5 2024-09-19T14:13:45.823 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.821+0000 7faf3d539800 20 remove_watcher() i=6 2024-09-19T14:13:45.824 INFO:tasks.workunit.client.0.smithi094.stderr:2024-09-19T14:13:45.822+0000 7faf3d539800 20 remove_watcher() i=7 2024-09-19T14:13:45.834 INFO:tasks.workunit.client.0.smithi094.stderr:Deleting bucket versioning-bucket 2024-09-19T14:13:45.869 INFO:tasks.workunit.client.0.smithi094.stderr:Completed bucket versioning tests 2024-09-19T14:13:45.870 INFO:tasks.workunit.client.0.smithi094.stdout:connected to http://localhost:80 2024-09-19T14:13:45.928 INFO:tasks.workunit.client.0.smithi094.stderr:+ deactivate 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ export PATH 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ hash -r 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' -n '' ']' 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset VIRTUAL_ENV 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T14:13:45.929 INFO:tasks.workunit.client.0.smithi094.stderr:+ unset -f deactivate 2024-09-19T14:13:45.930 INFO:tasks.workunit.client.0.smithi094.stderr:+ echo OK. 2024-09-19T14:13:45.930 INFO:tasks.workunit.client.0.smithi094.stdout:OK. 2024-09-19T14:13:45.931 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T14:13:45.931 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T14:13:46.012 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-19T14:13:46.012 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T14:13:46.375 DEBUG:teuthology.parallel:result is None 2024-09-19T14:13:46.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:13:46.414 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:13:46.415 DEBUG:teuthology.orchestra.run.smithi094:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:13:46.484 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:13:46.484 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-19T14:13:46.495 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-19T14:13:46.611 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-19T14:13:46.611 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-19T14:13:46.611 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-19T14:13:46.673 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-19T14:13:46.674 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-19T14:13:46.732 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:46.732 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:46.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.762+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 realm 2024-09-19T14:13:46.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:46.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.764+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.765+0000 7fc463814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:46.769 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.765+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.765+0000 7fc463814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:46.770 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.765+0000 7fc463814800 20 searching for the correct realm 2024-09-19T14:13:46.772 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.770+0000 7fc45f6cc640 0 -- 172.21.15.94:0/2196627958 >> [v2:172.21.15.149:6802/2885675404,v1:172.21.15.149:6803/2885675404] conn(0x7fc44805b040 msgr2=0x7fc448096560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:46.978 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.976+0000 7fc45eecb640 0 -- 172.21.15.94:0/2196627958 >> [v2:172.21.15.149:6810/155328186,v1:172.21.15.149:6811/155328186] conn(0x5557207127e0 msgr2=0x555720714bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.978+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.981 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 zone default found 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 4 Realm: () 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 zonegroup default 2024-09-19T14:13:46.983 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.979+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 started sync module instance, tier type = 2024-09-19T14:13:46.984 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.980+0000 7fc463814800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=0 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=1 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=2 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=3 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=4 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=5 2024-09-19T14:13:46.992 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.990+0000 7fc463814800 20 add_watcher() i=6 2024-09-19T14:13:46.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.991+0000 7fc463814800 20 add_watcher() i=7 2024-09-19T14:13:46.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.991+0000 7fc463814800 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:46.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.992+0000 7fc3157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:46.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.993+0000 7fc463814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:46.995 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:46.993+0000 7fc463814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:47.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.033+0000 7fc28ffff640 20 reqs_thread_entry: start 2024-09-19T14:13:47.036 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.033+0000 7fc463814800 20 init_complete bucket index max shards: 11 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.033+0000 7fc463814800 20 Filter name: none 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc28dffb640 20 reqs_thread_entry: start 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc463814800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc463814800 20 rados->read ofs=0 len=0 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc463814800 20 rados_obj.operate() r=0 bl.length=482 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc463814800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc463814800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.034+0000 7fc463814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:47.037 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.035+0000 7fc463814800 10 removing key index: SSPLTYERYOXLIWRYAZOF 2024-09-19T14:13:47.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.036+0000 7fc463814800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:SSPLTYERYOXLIWRYAZOF, ofs0, ns] 2024-09-19T14:13:47.038 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.036+0000 7fc3427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497473 cookie 93832694846864 notifier 8822 bl.length()=170 2024-09-19T14:13:47.039 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.037+0000 7fc463814800 10 removing email index: tester.client.0_test@test.test 2024-09-19T14:13:47.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.038+0000 7fc463814800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-19T14:13:47.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.038+0000 7fc341ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497212 cookie 93832694840576 notifier 8822 bl.length()=181 2024-09-19T14:13:47.040 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.038+0000 7fc463814800 10 removing user buckets index 2024-09-19T14:13:47.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.040+0000 7fc463814800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-19T14:13:47.042 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.040+0000 7fc3427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497239 cookie 93832694854288 notifier 8822 bl.length()=172 2024-09-19T14:13:47.043 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.041+0000 7fc463814800 10 removing user index: tester.client.0 2024-09-19T14:13:47.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.042+0000 7fc463814800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-19T14:13:47.044 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.042+0000 7fc463814800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-19T14:13:47.045 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.043+0000 7fc341ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497474 cookie 93832694837408 notifier 8822 bl.length()=164 2024-09-19T14:13:47.046 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.044+0000 7fc3157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.046+0000 7fc463814800 20 remove_watcher() i=0 2024-09-19T14:13:47.048 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.046+0000 7fc463814800 2 removed watcher, disabling cache 2024-09-19T14:13:47.049 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.047+0000 7fc463814800 20 remove_watcher() i=1 2024-09-19T14:13:47.050 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.048+0000 7fc463814800 20 remove_watcher() i=2 2024-09-19T14:13:47.051 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.050+0000 7fc463814800 20 remove_watcher() i=3 2024-09-19T14:13:47.053 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.051+0000 7fc463814800 20 remove_watcher() i=4 2024-09-19T14:13:47.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.052+0000 7fc463814800 20 remove_watcher() i=5 2024-09-19T14:13:47.054 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.052+0000 7fc463814800 20 remove_watcher() i=6 2024-09-19T14:13:47.055 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:13:47.053+0000 7fc463814800 20 remove_watcher() i=7 2024-09-19T14:13:47.066 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-19T14:13:47.076 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-19T14:13:47.085 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-19T14:13:47.140 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-19T14:13:47.150 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-19T14:13:47.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:13:47.151 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-19T14:13:47.148+0000 7f6501409640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 43983) UID: 0 2024-09-19T14:13:47.151 INFO:tasks.rgw.client.0.smithi094.stdout:2024-09-19T14:13:47.148+0000 7f6506d22880 -1 shutting down 2024-09-19T14:14:17.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-19T14:14:17.657 INFO:tasks.rgw.client.0:Stopped 2024-09-19T14:14:17.657 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-19T14:14:17.692 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /etc/ceph/vault-root-token 2024-09-19T14:14:17.775 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-19T14:14:17.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-19T14:14:17.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-19T14:14:17.856 DEBUG:teuthology.orchestra.run.smithi094:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-19T14:14:17.954 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:17.955 INFO:teuthology.orchestra.run.smithi094.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:17.987 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.986+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 realm 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:17.989 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.987+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:17.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.988+0000 7f1e66087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:17.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.988+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:17.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.989+0000 7f1e66087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:17.990 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.989+0000 7f1e66087800 20 searching for the correct realm 2024-09-19T14:14:17.993 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.992+0000 7f1e64372640 0 -- 172.21.15.94:0/2208066818 >> [v2:172.21.15.149:6818/2247801421,v1:172.21.15.149:6819/2247801421] conn(0x7f1e4c001c20 msgr2=0x7f1e4c067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:17.996 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:17.995+0000 7f1e63b71640 0 -- 172.21.15.94:0/2208066818 >> [v2:172.21.15.94:6808/2947892333,v1:172.21.15.94:6809/2947892333] conn(0x7f1e4c0722d0 msgr2=0x7f1e4c0729b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:14:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.201+0000 7f1e66087800 20 RGWRados::pool_iterate: got zonegroup_info.caecde26-c7f4-497f-8f73-0cca89ea7a27 2024-09-19T14:14:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.201+0000 7f1e66087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.201+0000 7f1e66087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:18.203 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.201+0000 7f1e66087800 20 RGWRados::pool_iterate: got zone_info.ebdf9632-5f0a-4135-af04-1b7f59e5ac82 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.201+0000 7f1e66087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.201+0000 7f1e66087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:18.204 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:18.208 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 zone default found 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 4 Realm: () 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 4 ZoneGroup: default (caecde26-c7f4-497f-8f73-0cca89ea7a27) 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 4 Zone: default (ebdf9632-5f0a-4135-af04-1b7f59e5ac82) 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.202+0000 7f1e66087800 20 zonegroup default 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 rados->read ofs=0 len=0 2024-09-19T14:14:18.209 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.203+0000 7f1e66087800 20 started sync module instance, tier type = 2024-09-19T14:14:18.210 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.204+0000 7f1e66087800 20 started zone id=ebdf9632-5f0a-4135-af04-1b7f59e5ac82 (name=default) with tier type = 2024-09-19T14:14:18.214 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=0 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=1 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=2 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=3 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=4 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=5 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.213+0000 7f1e66087800 20 add_watcher() i=6 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.214+0000 7f1e66087800 20 add_watcher() i=7 2024-09-19T14:14:18.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.214+0000 7f1e66087800 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:18.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.216+0000 7f1d19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:18.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.216+0000 7f1e66087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:18.217 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.216+0000 7f1e66087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.254+0000 7f1d18fe1640 20 reqs_thread_entry: start 2024-09-19T14:14:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.254+0000 7f1e66087800 20 init_complete bucket index max shards: 11 2024-09-19T14:14:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.254+0000 7f1e66087800 20 Filter name: none 2024-09-19T14:14:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.254+0000 7f1c927fc640 20 reqs_thread_entry: start 2024-09-19T14:14:18.256 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.254+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:14:18.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.256+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.257 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.256+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.257+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:14:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.257+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_N12cIUi8xGunMF-LGxi7qKQtnSEaUr9', time=2024-09-19T16:05:06.589952+0000, chain.objs.size()=2 2024-09-19T14:14:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.257+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.DUiZUVpC78TnuOqo-NR2MffvWuEnURT_0 2024-09-19T14:14:18.258 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.257+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.DUiZUVpC78TnuOqo-NR2MffvWuEnURT_1 2024-09-19T14:14:18.260 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.259+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.262 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.261+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:14:18.263 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.262+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.264 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:14:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_U-Zwmb-DrN6pa5HnwsbcHglIDyq4Pb7', time=2024-09-19T16:05:08.035777+0000, chain.objs.size()=2 2024-09-19T14:14:18.265 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.Vy5uLUw1XIDF7DVjd9IYPZIeucpdqIY_1 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.Vy5uLUw1XIDF7DVjd9IYPZIeucpdqIY_2 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11539942028803324233', time=2024-09-19T16:07:42.899104+0000, chain.objs.size()=6 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.W8Fqn9IRCexkZMHTQL0Zv99ajgmeNEP7.1 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im.2 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im.3 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im.4 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im.5 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im.6 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9249455308921105007', time=2024-09-19T16:07:45.582022+0000, chain.objs.size()=6 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz.1 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.-52Xr5OVP2PrhUlAVM81Q4fUkQy4ZcfP.2 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.XP-S_J6NyeL8cnpgc2_h4SWdQXwBQzUG.3 2024-09-19T14:14:18.266 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.263+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz.4 2024-09-19T14:14:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.267+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz.5 2024-09-19T14:14:18.268 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.267+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz.6 2024-09-19T14:14:18.271 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.270+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.273 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.272+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:14:18.274 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.273+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.275 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17329063774709615445', time=2024-09-19T16:07:39.689957+0000, chain.objs.size()=6 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.520__multipart_mymultipart.2~qyu8xfS_fGi-QiEQdxG6MNkoawg7Jqz.1 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.520__multipart_mymultipart.2~qyu8xfS_fGi-QiEQdxG6MNkoawg7Jqz.2 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.520__multipart_mymultipart.2~qyu8xfS_fGi-QiEQdxG6MNkoawg7Jqz.3 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.520__multipart_mymultipart.2~qyu8xfS_fGi-QiEQdxG6MNkoawg7Jqz.4 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.520__multipart_mymultipart.2~qyu8xfS_fGi-QiEQdxG6MNkoawg7Jqz.5 2024-09-19T14:14:18.276 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.274+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.520__multipart_mymultipart.2~qyu8xfS_fGi-QiEQdxG6MNkoawg7Jqz.6 2024-09-19T14:14:18.277 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.276+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.278+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:14:18.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:14:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_CXeX19jvy-XDnrvOhxZzMjEVwpZmfr4', time=2024-09-19T16:05:05.957350+0000, chain.objs.size()=1 2024-09-19T14:14:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.4FrB5wuXFx7b06uGWneVNRnM8VeuSw8_0 2024-09-19T14:14:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4791543330348105060', time=2024-09-19T16:08:28.150690+0000, chain.objs.size()=1 2024-09-19T14:14:18.282 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.280+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.564__shadow_.iJbVrT7gv1nJjZQOO2vQCCWUtpMCErg_1 2024-09-19T14:14:18.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.282+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.284+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:14:18.286 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.285+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.287 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7236826893010616525', time=2024-09-19T16:07:35.731427+0000, chain.objs.size()=6 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.1 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.2 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.3 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.4 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.5 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.6 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13838649981720292092', time=2024-09-19T16:07:38.549031+0000, chain.objs.size()=1 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.519__multipart_mymultipart.2~Cg9NxT7vnxoeKhSwg1Pb_AiO3XJ5I3F.1 2024-09-19T14:14:18.288 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10810175890769642539', time=2024-09-19T16:07:41.051943+0000, chain.objs.size()=3 2024-09-19T14:14:18.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~jY_M9d4EZbG4bHuKXAflDChxIJpv-k3.1 2024-09-19T14:14:18.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~jY_M9d4EZbG4bHuKXAflDChxIJpv-k3.2 2024-09-19T14:14:18.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.286+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~jY_M9d4EZbG4bHuKXAflDChxIJpv-k3.3 2024-09-19T14:14:18.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.288+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.291 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.290+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:14:18.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16238464418503623923', time=2024-09-19T16:07:47.623099+0000, chain.objs.size()=2 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~6J0K6obtWY9Byiy3YMpDT4fvvg3iJ76.1 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~6J0K6obtWY9Byiy3YMpDT4fvvg3iJ76.2 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8872780890446214696', time=2024-09-19T16:07:49.787927+0000, chain.objs.size()=2 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.529__multipart_mymultipart.2~3I-zosArzrHxpP6fRnBA2vUOV04TXLP.1 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.529__multipart_mymultipart.2~3I-zosArzrHxpP6fRnBA2vUOV04TXLP.2 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.715678002481049050', time=2024-09-19T16:09:06.437261+0000, chain.objs.size()=6 2024-09-19T14:14:18.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.614__multipart_multipart_enc.2~ZsAX0A8nCNPr6_uE_Ril8_QCOLhGmeT.1 2024-09-19T14:14:18.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.614__multipart_multipart_enc.2~ZsAX0A8nCNPr6_uE_Ril8_QCOLhGmeT.2 2024-09-19T14:14:18.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.614__multipart_multipart_enc.2~ZsAX0A8nCNPr6_uE_Ril8_QCOLhGmeT.3 2024-09-19T14:14:18.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.614__multipart_multipart_enc.2~ZsAX0A8nCNPr6_uE_Ril8_QCOLhGmeT.4 2024-09-19T14:14:18.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.614__multipart_multipart_enc.2~ZsAX0A8nCNPr6_uE_Ril8_QCOLhGmeT.5 2024-09-19T14:14:18.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.292+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.614__multipart_multipart_enc.2~ZsAX0A8nCNPr6_uE_Ril8_QCOLhGmeT.6 2024-09-19T14:14:18.299 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.298+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.301 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.300+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:14:18.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.303 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:14:18.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_IKx90BQvBgpfVAQ4ZXc9v4LdBia25hu', time=2024-09-19T16:05:09.192289+0000, chain.objs.size()=1 2024-09-19T14:14:18.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.166__shadow_.zH4QL1bJ5CHPA-XKF-KPMpOC8-nbOvM_0 2024-09-19T14:14:18.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3296102482306347720', time=2024-09-19T16:07:38.827967+0000, chain.objs.size()=1 2024-09-19T14:14:18.304 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.302+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.519__multipart_mymultipart.2~ifzN-2Kcku8sNvUojMoW5SYZLDxJmwO.1 2024-09-19T14:14:18.305 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.304+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.307 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.306+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:14:18.308 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.307+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.309 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-19T14:14:18.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_CNlsCL2nJrjFoxO1IxzuHW_Ndqq8w-Q', time=2024-09-19T16:05:08.181637+0000, chain.objs.size()=2 2024-09-19T14:14:18.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.dQ9E0ig5dYvZGMd67rxreWFPVJqjylz_0 2024-09-19T14:14:18.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.dQ9E0ig5dYvZGMd67rxreWFPVJqjylz_1 2024-09-19T14:14:18.310 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im', time=2024-09-19T16:07:42.117860+0000, chain.objs.size()=1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~UjDKu-hr6dmaRYxoMiu7qvqC8ZJL2Im.1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd', time=2024-09-19T16:07:43.666791+0000, chain.objs.size()=1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd.3 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2555082436868028170', time=2024-09-19T16:07:46.288790+0000, chain.objs.size()=2 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~e3LEfyiMDJPkZ47HPFotcViYOxICcnu.1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~e3LEfyiMDJPkZ47HPFotcViYOxICcnu.2 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~cyeTeA0G9uGYwfKKJVQhLRHofyWRt_W', time=2024-09-19T16:07:50.750100+0000, chain.objs.size()=1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.532__multipart_mymultipart.2~cyeTeA0G9uGYwfKKJVQhLRHofyWRt_W.1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3148094914963641971', time=2024-09-19T16:12:01.067421+0000, chain.objs.size()=1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.308+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.743__multipart_mymultipart3.2~zyp6hSDXo-HXJw5szbQeZ4QlGmdE9FI.1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.309+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13105052088693059943', time=2024-09-19T16:12:26.113947+0000, chain.objs.size()=4 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.309+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.780__shadow_.XWESEbEPjt5ZlF4ftN_azgWKOuNnEgU_1 2024-09-19T14:14:18.311 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.309+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.780__shadow_.XWESEbEPjt5ZlF4ftN_azgWKOuNnEgU_2 2024-09-19T14:14:18.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.309+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.780__shadow_.XWESEbEPjt5ZlF4ftN_azgWKOuNnEgU_3 2024-09-19T14:14:18.312 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.309+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.780__shadow_.XWESEbEPjt5ZlF4ftN_azgWKOuNnEgU_4 2024-09-19T14:14:18.315 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.314+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.317 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.316+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:14:18.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.318+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.319 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.318+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16513053507373052047', time=2024-09-19T16:05:05.721702+0000, chain.objs.size()=3 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-FROZEN.2~MOr5ec712p9qj6gsyUYsUGCTbSatm7H.1 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-FROZEN.2~MOr5ec712p9qj6gsyUYsUGCTbSatm7H.2 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-FROZEN.2~MOr5ec712p9qj6gsyUYsUGCTbSatm7H.3 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7221889455388745599', time=2024-09-19T16:07:35.955509+0000, chain.objs.size()=6 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.1 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.2 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.3 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.4 2024-09-19T14:14:18.321 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.5 2024-09-19T14:14:18.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.6 2024-09-19T14:14:18.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~hRRnCWFy6tasDtDdB-qp5y47hFQV6Nb', time=2024-09-19T16:07:51.807443+0000, chain.objs.size()=1 2024-09-19T14:14:18.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.536__multipart_mymultipart.2~hRRnCWFy6tasDtDdB-qp5y47hFQV6Nb.3 2024-09-19T14:14:18.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15869827499367191312', time=2024-09-19T16:11:12.070702+0000, chain.objs.size()=6 2024-09-19T14:14:18.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.624__multipart_multipart_enc.2~Q6EAxuW0LOD2RCE2ykMueSmZasQTbiw.1 2024-09-19T14:14:18.322 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.319+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.624__multipart_multipart_enc.2~Q6EAxuW0LOD2RCE2ykMueSmZasQTbiw.2 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.624__multipart_multipart_enc.2~Q6EAxuW0LOD2RCE2ykMueSmZasQTbiw.3 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.624__multipart_multipart_enc.2~Q6EAxuW0LOD2RCE2ykMueSmZasQTbiw.4 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.624__multipart_multipart_enc.2~Q6EAxuW0LOD2RCE2ykMueSmZasQTbiw.5 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.624__multipart_multipart_enc.2~Q6EAxuW0LOD2RCE2ykMueSmZasQTbiw.6 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp', time=2024-09-19T16:11:13.397971+0000, chain.objs.size()=6 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.626__multipart_multipart_enc.2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp.1 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.626__multipart_multipart_enc.2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp.2 2024-09-19T14:14:18.323 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.626__multipart_multipart_enc.2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp.3 2024-09-19T14:14:18.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.626__multipart_multipart_enc.2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp.4 2024-09-19T14:14:18.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.626__multipart_multipart_enc.2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp.5 2024-09-19T14:14:18.324 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.321+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.626__multipart_multipart_enc.2~S79rY2Lt5fsJQEjnAddKsxAZWZM9Egp.6 2024-09-19T14:14:18.327 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.326+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.329 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.328+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:14:18.330 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.329+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.331 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:14:18.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15405424947171328666', time=2024-09-19T16:05:06.399563+0000, chain.objs.size()=2 2024-09-19T14:14:18.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.hTiCcMTVahQoBQQ4zHE1jsnhFdWOicb_0 2024-09-19T14:14:18.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.hTiCcMTVahQoBQQ4zHE1jsnhFdWOicb_1 2024-09-19T14:14:18.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2256544060017688561', time=2024-09-19T16:05:07.962589+0000, chain.objs.size()=3 2024-09-19T14:14:18.332 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-FROZEN.2~tLd6H5vbjXCZLgIVPevzbRpvL3sbH5q.1 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-FROZEN.2~tLd6H5vbjXCZLgIVPevzbRpvL3sbH5q.2 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-FROZEN.2~tLd6H5vbjXCZLgIVPevzbRpvL3sbH5q.3 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18134149331428516328', time=2024-09-19T16:07:48.404480+0000, chain.objs.size()=3 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~r4ehqnGBtL-bOQdN55436PRd5yeYcuI.1 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~r4ehqnGBtL-bOQdN55436PRd5yeYcuI.2 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~r4ehqnGBtL-bOQdN55436PRd5yeYcuI.3 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.2207647922850403513', time=2024-09-19T16:11:23.371705+0000, chain.objs.size()=6 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.661__multipart_bar.2~nqtLQxZ-ya9xG2ojp3duzqcHOH8rnbD.1 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.661__multipart_bar.2~nqtLQxZ-ya9xG2ojp3duzqcHOH8rnbD.2 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.661__multipart_bar.2~nqtLQxZ-ya9xG2ojp3duzqcHOH8rnbD.3 2024-09-19T14:14:18.333 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.330+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.661__multipart_bar.2~nqtLQxZ-ya9xG2ojp3duzqcHOH8rnbD.4 2024-09-19T14:14:18.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.333+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.661__multipart_bar.2~nqtLQxZ-ya9xG2ojp3duzqcHOH8rnbD.5 2024-09-19T14:14:18.335 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.334+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.661__multipart_bar.2~nqtLQxZ-ya9xG2ojp3duzqcHOH8rnbD.6 2024-09-19T14:14:18.336 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.335+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.338 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.337+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:14:18.339 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.338+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.339+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.339+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:14:18.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.339+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_hVS_Z8vfcPk36RSNqe2kM0B-DLiRRtX', time=2024-09-19T16:05:07.566614+0000, chain.objs.size()=2 2024-09-19T14:14:18.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.339+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.gFG2cdjseT-8Q4Jux3gYyZcZkuzLR5__1 2024-09-19T14:14:18.340 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.339+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.gFG2cdjseT-8Q4Jux3gYyZcZkuzLR5__2 2024-09-19T14:14:18.342 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.341+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.344 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.343+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:14:18.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.345+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.346 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.345+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.347 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_UPoxcQuAEkc9ytuDhbF6_-sFAUWAHAp', time=2024-09-19T16:05:06.463802+0000, chain.objs.size()=1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.FpyA4cu36c1ejKx_kAFmjUPzF3MKjqP_1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9413771037654893370', time=2024-09-19T16:07:38.316616+0000, chain.objs.size()=1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.519__multipart_mymultipart.2~85n4W-aJvzl9QuclO4OcWvKAZ9qkhRO.1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15104443195845425275', time=2024-09-19T16:07:38.715255+0000, chain.objs.size()=1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.518__shadow_.QxlowvjyTCo99307M41JkXOyTHTvn0D_1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1516981332009380630', time=2024-09-19T16:07:48.180064+0000, chain.objs.size()=3 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~d3aXwk2dui1uG0NX-q9HH2F6dhQy0xi.1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~d3aXwk2dui1uG0NX-q9HH2F6dhQy0xi.2 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~d3aXwk2dui1uG0NX-q9HH2F6dhQy0xi.3 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9067617544165058137', time=2024-09-19T16:11:23.483194+0000, chain.objs.size()=6 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.662__multipart_baz.2~lV8jLBTczEHbhrBnK9xacNVUJn08OUe.1 2024-09-19T14:14:18.348 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.662__multipart_baz.2~lV8jLBTczEHbhrBnK9xacNVUJn08OUe.2 2024-09-19T14:14:18.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.662__multipart_baz.2~lV8jLBTczEHbhrBnK9xacNVUJn08OUe.3 2024-09-19T14:14:18.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.662__multipart_baz.2~lV8jLBTczEHbhrBnK9xacNVUJn08OUe.4 2024-09-19T14:14:18.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.662__multipart_baz.2~lV8jLBTczEHbhrBnK9xacNVUJn08OUe.5 2024-09-19T14:14:18.349 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.346+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.662__multipart_baz.2~lV8jLBTczEHbhrBnK9xacNVUJn08OUe.6 2024-09-19T14:14:18.350 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.349+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.353 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.352+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:14:18.354 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.353+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.355 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4464277803428695313', time=2024-09-19T16:07:47.417172+0000, chain.objs.size()=1 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~cI-9nXamAvxg4Z2WqVJ6pXJZhYFCfMk.1 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16750116711611875160', time=2024-09-19T16:09:07.845132+0000, chain.objs.size()=6 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.615__multipart_multipart_enc.2~c1gJccQbfeLfHNK-Mdf_gPlhfSLaua7.1 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.615__multipart_multipart_enc.2~c1gJccQbfeLfHNK-Mdf_gPlhfSLaua7.2 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.615__multipart_multipart_enc.2~c1gJccQbfeLfHNK-Mdf_gPlhfSLaua7.3 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.615__multipart_multipart_enc.2~c1gJccQbfeLfHNK-Mdf_gPlhfSLaua7.4 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.615__multipart_multipart_enc.2~c1gJccQbfeLfHNK-Mdf_gPlhfSLaua7.5 2024-09-19T14:14:18.356 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.354+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.615__multipart_multipart_enc.2~c1gJccQbfeLfHNK-Mdf_gPlhfSLaua7.6 2024-09-19T14:14:18.358 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.357+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.360 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.359+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:14:18.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.360+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-19T14:14:18.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_wcsNXxuGm700ckgwkqgKRdkna0v4r9_', time=2024-09-19T16:05:07.066619+0000, chain.objs.size()=1 2024-09-19T14:14:18.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.f6vaOG4c0-0NLXAknCs3FZXcFrVcIeb_0 2024-09-19T14:14:18.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_3Uy6LtFDFowb9d8Nn0w5S8YR8dJW5HO', time=2024-09-19T16:05:08.618123+0000, chain.objs.size()=1 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.164__shadow_.u3-K-OdKcuAt6PvxemzQ7PRNxD62-v__0 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14520769776310407896', time=2024-09-19T16:07:35.845322+0000, chain.objs.size()=6 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.1 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.2 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.3 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.4 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.5 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.6 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8626867162524898549', time=2024-09-19T16:07:38.716687+0000, chain.objs.size()=1 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.518__shadow_.WMhu9GGoYEy9I8PY2SX99lwXToHlgdi_1 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y', time=2024-09-19T16:07:42.893614+0000, chain.objs.size()=1 2024-09-19T14:14:18.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y.2 2024-09-19T14:14:18.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs', time=2024-09-19T16:07:45.569213+0000, chain.objs.size()=1 2024-09-19T14:14:18.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs.1 2024-09-19T14:14:18.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs', time=2024-09-19T16:07:45.570865+0000, chain.objs.size()=1 2024-09-19T14:14:18.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.361+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs.2 2024-09-19T14:14:18.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs', time=2024-09-19T16:07:45.572284+0000, chain.objs.size()=1 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs.3 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs', time=2024-09-19T16:07:45.573826+0000, chain.objs.size()=1 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs.4 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs', time=2024-09-19T16:07:45.575268+0000, chain.objs.size()=1 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs.5 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs', time=2024-09-19T16:07:45.576611+0000, chain.objs.size()=1 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.363+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~CLAh5whfYVFBlBwQi0_ER6MtzBXENcs.6 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.364+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7666968710459819252', time=2024-09-19T16:07:47.896053+0000, chain.objs.size()=2 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.364+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~duAAqekLBW_3TDQtWItMpZHb6wsj2k5.1 2024-09-19T14:14:18.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.364+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~duAAqekLBW_3TDQtWItMpZHb6wsj2k5.2 2024-09-19T14:14:18.367 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.365+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.367+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:14:18.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.368+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.13920227581801000023', time=2024-09-19T16:05:04.751486+0000, chain.objs.size()=2 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.159__shadow_.HgcmGTKk6_dpBsAEX24c8VoRjBMgAm2_0 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.159__shadow_.HgcmGTKk6_dpBsAEX24c8VoRjBMgAm2_1 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_d8p2RD2hX5Ocjjv_ludt7vNK6KpcT2_', time=2024-09-19T16:05:08.623119+0000, chain.objs.size()=1 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.164__shadow_.lSpAPSBA4uCRdwREyzBAhv0-0NWaCo0_0 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~RLvmjOgSowLl2YWQNOLGDIcqyd9Cc1b', time=2024-09-19T16:05:25.503288+0000, chain.objs.size()=1 2024-09-19T14:14:18.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.202__multipart_mymultipart.2~RLvmjOgSowLl2YWQNOLGDIcqyd9Cc1b.1 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14699285628450485559', time=2024-09-19T16:07:37.564231+0000, chain.objs.size()=1 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.517__multipart_mymultipartcopy.2~8DGux3ZPlMR5tPOidU4HmV7HCFAhp8l.1 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5053479387350209521', time=2024-09-19T16:08:56.435001+0000, chain.objs.size()=4 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~-R0XvE_6mA2MltIvFFbfG9cZeZXj0L_.1 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~-R0XvE_6mA2MltIvFFbfG9cZeZXj0L_.2 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~-R0XvE_6mA2MltIvFFbfG9cZeZXj0L_.3 2024-09-19T14:14:18.372 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.369+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~-R0XvE_6mA2MltIvFFbfG9cZeZXj0L_.4 2024-09-19T14:14:18.374 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.373+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.375+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:14:18.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.376+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-19T14:14:18.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_AIW7e2zdjBeNpv20g2TZzVJRnoW9_MF', time=2024-09-19T16:05:06.595347+0000, chain.objs.size()=2 2024-09-19T14:14:18.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.eTZpFalNizQsA7m0-9-C78Xtmdpjikh_0 2024-09-19T14:14:18.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.eTZpFalNizQsA7m0-9-C78Xtmdpjikh_1 2024-09-19T14:14:18.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7924929316770578476', time=2024-09-19T16:05:07.016410+0000, chain.objs.size()=3 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-STANDARD.2~LuN9-D0ywMZIXIh2Ma9NF3R9SU97IwI.1 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-STANDARD.2~LuN9-D0ywMZIXIh2Ma9NF3R9SU97IwI.2 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-STANDARD.2~LuN9-D0ywMZIXIh2Ma9NF3R9SU97IwI.3 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11596568381616714051', time=2024-09-19T16:07:38.106126+0000, chain.objs.size()=1 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.519__multipart_mymultipart.2~NpLM8KC3WzUFrsu5dw2Ic97LfX9begZ.1 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZGeNgYf2ODfo_O6qSZL3BQyKhFbksQf', time=2024-09-19T16:08:23.646367+0000, chain.objs.size()=1 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.562__multipart_mymultipart.2~ZGeNgYf2ODfo_O6qSZL3BQyKhFbksQf.1 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3238867628797048575', time=2024-09-19T16:09:08.655308+0000, chain.objs.size()=6 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.616__multipart_multipart_enc.2~_J0AKqbi5AGJMwJKi-xN0M9F0FALxek.1 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.616__multipart_multipart_enc.2~_J0AKqbi5AGJMwJKi-xN0M9F0FALxek.2 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.616__multipart_multipart_enc.2~_J0AKqbi5AGJMwJKi-xN0M9F0FALxek.3 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.616__multipart_multipart_enc.2~_J0AKqbi5AGJMwJKi-xN0M9F0FALxek.4 2024-09-19T14:14:18.380 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.377+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.616__multipart_multipart_enc.2~_J0AKqbi5AGJMwJKi-xN0M9F0FALxek.5 2024-09-19T14:14:18.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.380+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.616__multipart_multipart_enc.2~_J0AKqbi5AGJMwJKi-xN0M9F0FALxek.6 2024-09-19T14:14:18.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.380+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.732745726192406370', time=2024-09-19T16:11:18.439751+0000, chain.objs.size()=1 2024-09-19T14:14:18.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.380+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.648__shadow_.Ct8pugl5wLtV5MHQNa04RCs4XOOyy_Q_1 2024-09-19T14:14:18.381 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.380+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4666833172928734516', time=2024-09-19T16:12:09.808145+0000, chain.objs.size()=1 2024-09-19T14:14:18.382 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.380+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.762__shadow_.wK-2OnNMnj4YJE67fdAaHHlZql7zqMN_1 2024-09-19T14:14:18.383 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.383+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.385 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.384+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:14:18.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.386+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.387 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.386+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.15599353298393504909', time=2024-09-19T16:07:46.174202+0000, chain.objs.size()=1 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~njW7cZO0bGCKlA_ltOJvc_OwVxy-IRJ.1 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7992640351805392491', time=2024-09-19T16:07:46.468551+0000, chain.objs.size()=2 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~gAYPBZLiZk_w1T5sdi59sGjSvlZZo5N.1 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~gAYPBZLiZk_w1T5sdi59sGjSvlZZo5N.2 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~ztoQVLdBhB0bKKmP_b-vsu2z6ObR6ht', time=2024-09-19T16:07:50.108228+0000, chain.objs.size()=2 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.530__multipart_mymultipart.2~ztoQVLdBhB0bKKmP_b-vsu2z6ObR6ht.1 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.530__multipart_mymultipart.2~ztoQVLdBhB0bKKmP_b-vsu2z6ObR6ht.2 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.11316333544121002343', time=2024-09-19T16:11:17.814643+0000, chain.objs.size()=1 2024-09-19T14:14:18.389 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.387+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.646__shadow_.orXBdx1clW5GsxhBJl-6XEZVskbzXmp_1 2024-09-19T14:14:18.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.389+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.391+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:14:18.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.392+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.393+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.393+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:14:18.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.393+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14903373018331277632', time=2024-09-19T16:05:06.146470+0000, chain.objs.size()=2 2024-09-19T14:14:18.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.393+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.b6fg6PbftUwkKPOhq5VGE2Ta0GmtaoA_0 2024-09-19T14:14:18.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.393+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.b6fg6PbftUwkKPOhq5VGE2Ta0GmtaoA_1 2024-09-19T14:14:18.396 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.395+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.397+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:14:18.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.400 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-19T14:14:18.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_LI5r9zMbcQDCNJa8rkW7jKZ-ZxmBOBh', time=2024-09-19T16:05:06.208578+0000, chain.objs.size()=1 2024-09-19T14:14:18.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.R1fLtER798YD33FRCJLO2eEcqIOy-Bs_1 2024-09-19T14:14:18.401 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_g1MqlbOhp5p26YE53GyfPLkvAJahEz2', time=2024-09-19T16:05:06.599906+0000, chain.objs.size()=1 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.161__shadow_.4Cd8IVimhvmuLK9qQOCQD6FbAQhXya4_0 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12377485648258506509', time=2024-09-19T16:05:09.121523+0000, chain.objs.size()=2 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.165__multipart_foo.2~ZmU6P2Qoqpr3Wd46QEXIO0L0kpiy35y.1 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.165__multipart_foo.2~ZmU6P2Qoqpr3Wd46QEXIO0L0kpiy35y.2 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16409288574713222277', time=2024-09-19T16:07:36.342022+0000, chain.objs.size()=1 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.512__multipart_mymultipart.2~F2ekFyjdc9L1PssLDgMGtaNdvPjzRtp.1 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.701921462473364136', time=2024-09-19T16:08:05.595273+0000, chain.objs.size()=4 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.536__multipart_mymultipart.2~hRRnCWFy6tasDtDdB-qp5y47hFQV6Nb.1 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.399+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.536__multipart_mymultipart.2~hRRnCWFy6tasDtDdB-qp5y47hFQV6Nb.2 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.400+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.536__multipart_mymultipart.64x1emqxiW1lE3HngF-AhCV-8KvwLeQo.3 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.400+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.536__multipart_mymultipart.2~hRRnCWFy6tasDtDdB-qp5y47hFQV6Nb.4 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.400+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17857918252975121303', time=2024-09-19T16:11:23.600337+0000, chain.objs.size()=6 2024-09-19T14:14:18.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.400+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.663__multipart_foo.2~fKn6sKqxzh9YsI4OhlsygLzI7zgvRfx.1 2024-09-19T14:14:18.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.400+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.663__multipart_foo.2~fKn6sKqxzh9YsI4OhlsygLzI7zgvRfx.2 2024-09-19T14:14:18.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.400+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.663__multipart_foo.2~fKn6sKqxzh9YsI4OhlsygLzI7zgvRfx.3 2024-09-19T14:14:18.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.402+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.663__multipart_foo.2~fKn6sKqxzh9YsI4OhlsygLzI7zgvRfx.4 2024-09-19T14:14:18.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.402+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.663__multipart_foo.2~fKn6sKqxzh9YsI4OhlsygLzI7zgvRfx.5 2024-09-19T14:14:18.403 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.402+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.663__multipart_foo.2~fKn6sKqxzh9YsI4OhlsygLzI7zgvRfx.6 2024-09-19T14:14:18.404 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.403+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.406 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.405+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:14:18.407 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.408 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6737993970712293778', time=2024-09-19T16:07:41.345882+0000, chain.objs.size()=3 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~qJ0zYAeR8Ko-4jkPtC3iarTkJ6E0BBc.1 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~qJ0zYAeR8Ko-4jkPtC3iarTkJ6E0BBc.2 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~qJ0zYAeR8Ko-4jkPtC3iarTkJ6E0BBc.3 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14511521005111373759', time=2024-09-19T16:07:48.509428+0000, chain.objs.size()=2 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.525__shadow_.0XLpg5L0dTk_CCwVbzZmuQDPCePfW3Z_1 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.525__shadow_.0XLpg5L0dTk_CCwVbzZmuQDPCePfW3Z_2 2024-09-19T14:14:18.410 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6102095360955032726', time=2024-09-19T16:07:48.623695+0000, chain.objs.size()=2 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~g-1fHiX4idTvU8h4Gq3Tbvh93uVy6_m.1 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.526__multipart_mymultipart.2~g-1fHiX4idTvU8h4Gq3Tbvh93uVy6_m.2 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~uQtwba_PDZ9041W0PPvVyYnByb2OGdC', time=2024-09-19T16:07:50.764115+0000, chain.objs.size()=1 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.532__multipart_mymultipart2.2~uQtwba_PDZ9041W0PPvVyYnByb2OGdC.1 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14535752766711871052', time=2024-09-19T16:08:21.283446+0000, chain.objs.size()=1 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.407+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.556__shadow_.yFd4l8aX1QlU876Kr8PnB7JDfyrwAaX_1 2024-09-19T14:14:18.411 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.410+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.412+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:14:18.417 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.6681158137819698816', time=2024-09-19T16:05:04.745870+0000, chain.objs.size()=2 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.159__shadow_.SBR-3GnK29uC_2qwxU9TCRoXe0F2R7C_0 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.159__shadow_.SBR-3GnK29uC_2qwxU9TCRoXe0F2R7C_1 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8568780313980826672', time=2024-09-19T16:08:56.559366+0000, chain.objs.size()=4 2024-09-19T14:14:18.418 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~nd8PfWxaFIV-5kWR-dIx8Ut52ZUhJod.1 2024-09-19T14:14:18.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~nd8PfWxaFIV-5kWR-dIx8Ut52ZUhJod.2 2024-09-19T14:14:18.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~nd8PfWxaFIV-5kWR-dIx8Ut52ZUhJod.3 2024-09-19T14:14:18.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.414+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~nd8PfWxaFIV-5kWR-dIx8Ut52ZUhJod.4 2024-09-19T14:14:18.419 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.417+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.420 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.419+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:14:18.421 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.420+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.420+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:14:18.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1417120127820749997', time=2024-09-19T16:05:05.726730+0000, chain.objs.size()=3 2024-09-19T14:14:18.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-LUKEWARM.2~95c4RcZtKfAfQ4v_gnv99NiwjKDoQmJ.1 2024-09-19T14:14:18.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-LUKEWARM.2~95c4RcZtKfAfQ4v_gnv99NiwjKDoQmJ.2 2024-09-19T14:14:18.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-LUKEWARM.2~95c4RcZtKfAfQ4v_gnv99NiwjKDoQmJ.3 2024-09-19T14:14:18.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_SQu7tRHUvh3xq2PVTOhCaoTeTgaixOj', time=2024-09-19T16:05:09.197579+0000, chain.objs.size()=1 2024-09-19T14:14:18.423 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.421+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.166__shadow_.aSwvcXp1iVwFtmw6j3zLHeiDssoXR1C_0 2024-09-19T14:14:18.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.423+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.425+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:14:18.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.426+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:14:18.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3781412302191244365', time=2024-09-19T16:05:05.731772+0000, chain.objs.size()=3 2024-09-19T14:14:18.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-STANDARD.2~7lL5xRPgo6R5v8VaaF5YIaW5kxHzQo0.1 2024-09-19T14:14:18.429 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-STANDARD.2~7lL5xRPgo6R5v8VaaF5YIaW5kxHzQo0.2 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.160__multipart_mymultipart-STANDARD.2~7lL5xRPgo6R5v8VaaF5YIaW5kxHzQo0.3 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.9839211444032097857', time=2024-09-19T16:07:35.730706+0000, chain.objs.size()=6 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.1 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.2 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.3 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.4 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.5 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.6 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1244432868938025697', time=2024-09-19T16:07:46.877282+0000, chain.objs.size()=2 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~GYJbx8JuRvgT-j5Ok7e9C8l6Pnp6HFa.1 2024-09-19T14:14:18.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.427+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~GYJbx8JuRvgT-j5Ok7e9C8l6Pnp6HFa.2 2024-09-19T14:14:18.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.429+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.432+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:14:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.433+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.433+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:14:18.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.3984763754404245185', time=2024-09-19T16:07:43.672239+0000, chain.objs.size()=6 2024-09-19T14:14:18.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y.1 2024-09-19T14:14:18.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.335f0YTT2CUVtu0j3w_pLaPjHof3Bu68.2 2024-09-19T14:14:18.435 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y.3 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y.4 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y.5 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~rTCDtceTXBT9IC-XnWzualrAq_eyJ1y.6 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz', time=2024-09-19T16:07:44.524751+0000, chain.objs.size()=1 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz.2 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz', time=2024-09-19T16:07:44.526040+0000, chain.objs.size()=1 2024-09-19T14:14:18.436 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.434+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~VeNMdJQb94lod8xDRyv8VhEjdwHoHfz.3 2024-09-19T14:14:18.437 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.436+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.439 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.438+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:14:18.440 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.439+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.440+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.441 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.440+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.442 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.441+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:14:18.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.442+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.443 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4641618914838436134', time=2024-09-19T16:07:41.480604+0000, chain.objs.size()=2 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.521__shadow:j6j570XiyGTqm5yuc4WYKD5ORbpufS8_.HwZ1vSDKx6zXS48se-djBw7lPQXdj_x_1 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.521__shadow:j6j570XiyGTqm5yuc4WYKD5ORbpufS8_.HwZ1vSDKx6zXS48se-djBw7lPQXdj_x_2 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10836226748463966096', time=2024-09-19T16:08:07.375051+0000, chain.objs.size()=1 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.537__multipart_mymultipart.2~naEBGJgMzdY6NCQ91g4w7gMsY4aQGGc.1 2024-09-19T14:14:18.445 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-', time=2024-09-19T16:11:12.754330+0000, chain.objs.size()=6 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.625__multipart_multipart_enc.2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-.1 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.625__multipart_multipart_enc.2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-.2 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.625__multipart_multipart_enc.2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-.3 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.625__multipart_multipart_enc.2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-.4 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.625__multipart_multipart_enc.2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-.5 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.625__multipart_multipart_enc.2~m8HuGK1Q-6Gu3ZG_J0A-CHulo4W_Bn-.6 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~UVLJlj7ooGy_HHDX1SkiFjUAOPHMbU-', time=2024-09-19T16:12:01.119704+0000, chain.objs.size()=1 2024-09-19T14:14:18.446 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.443+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.743__multipart_mymultipart.2~UVLJlj7ooGy_HHDX1SkiFjUAOPHMbU-.1 2024-09-19T14:14:18.449 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.448+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.451 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.450+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:14:18.452 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.451+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.453 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:14:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.16706823274276776052', time=2024-09-19T16:05:07.481273+0000, chain.objs.size()=3 2024-09-19T14:14:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-LUKEWARM.2~DMicS7PkBhAkv2xytgKDkuRogY8NXu1.1 2024-09-19T14:14:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-LUKEWARM.2~DMicS7PkBhAkv2xytgKDkuRogY8NXu1.2 2024-09-19T14:14:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__multipart_foo-LUKEWARM.2~DMicS7PkBhAkv2xytgKDkuRogY8NXu1.3 2024-09-19T14:14:18.454 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.14020017939949686186', time=2024-09-19T16:07:35.954890+0000, chain.objs.size()=6 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.1 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.2 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.3 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.4 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.5 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.6 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4893651107775768843', time=2024-09-19T16:11:34.234986+0000, chain.objs.size()=1 2024-09-19T14:14:18.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.452+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.712__multipart_file1.2~5uNIXe-hx1S-1cXG8d-mwEtwCEm1S2Q.1 2024-09-19T14:14:18.456 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.455+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.457+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:14:18.459 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.458+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.459+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.459+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:14:18.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.459+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_2xtwrHoXHAHgld3esJRljSXzoUknkmd', time=2024-09-19T16:05:08.186865+0000, chain.objs.size()=1 2024-09-19T14:14:18.460 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.459+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.-tk7tiiaGSi_P2KdXkEwHByq6wAjGgQ_0 2024-09-19T14:14:18.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.459+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.17309533179366081556', time=2024-09-19T16:07:36.856303+0000, chain.objs.size()=1 2024-09-19T14:14:18.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.459+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.514__multipart_mymultipart.2~0MI233q5Dh8pdNjgK-kSGGg2er5F4om.1 2024-09-19T14:14:18.461 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.460+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.463 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.462+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:14:18.464 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.463+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.465 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-19T14:14:18.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='_8NbEV-9LHqhjofI7Z-r9U-SgKLZKYHC', time=2024-09-19T16:05:08.176364+0000, chain.objs.size()=2 2024-09-19T14:14:18.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.mNTcZl2liUrtzBO7DEXj292pZF8grtN_0 2024-09-19T14:14:18.466 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.162__shadow_.mNTcZl2liUrtzBO7DEXj292pZF8grtN_1 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.10094617995841446132', time=2024-09-19T16:07:35.731012+0000, chain.objs.size()=6 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.1 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.2 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.3 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.4 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.5 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.508__multipart_srcmultipart.2~nOU39NTGRc89H_BT1ZtqWlrTCAAdpMa.6 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.12069075776617740023', time=2024-09-19T16:07:46.809061+0000, chain.objs.size()=3 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~AZLEoxaRt41bMHr9H-rscNv47xSjTNP.1 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~AZLEoxaRt41bMHr9H-rscNv47xSjTNP.2 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~AZLEoxaRt41bMHr9H-rscNv47xSjTNP.3 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco', time=2024-09-19T16:07:48.909040+0000, chain.objs.size()=10 2024-09-19T14:14:18.467 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.464+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.1 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.2 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.3 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.4 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.5 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.6 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.7 2024-09-19T14:14:18.469 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.8 2024-09-19T14:14:18.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.9 2024-09-19T14:14:18.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.527__multipart_mymultipart.2~qovETGgCEuEhdz_5HdJZ43ZLUR-pgco.10 2024-09-19T14:14:18.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~hCGLwtPqIp0eFco2gflnflu0EaGrbx3', time=2024-09-19T16:07:50.757561+0000, chain.objs.size()=2 2024-09-19T14:14:18.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.532__multipart_mymultipart.2~hCGLwtPqIp0eFco2gflnflu0EaGrbx3.1 2024-09-19T14:14:18.470 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.467+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.532__multipart_mymultipart.2~hCGLwtPqIp0eFco2gflnflu0EaGrbx3.2 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7645551791520761128', time=2024-09-19T16:11:59.413934+0000, chain.objs.size()=10 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.1 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.2 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.3 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.4 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.5 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.6 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.7 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.469+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.8 2024-09-19T14:14:18.471 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.470+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.9 2024-09-19T14:14:18.472 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.470+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.736__multipart_foo.2~CrKGQ3TDc6OBL9HVIk-NbXriYX6V5nu.10 2024-09-19T14:14:18.473 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.472+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.477 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.474+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:14:18.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.475+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.475+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~alXYbAiT94IGhJWflcIlzvOXkPczLPn', time=2024-09-19T16:05:25.827988+0000, chain.objs.size()=1 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.203__multipart_mymultipart.2~alXYbAiT94IGhJWflcIlzvOXkPczLPn.1 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~U4hvzM5xZSEmi-xKrUv5iD82rQKvIQ-', time=2024-09-19T16:07:51.278052+0000, chain.objs.size()=1 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.534__multipart_mymultipart.2~U4hvzM5xZSEmi-xKrUv5iD82rQKvIQ-.1 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.5637761011226056907', time=2024-09-19T16:08:23.579288+0000, chain.objs.size()=1 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.562__multipart_mymultipart.2~lSPE3N93pkRrJd9L2GCzKjzHkrDpx55.1 2024-09-19T14:14:18.479 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4299327604276019494', time=2024-09-19T16:08:23.807150+0000, chain.objs.size()=1 2024-09-19T14:14:18.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.562__multipart_mymultipart.2TozkoSQMpIqZSjqx4RH2bLi5dcgWVBq.1 2024-09-19T14:14:18.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~37je_Am5NDNcMVylC76E0yNDBUxiSbi', time=2024-09-19T16:12:01.125013+0000, chain.objs.size()=1 2024-09-19T14:14:18.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.476+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.743__multipart_mymultipart2.2~37je_Am5NDNcMVylC76E0yNDBUxiSbi.1 2024-09-19T14:14:18.480 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.478+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.481 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.480+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:14:18.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.481+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.482 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.481+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.1854891041562243889', time=2024-09-19T16:07:41.579082+0000, chain.objs.size()=3 2024-09-19T14:14:18.483 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~ycxl_XILBMXrjTbYWTEQYe7lC1UdDHM.1 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~ycxl_XILBMXrjTbYWTEQYe7lC1UdDHM.2 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.522__multipart_mymultipart.2~ycxl_XILBMXrjTbYWTEQYe7lC1UdDHM.3 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.833987556274854280', time=2024-09-19T16:07:45.875522+0000, chain.objs.size()=6 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.4-mNINaTJ_M2BftUYQL8dwJA_RR2mUgi.1 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.NpkTGiCFXQxGB2SWxTOfu4IinoVYOqpm.2 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart._ngbtadLNm3VAUfOVlKIGgpo4cKMn2G6.3 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.VBQniS8tk6Fldox2H7DBDGXOm5no9jH5.4 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.fFARDgvNHkEQqXv-Yn-cjZVfBXkHj4w-.5 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.qqglxsL2i1X3NndxBZIUFnvQwa2pnpPW.6 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7162557934909551775', time=2024-09-19T16:07:49.328890+0000, chain.objs.size()=4 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.528__multipart_mymultipart.2~v_oodFyMGfZCpQAHHbhe-h0ZEukcjbL.1 2024-09-19T14:14:18.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.528__multipart_mymultipart.2~v_oodFyMGfZCpQAHHbhe-h0ZEukcjbL.2 2024-09-19T14:14:18.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.482+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.528__multipart_mymultipart.2~v_oodFyMGfZCpQAHHbhe-h0ZEukcjbL.3 2024-09-19T14:14:18.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.484+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.528__multipart_mymultipart.2~v_oodFyMGfZCpQAHHbhe-h0ZEukcjbL.4 2024-09-19T14:14:18.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.484+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7903662065728108540', time=2024-09-19T16:08:22.577856+0000, chain.objs.size()=1 2024-09-19T14:14:18.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.484+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.559__shadow_.lu7Dsv_ncU9VP6hyZRZxD4arWrLWlc8_1 2024-09-19T14:14:18.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.484+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.4267902356112670239', time=2024-09-19T16:11:31.987964+0000, chain.objs.size()=1 2024-09-19T14:14:18.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.484+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.703__multipart_file1.2~IbSkC5tZXnToqRCslthTMt8rm61s5Vb.1 2024-09-19T14:14:18.487 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.486+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.489 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.488+0000 7f1e66087800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:14:18.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.489+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:18.490 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.489+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:18.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:14:18.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.18255762170419327830', time=2024-09-19T16:07:44.531896+0000, chain.objs.size()=6 2024-09-19T14:14:18.491 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd.1 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd.2 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.HN1XhE5cPRHAEQxsaUZ7fwEP9uG-xkQl.3 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd.4 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd.5 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.523__multipart_mymultipart.2~JiBBzdQ9HJbjrqkowpdMb5BGhYbtnzd.6 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.7878516248477230462', time=2024-09-19T16:07:46.627517+0000, chain.objs.size()=3 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~SuZXVeCEioBkx3KmQAZzD1jV0KCuiVe.1 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~SuZXVeCEioBkx3KmQAZzD1jV0KCuiVe.2 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.524__multipart_mymultipart.2~SuZXVeCEioBkx3KmQAZzD1jV0KCuiVe.3 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='2~nT9Qxk3x59cjH9RCdPahEDm7frQJeqS', time=2024-09-19T16:07:51.475808+0000, chain.objs.size()=1 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.535__multipart_mymultipart.2~nT9Qxk3x59cjH9RCdPahEDm7frQJeqS.1 2024-09-19T14:14:18.492 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8022689896145979551', time=2024-09-19T16:08:56.663525+0000, chain.objs.size()=4 2024-09-19T14:14:18.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~m0sJt6DvDGBKTYWcWAubahB-8JE0naJ.1 2024-09-19T14:14:18.493 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.490+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~m0sJt6DvDGBKTYWcWAubahB-8JE0naJ.2 2024-09-19T14:14:18.494 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.493+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~m0sJt6DvDGBKTYWcWAubahB-8JE0naJ.3 2024-09-19T14:14:18.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.494+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.579__multipart_testobj.2~m0sJt6DvDGBKTYWcWAubahB-8JE0naJ.4 2024-09-19T14:14:18.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.494+0000 7f1e66087800 20 garbage collection: RGWGC::process iterating over entry tag='ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.8620358803769103054', time=2024-09-19T16:12:01.529091+0000, chain.objs.size()=3 2024-09-19T14:14:18.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.494+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.744__multipart_mymultipart3.2~Sty8xZhm8l5fAqAdHbeUDlcaw8zapXC.1 2024-09-19T14:14:18.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.494+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.744__multipart_mymultipart3.2~Sty8xZhm8l5fAqAdHbeUDlcaw8zapXC.2 2024-09-19T14:14:18.495 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.494+0000 7f1e66087800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ebdf9632-5f0a-4135-af04-1b7f59e5ac82.4532.744__multipart_mymultipart3.2~Sty8xZhm8l5fAqAdHbeUDlcaw8zapXC.3 2024-09-19T14:14:18.497 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.496+0000 7f1e66087800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:18.499 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.498+0000 7f1d19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:18.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.500+0000 7f1e66087800 20 remove_watcher() i=0 2024-09-19T14:14:18.501 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.500+0000 7f1e66087800 2 removed watcher, disabling cache 2024-09-19T14:14:18.502 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.501+0000 7f1e66087800 20 remove_watcher() i=1 2024-09-19T14:14:18.503 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.502+0000 7f1e66087800 20 remove_watcher() i=2 2024-09-19T14:14:18.504 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.503+0000 7f1e66087800 20 remove_watcher() i=3 2024-09-19T14:14:18.505 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.504+0000 7f1e66087800 20 remove_watcher() i=4 2024-09-19T14:14:18.506 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.505+0000 7f1e66087800 20 remove_watcher() i=5 2024-09-19T14:14:18.507 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.506+0000 7f1e66087800 20 remove_watcher() i=6 2024-09-19T14:14:18.508 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-19T14:14:18.507+0000 7f1e66087800 20 remove_watcher() i=7 2024-09-19T14:14:18.518 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-19T14:14:18.530 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T14:14:18.540 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T14:14:18.540 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:14:18.867 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:14:18.880 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:14:18.884 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1406,"stamp":"2024-09-19T14:14:17.707646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615701328,"num_objects":912,"num_object_clones":0,"num_object_copies":1824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":295721,"num_read_kb":3210662,"num_write":145183,"num_write_kb":2512502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13898,"ondisk_log_size":13898,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2468560,"kb_used_data":1232144,"kb_used_omap":12,"kb_used_meta":1236275,"kb_avail":752506160,"statfs":{"total":773094113280,"available":770566307840,"internally_reserved":0,"allocated":1261715456,"data_stored":1247670494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1265946160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004936"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.604790+0000","last_change":"2024-09-19T14:03:08.839286+0000","last_active":"2024-09-19T14:10:41.604790+0000","last_peered":"2024-09-19T14:10:41.604790+0000","last_clean":"2024-09-19T14:10:41.604790+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:10:41.604790+0000","last_undegraded":"2024-09-19T14:10:41.604790+0000","last_fullsized":"2024-09-19T14:10:41.604790+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:42.826327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.602224+0000","last_change":"2024-09-19T13:52:51.581992+0000","last_active":"2024-09-19T14:10:21.602224+0000","last_peered":"2024-09-19T14:10:21.602224+0000","last_clean":"2024-09-19T14:10:21.602224+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:10:21.602224+0000","last_undegraded":"2024-09-19T14:10:21.602224+0000","last_fullsized":"2024-09-19T14:10:21.602224+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:21.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722729+0000","last_change":"2024-09-19T13:52:48.556806+0000","last_active":"2024-09-19T14:10:21.722729+0000","last_peered":"2024-09-19T14:10:21.722729+0000","last_clean":"2024-09-19T14:10:21.722729+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:10:21.722729+0000","last_undegraded":"2024-09-19T14:10:21.722729+0000","last_fullsized":"2024-09-19T14:10:21.722729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:12.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.618002+0000","last_change":"2024-09-19T13:51:15.739764+0000","last_active":"2024-09-19T14:12:06.618002+0000","last_peered":"2024-09-19T14:12:06.618002+0000","last_clean":"2024-09-19T14:12:06.618002+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:12:06.618002+0000","last_undegraded":"2024-09-19T14:12:06.618002+0000","last_fullsized":"2024-09-19T14:12:06.618002+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:19.998068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.811878+0000","last_change":"2024-09-19T14:03:08.835558+0000","last_active":"2024-09-19T14:10:41.811878+0000","last_peered":"2024-09-19T14:10:41.811878+0000","last_clean":"2024-09-19T14:10:41.811878+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:10:41.811878+0000","last_undegraded":"2024-09-19T14:10:41.811878+0000","last_fullsized":"2024-09-19T14:10:41.811878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:48.618379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723070+0000","last_change":"2024-09-19T13:52:51.587845+0000","last_active":"2024-09-19T14:10:21.723070+0000","last_peered":"2024-09-19T14:10:21.723070+0000","last_clean":"2024-09-19T14:10:21.723070+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:10:21.723070+0000","last_undegraded":"2024-09-19T14:10:21.723070+0000","last_fullsized":"2024-09-19T14:10:21.723070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:46.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.638390+0000","last_change":"2024-09-19T13:52:48.554640+0000","last_active":"2024-09-19T14:10:21.638390+0000","last_peered":"2024-09-19T14:10:21.638390+0000","last_clean":"2024-09-19T14:10:21.638390+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:10:21.638390+0000","last_undegraded":"2024-09-19T14:10:21.638390+0000","last_fullsized":"2024-09-19T14:10:21.638390+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:35.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.816386+0000","last_change":"2024-09-19T13:51:15.745607+0000","last_active":"2024-09-19T14:11:16.816386+0000","last_peered":"2024-09-19T14:11:16.816386+0000","last_clean":"2024-09-19T14:11:16.816386+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:11:16.816386+0000","last_undegraded":"2024-09-19T14:11:16.816386+0000","last_fullsized":"2024-09-19T14:11:16.816386+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.713992+0000","last_change":"2024-09-19T14:03:08.837569+0000","last_active":"2024-09-19T14:10:26.713992+0000","last_peered":"2024-09-19T14:10:26.713992+0000","last_clean":"2024-09-19T14:10:26.713992+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:10:26.713992+0000","last_undegraded":"2024-09-19T14:10:26.713992+0000","last_fullsized":"2024-09-19T14:10:26.713992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:12.734099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.614000+0000","last_change":"2024-09-19T13:52:51.586976+0000","last_active":"2024-09-19T14:11:36.614000+0000","last_peered":"2024-09-19T14:11:36.614000+0000","last_clean":"2024-09-19T14:11:36.614000+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:11:36.614000+0000","last_undegraded":"2024-09-19T14:11:36.614000+0000","last_fullsized":"2024-09-19T14:11:36.614000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:28.946709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813410+0000","last_change":"2024-09-19T13:52:48.554485+0000","last_active":"2024-09-19T14:10:51.813410+0000","last_peered":"2024-09-19T14:10:51.813410+0000","last_clean":"2024-09-19T14:10:51.813410+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:10:51.813410+0000","last_undegraded":"2024-09-19T14:10:51.813410+0000","last_fullsized":"2024-09-19T14:10:51.813410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:12.978118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611594+0000","last_change":"2024-09-19T13:51:15.737359+0000","last_active":"2024-09-19T14:11:16.611594+0000","last_peered":"2024-09-19T14:11:16.611594+0000","last_clean":"2024-09-19T14:11:16.611594+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:11:16.611594+0000","last_undegraded":"2024-09-19T14:11:16.611594+0000","last_fullsized":"2024-09-19T14:11:16.611594+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:50.162815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723353+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:10:26.723353+0000","last_peered":"2024-09-19T14:10:26.723353+0000","last_clean":"2024-09-19T14:10:26.723353+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:10:26.723353+0000","last_undegraded":"2024-09-19T14:10:26.723353+0000","last_fullsized":"2024-09-19T14:10:26.723353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.363715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.727658+0000","last_change":"2024-09-19T13:52:51.581539+0000","last_active":"2024-09-19T14:10:56.727658+0000","last_peered":"2024-09-19T14:10:56.727658+0000","last_clean":"2024-09-19T14:10:56.727658+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:10:56.727658+0000","last_undegraded":"2024-09-19T14:10:56.727658+0000","last_fullsized":"2024-09-19T14:10:56.727658+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:52.537771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733334+0000","last_change":"2024-09-19T13:52:48.553843+0000","last_active":"2024-09-19T14:11:36.733334+0000","last_peered":"2024-09-19T14:11:36.733334+0000","last_clean":"2024-09-19T14:11:36.733334+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:11:36.733334+0000","last_undegraded":"2024-09-19T14:11:36.733334+0000","last_fullsized":"2024-09-19T14:11:36.733334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:42.945314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730599+0000","last_change":"2024-09-19T13:51:15.746581+0000","last_active":"2024-09-19T14:11:16.730599+0000","last_peered":"2024-09-19T14:11:16.730599+0000","last_clean":"2024-09-19T14:11:16.730599+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:11:16.730599+0000","last_undegraded":"2024-09-19T14:11:16.730599+0000","last_fullsized":"2024-09-19T14:11:16.730599+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:13.432237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730008+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:11:11.730008+0000","last_peered":"2024-09-19T14:11:11.730008+0000","last_clean":"2024-09-19T14:11:11.730008+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:11:11.730008+0000","last_undegraded":"2024-09-19T14:11:11.730008+0000","last_fullsized":"2024-09-19T14:11:11.730008+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.597736+0000","last_change":"2024-09-19T13:53:44.846213+0000","last_active":"2024-09-19T14:09:51.597736+0000","last_peered":"2024-09-19T14:09:51.597736+0000","last_clean":"2024-09-19T14:09:51.597736+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:09:51.597736+0000","last_undegraded":"2024-09-19T14:09:51.597736+0000","last_fullsized":"2024-09-19T14:09:51.597736+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:34.290843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'4","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.598177+0000","last_change":"2024-09-19T13:52:48.552836+0000","last_active":"2024-09-19T14:09:46.598177+0000","last_peered":"2024-09-19T14:09:46.598177+0000","last_clean":"2024-09-19T14:09:46.598177+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:09:46.598177+0000","last_undegraded":"2024-09-19T14:09:46.598177+0000","last_fullsized":"2024-09-19T14:09:46.598177+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:10.701239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12817,"num_write":4,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730570+0000","last_change":"2024-09-19T13:51:15.743989+0000","last_active":"2024-09-19T14:11:16.730570+0000","last_peered":"2024-09-19T14:11:16.730570+0000","last_clean":"2024-09-19T14:11:16.730570+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:11:16.730570+0000","last_undegraded":"2024-09-19T14:11:16.730570+0000","last_fullsized":"2024-09-19T14:11:16.730570+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:33.192776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647908+0000","last_change":"2024-09-19T14:03:08.837855+0000","last_active":"2024-09-19T14:11:31.647908+0000","last_peered":"2024-09-19T14:11:31.647908+0000","last_clean":"2024-09-19T14:11:31.647908+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:11:31.647908+0000","last_undegraded":"2024-09-19T14:11:31.647908+0000","last_fullsized":"2024-09-19T14:11:31.647908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:17.620266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.708338+0000","last_change":"2024-09-19T13:52:51.576379+0000","last_active":"2024-09-19T14:09:46.708338+0000","last_peered":"2024-09-19T14:09:46.708338+0000","last_clean":"2024-09-19T14:09:46.708338+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:09:46.708338+0000","last_undegraded":"2024-09-19T14:09:46.708338+0000","last_fullsized":"2024-09-19T14:09:46.708338+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:14.311651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.718219+0000","last_change":"2024-09-19T13:52:48.553148+0000","last_active":"2024-09-19T14:09:51.718219+0000","last_peered":"2024-09-19T14:09:51.718219+0000","last_clean":"2024-09-19T14:09:51.718219+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:09:51.718219+0000","last_undegraded":"2024-09-19T14:09:51.718219+0000","last_fullsized":"2024-09-19T14:09:51.718219+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:55.422175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720708+0000","last_change":"2024-09-19T13:51:15.746742+0000","last_active":"2024-09-19T14:11:16.720708+0000","last_peered":"2024-09-19T14:11:16.720708+0000","last_clean":"2024-09-19T14:11:16.720708+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:11:16.720708+0000","last_undegraded":"2024-09-19T14:11:16.720708+0000","last_fullsized":"2024-09-19T14:11:16.720708+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:30.998138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739569+0000","last_change":"2024-09-19T14:03:08.842863+0000","last_active":"2024-09-19T14:10:41.739569+0000","last_peered":"2024-09-19T14:10:41.739569+0000","last_clean":"2024-09-19T14:10:41.739569+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:10:41.739569+0000","last_undegraded":"2024-09-19T14:10:41.739569+0000","last_fullsized":"2024-09-19T14:10:41.739569+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:07.703304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.713321+0000","last_change":"2024-09-19T13:52:51.577966+0000","last_active":"2024-09-19T14:10:21.713321+0000","last_peered":"2024-09-19T14:10:21.713321+0000","last_clean":"2024-09-19T14:10:21.713321+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:10:21.713321+0000","last_undegraded":"2024-09-19T14:10:21.713321+0000","last_fullsized":"2024-09-19T14:10:21.713321+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:07.818951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723019+0000","last_change":"2024-09-19T13:52:48.556329+0000","last_active":"2024-09-19T14:10:21.723019+0000","last_peered":"2024-09-19T14:10:21.723019+0000","last_clean":"2024-09-19T14:10:21.723019+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:10:21.723019+0000","last_undegraded":"2024-09-19T14:10:21.723019+0000","last_fullsized":"2024-09-19T14:10:21.723019+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:39.632455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":103,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.222490+0000","last_change":"2024-09-19T13:51:15.738677+0000","last_active":"2024-09-19T14:11:23.222490+0000","last_peered":"2024-09-19T14:11:23.222490+0000","last_clean":"2024-09-19T14:11:23.222490+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:11:23.222490+0000","last_undegraded":"2024-09-19T14:11:23.222490+0000","last_fullsized":"2024-09-19T14:11:23.222490+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:11.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739606+0000","last_change":"2024-09-19T14:03:08.844476+0000","last_active":"2024-09-19T14:10:41.739606+0000","last_peered":"2024-09-19T14:10:41.739606+0000","last_clean":"2024-09-19T14:10:41.739606+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:10:41.739606+0000","last_undegraded":"2024-09-19T14:10:41.739606+0000","last_fullsized":"2024-09-19T14:10:41.739606+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:07.162545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722684+0000","last_change":"2024-09-19T13:52:51.580942+0000","last_active":"2024-09-19T14:10:21.722684+0000","last_peered":"2024-09-19T14:10:21.722684+0000","last_clean":"2024-09-19T14:10:21.722684+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:10:21.722684+0000","last_undegraded":"2024-09-19T14:10:21.722684+0000","last_fullsized":"2024-09-19T14:10:21.722684+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:13.538115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":6,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.603559+0000","last_change":"2024-09-19T13:52:48.559959+0000","last_active":"2024-09-19T14:10:21.603559+0000","last_peered":"2024-09-19T14:10:21.603559+0000","last_clean":"2024-09-19T14:10:21.603559+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:10:21.603559+0000","last_undegraded":"2024-09-19T14:10:21.603559+0000","last_fullsized":"2024-09-19T14:10:21.603559+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:01.163462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.640638+0000","last_change":"2024-09-19T13:51:15.740479+0000","last_active":"2024-09-19T14:10:36.640638+0000","last_peered":"2024-09-19T14:10:36.640638+0000","last_clean":"2024-09-19T14:10:36.640638+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:10:36.640638+0000","last_undegraded":"2024-09-19T14:10:36.640638+0000","last_fullsized":"2024-09-19T14:10:36.640638+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:23.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636875+0000","last_change":"2024-09-19T14:03:08.839816+0000","last_active":"2024-09-19T14:10:11.636875+0000","last_peered":"2024-09-19T14:10:11.636875+0000","last_clean":"2024-09-19T14:10:11.636875+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:10:11.636875+0000","last_undegraded":"2024-09-19T14:10:11.636875+0000","last_fullsized":"2024-09-19T14:10:11.636875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:56.109994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717106+0000","last_change":"2024-09-19T13:52:51.579222+0000","last_active":"2024-09-19T14:09:46.717106+0000","last_peered":"2024-09-19T14:09:46.717106+0000","last_clean":"2024-09-19T14:09:46.717106+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:09:46.717106+0000","last_undegraded":"2024-09-19T14:09:46.717106+0000","last_fullsized":"2024-09-19T14:09:46.717106+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:47.019906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'8","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.612336+0000","last_change":"2024-09-19T13:52:48.554787+0000","last_active":"2024-09-19T14:11:36.612336+0000","last_peered":"2024-09-19T14:11:36.612336+0000","last_clean":"2024-09-19T14:11:36.612336+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:11:36.612336+0000","last_undegraded":"2024-09-19T14:11:36.612336+0000","last_fullsized":"2024-09-19T14:11:36.612336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:28.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.128068+0000","last_change":"2024-09-19T13:51:15.739410+0000","last_active":"2024-09-19T14:12:01.128068+0000","last_peered":"2024-09-19T14:12:01.128068+0000","last_clean":"2024-09-19T14:12:01.128068+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:12:01.128068+0000","last_undegraded":"2024-09-19T14:12:01.128068+0000","last_fullsized":"2024-09-19T14:12:01.128068+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:59.512917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.807924+0000","last_change":"2024-09-19T14:03:08.841302+0000","last_active":"2024-09-19T14:10:11.807924+0000","last_peered":"2024-09-19T14:10:11.807924+0000","last_clean":"2024-09-19T14:10:11.807924+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:10:11.807924+0000","last_undegraded":"2024-09-19T14:10:11.807924+0000","last_fullsized":"2024-09-19T14:10:11.807924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:41.250326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733241+0000","last_change":"2024-09-19T13:52:51.578766+0000","last_active":"2024-09-19T14:11:36.733241+0000","last_peered":"2024-09-19T14:11:36.733241+0000","last_clean":"2024-09-19T14:11:36.733241+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:11:36.733241+0000","last_undegraded":"2024-09-19T14:11:36.733241+0000","last_fullsized":"2024-09-19T14:11:36.733241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:06.602738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'1","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.730748+0000","last_change":"2024-09-19T13:52:48.554709+0000","last_active":"2024-09-19T14:09:46.730748+0000","last_peered":"2024-09-19T14:09:46.730748+0000","last_clean":"2024-09-19T14:09:46.730748+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:09:46.730748+0000","last_undegraded":"2024-09-19T14:09:46.730748+0000","last_fullsized":"2024-09-19T14:09:46.730748+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:18.382465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60368,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.724834+0000","last_change":"2024-09-19T13:51:15.744268+0000","last_active":"2024-09-19T14:10:36.724834+0000","last_peered":"2024-09-19T14:10:36.724834+0000","last_clean":"2024-09-19T14:10:36.724834+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:10:36.724834+0000","last_undegraded":"2024-09-19T14:10:36.724834+0000","last_fullsized":"2024-09-19T14:10:36.724834+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:44.697556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734779+0000","last_change":"2024-09-19T14:03:08.840741+0000","last_active":"2024-09-19T14:10:11.734779+0000","last_peered":"2024-09-19T14:10:11.734779+0000","last_clean":"2024-09-19T14:10:11.734779+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:10:11.734779+0000","last_undegraded":"2024-09-19T14:10:11.734779+0000","last_fullsized":"2024-09-19T14:10:11.734779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:28.511196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717148+0000","last_change":"2024-09-19T13:52:51.576629+0000","last_active":"2024-09-19T14:09:46.717148+0000","last_peered":"2024-09-19T14:09:46.717148+0000","last_clean":"2024-09-19T14:09:46.717148+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:09:46.717148+0000","last_undegraded":"2024-09-19T14:09:46.717148+0000","last_fullsized":"2024-09-19T14:09:46.717148+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:12.831765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'1","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.804394+0000","last_change":"2024-09-19T13:52:48.558114+0000","last_active":"2024-09-19T14:09:46.804394+0000","last_peered":"2024-09-19T14:09:46.804394+0000","last_clean":"2024-09-19T14:09:46.804394+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:09:46.804394+0000","last_undegraded":"2024-09-19T14:09:46.804394+0000","last_fullsized":"2024-09-19T14:09:46.804394+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:06.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.811335+0000","last_change":"2024-09-19T13:51:15.739232+0000","last_active":"2024-09-19T14:10:36.811335+0000","last_peered":"2024-09-19T14:10:36.811335+0000","last_clean":"2024-09-19T14:10:36.811335+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:10:36.811335+0000","last_undegraded":"2024-09-19T14:10:36.811335+0000","last_fullsized":"2024-09-19T14:10:36.811335+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:51.455590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600709+0000","last_change":"2024-09-19T14:03:08.838834+0000","last_active":"2024-09-19T14:10:11.600709+0000","last_peered":"2024-09-19T14:10:11.600709+0000","last_clean":"2024-09-19T14:10:11.600709+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:10:11.600709+0000","last_undegraded":"2024-09-19T14:10:11.600709+0000","last_fullsized":"2024-09-19T14:10:11.600709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:03.093578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717534+0000","last_change":"2024-09-19T13:52:51.583920+0000","last_active":"2024-09-19T14:09:46.717534+0000","last_peered":"2024-09-19T14:09:46.717534+0000","last_clean":"2024-09-19T14:09:46.717534+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:09:46.717534+0000","last_undegraded":"2024-09-19T14:09:46.717534+0000","last_fullsized":"2024-09-19T14:09:46.717534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:36.896326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'7","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.598296+0000","last_change":"2024-09-19T13:52:48.555699+0000","last_active":"2024-09-19T14:09:46.598296+0000","last_peered":"2024-09-19T14:09:46.598296+0000","last_clean":"2024-09-19T14:09:46.598296+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:09:46.598296+0000","last_undegraded":"2024-09-19T14:09:46.598296+0000","last_fullsized":"2024-09-19T14:09:46.598296+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:08.653057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.732994+0000","last_change":"2024-09-19T13:51:15.743134+0000","last_active":"2024-09-19T14:10:01.732994+0000","last_peered":"2024-09-19T14:10:01.732994+0000","last_clean":"2024-09-19T14:10:01.732994+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:10:01.732994+0000","last_undegraded":"2024-09-19T14:10:01.732994+0000","last_fullsized":"2024-09-19T14:10:01.732994+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:20.033888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723447+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:10:26.723447+0000","last_peered":"2024-09-19T14:10:26.723447+0000","last_clean":"2024-09-19T14:10:26.723447+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:10:26.723447+0000","last_undegraded":"2024-09-19T14:10:26.723447+0000","last_fullsized":"2024-09-19T14:10:26.723447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:46.882911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'13","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647858+0000","last_change":"2024-09-19T13:52:51.584825+0000","last_active":"2024-09-19T14:11:31.647858+0000","last_peered":"2024-09-19T14:11:31.647858+0000","last_clean":"2024-09-19T14:11:31.647858+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:11:31.647858+0000","last_undegraded":"2024-09-19T14:11:31.647858+0000","last_fullsized":"2024-09-19T14:11:31.647858+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:27.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11793,"num_write":33,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732335+0000","last_change":"2024-09-19T13:52:48.558319+0000","last_active":"2024-09-19T14:11:31.732335+0000","last_peered":"2024-09-19T14:11:31.732335+0000","last_clean":"2024-09-19T14:11:31.732335+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:11:31.732335+0000","last_undegraded":"2024-09-19T14:11:31.732335+0000","last_fullsized":"2024-09-19T14:11:31.732335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:02.238052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.235548+0000","last_change":"2024-09-19T13:51:15.743038+0000","last_active":"2024-09-19T14:11:22.235548+0000","last_peered":"2024-09-19T14:11:22.235548+0000","last_clean":"2024-09-19T14:11:22.235548+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:11:22.235548+0000","last_undegraded":"2024-09-19T14:11:22.235548+0000","last_fullsized":"2024-09-19T14:11:22.235548+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:09.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.604316+0000","last_change":"2024-09-19T14:03:08.842157+0000","last_active":"2024-09-19T14:10:26.604316+0000","last_peered":"2024-09-19T14:10:26.604316+0000","last_clean":"2024-09-19T14:10:26.604316+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:10:26.604316+0000","last_undegraded":"2024-09-19T14:10:26.604316+0000","last_fullsized":"2024-09-19T14:10:26.604316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647830+0000","last_change":"2024-09-19T13:52:51.582431+0000","last_active":"2024-09-19T14:11:31.647830+0000","last_peered":"2024-09-19T14:11:31.647830+0000","last_clean":"2024-09-19T14:11:31.647830+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:11:31.647830+0000","last_undegraded":"2024-09-19T14:11:31.647830+0000","last_fullsized":"2024-09-19T14:11:31.647830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:56.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732554+0000","last_change":"2024-09-19T13:52:48.558710+0000","last_active":"2024-09-19T14:11:31.732554+0000","last_peered":"2024-09-19T14:11:31.732554+0000","last_clean":"2024-09-19T14:11:31.732554+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:11:31.732554+0000","last_undegraded":"2024-09-19T14:11:31.732554+0000","last_fullsized":"2024-09-19T14:11:31.732554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:43.224289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599659+0000","last_change":"2024-09-19T13:51:15.739209+0000","last_active":"2024-09-19T14:09:56.599659+0000","last_peered":"2024-09-19T14:09:56.599659+0000","last_clean":"2024-09-19T14:09:56.599659+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:09:56.599659+0000","last_undegraded":"2024-09-19T14:09:56.599659+0000","last_fullsized":"2024-09-19T14:09:56.599659+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:48.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602888+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:10:16.602888+0000","last_peered":"2024-09-19T14:10:16.602888+0000","last_clean":"2024-09-19T14:10:16.602888+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:10:16.602888+0000","last_undegraded":"2024-09-19T14:10:16.602888+0000","last_fullsized":"2024-09-19T14:10:16.602888+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:48.528788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732599+0000","last_change":"2024-09-19T13:52:51.580249+0000","last_active":"2024-09-19T14:11:31.732599+0000","last_peered":"2024-09-19T14:11:31.732599+0000","last_clean":"2024-09-19T14:11:31.732599+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:11:31.732599+0000","last_undegraded":"2024-09-19T14:11:31.732599+0000","last_fullsized":"2024-09-19T14:11:31.732599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:23.302145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722601+0000","last_change":"2024-09-19T13:52:48.548153+0000","last_active":"2024-09-19T14:11:31.722601+0000","last_peered":"2024-09-19T14:11:31.722601+0000","last_clean":"2024-09-19T14:11:31.722601+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:11:31.722601+0000","last_undegraded":"2024-09-19T14:11:31.722601+0000","last_fullsized":"2024-09-19T14:11:31.722601+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:48.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":214,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718953+0000","last_change":"2024-09-19T13:51:15.736147+0000","last_active":"2024-09-19T14:09:56.718953+0000","last_peered":"2024-09-19T14:09:56.718953+0000","last_clean":"2024-09-19T14:09:56.718953+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:09:56.718953+0000","last_undegraded":"2024-09-19T14:09:56.718953+0000","last_fullsized":"2024-09-19T14:09:56.718953+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:46:19.842918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723422+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:10:26.723422+0000","last_peered":"2024-09-19T14:10:26.723422+0000","last_clean":"2024-09-19T14:10:26.723422+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:10:26.723422+0000","last_undegraded":"2024-09-19T14:10:26.723422+0000","last_fullsized":"2024-09-19T14:10:26.723422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:18.667527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722586+0000","last_change":"2024-09-19T13:52:51.585924+0000","last_active":"2024-09-19T14:11:31.722586+0000","last_peered":"2024-09-19T14:11:31.722586+0000","last_clean":"2024-09-19T14:11:31.722586+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:11:31.722586+0000","last_undegraded":"2024-09-19T14:11:31.722586+0000","last_fullsized":"2024-09-19T14:11:31.722586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:33.073773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18432,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'8","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611549+0000","last_change":"2024-09-19T13:52:48.547186+0000","last_active":"2024-09-19T14:11:31.611549+0000","last_peered":"2024-09-19T14:11:31.611549+0000","last_clean":"2024-09-19T14:11:31.611549+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:11:31.611549+0000","last_undegraded":"2024-09-19T14:11:31.611549+0000","last_fullsized":"2024-09-19T14:11:31.611549+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:31.825750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339881,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":26674,"num_write":8,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.377489+0000","last_change":"2024-09-19T13:51:15.745411+0000","last_active":"2024-09-19T14:12:01.377489+0000","last_peered":"2024-09-19T14:12:01.377489+0000","last_clean":"2024-09-19T14:12:01.377489+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:12:01.377489+0000","last_undegraded":"2024-09-19T14:12:01.377489+0000","last_fullsized":"2024-09-19T14:12:01.377489+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:56.436504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820573+0000","last_change":"2024-09-19T14:03:08.839556+0000","last_active":"2024-09-19T14:11:51.820573+0000","last_peered":"2024-09-19T14:11:51.820573+0000","last_clean":"2024-09-19T14:11:51.820573+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:11:51.820573+0000","last_undegraded":"2024-09-19T14:11:51.820573+0000","last_fullsized":"2024-09-19T14:11:51.820573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:45.080550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'6","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726983+0000","last_change":"2024-09-19T13:52:51.578477+0000","last_active":"2024-09-19T14:10:51.726983+0000","last_peered":"2024-09-19T14:10:51.726983+0000","last_clean":"2024-09-19T14:10:51.726983+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:10:51.726983+0000","last_undegraded":"2024-09-19T14:10:51.726983+0000","last_fullsized":"2024-09-19T14:10:51.726983+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:50.156854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'1","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740989+0000","last_change":"2024-09-19T13:52:48.558154+0000","last_active":"2024-09-19T14:10:51.740989+0000","last_peered":"2024-09-19T14:10:51.740989+0000","last_clean":"2024-09-19T14:10:51.740989+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:10:51.740989+0000","last_undegraded":"2024-09-19T14:10:51.740989+0000","last_fullsized":"2024-09-19T14:10:51.740989+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:17.554459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733289+0000","last_change":"2024-09-19T13:51:15.743194+0000","last_active":"2024-09-19T14:11:36.733289+0000","last_peered":"2024-09-19T14:11:36.733289+0000","last_clean":"2024-09-19T14:11:36.733289+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:11:36.733289+0000","last_undegraded":"2024-09-19T14:11:36.733289+0000","last_fullsized":"2024-09-19T14:11:36.733289+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:50.338128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732215+0000","last_change":"2024-09-19T14:03:08.841430+0000","last_active":"2024-09-19T14:09:56.732215+0000","last_peered":"2024-09-19T14:09:56.732215+0000","last_clean":"2024-09-19T14:09:56.732215+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:09:56.732215+0000","last_undegraded":"2024-09-19T14:09:56.732215+0000","last_fullsized":"2024-09-19T14:09:56.732215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:02.341745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726947+0000","last_change":"2024-09-19T13:52:51.585844+0000","last_active":"2024-09-19T14:10:51.726947+0000","last_peered":"2024-09-19T14:10:51.726947+0000","last_clean":"2024-09-19T14:10:51.726947+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:10:51.726947+0000","last_undegraded":"2024-09-19T14:10:51.726947+0000","last_fullsized":"2024-09-19T14:10:51.726947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:51.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813367+0000","last_change":"2024-09-19T13:52:48.558799+0000","last_active":"2024-09-19T14:10:51.813367+0000","last_peered":"2024-09-19T14:10:51.813367+0000","last_clean":"2024-09-19T14:10:51.813367+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:10:51.813367+0000","last_undegraded":"2024-09-19T14:10:51.813367+0000","last_fullsized":"2024-09-19T14:10:51.813367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:02.090671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.123898+0000","last_change":"2024-09-19T13:51:15.747319+0000","last_active":"2024-09-19T14:12:01.123898+0000","last_peered":"2024-09-19T14:12:01.123898+0000","last_clean":"2024-09-19T14:12:01.123898+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:12:01.123898+0000","last_undegraded":"2024-09-19T14:12:01.123898+0000","last_fullsized":"2024-09-19T14:12:01.123898+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:36.553112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.725348+0000","last_change":"2024-09-19T14:03:08.837522+0000","last_active":"2024-09-19T14:11:51.725348+0000","last_peered":"2024-09-19T14:11:51.725348+0000","last_clean":"2024-09-19T14:11:51.725348+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:11:51.725348+0000","last_undegraded":"2024-09-19T14:11:51.725348+0000","last_fullsized":"2024-09-19T14:11:51.725348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:20.683332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643598+0000","last_change":"2024-09-19T13:52:51.586120+0000","last_active":"2024-09-19T14:10:56.643598+0000","last_peered":"2024-09-19T14:10:56.643598+0000","last_clean":"2024-09-19T14:10:56.643598+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:10:56.643598+0000","last_undegraded":"2024-09-19T14:10:56.643598+0000","last_fullsized":"2024-09-19T14:10:56.643598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:59.884434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.607991+0000","last_change":"2024-09-19T13:52:48.554380+0000","last_active":"2024-09-19T14:10:51.607991+0000","last_peered":"2024-09-19T14:10:51.607991+0000","last_clean":"2024-09-19T14:10:51.607991+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:10:51.607991+0000","last_undegraded":"2024-09-19T14:10:51.607991+0000","last_fullsized":"2024-09-19T14:10:51.607991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:07.309256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722642+0000","last_change":"2024-09-19T13:51:15.747867+0000","last_active":"2024-09-19T14:11:31.722642+0000","last_peered":"2024-09-19T14:11:31.722642+0000","last_clean":"2024-09-19T14:11:31.722642+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:11:31.722642+0000","last_undegraded":"2024-09-19T14:11:31.722642+0000","last_fullsized":"2024-09-19T14:11:31.722642+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749807+0000","last_change":"2024-09-19T14:03:08.841866+0000","last_active":"2024-09-19T14:11:51.749807+0000","last_peered":"2024-09-19T14:11:51.749807+0000","last_clean":"2024-09-19T14:11:51.749807+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:11:51.749807+0000","last_undegraded":"2024-09-19T14:11:51.749807+0000","last_fullsized":"2024-09-19T14:11:51.749807+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:36.658533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727005+0000","last_change":"2024-09-19T13:52:51.582164+0000","last_active":"2024-09-19T14:10:51.727005+0000","last_peered":"2024-09-19T14:10:51.727005+0000","last_clean":"2024-09-19T14:10:51.727005+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:10:51.727005+0000","last_undegraded":"2024-09-19T14:10:51.727005+0000","last_fullsized":"2024-09-19T14:10:51.727005+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:27.713291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'7","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643565+0000","last_change":"2024-09-19T13:52:48.547009+0000","last_active":"2024-09-19T14:10:56.643565+0000","last_peered":"2024-09-19T14:10:56.643565+0000","last_clean":"2024-09-19T14:10:56.643565+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:10:56.643565+0000","last_undegraded":"2024-09-19T14:10:56.643565+0000","last_fullsized":"2024-09-19T14:10:56.643565+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:40.726822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.310015+0000","last_change":"2024-09-19T13:51:15.740368+0000","last_active":"2024-09-19T14:11:59.310015+0000","last_peered":"2024-09-19T14:11:59.310015+0000","last_clean":"2024-09-19T14:11:59.310015+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:11:59.310015+0000","last_undegraded":"2024-09-19T14:11:59.310015+0000","last_fullsized":"2024-09-19T14:11:59.310015+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.326002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718769+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:09:56.718769+0000","last_peered":"2024-09-19T14:09:56.718769+0000","last_clean":"2024-09-19T14:09:56.718769+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:09:56.718769+0000","last_undegraded":"2024-09-19T14:09:56.718769+0000","last_fullsized":"2024-09-19T14:09:56.718769+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:23.564561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'3","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721393+0000","last_change":"2024-09-19T13:52:51.584114+0000","last_active":"2024-09-19T14:10:11.721393+0000","last_peered":"2024-09-19T14:10:11.721393+0000","last_clean":"2024-09-19T14:10:11.721393+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:10:11.721393+0000","last_undegraded":"2024-09-19T14:10:11.721393+0000","last_fullsized":"2024-09-19T14:10:11.721393+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:15.511565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.601992+0000","last_change":"2024-09-19T13:52:48.555321+0000","last_active":"2024-09-19T14:10:11.601992+0000","last_peered":"2024-09-19T14:10:11.601992+0000","last_clean":"2024-09-19T14:10:11.601992+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:10:11.601992+0000","last_undegraded":"2024-09-19T14:10:11.601992+0000","last_fullsized":"2024-09-19T14:10:11.601992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:35.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613130+0000","last_change":"2024-09-19T13:51:15.743442+0000","last_active":"2024-09-19T14:11:31.613130+0000","last_peered":"2024-09-19T14:11:31.613130+0000","last_clean":"2024-09-19T14:11:31.613130+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:11:31.613130+0000","last_undegraded":"2024-09-19T14:11:31.613130+0000","last_fullsized":"2024-09-19T14:11:31.613130+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:06.945466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.733045+0000","last_change":"2024-09-19T14:03:08.843681+0000","last_active":"2024-09-19T14:10:01.733045+0000","last_peered":"2024-09-19T14:10:01.733045+0000","last_clean":"2024-09-19T14:10:01.733045+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:10:01.733045+0000","last_undegraded":"2024-09-19T14:10:01.733045+0000","last_fullsized":"2024-09-19T14:10:01.733045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:00.158335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734797+0000","last_change":"2024-09-19T13:52:51.586345+0000","last_active":"2024-09-19T14:10:11.734797+0000","last_peered":"2024-09-19T14:10:11.734797+0000","last_clean":"2024-09-19T14:10:11.734797+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:10:11.734797+0000","last_undegraded":"2024-09-19T14:10:11.734797+0000","last_fullsized":"2024-09-19T14:10:11.734797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.184586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636840+0000","last_change":"2024-09-19T13:52:48.546287+0000","last_active":"2024-09-19T14:10:11.636840+0000","last_peered":"2024-09-19T14:10:11.636840+0000","last_clean":"2024-09-19T14:10:11.636840+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:10:11.636840+0000","last_undegraded":"2024-09-19T14:10:11.636840+0000","last_fullsized":"2024-09-19T14:10:11.636840+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:25.721235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:13.401604+0000","last_change":"2024-09-19T13:51:15.743432+0000","last_active":"2024-09-19T14:11:13.401604+0000","last_peered":"2024-09-19T14:11:13.401604+0000","last_clean":"2024-09-19T14:11:13.401604+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:11:13.401604+0000","last_undegraded":"2024-09-19T14:11:13.401604+0000","last_fullsized":"2024-09-19T14:11:13.401604+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:33.234941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732266+0000","last_change":"2024-09-19T14:03:08.842574+0000","last_active":"2024-09-19T14:09:56.732266+0000","last_peered":"2024-09-19T14:09:56.732266+0000","last_clean":"2024-09-19T14:09:56.732266+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:09:56.732266+0000","last_undegraded":"2024-09-19T14:09:56.732266+0000","last_fullsized":"2024-09-19T14:09:56.732266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:57.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.642788+0000","last_change":"2024-09-19T13:52:51.583284+0000","last_active":"2024-09-19T14:10:51.642788+0000","last_peered":"2024-09-19T14:10:51.642788+0000","last_clean":"2024-09-19T14:10:51.642788+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:10:51.642788+0000","last_undegraded":"2024-09-19T14:10:51.642788+0000","last_fullsized":"2024-09-19T14:10:51.642788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:42.843357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602834+0000","last_change":"2024-09-19T13:52:48.557637+0000","last_active":"2024-09-19T14:10:16.602834+0000","last_peered":"2024-09-19T14:10:16.602834+0000","last_clean":"2024-09-19T14:10:16.602834+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:10:16.602834+0000","last_undegraded":"2024-09-19T14:10:16.602834+0000","last_fullsized":"2024-09-19T14:10:16.602834+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:06.589139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.726202+0000","last_change":"2024-09-19T13:51:15.742226+0000","last_active":"2024-09-19T14:10:46.726202+0000","last_peered":"2024-09-19T14:10:46.726202+0000","last_clean":"2024-09-19T14:10:46.726202+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:10:46.726202+0000","last_undegraded":"2024-09-19T14:10:46.726202+0000","last_fullsized":"2024-09-19T14:10:46.726202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:54.177354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599771+0000","last_change":"2024-09-19T14:03:08.836511+0000","last_active":"2024-09-19T14:09:56.599771+0000","last_peered":"2024-09-19T14:09:56.599771+0000","last_clean":"2024-09-19T14:09:56.599771+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:09:56.599771+0000","last_undegraded":"2024-09-19T14:09:56.599771+0000","last_fullsized":"2024-09-19T14:09:56.599771+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:37.198257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.735788+0000","last_change":"2024-09-19T13:52:51.586838+0000","last_active":"2024-09-19T14:10:16.735788+0000","last_peered":"2024-09-19T14:10:16.735788+0000","last_clean":"2024-09-19T14:10:16.735788+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:10:16.735788+0000","last_undegraded":"2024-09-19T14:10:16.735788+0000","last_fullsized":"2024-09-19T14:10:16.735788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:15.962404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727446+0000","last_change":"2024-09-19T13:52:48.556403+0000","last_active":"2024-09-19T14:10:51.727446+0000","last_peered":"2024-09-19T14:10:51.727446+0000","last_clean":"2024-09-19T14:10:51.727446+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:10:51.727446+0000","last_undegraded":"2024-09-19T14:10:51.727446+0000","last_fullsized":"2024-09-19T14:10:51.727446+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:20.551373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.716860+0000","last_change":"2024-09-19T13:51:15.746021+0000","last_active":"2024-09-19T14:10:46.716860+0000","last_peered":"2024-09-19T14:10:46.716860+0000","last_clean":"2024-09-19T14:10:46.716860+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:10:46.716860+0000","last_undegraded":"2024-09-19T14:10:46.716860+0000","last_fullsized":"2024-09-19T14:10:46.716860+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:23.497158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.746520+0000","last_change":"2024-09-19T14:03:08.843561+0000","last_active":"2024-09-19T14:11:31.746520+0000","last_peered":"2024-09-19T14:11:31.746520+0000","last_clean":"2024-09-19T14:11:31.746520+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:11:31.746520+0000","last_undegraded":"2024-09-19T14:11:31.746520+0000","last_fullsized":"2024-09-19T14:11:31.746520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:24.992091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614667+0000","last_change":"2024-09-19T13:52:51.586079+0000","last_active":"2024-09-19T14:11:41.614667+0000","last_peered":"2024-09-19T14:11:41.614667+0000","last_clean":"2024-09-19T14:11:41.614667+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:11:41.614667+0000","last_undegraded":"2024-09-19T14:11:41.614667+0000","last_fullsized":"2024-09-19T14:11:41.614667+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:06.216009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747325+0000","last_change":"2024-09-19T13:52:48.554440+0000","last_active":"2024-09-19T14:11:36.747325+0000","last_peered":"2024-09-19T14:11:36.747325+0000","last_clean":"2024-09-19T14:11:36.747325+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:11:36.747325+0000","last_undegraded":"2024-09-19T14:11:36.747325+0000","last_fullsized":"2024-09-19T14:11:36.747325+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:31.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.607300+0000","last_change":"2024-09-19T13:51:15.740499+0000","last_active":"2024-09-19T14:10:46.607300+0000","last_peered":"2024-09-19T14:10:46.607300+0000","last_clean":"2024-09-19T14:10:46.607300+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:10:46.607300+0000","last_undegraded":"2024-09-19T14:10:46.607300+0000","last_fullsized":"2024-09-19T14:10:46.607300+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:10.208746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611531+0000","last_change":"2024-09-19T14:03:08.840165+0000","last_active":"2024-09-19T14:11:31.611531+0000","last_peered":"2024-09-19T14:11:31.611531+0000","last_clean":"2024-09-19T14:11:31.611531+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:11:31.611531+0000","last_undegraded":"2024-09-19T14:11:31.611531+0000","last_fullsized":"2024-09-19T14:11:31.611531+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:26.897102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613946+0000","last_change":"2024-09-19T13:52:51.587531+0000","last_active":"2024-09-19T14:11:36.613946+0000","last_peered":"2024-09-19T14:11:36.613946+0000","last_clean":"2024-09-19T14:11:36.613946+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:11:36.613946+0000","last_undegraded":"2024-09-19T14:11:36.613946+0000","last_fullsized":"2024-09-19T14:11:36.613946+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:31.550230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818442+0000","last_change":"2024-09-19T13:52:48.558491+0000","last_active":"2024-09-19T14:11:36.818442+0000","last_peered":"2024-09-19T14:11:36.818442+0000","last_clean":"2024-09-19T14:11:36.818442+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:11:36.818442+0000","last_undegraded":"2024-09-19T14:11:36.818442+0000","last_fullsized":"2024-09-19T14:11:36.818442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:47.947923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.610873+0000","last_change":"2024-09-19T13:51:15.745899+0000","last_active":"2024-09-19T14:11:11.610873+0000","last_peered":"2024-09-19T14:11:11.610873+0000","last_clean":"2024-09-19T14:11:11.610873+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:11:11.610873+0000","last_undegraded":"2024-09-19T14:11:11.610873+0000","last_fullsized":"2024-09-19T14:11:11.610873+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:38.734235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645917+0000","last_change":"2024-09-19T14:03:08.834382+0000","last_active":"2024-09-19T14:11:16.645917+0000","last_peered":"2024-09-19T14:11:16.645917+0000","last_clean":"2024-09-19T14:11:16.645917+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:11:16.645917+0000","last_undegraded":"2024-09-19T14:11:16.645917+0000","last_fullsized":"2024-09-19T14:11:16.645917+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:23.550035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734947+0000","last_change":"2024-09-19T13:52:51.587324+0000","last_active":"2024-09-19T14:10:11.734947+0000","last_peered":"2024-09-19T14:10:11.734947+0000","last_clean":"2024-09-19T14:10:11.734947+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:10:11.734947+0000","last_undegraded":"2024-09-19T14:10:11.734947+0000","last_fullsized":"2024-09-19T14:10:11.734947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:31.730122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600809+0000","last_change":"2024-09-19T13:52:48.553095+0000","last_active":"2024-09-19T14:10:11.600809+0000","last_peered":"2024-09-19T14:10:11.600809+0000","last_clean":"2024-09-19T14:10:11.600809+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:10:11.600809+0000","last_undegraded":"2024-09-19T14:10:11.600809+0000","last_fullsized":"2024-09-19T14:10:11.600809+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:06.522712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752646+0000","last_change":"2024-09-19T13:51:15.745034+0000","last_active":"2024-09-19T14:12:11.752646+0000","last_peered":"2024-09-19T14:12:11.752646+0000","last_clean":"2024-09-19T14:12:11.752646+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:12:11.752646+0000","last_undegraded":"2024-09-19T14:12:11.752646+0000","last_fullsized":"2024-09-19T14:12:11.752646+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.684247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732364+0000","last_change":"2024-09-19T14:03:08.839316+0000","last_active":"2024-09-19T14:11:31.732364+0000","last_peered":"2024-09-19T14:11:31.732364+0000","last_clean":"2024-09-19T14:11:31.732364+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:11:31.732364+0000","last_undegraded":"2024-09-19T14:11:31.732364+0000","last_fullsized":"2024-09-19T14:11:31.732364+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:47.115178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721502+0000","last_change":"2024-09-19T13:52:51.583041+0000","last_active":"2024-09-19T14:10:11.721502+0000","last_peered":"2024-09-19T14:10:11.721502+0000","last_clean":"2024-09-19T14:10:11.721502+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:10:11.721502+0000","last_undegraded":"2024-09-19T14:10:11.721502+0000","last_fullsized":"2024-09-19T14:10:11.721502+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:32.304868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'1","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734967+0000","last_change":"2024-09-19T13:52:48.558143+0000","last_active":"2024-09-19T14:10:11.734967+0000","last_peered":"2024-09-19T14:10:11.734967+0000","last_clean":"2024-09-19T14:10:11.734967+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:10:11.734967+0000","last_undegraded":"2024-09-19T14:10:11.734967+0000","last_fullsized":"2024-09-19T14:10:11.734967+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:09.148223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.652462+0000","last_change":"2024-09-19T13:51:15.746992+0000","last_active":"2024-09-19T14:12:06.652462+0000","last_peered":"2024-09-19T14:12:06.652462+0000","last_clean":"2024-09-19T14:12:06.652462+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:12:06.652462+0000","last_undegraded":"2024-09-19T14:12:06.652462+0000","last_fullsized":"2024-09-19T14:12:06.652462+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:59.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820648+0000","last_change":"2024-09-19T14:03:08.835971+0000","last_active":"2024-09-19T14:11:51.820648+0000","last_peered":"2024-09-19T14:11:51.820648+0000","last_clean":"2024-09-19T14:11:51.820648+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:11:51.820648+0000","last_undegraded":"2024-09-19T14:11:51.820648+0000","last_fullsized":"2024-09-19T14:11:51.820648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:49.881174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648494+0000","last_change":"2024-09-19T13:52:51.582819+0000","last_active":"2024-09-19T14:11:36.648494+0000","last_peered":"2024-09-19T14:11:36.648494+0000","last_clean":"2024-09-19T14:11:36.648494+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:11:36.648494+0000","last_undegraded":"2024-09-19T14:11:36.648494+0000","last_fullsized":"2024-09-19T14:11:36.648494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:43.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.741650+0000","last_change":"2024-09-19T13:52:48.556826+0000","last_active":"2024-09-19T14:10:56.741650+0000","last_peered":"2024-09-19T14:10:56.741650+0000","last_clean":"2024-09-19T14:10:56.741650+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:10:56.741650+0000","last_undegraded":"2024-09-19T14:10:56.741650+0000","last_fullsized":"2024-09-19T14:10:56.741650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:39.933207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.616079+0000","last_change":"2024-09-19T13:51:15.742662+0000","last_active":"2024-09-19T14:12:06.616079+0000","last_peered":"2024-09-19T14:12:06.616079+0000","last_clean":"2024-09-19T14:12:06.616079+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:12:06.616079+0000","last_undegraded":"2024-09-19T14:12:06.616079+0000","last_fullsized":"2024-09-19T14:12:06.616079+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:47.205807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.616208+0000","last_change":"2024-09-19T14:03:08.837483+0000","last_active":"2024-09-19T14:11:51.616208+0000","last_peered":"2024-09-19T14:11:51.616208+0000","last_clean":"2024-09-19T14:11:51.616208+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:11:51.616208+0000","last_undegraded":"2024-09-19T14:11:51.616208+0000","last_fullsized":"2024-09-19T14:11:51.616208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:43.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.607103+0000","last_change":"2024-09-19T13:52:51.582481+0000","last_active":"2024-09-19T14:10:56.607103+0000","last_peered":"2024-09-19T14:10:56.607103+0000","last_clean":"2024-09-19T14:10:56.607103+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:10:56.607103+0000","last_undegraded":"2024-09-19T14:10:56.607103+0000","last_fullsized":"2024-09-19T14:10:56.607103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.118790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747273+0000","last_change":"2024-09-19T13:52:48.558237+0000","last_active":"2024-09-19T14:11:36.747273+0000","last_peered":"2024-09-19T14:11:36.747273+0000","last_clean":"2024-09-19T14:11:36.747273+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:11:36.747273+0000","last_undegraded":"2024-09-19T14:11:36.747273+0000","last_fullsized":"2024-09-19T14:11:36.747273+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:14.742516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.737132+0000","last_change":"2024-09-19T13:51:15.739439+0000","last_active":"2024-09-19T14:12:06.737132+0000","last_peered":"2024-09-19T14:12:06.737132+0000","last_clean":"2024-09-19T14:12:06.737132+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:12:06.737132+0000","last_undegraded":"2024-09-19T14:12:06.737132+0000","last_fullsized":"2024-09-19T14:12:06.737132+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:29.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613161+0000","last_change":"2024-09-19T14:03:08.843652+0000","last_active":"2024-09-19T14:11:31.613161+0000","last_peered":"2024-09-19T14:11:31.613161+0000","last_clean":"2024-09-19T14:11:31.613161+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:11:31.613161+0000","last_undegraded":"2024-09-19T14:11:31.613161+0000","last_fullsized":"2024-09-19T14:11:31.613161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:18.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'6","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723289+0000","last_change":"2024-09-19T13:52:51.584999+0000","last_active":"2024-09-19T14:11:36.723289+0000","last_peered":"2024-09-19T14:11:36.723289+0000","last_clean":"2024-09-19T14:11:36.723289+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:11:36.723289+0000","last_undegraded":"2024-09-19T14:11:36.723289+0000","last_fullsized":"2024-09-19T14:11:36.723289+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:06.878095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21053,"num_write":11,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648525+0000","last_change":"2024-09-19T13:52:48.554967+0000","last_active":"2024-09-19T14:11:36.648525+0000","last_peered":"2024-09-19T14:11:36.648525+0000","last_clean":"2024-09-19T14:11:36.648525+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:11:36.648525+0000","last_undegraded":"2024-09-19T14:11:36.648525+0000","last_fullsized":"2024-09-19T14:11:36.648525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:11.689955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.726954+0000","last_change":"2024-09-19T13:51:15.746342+0000","last_active":"2024-09-19T14:12:06.726954+0000","last_peered":"2024-09-19T14:12:06.726954+0000","last_clean":"2024-09-19T14:12:06.726954+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:12:06.726954+0000","last_undegraded":"2024-09-19T14:12:06.726954+0000","last_fullsized":"2024-09-19T14:12:06.726954+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:44.550078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747359+0000","last_change":"2024-09-19T14:03:08.842987+0000","last_active":"2024-09-19T14:11:36.747359+0000","last_peered":"2024-09-19T14:11:36.747359+0000","last_clean":"2024-09-19T14:11:36.747359+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:11:36.747359+0000","last_undegraded":"2024-09-19T14:11:36.747359+0000","last_fullsized":"2024-09-19T14:11:36.747359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:51.898754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733214+0000","last_change":"2024-09-19T13:52:51.581838+0000","last_active":"2024-09-19T14:11:36.733214+0000","last_peered":"2024-09-19T14:11:36.733214+0000","last_clean":"2024-09-19T14:11:36.733214+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:11:36.733214+0000","last_undegraded":"2024-09-19T14:11:36.733214+0000","last_fullsized":"2024-09-19T14:11:36.733214+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:20.245214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108793,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":214,"num_write":2,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723307+0000","last_change":"2024-09-19T13:52:48.546981+0000","last_active":"2024-09-19T14:11:36.723307+0000","last_peered":"2024-09-19T14:11:36.723307+0000","last_clean":"2024-09-19T14:11:36.723307+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:11:36.723307+0000","last_undegraded":"2024-09-19T14:11:36.723307+0000","last_fullsized":"2024-09-19T14:11:36.723307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:09.807617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.748475+0000","last_change":"2024-09-19T13:51:15.745532+0000","last_active":"2024-09-19T14:11:22.748475+0000","last_peered":"2024-09-19T14:11:22.748475+0000","last_clean":"2024-09-19T14:11:22.748475+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:11:22.748475+0000","last_undegraded":"2024-09-19T14:11:22.748475+0000","last_fullsized":"2024-09-19T14:11:22.748475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:14.528177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'190","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.408408+0000","last_change":"2024-09-19T13:36:07.808934+0000","last_active":"2024-09-19T14:12:12.408408+0000","last_peered":"2024-09-19T14:12:12.408408+0000","last_clean":"2024-09-19T14:12:12.408408+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:12:12.408408+0000","last_undegraded":"2024-09-19T14:12:12.408408+0000","last_fullsized":"2024-09-19T14:12:12.408408+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:00.228367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7200863,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":14767,"num_write":954,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'808","reported_seq":2383,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544116+0000","last_change":"2024-09-19T13:36:09.334352+0000","last_active":"2024-09-19T14:12:15.544116+0000","last_peered":"2024-09-19T14:12:15.544116+0000","last_clean":"2024-09-19T14:12:15.544116+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:12:15.544116+0000","last_undegraded":"2024-09-19T14:12:15.544116+0000","last_fullsized":"2024-09-19T14:12:15.544116+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:03.775963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648600+0000","last_change":"2024-09-19T13:36:07.810255+0000","last_active":"2024-09-19T14:11:36.648600+0000","last_peered":"2024-09-19T14:11:36.648600+0000","last_clean":"2024-09-19T14:11:36.648600+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:11:36.648600+0000","last_undegraded":"2024-09-19T14:11:36.648600+0000","last_fullsized":"2024-09-19T14:11:36.648600+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:57.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":5759,"num_write":872,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'700","reported_seq":2388,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607197+0000","last_change":"2024-09-19T13:36:09.341109+0000","last_active":"2024-09-19T14:12:13.607197+0000","last_peered":"2024-09-19T14:12:13.607197+0000","last_clean":"2024-09-19T14:12:13.607197+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:12:13.607197+0000","last_undegraded":"2024-09-19T14:12:13.607197+0000","last_fullsized":"2024-09-19T14:12:13.607197+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.137955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'219","reported_seq":847,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613967+0000","last_change":"2024-09-19T13:36:07.802705+0000","last_active":"2024-09-19T14:11:36.613967+0000","last_peered":"2024-09-19T14:11:36.613967+0000","last_clean":"2024-09-19T14:11:36.613967+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:11:36.613967+0000","last_undegraded":"2024-09-19T14:11:36.613967+0000","last_fullsized":"2024-09-19T14:11:36.613967+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.788681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":12221,"num_write":1123,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'389","reported_seq":1859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260118+0000","last_change":"2024-09-19T13:36:09.331848+0000","last_active":"2024-09-19T14:12:20.260118+0000","last_peered":"2024-09-19T14:12:20.260118+0000","last_clean":"2024-09-19T14:12:20.260118+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:12:20.260118+0000","last_undegraded":"2024-09-19T14:12:20.260118+0000","last_fullsized":"2024-09-19T14:12:20.260118+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:25:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'216","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.617260+0000","last_change":"2024-09-19T13:36:07.812873+0000","last_active":"2024-09-19T14:12:16.617260+0000","last_peered":"2024-09-19T14:12:16.617260+0000","last_clean":"2024-09-19T14:12:16.617260+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:12:16.617260+0000","last_undegraded":"2024-09-19T14:12:16.617260+0000","last_fullsized":"2024-09-19T14:12:16.617260+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:44.575892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471640,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":9100,"num_write":1123,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'993","reported_seq":2638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.225812+0000","last_change":"2024-09-19T13:36:44.400454+0000","last_active":"2024-09-19T14:12:13.225812+0000","last_peered":"2024-09-19T14:12:13.225812+0000","last_clean":"2024-09-19T14:12:13.225812+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:12:13.225812+0000","last_undegraded":"2024-09-19T14:12:13.225812+0000","last_fullsized":"2024-09-19T14:12:13.225812+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.890102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'193","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.004337+0000","last_change":"2024-09-19T13:36:07.808137+0000","last_active":"2024-09-19T14:12:07.004337+0000","last_peered":"2024-09-19T14:12:07.004337+0000","last_clean":"2024-09-19T14:12:07.004337+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:12:07.004337+0000","last_undegraded":"2024-09-19T14:12:07.004337+0000","last_fullsized":"2024-09-19T14:12:07.004337+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:25.229167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439926,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":134002,"num_write":940,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'557","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176066+0000","last_change":"2024-09-19T13:36:09.334428+0000","last_active":"2024-09-19T14:12:26.176066+0000","last_peered":"2024-09-19T14:12:26.176066+0000","last_clean":"2024-09-19T14:12:26.176066+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:12:26.176066+0000","last_undegraded":"2024-09-19T14:12:26.176066+0000","last_fullsized":"2024-09-19T14:12:26.176066+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:02.385725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'189","reported_seq":762,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.695601+0000","last_change":"2024-09-19T13:36:07.816316+0000","last_active":"2024-09-19T14:11:31.695601+0000","last_peered":"2024-09-19T14:11:31.695601+0000","last_clean":"2024-09-19T14:11:31.695601+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:11:31.695601+0000","last_undegraded":"2024-09-19T14:11:31.695601+0000","last_fullsized":"2024-09-19T14:11:31.695601+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.797797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":377,"num_write":870,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'835","reported_seq":2442,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544277+0000","last_change":"2024-09-19T13:36:09.333458+0000","last_active":"2024-09-19T14:12:15.544277+0000","last_peered":"2024-09-19T14:12:15.544277+0000","last_clean":"2024-09-19T14:12:15.544277+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:12:15.544277+0000","last_undegraded":"2024-09-19T14:12:15.544277+0000","last_fullsized":"2024-09-19T14:12:15.544277+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.936303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'185","reported_seq":783,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:33.178972+0000","last_change":"2024-09-19T13:36:07.816581+0000","last_active":"2024-09-19T14:11:33.178972+0000","last_peered":"2024-09-19T14:11:33.178972+0000","last_clean":"2024-09-19T14:11:33.178972+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:11:33.178972+0000","last_undegraded":"2024-09-19T14:11:33.178972+0000","last_fullsized":"2024-09-19T14:11:33.178972+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:11.595208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7227774,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":7782,"num_write":889,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'502","reported_seq":2283,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226009+0000","last_change":"2024-09-19T13:36:09.343477+0000","last_active":"2024-09-19T14:12:13.226009+0000","last_peered":"2024-09-19T14:12:13.226009+0000","last_clean":"2024-09-19T14:12:13.226009+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:12:13.226009+0000","last_undegraded":"2024-09-19T14:12:13.226009+0000","last_fullsized":"2024-09-19T14:12:13.226009+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'191","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:29.597137+0000","last_change":"2024-09-19T13:36:07.807757+0000","last_active":"2024-09-19T14:11:29.597137+0000","last_peered":"2024-09-19T14:11:29.597137+0000","last_clean":"2024-09-19T14:11:29.597137+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:11:29.597137+0000","last_undegraded":"2024-09-19T14:11:29.597137+0000","last_fullsized":"2024-09-19T14:11:29.597137+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:20.739883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534370,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1086,"num_read_kb":38780,"num_write":952,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'842","reported_seq":2345,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819911+0000","last_change":"2024-09-19T13:36:09.343462+0000","last_active":"2024-09-19T14:12:14.819911+0000","last_peered":"2024-09-19T14:12:14.819911+0000","last_clean":"2024-09-19T14:12:14.819911+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:12:14.819911+0000","last_undegraded":"2024-09-19T14:12:14.819911+0000","last_fullsized":"2024-09-19T14:12:14.819911+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:58.095506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'549","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171201+0000","last_change":"2024-09-19T13:36:09.331543+0000","last_active":"2024-09-19T14:12:15.171201+0000","last_peered":"2024-09-19T14:12:15.171201+0000","last_clean":"2024-09-19T14:12:15.171201+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:12:15.171201+0000","last_undegraded":"2024-09-19T14:12:15.171201+0000","last_fullsized":"2024-09-19T14:12:15.171201+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.041550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'185","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:30.861841+0000","last_change":"2024-09-19T13:36:07.812427+0000","last_active":"2024-09-19T14:11:30.861841+0000","last_peered":"2024-09-19T14:11:30.861841+0000","last_clean":"2024-09-19T14:11:30.861841+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:11:30.861841+0000","last_undegraded":"2024-09-19T14:11:30.861841+0000","last_fullsized":"2024-09-19T14:11:30.861841+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:24.508499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12224342,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":11511,"num_write":890,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'380","reported_seq":1872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355286+0000","last_change":"2024-09-19T13:36:09.341235+0000","last_active":"2024-09-19T14:12:27.355286+0000","last_peered":"2024-09-19T14:12:27.355286+0000","last_clean":"2024-09-19T14:12:27.355286+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:12:27.355286+0000","last_undegraded":"2024-09-19T14:12:27.355286+0000","last_fullsized":"2024-09-19T14:12:27.355286+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:22.590894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'187","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.001105+0000","last_change":"2024-09-19T13:36:07.811910+0000","last_active":"2024-09-19T14:11:59.001105+0000","last_peered":"2024-09-19T14:11:59.001105+0000","last_clean":"2024-09-19T14:11:59.001105+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:11:59.001105+0000","last_undegraded":"2024-09-19T14:11:59.001105+0000","last_fullsized":"2024-09-19T14:11:59.001105+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:59.243018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277338,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":26719,"num_write":909,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'556","reported_seq":2179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882271+0000","last_change":"2024-09-19T13:36:09.336283+0000","last_active":"2024-09-19T14:12:15.882271+0000","last_peered":"2024-09-19T14:12:15.882271+0000","last_clean":"2024-09-19T14:12:15.882271+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:12:15.882271+0000","last_undegraded":"2024-09-19T14:12:15.882271+0000","last_fullsized":"2024-09-19T14:12:15.882271+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:45.974339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'215","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:09.696524+0000","last_change":"2024-09-19T13:36:44.401303+0000","last_active":"2024-09-19T14:12:09.696524+0000","last_peered":"2024-09-19T14:12:09.696524+0000","last_clean":"2024-09-19T14:12:09.696524+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:12:09.696524+0000","last_undegraded":"2024-09-19T14:12:09.696524+0000","last_fullsized":"2024-09-19T14:12:09.696524+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:04.996764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14025071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":619,"num_read_kb":31849,"num_write":1135,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'377","reported_seq":1908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260138+0000","last_change":"2024-09-19T13:36:09.337079+0000","last_active":"2024-09-19T14:12:20.260138+0000","last_peered":"2024-09-19T14:12:20.260138+0000","last_clean":"2024-09-19T14:12:20.260138+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:12:20.260138+0000","last_undegraded":"2024-09-19T14:12:20.260138+0000","last_fullsized":"2024-09-19T14:12:20.260138+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:50.941135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'202","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.779251+0000","last_change":"2024-09-19T13:36:07.806856+0000","last_active":"2024-09-19T14:12:12.779251+0000","last_peered":"2024-09-19T14:12:12.779251+0000","last_clean":"2024-09-19T14:12:12.779251+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:12:12.779251+0000","last_undegraded":"2024-09-19T14:12:12.779251+0000","last_fullsized":"2024-09-19T14:12:12.779251+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:01.787704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5491166,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":559,"num_read_kb":49502,"num_write":985,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'390","reported_seq":1995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176428+0000","last_change":"2024-09-19T13:36:09.324663+0000","last_active":"2024-09-19T14:12:26.176428+0000","last_peered":"2024-09-19T14:12:26.176428+0000","last_clean":"2024-09-19T14:12:26.176428+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:12:26.176428+0000","last_undegraded":"2024-09-19T14:12:26.176428+0000","last_fullsized":"2024-09-19T14:12:26.176428+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:16.398494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'190","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.103953+0000","last_change":"2024-09-19T13:36:07.807094+0000","last_active":"2024-09-19T14:13:45.103953+0000","last_peered":"2024-09-19T14:13:45.103953+0000","last_clean":"2024-09-19T14:13:45.103953+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:13:45.103953+0000","last_undegraded":"2024-09-19T14:13:45.103953+0000","last_fullsized":"2024-09-19T14:13:45.103953+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:17.714362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11536576,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":176003,"num_write":885,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'907","reported_seq":2603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176234+0000","last_change":"2024-09-19T13:36:09.331135+0000","last_active":"2024-09-19T14:12:26.176234+0000","last_peered":"2024-09-19T14:12:26.176234+0000","last_clean":"2024-09-19T14:12:26.176234+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:12:26.176234+0000","last_undegraded":"2024-09-19T14:12:26.176234+0000","last_fullsized":"2024-09-19T14:12:26.176234+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:01.836377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'239","reported_seq":900,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727853+0000","last_change":"2024-09-19T13:36:07.813101+0000","last_active":"2024-09-19T14:12:25.727853+0000","last_peered":"2024-09-19T14:12:25.727853+0000","last_clean":"2024-09-19T14:12:25.727853+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:12:25.727853+0000","last_undegraded":"2024-09-19T14:12:25.727853+0000","last_fullsized":"2024-09-19T14:12:25.727853+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:17.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33577113,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":112164,"num_write":1130,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'136","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.817689+0000","last_change":"2024-09-19T13:36:17.363690+0000","last_active":"2024-09-19T14:12:27.817689+0000","last_peered":"2024-09-19T14:12:27.817689+0000","last_clean":"2024-09-19T14:12:27.817689+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:12:27.817689+0000","last_undegraded":"2024-09-19T14:12:27.817689+0000","last_fullsized":"2024-09-19T14:12:27.817689+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:29.851738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'815","reported_seq":2311,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260090+0000","last_change":"2024-09-19T13:36:09.344275+0000","last_active":"2024-09-19T14:12:20.260090+0000","last_peered":"2024-09-19T14:12:20.260090+0000","last_clean":"2024-09-19T14:12:20.260090+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:12:20.260090+0000","last_undegraded":"2024-09-19T14:12:20.260090+0000","last_fullsized":"2024-09-19T14:12:20.260090+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:38.192022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'172","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.769129+0000","last_change":"2024-09-19T13:36:07.808149+0000","last_active":"2024-09-19T14:12:25.769129+0000","last_peered":"2024-09-19T14:12:25.769129+0000","last_clean":"2024-09-19T14:12:25.769129+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:12:25.769129+0000","last_undegraded":"2024-09-19T14:12:25.769129+0000","last_fullsized":"2024-09-19T14:12:25.769129+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:33.668595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12628349,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":648,"num_read_kb":47147,"num_write":842,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599370+0000","last_change":"2024-09-19T13:36:11.340404+0000","last_active":"2024-09-19T14:10:01.599370+0000","last_peered":"2024-09-19T14:10:01.599370+0000","last_clean":"2024-09-19T14:10:01.599370+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:10:01.599370+0000","last_undegraded":"2024-09-19T14:10:01.599370+0000","last_fullsized":"2024-09-19T14:10:01.599370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.755867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'190","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.621211+0000","last_change":"2024-09-19T13:36:13.346842+0000","last_active":"2024-09-19T14:12:31.621211+0000","last_peered":"2024-09-19T14:12:31.621211+0000","last_clean":"2024-09-19T14:12:31.621211+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:12:31.621211+0000","last_undegraded":"2024-09-19T14:12:31.621211+0000","last_fullsized":"2024-09-19T14:12:31.621211+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:09.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":253,"num_read_kb":352,"num_write":152,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733994+0000","last_change":"2024-09-19T13:36:15.353039+0000","last_active":"2024-09-19T14:10:06.733994+0000","last_peered":"2024-09-19T14:10:06.733994+0000","last_clean":"2024-09-19T14:10:06.733994+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:10:06.733994+0000","last_undegraded":"2024-09-19T14:10:06.733994+0000","last_fullsized":"2024-09-19T14:10:06.733994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:40.506433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2504","reported_seq":4316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.251946+0000","last_change":"2024-09-19T13:36:17.362187+0000","last_active":"2024-09-19T14:12:26.251946+0000","last_peered":"2024-09-19T14:12:26.251946+0000","last_clean":"2024-09-19T14:12:26.251946+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:12:26.251946+0000","last_undegraded":"2024-09-19T14:12:26.251946+0000","last_fullsized":"2024-09-19T14:12:26.251946+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:08.218008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'475","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819729+0000","last_change":"2024-09-19T13:36:09.335816+0000","last_active":"2024-09-19T14:12:14.819729+0000","last_peered":"2024-09-19T14:12:14.819729+0000","last_clean":"2024-09-19T14:12:14.819729+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:12:14.819729+0000","last_undegraded":"2024-09-19T14:12:14.819729+0000","last_fullsized":"2024-09-19T14:12:14.819729+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:08.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'168","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.882445+0000","last_change":"2024-09-19T13:36:07.812428+0000","last_active":"2024-09-19T14:11:58.882445+0000","last_peered":"2024-09-19T14:11:58.882445+0000","last_clean":"2024-09-19T14:11:58.882445+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:11:58.882445+0000","last_undegraded":"2024-09-19T14:11:58.882445+0000","last_fullsized":"2024-09-19T14:11:58.882445+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:55.799082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":369,"num_read_kb":36151,"num_write":773,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730615+0000","last_change":"2024-09-19T13:36:11.336313+0000","last_active":"2024-09-19T14:11:16.730615+0000","last_peered":"2024-09-19T14:11:16.730615+0000","last_clean":"2024-09-19T14:11:16.730615+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:11:16.730615+0000","last_undegraded":"2024-09-19T14:11:16.730615+0000","last_fullsized":"2024-09-19T14:11:16.730615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'78","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.395391+0000","last_change":"2024-09-19T13:36:13.337644+0000","last_active":"2024-09-19T14:12:14.395391+0000","last_peered":"2024-09-19T14:12:14.395391+0000","last_clean":"2024-09-19T14:12:14.395391+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:12:14.395391+0000","last_undegraded":"2024-09-19T14:12:14.395391+0000","last_fullsized":"2024-09-19T14:12:14.395391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.720756+0000","last_change":"2024-09-19T13:36:15.349335+0000","last_active":"2024-09-19T14:10:06.720756+0000","last_peered":"2024-09-19T14:10:06.720756+0000","last_clean":"2024-09-19T14:10:06.720756+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:10:06.720756+0000","last_undegraded":"2024-09-19T14:10:06.720756+0000","last_fullsized":"2024-09-19T14:10:06.720756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:03.785626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'134","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.878009+0000","last_change":"2024-09-19T13:36:17.360523+0000","last_active":"2024-09-19T14:12:15.878009+0000","last_peered":"2024-09-19T14:12:15.878009+0000","last_clean":"2024-09-19T14:12:15.878009+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:12:15.878009+0000","last_undegraded":"2024-09-19T14:12:15.878009+0000","last_fullsized":"2024-09-19T14:12:15.878009+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:18.406844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'833","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.865020+0000","last_change":"2024-09-19T13:36:09.338236+0000","last_active":"2024-09-19T14:13:45.865020+0000","last_peered":"2024-09-19T14:13:45.865020+0000","last_clean":"2024-09-19T14:13:45.865020+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:13:45.865020+0000","last_undegraded":"2024-09-19T14:13:45.865020+0000","last_fullsized":"2024-09-19T14:13:45.865020+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:40.242627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'163","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.361325+0000","last_change":"2024-09-19T13:36:07.806261+0000","last_active":"2024-09-19T14:11:34.361325+0000","last_peered":"2024-09-19T14:11:34.361325+0000","last_clean":"2024-09-19T14:11:34.361325+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:11:34.361325+0000","last_undegraded":"2024-09-19T14:11:34.361325+0000","last_fullsized":"2024-09-19T14:11:34.361325+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:30.372295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11079321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":63998,"num_write":815,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719618+0000","last_change":"2024-09-19T13:36:11.337174+0000","last_active":"2024-09-19T14:10:01.719618+0000","last_peered":"2024-09-19T14:10:01.719618+0000","last_clean":"2024-09-19T14:10:01.719618+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:10:01.719618+0000","last_undegraded":"2024-09-19T14:10:01.719618+0000","last_fullsized":"2024-09-19T14:10:01.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:56.806199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'103","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.682418+0000","last_change":"2024-09-19T13:36:13.342093+0000","last_active":"2024-09-19T14:12:06.682418+0000","last_peered":"2024-09-19T14:12:06.682418+0000","last_clean":"2024-09-19T14:12:06.682418+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:12:06.682418+0000","last_undegraded":"2024-09-19T14:12:06.682418+0000","last_fullsized":"2024-09-19T14:12:06.682418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.319447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'760","reported_seq":2062,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.050138+0000","last_change":"2024-09-19T13:36:15.353722+0000","last_active":"2024-09-19T14:13:47.050138+0000","last_peered":"2024-09-19T14:13:47.050138+0000","last_clean":"2024-09-19T14:13:47.050138+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:13:47.050138+0000","last_undegraded":"2024-09-19T14:13:47.050138+0000","last_fullsized":"2024-09-19T14:13:47.050138+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:26.683896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'275","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.861063+0000","last_change":"2024-09-19T13:36:17.362162+0000","last_active":"2024-09-19T14:12:27.861063+0000","last_peered":"2024-09-19T14:12:27.861063+0000","last_clean":"2024-09-19T14:12:27.861063+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:12:27.861063+0000","last_undegraded":"2024-09-19T14:12:27.861063+0000","last_fullsized":"2024-09-19T14:12:27.861063+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:30.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'431","reported_seq":1979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607238+0000","last_change":"2024-09-19T13:36:09.336191+0000","last_active":"2024-09-19T14:12:13.607238+0000","last_peered":"2024-09-19T14:12:13.607238+0000","last_clean":"2024-09-19T14:12:13.607238+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:12:13.607238+0000","last_undegraded":"2024-09-19T14:12:13.607238+0000","last_fullsized":"2024-09-19T14:12:13.607238+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:03.461778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'175","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.158614+0000","last_change":"2024-09-19T13:36:07.816563+0000","last_active":"2024-09-19T14:12:11.158614+0000","last_peered":"2024-09-19T14:12:11.158614+0000","last_clean":"2024-09-19T14:12:11.158614+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:12:11.158614+0000","last_undegraded":"2024-09-19T14:12:11.158614+0000","last_fullsized":"2024-09-19T14:12:11.158614+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:45.659866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21324016,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":442,"num_read_kb":22529,"num_write":867,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599419+0000","last_change":"2024-09-19T13:36:11.335988+0000","last_active":"2024-09-19T14:10:01.599419+0000","last_peered":"2024-09-19T14:10:01.599419+0000","last_clean":"2024-09-19T14:10:01.599419+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:10:01.599419+0000","last_undegraded":"2024-09-19T14:10:01.599419+0000","last_fullsized":"2024-09-19T14:10:01.599419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:16.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'111","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.755401+0000","last_change":"2024-09-19T13:36:13.678694+0000","last_active":"2024-09-19T14:12:31.755401+0000","last_peered":"2024-09-19T14:12:31.755401+0000","last_clean":"2024-09-19T14:12:31.755401+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:12:31.755401+0000","last_undegraded":"2024-09-19T14:12:31.755401+0000","last_fullsized":"2024-09-19T14:12:31.755401+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":236,"num_write":88,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'791","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.054231+0000","last_change":"2024-09-19T13:36:15.347048+0000","last_active":"2024-09-19T14:13:47.054231+0000","last_peered":"2024-09-19T14:13:47.054231+0000","last_clean":"2024-09-19T14:13:47.054231+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:13:47.054231+0000","last_undegraded":"2024-09-19T14:13:47.054231+0000","last_fullsized":"2024-09-19T14:13:47.054231+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:55.442266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'450","reported_seq":2022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226765+0000","last_change":"2024-09-19T13:36:09.334631+0000","last_active":"2024-09-19T14:12:13.226765+0000","last_peered":"2024-09-19T14:12:13.226765+0000","last_clean":"2024-09-19T14:12:13.226765+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:12:13.226765+0000","last_undegraded":"2024-09-19T14:12:13.226765+0000","last_fullsized":"2024-09-19T14:12:13.226765+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:01.778994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'232","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.304893+0000","last_change":"2024-09-19T13:36:07.809526+0000","last_active":"2024-09-19T14:12:01.304893+0000","last_peered":"2024-09-19T14:12:01.304893+0000","last_clean":"2024-09-19T14:12:01.304893+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:12:01.304893+0000","last_undegraded":"2024-09-19T14:12:01.304893+0000","last_fullsized":"2024-09-19T14:12:01.304893+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:56.101821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059510,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":46832,"num_write":1026,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740936+0000","last_change":"2024-09-19T13:36:11.332976+0000","last_active":"2024-09-19T14:10:51.740936+0000","last_peered":"2024-09-19T14:10:51.740936+0000","last_clean":"2024-09-19T14:10:51.740936+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:10:51.740936+0000","last_undegraded":"2024-09-19T14:10:51.740936+0000","last_fullsized":"2024-09-19T14:10:51.740936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:44.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'185","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:11.624593+0000","last_change":"2024-09-19T13:36:13.679868+0000","last_active":"2024-09-19T14:13:11.624593+0000","last_peered":"2024-09-19T14:13:11.624593+0000","last_clean":"2024-09-19T14:13:11.624593+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:13:11.624593+0000","last_undegraded":"2024-09-19T14:13:11.624593+0000","last_fullsized":"2024-09-19T14:13:11.624593+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:05.662964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":296,"num_write":138,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.635466+0000","last_change":"2024-09-19T13:36:15.351051+0000","last_active":"2024-09-19T14:10:01.635466+0000","last_peered":"2024-09-19T14:10:01.635466+0000","last_clean":"2024-09-19T14:10:01.635466+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:10:01.635466+0000","last_undegraded":"2024-09-19T14:10:01.635466+0000","last_fullsized":"2024-09-19T14:10:01.635466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:18.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'538","reported_seq":1352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.036523+0000","last_change":"2024-09-19T13:36:17.360774+0000","last_active":"2024-09-19T14:13:47.036523+0000","last_peered":"2024-09-19T14:13:47.036523+0000","last_clean":"2024-09-19T14:13:47.036523+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:13:47.036523+0000","last_undegraded":"2024-09-19T14:13:47.036523+0000","last_fullsized":"2024-09-19T14:13:47.036523+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355481+0000","last_change":"2024-09-19T13:36:09.332369+0000","last_active":"2024-09-19T14:12:27.355481+0000","last_peered":"2024-09-19T14:12:27.355481+0000","last_clean":"2024-09-19T14:12:27.355481+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:12:27.355481+0000","last_undegraded":"2024-09-19T14:12:27.355481+0000","last_fullsized":"2024-09-19T14:12:27.355481+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:59.620240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'197","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:29.355415+0000","last_change":"2024-09-19T13:36:07.806031+0000","last_active":"2024-09-19T14:11:29.355415+0000","last_peered":"2024-09-19T14:11:29.355415+0000","last_clean":"2024-09-19T14:11:29.355415+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:11:29.355415+0000","last_undegraded":"2024-09-19T14:11:29.355415+0000","last_fullsized":"2024-09-19T14:11:29.355415+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:23.397652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5298782,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":505,"num_read_kb":31454,"num_write":891,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"34'3","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.756819+0000","last_change":"2024-09-19T13:36:11.333511+0000","last_active":"2024-09-19T14:13:46.756819+0000","last_peered":"2024-09-19T14:13:46.756819+0000","last_clean":"2024-09-19T14:13:46.756819+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:13:46.756819+0000","last_undegraded":"2024-09-19T14:13:46.756819+0000","last_fullsized":"2024-09-19T14:13:46.756819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:38.186843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'122","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738418+0000","last_change":"2024-09-19T13:36:13.346402+0000","last_active":"2024-09-19T14:12:16.738418+0000","last_peered":"2024-09-19T14:12:16.738418+0000","last_clean":"2024-09-19T14:12:16.738418+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:12:16.738418+0000","last_undegraded":"2024-09-19T14:12:16.738418+0000","last_fullsized":"2024-09-19T14:12:16.738418+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:23.310060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":221,"num_write":80,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:01.728430+0000","last_change":"2024-09-19T13:36:15.346352+0000","last_active":"2024-09-19T14:11:01.728430+0000","last_peered":"2024-09-19T14:11:01.728430+0000","last_clean":"2024-09-19T14:11:01.728430+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:11:01.728430+0000","last_undegraded":"2024-09-19T14:11:01.728430+0000","last_fullsized":"2024-09-19T14:11:01.728430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:31.554437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'173","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.844081+0000","last_change":"2024-09-19T13:36:17.360996+0000","last_active":"2024-09-19T14:13:36.844081+0000","last_peered":"2024-09-19T14:13:36.844081+0000","last_clean":"2024-09-19T14:13:36.844081+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:13:36.844081+0000","last_undegraded":"2024-09-19T14:13:36.844081+0000","last_fullsized":"2024-09-19T14:13:36.844081+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:40.718784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'343","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.175897+0000","last_change":"2024-09-19T13:36:44.478051+0000","last_active":"2024-09-19T14:12:26.175897+0000","last_peered":"2024-09-19T14:12:26.175897+0000","last_clean":"2024-09-19T14:12:26.175897+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:12:26.175897+0000","last_undegraded":"2024-09-19T14:12:26.175897+0000","last_fullsized":"2024-09-19T14:12:26.175897+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:28:06.614029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'234","reported_seq":1057,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.697721+0000","last_change":"2024-09-19T13:36:07.812190+0000","last_active":"2024-09-19T14:12:03.697721+0000","last_peered":"2024-09-19T14:12:03.697721+0000","last_clean":"2024-09-19T14:12:03.697721+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:12:03.697721+0000","last_undegraded":"2024-09-19T14:12:03.697721+0000","last_fullsized":"2024-09-19T14:12:03.697721+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:32.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17101928,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1167,"num_read_kb":168929,"num_write":1048,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805690+0000","last_change":"2024-09-19T13:36:11.333725+0000","last_active":"2024-09-19T14:09:56.805690+0000","last_peered":"2024-09-19T14:09:56.805690+0000","last_clean":"2024-09-19T14:09:56.805690+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:09:56.805690+0000","last_undegraded":"2024-09-19T14:09:56.805690+0000","last_fullsized":"2024-09-19T14:09:56.805690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:01.253625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'157","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.866319+0000","last_change":"2024-09-19T13:36:13.348257+0000","last_active":"2024-09-19T14:13:45.866319+0000","last_peered":"2024-09-19T14:13:45.866319+0000","last_clean":"2024-09-19T14:13:45.866319+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:13:45.866319+0000","last_undegraded":"2024-09-19T14:13:45.866319+0000","last_fullsized":"2024-09-19T14:13:45.866319+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:53.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":224,"num_write":106,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'801","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.055129+0000","last_change":"2024-09-19T13:36:15.347632+0000","last_active":"2024-09-19T14:13:47.055129+0000","last_peered":"2024-09-19T14:13:47.055129+0000","last_clean":"2024-09-19T14:13:47.055129+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:13:47.055129+0000","last_undegraded":"2024-09-19T14:13:47.055129+0000","last_fullsized":"2024-09-19T14:13:47.055129+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:07.500173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.860638+0000","last_change":"2024-09-19T13:36:17.360696+0000","last_active":"2024-09-19T14:13:45.860638+0000","last_peered":"2024-09-19T14:13:45.860638+0000","last_clean":"2024-09-19T14:13:45.860638+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:13:45.860638+0000","last_undegraded":"2024-09-19T14:13:45.860638+0000","last_fullsized":"2024-09-19T14:13:45.860638+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:33.562231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'423","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.167396+0000","last_change":"2024-09-19T13:36:09.341941+0000","last_active":"2024-09-19T14:12:26.167396+0000","last_peered":"2024-09-19T14:12:26.167396+0000","last_clean":"2024-09-19T14:12:26.167396+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:12:26.167396+0000","last_undegraded":"2024-09-19T14:12:26.167396+0000","last_fullsized":"2024-09-19T14:12:26.167396+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:51.059363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'202","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.616585+0000","last_change":"2024-09-19T13:36:07.809548+0000","last_active":"2024-09-19T14:12:11.616585+0000","last_peered":"2024-09-19T14:12:11.616585+0000","last_clean":"2024-09-19T14:12:11.616585+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:12:11.616585+0000","last_undegraded":"2024-09-19T14:12:11.616585+0000","last_fullsized":"2024-09-19T14:12:11.616585+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:50.752222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9447432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":50665,"num_write":1022,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813329+0000","last_change":"2024-09-19T13:36:11.328331+0000","last_active":"2024-09-19T14:10:51.813329+0000","last_peered":"2024-09-19T14:10:51.813329+0000","last_clean":"2024-09-19T14:10:51.813329+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:10:51.813329+0000","last_undegraded":"2024-09-19T14:10:51.813329+0000","last_fullsized":"2024-09-19T14:10:51.813329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:34.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'182","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.001238+0000","last_change":"2024-09-19T13:36:13.346349+0000","last_active":"2024-09-19T14:13:47.001238+0000","last_peered":"2024-09-19T14:13:47.001238+0000","last_clean":"2024-09-19T14:13:47.001238+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:13:47.001238+0000","last_undegraded":"2024-09-19T14:13:47.001238+0000","last_fullsized":"2024-09-19T14:13:47.001238+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:53.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":249,"num_read_kb":370,"num_write":122,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.814113+0000","last_change":"2024-09-19T13:36:15.353964+0000","last_active":"2024-09-19T14:10:56.814113+0000","last_peered":"2024-09-19T14:10:56.814113+0000","last_clean":"2024-09-19T14:10:56.814113+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:10:56.814113+0000","last_undegraded":"2024-09-19T14:10:56.814113+0000","last_fullsized":"2024-09-19T14:10:56.814113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:04.430132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'170","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.168956+0000","last_change":"2024-09-19T13:36:17.362550+0000","last_active":"2024-09-19T14:12:15.168956+0000","last_peered":"2024-09-19T14:12:15.168956+0000","last_clean":"2024-09-19T14:12:15.168956+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:12:15.168956+0000","last_undegraded":"2024-09-19T14:12:15.168956+0000","last_fullsized":"2024-09-19T14:12:15.168956+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:34.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1295","reported_seq":3068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.858675+0000","last_change":"2024-09-19T13:36:09.334870+0000","last_active":"2024-09-19T14:13:45.858675+0000","last_peered":"2024-09-19T14:13:45.858675+0000","last_clean":"2024-09-19T14:13:45.858675+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:13:45.858675+0000","last_undegraded":"2024-09-19T14:13:45.858675+0000","last_fullsized":"2024-09-19T14:13:45.858675+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:57.257237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'184","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.685114+0000","last_change":"2024-09-19T13:36:07.799829+0000","last_active":"2024-09-19T14:11:34.685114+0000","last_peered":"2024-09-19T14:11:34.685114+0000","last_clean":"2024-09-19T14:11:34.685114+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:11:34.685114+0000","last_undegraded":"2024-09-19T14:11:34.685114+0000","last_fullsized":"2024-09-19T14:11:34.685114+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17713223,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":441,"num_read_kb":2025,"num_write":899,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805745+0000","last_change":"2024-09-19T13:36:11.338782+0000","last_active":"2024-09-19T14:09:56.805745+0000","last_peered":"2024-09-19T14:09:56.805745+0000","last_clean":"2024-09-19T14:09:56.805745+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:09:56.805745+0000","last_undegraded":"2024-09-19T14:09:56.805745+0000","last_fullsized":"2024-09-19T14:09:56.805745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:16.443904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'142","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.115082+0000","last_change":"2024-09-19T13:36:13.344371+0000","last_active":"2024-09-19T14:12:26.115082+0000","last_peered":"2024-09-19T14:12:26.115082+0000","last_clean":"2024-09-19T14:12:26.115082+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:12:26.115082+0000","last_undegraded":"2024-09-19T14:12:26.115082+0000","last_fullsized":"2024-09-19T14:12:26.115082+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:58.796476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11393,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":257,"num_write":156,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601278+0000","last_change":"2024-09-19T13:36:15.348413+0000","last_active":"2024-09-19T14:10:06.601278+0000","last_peered":"2024-09-19T14:10:06.601278+0000","last_clean":"2024-09-19T14:10:06.601278+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:10:06.601278+0000","last_undegraded":"2024-09-19T14:10:06.601278+0000","last_fullsized":"2024-09-19T14:10:06.601278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.820957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'118","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.738924+0000","last_change":"2024-09-19T13:36:17.364393+0000","last_active":"2024-09-19T14:12:21.738924+0000","last_peered":"2024-09-19T14:12:21.738924+0000","last_clean":"2024-09-19T14:12:21.738924+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:12:21.738924+0000","last_undegraded":"2024-09-19T14:12:21.738924+0000","last_fullsized":"2024-09-19T14:12:21.738924+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:02.719840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'468","reported_seq":2089,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.926778+0000","last_change":"2024-09-19T13:36:09.329775+0000","last_active":"2024-09-19T14:12:13.926778+0000","last_peered":"2024-09-19T14:12:13.926778+0000","last_clean":"2024-09-19T14:12:13.926778+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:12:13.926778+0000","last_undegraded":"2024-09-19T14:12:13.926778+0000","last_fullsized":"2024-09-19T14:12:13.926778+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:15.175433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'213","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.023429+0000","last_change":"2024-09-19T13:36:07.814623+0000","last_active":"2024-09-19T14:11:55.023429+0000","last_peered":"2024-09-19T14:11:55.023429+0000","last_clean":"2024-09-19T14:11:55.023429+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:11:55.023429+0000","last_undegraded":"2024-09-19T14:11:55.023429+0000","last_fullsized":"2024-09-19T14:11:55.023429+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:56.724159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9464391,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":62927,"num_write":1021,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.634762+0000","last_change":"2024-09-19T13:36:11.336246+0000","last_active":"2024-09-19T14:09:56.634762+0000","last_peered":"2024-09-19T14:09:56.634762+0000","last_clean":"2024-09-19T14:09:56.634762+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:09:56.634762+0000","last_undegraded":"2024-09-19T14:09:56.634762+0000","last_fullsized":"2024-09-19T14:09:56.634762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:18.982990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'142","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.823060+0000","last_change":"2024-09-19T13:36:13.343683+0000","last_active":"2024-09-19T14:12:16.823060+0000","last_peered":"2024-09-19T14:12:16.823060+0000","last_clean":"2024-09-19T14:12:16.823060+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:12:16.823060+0000","last_undegraded":"2024-09-19T14:12:16.823060+0000","last_fullsized":"2024-09-19T14:12:16.823060+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.516524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":173,"num_write":90,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'733","reported_seq":2197,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.051292+0000","last_change":"2024-09-19T13:36:15.350112+0000","last_active":"2024-09-19T14:13:47.051292+0000","last_peered":"2024-09-19T14:13:47.051292+0000","last_clean":"2024-09-19T14:13:47.051292+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:13:47.051292+0000","last_undegraded":"2024-09-19T14:13:47.051292+0000","last_fullsized":"2024-09-19T14:13:47.051292+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.284435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'119","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.540330+0000","last_change":"2024-09-19T13:36:17.355488+0000","last_active":"2024-09-19T14:12:15.540330+0000","last_peered":"2024-09-19T14:12:15.540330+0000","last_clean":"2024-09-19T14:12:15.540330+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:12:15.540330+0000","last_undegraded":"2024-09-19T14:12:15.540330+0000","last_fullsized":"2024-09-19T14:12:15.540330+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.296270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1573","reported_seq":3192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.346545+0000","last_change":"2024-09-19T13:36:09.332881+0000","last_active":"2024-09-19T14:12:27.346545+0000","last_peered":"2024-09-19T14:12:27.346545+0000","last_clean":"2024-09-19T14:12:27.346545+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:12:27.346545+0000","last_undegraded":"2024-09-19T14:12:27.346545+0000","last_fullsized":"2024-09-19T14:12:27.346545+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:05.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'194","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.823808+0000","last_change":"2024-09-19T13:36:07.800961+0000","last_active":"2024-09-19T14:11:58.823808+0000","last_peered":"2024-09-19T14:11:58.823808+0000","last_clean":"2024-09-19T14:11:58.823808+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:11:58.823808+0000","last_undegraded":"2024-09-19T14:11:58.823808+0000","last_fullsized":"2024-09-19T14:11:58.823808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5742454,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":26305,"num_write":897,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"34'6","reported_seq":1916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.767074+0000","last_change":"2024-09-19T13:36:11.338913+0000","last_active":"2024-09-19T14:13:46.767074+0000","last_peered":"2024-09-19T14:13:46.767074+0000","last_clean":"2024-09-19T14:13:46.767074+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:13:46.767074+0000","last_undegraded":"2024-09-19T14:13:46.767074+0000","last_fullsized":"2024-09-19T14:13:46.767074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:36.373641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1673,"num_read_kb":2140,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'75","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.605372+0000","last_change":"2024-09-19T13:36:13.678517+0000","last_active":"2024-09-19T14:11:59.605372+0000","last_peered":"2024-09-19T14:11:59.605372+0000","last_clean":"2024-09-19T14:11:59.605372+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:11:59.605372+0000","last_undegraded":"2024-09-19T14:11:59.605372+0000","last_fullsized":"2024-09-19T14:11:59.605372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:55.910454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'776","reported_seq":4734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.052375+0000","last_change":"2024-09-19T13:36:15.352291+0000","last_active":"2024-09-19T14:13:47.052375+0000","last_peered":"2024-09-19T14:13:47.052375+0000","last_clean":"2024-09-19T14:13:47.052375+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:13:47.052375+0000","last_undegraded":"2024-09-19T14:13:47.052375+0000","last_fullsized":"2024-09-19T14:13:47.052375+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:43.392004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'128","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.409862+0000","last_change":"2024-09-19T13:36:17.360266+0000","last_active":"2024-09-19T14:12:26.409862+0000","last_peered":"2024-09-19T14:12:26.409862+0000","last_clean":"2024-09-19T14:12:26.409862+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:12:26.409862+0000","last_undegraded":"2024-09-19T14:12:26.409862+0000","last_fullsized":"2024-09-19T14:12:26.409862+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:17.091973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'908","reported_seq":2529,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.393463+0000","last_change":"2024-09-19T13:36:09.345481+0000","last_active":"2024-09-19T14:12:14.393463+0000","last_peered":"2024-09-19T14:12:14.393463+0000","last_clean":"2024-09-19T14:12:14.393463+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:12:14.393463+0000","last_undegraded":"2024-09-19T14:12:14.393463+0000","last_fullsized":"2024-09-19T14:12:14.393463+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:16.331902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'179","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:32.410844+0000","last_change":"2024-09-19T13:36:07.803394+0000","last_active":"2024-09-19T14:11:32.410844+0000","last_peered":"2024-09-19T14:11:32.410844+0000","last_clean":"2024-09-19T14:11:32.410844+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:11:32.410844+0000","last_undegraded":"2024-09-19T14:11:32.410844+0000","last_fullsized":"2024-09-19T14:11:32.410844+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:45.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.719129+0000","last_change":"2024-09-19T13:36:11.334156+0000","last_active":"2024-09-19T14:09:56.719129+0000","last_peered":"2024-09-19T14:09:56.719129+0000","last_clean":"2024-09-19T14:09:56.719129+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:09:56.719129+0000","last_undegraded":"2024-09-19T14:09:56.719129+0000","last_fullsized":"2024-09-19T14:09:56.719129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:26.831809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'191","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:50.254879+0000","last_change":"2024-09-19T13:36:13.346678+0000","last_active":"2024-09-19T14:12:50.254879+0000","last_peered":"2024-09-19T14:12:50.254879+0000","last_clean":"2024-09-19T14:12:50.254879+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:12:50.254879+0000","last_undegraded":"2024-09-19T14:12:50.254879+0000","last_fullsized":"2024-09-19T14:12:50.254879+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:27.806745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":857,"num_read_kb":894,"num_write":1378,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.710550+0000","last_change":"2024-09-19T13:36:15.349430+0000","last_active":"2024-09-19T14:10:01.710550+0000","last_peered":"2024-09-19T14:10:01.710550+0000","last_clean":"2024-09-19T14:10:01.710550+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:10:01.710550+0000","last_undegraded":"2024-09-19T14:10:01.710550+0000","last_fullsized":"2024-09-19T14:10:01.710550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:55.349813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'116","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.223769+0000","last_change":"2024-09-19T13:36:17.354159+0000","last_active":"2024-09-19T14:12:13.223769+0000","last_peered":"2024-09-19T14:12:13.223769+0000","last_clean":"2024-09-19T14:12:13.223769+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:12:13.223769+0000","last_undegraded":"2024-09-19T14:12:13.223769+0000","last_fullsized":"2024-09-19T14:12:13.223769+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:21.937480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176339+0000","last_change":"2024-09-19T13:36:09.335373+0000","last_active":"2024-09-19T14:12:26.176339+0000","last_peered":"2024-09-19T14:12:26.176339+0000","last_clean":"2024-09-19T14:12:26.176339+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:12:26.176339+0000","last_undegraded":"2024-09-19T14:12:26.176339+0000","last_fullsized":"2024-09-19T14:12:26.176339+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:13.238868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.751980+0000","last_change":"2024-09-19T13:35:53.209257+0000","last_active":"2024-09-19T14:12:06.751980+0000","last_peered":"2024-09-19T14:12:06.751980+0000","last_clean":"2024-09-19T14:12:06.751980+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:12:06.751980+0000","last_undegraded":"2024-09-19T14:12:06.751980+0000","last_fullsized":"2024-09-19T14:12:06.751980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_clean_scrub_stamp":"2024-09-19T13:35:51.725320+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:26.239545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610925+0000","last_change":"2024-09-19T13:36:00.766592+0000","last_active":"2024-09-19T14:11:26.610925+0000","last_peered":"2024-09-19T14:11:26.610925+0000","last_clean":"2024-09-19T14:11:26.610925+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:11:26.610925+0000","last_undegraded":"2024-09-19T14:11:26.610925+0000","last_fullsized":"2024-09-19T14:11:26.610925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:27.934615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'221","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.567842+0000","last_change":"2024-09-19T13:36:07.812870+0000","last_active":"2024-09-19T14:12:07.567842+0000","last_peered":"2024-09-19T14:12:07.567842+0000","last_clean":"2024-09-19T14:12:07.567842+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:12:07.567842+0000","last_undegraded":"2024-09-19T14:12:07.567842+0000","last_fullsized":"2024-09-19T14:12:07.567842+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745515,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":4141,"num_write":1066,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747345+0000","last_change":"2024-09-19T13:36:11.335928+0000","last_active":"2024-09-19T14:11:36.747345+0000","last_peered":"2024-09-19T14:11:36.747345+0000","last_clean":"2024-09-19T14:11:36.747345+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:11:36.747345+0000","last_undegraded":"2024-09-19T14:11:36.747345+0000","last_fullsized":"2024-09-19T14:11:36.747345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:19.656066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'323","reported_seq":997,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.020740+0000","last_change":"2024-09-19T13:36:13.348035+0000","last_active":"2024-09-19T14:13:47.020740+0000","last_peered":"2024-09-19T14:13:47.020740+0000","last_clean":"2024-09-19T14:13:47.020740+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:13:47.020740+0000","last_undegraded":"2024-09-19T14:13:47.020740+0000","last_fullsized":"2024-09-19T14:13:47.020740+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:31.984054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":882,"num_write":520,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.608712+0000","last_change":"2024-09-19T13:36:15.353267+0000","last_active":"2024-09-19T14:10:56.608712+0000","last_peered":"2024-09-19T14:10:56.608712+0000","last_clean":"2024-09-19T14:10:56.608712+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:10:56.608712+0000","last_undegraded":"2024-09-19T14:10:56.608712+0000","last_fullsized":"2024-09-19T14:10:56.608712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:16.239382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'189","reported_seq":879,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.764923+0000","last_change":"2024-09-19T13:36:17.356980+0000","last_active":"2024-09-19T14:12:27.764923+0000","last_peered":"2024-09-19T14:12:27.764923+0000","last_clean":"2024-09-19T14:12:27.764923+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:12:27.764923+0000","last_undegraded":"2024-09-19T14:12:27.764923+0000","last_fullsized":"2024-09-19T14:12:27.764923+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:00.567870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'974","reported_seq":2577,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855901+0000","last_change":"2024-09-19T13:36:09.343922+0000","last_active":"2024-09-19T14:13:45.855901+0000","last_peered":"2024-09-19T14:13:45.855901+0000","last_clean":"2024-09-19T14:13:45.855901+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:13:45.855901+0000","last_undegraded":"2024-09-19T14:13:45.855901+0000","last_fullsized":"2024-09-19T14:13:45.855901+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:14.020473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752563+0000","last_change":"2024-09-19T13:36:00.854468+0000","last_active":"2024-09-19T14:12:11.752563+0000","last_peered":"2024-09-19T14:12:11.752563+0000","last_clean":"2024-09-19T14:12:11.752563+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:12:11.752563+0000","last_undegraded":"2024-09-19T14:12:11.752563+0000","last_fullsized":"2024-09-19T14:12:11.752563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:35.110401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'205","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.871425+0000","last_change":"2024-09-19T13:36:07.802200+0000","last_active":"2024-09-19T14:12:13.871425+0000","last_peered":"2024-09-19T14:12:13.871425+0000","last_clean":"2024-09-19T14:12:13.871425+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:12:13.871425+0000","last_undegraded":"2024-09-19T14:12:13.871425+0000","last_fullsized":"2024-09-19T14:12:13.871425+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.035934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7278941,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":568,"num_read_kb":42960,"num_write":977,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.606429+0000","last_change":"2024-09-19T13:36:11.337197+0000","last_active":"2024-09-19T14:10:51.606429+0000","last_peered":"2024-09-19T14:10:51.606429+0000","last_clean":"2024-09-19T14:10:51.606429+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:10:51.606429+0000","last_undegraded":"2024-09-19T14:10:51.606429+0000","last_fullsized":"2024-09-19T14:10:51.606429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:00.715855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'809","reported_seq":2176,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.046671+0000","last_change":"2024-09-19T13:36:13.344429+0000","last_active":"2024-09-19T14:13:47.046671+0000","last_peered":"2024-09-19T14:13:47.046671+0000","last_clean":"2024-09-19T14:13:47.046671+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:13:47.046671+0000","last_undegraded":"2024-09-19T14:13:47.046671+0000","last_fullsized":"2024-09-19T14:13:47.046671+0000","mapping_epoch":28,"log_start":"260'700","ondisk_log_start":"260'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:47.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32444,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1113,"num_read_kb":1259,"num_write":234,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749934+0000","last_change":"2024-09-19T13:36:15.355170+0000","last_active":"2024-09-19T14:11:51.749934+0000","last_peered":"2024-09-19T14:11:51.749934+0000","last_clean":"2024-09-19T14:11:51.749934+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:11:51.749934+0000","last_undegraded":"2024-09-19T14:11:51.749934+0000","last_fullsized":"2024-09-19T14:11:51.749934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:24.165465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'128","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.807878+0000","last_change":"2024-09-19T13:36:17.353025+0000","last_active":"2024-09-19T14:13:45.807878+0000","last_peered":"2024-09-19T14:13:45.807878+0000","last_clean":"2024-09-19T14:13:45.807878+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:13:45.807878+0000","last_undegraded":"2024-09-19T14:13:45.807878+0000","last_fullsized":"2024-09-19T14:13:45.807878+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:31.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'770","reported_seq":2365,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226542+0000","last_change":"2024-09-19T13:36:09.335144+0000","last_active":"2024-09-19T14:12:13.226542+0000","last_peered":"2024-09-19T14:12:13.226542+0000","last_clean":"2024-09-19T14:12:13.226542+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:12:13.226542+0000","last_undegraded":"2024-09-19T14:12:13.226542+0000","last_fullsized":"2024-09-19T14:12:13.226542+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:14.738804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.817492+0000","last_change":"2024-09-19T13:36:00.763165+0000","last_active":"2024-09-19T14:11:26.817492+0000","last_peered":"2024-09-19T14:11:26.817492+0000","last_clean":"2024-09-19T14:11:26.817492+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:11:26.817492+0000","last_undegraded":"2024-09-19T14:11:26.817492+0000","last_fullsized":"2024-09-19T14:11:26.817492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:42.369963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'173","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.653405+0000","last_change":"2024-09-19T13:36:07.803619+0000","last_active":"2024-09-19T14:12:16.653405+0000","last_peered":"2024-09-19T14:12:16.653405+0000","last_clean":"2024-09-19T14:12:16.653405+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:12:16.653405+0000","last_undegraded":"2024-09-19T14:12:16.653405+0000","last_fullsized":"2024-09-19T14:12:16.653405+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:55.600380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10583521,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":421,"num_read_kb":6136,"num_write":872,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813393+0000","last_change":"2024-09-19T13:36:11.334995+0000","last_active":"2024-09-19T14:10:51.813393+0000","last_peered":"2024-09-19T14:10:51.813393+0000","last_clean":"2024-09-19T14:10:51.813393+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:10:51.813393+0000","last_undegraded":"2024-09-19T14:10:51.813393+0000","last_fullsized":"2024-09-19T14:10:51.813393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:49.486350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'201","reported_seq":1189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.151581+0000","last_change":"2024-09-19T13:36:13.678601+0000","last_active":"2024-09-19T14:13:47.151581+0000","last_peered":"2024-09-19T14:13:47.151581+0000","last_clean":"2024-09-19T14:13:47.151581+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:13:47.151581+0000","last_undegraded":"2024-09-19T14:13:47.151581+0000","last_fullsized":"2024-09-19T14:13:47.151581+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:44.121580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614634+0000","last_change":"2024-09-19T13:36:15.350412+0000","last_active":"2024-09-19T14:11:41.614634+0000","last_peered":"2024-09-19T14:11:41.614634+0000","last_clean":"2024-09-19T14:11:41.614634+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:11:41.614634+0000","last_undegraded":"2024-09-19T14:11:41.614634+0000","last_fullsized":"2024-09-19T14:11:41.614634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:44.795963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.456924+0000","last_change":"2024-09-19T13:36:17.363655+0000","last_active":"2024-09-19T14:12:27.456924+0000","last_peered":"2024-09-19T14:12:27.456924+0000","last_clean":"2024-09-19T14:12:27.456924+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:12:27.456924+0000","last_undegraded":"2024-09-19T14:12:27.456924+0000","last_fullsized":"2024-09-19T14:12:27.456924+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:54.511400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'351","reported_seq":1871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759134+0000","last_change":"2024-09-19T13:36:09.326835+0000","last_active":"2024-09-19T14:12:27.759134+0000","last_peered":"2024-09-19T14:12:27.759134+0000","last_clean":"2024-09-19T14:12:27.759134+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:12:27.759134+0000","last_undegraded":"2024-09-19T14:12:27.759134+0000","last_fullsized":"2024-09-19T14:12:27.759134+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:36.883583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610896+0000","last_change":"2024-09-19T13:36:00.767107+0000","last_active":"2024-09-19T14:11:26.610896+0000","last_peered":"2024-09-19T14:11:26.610896+0000","last_clean":"2024-09-19T14:11:26.610896+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:11:26.610896+0000","last_undegraded":"2024-09-19T14:11:26.610896+0000","last_fullsized":"2024-09-19T14:11:26.610896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:58.438229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'215","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733263+0000","last_change":"2024-09-19T13:36:07.801289+0000","last_active":"2024-09-19T14:11:36.733263+0000","last_peered":"2024-09-19T14:11:36.733263+0000","last_clean":"2024-09-19T14:11:36.733263+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:11:36.733263+0000","last_undegraded":"2024-09-19T14:11:36.733263+0000","last_fullsized":"2024-09-19T14:11:36.733263+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247065,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":5690,"num_write":1064,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614656+0000","last_change":"2024-09-19T13:36:11.337905+0000","last_active":"2024-09-19T14:11:41.614656+0000","last_peered":"2024-09-19T14:11:41.614656+0000","last_clean":"2024-09-19T14:11:41.614656+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:11:41.614656+0000","last_undegraded":"2024-09-19T14:11:41.614656+0000","last_fullsized":"2024-09-19T14:11:41.614656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:00.320875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'106","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622447+0000","last_change":"2024-09-19T13:36:13.341625+0000","last_active":"2024-09-19T14:13:06.622447+0000","last_peered":"2024-09-19T14:13:06.622447+0000","last_clean":"2024-09-19T14:13:06.622447+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:13:06.622447+0000","last_undegraded":"2024-09-19T14:13:06.622447+0000","last_fullsized":"2024-09-19T14:13:06.622447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:24.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.718378+0000","last_change":"2024-09-19T13:36:15.348466+0000","last_active":"2024-09-19T14:10:56.718378+0000","last_peered":"2024-09-19T14:10:56.718378+0000","last_clean":"2024-09-19T14:10:56.718378+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:10:56.718378+0000","last_undegraded":"2024-09-19T14:10:56.718378+0000","last_fullsized":"2024-09-19T14:10:56.718378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:41.097287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'106","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.019026+0000","last_change":"2024-09-19T13:36:17.362663+0000","last_active":"2024-09-19T14:12:27.019026+0000","last_peered":"2024-09-19T14:12:27.019026+0000","last_clean":"2024-09-19T14:12:27.019026+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:12:27.019026+0000","last_undegraded":"2024-09-19T14:12:27.019026+0000","last_fullsized":"2024-09-19T14:12:27.019026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:27.259346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'599","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260112+0000","last_change":"2024-09-19T13:36:09.342497+0000","last_active":"2024-09-19T14:12:20.260112+0000","last_peered":"2024-09-19T14:12:20.260112+0000","last_clean":"2024-09-19T14:12:20.260112+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:12:20.260112+0000","last_undegraded":"2024-09-19T14:12:20.260112+0000","last_fullsized":"2024-09-19T14:12:20.260112+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:24.198820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'199","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.820141+0000","last_change":"2024-09-19T13:36:07.809389+0000","last_active":"2024-09-19T14:12:15.820141+0000","last_peered":"2024-09-19T14:12:15.820141+0000","last_clean":"2024-09-19T14:12:15.820141+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:12:15.820141+0000","last_undegraded":"2024-09-19T14:12:15.820141+0000","last_fullsized":"2024-09-19T14:12:15.820141+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:41.507863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70057,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":569,"num_read_kb":24801,"num_write":993,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.647184+0000","last_change":"2024-09-19T13:36:00.763237+0000","last_active":"2024-09-19T14:11:26.647184+0000","last_peered":"2024-09-19T14:11:26.647184+0000","last_clean":"2024-09-19T14:11:26.647184+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:11:26.647184+0000","last_undegraded":"2024-09-19T14:11:26.647184+0000","last_fullsized":"2024-09-19T14:11:26.647184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:36.142012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613912+0000","last_change":"2024-09-19T13:36:11.333288+0000","last_active":"2024-09-19T14:11:36.613912+0000","last_peered":"2024-09-19T14:11:36.613912+0000","last_clean":"2024-09-19T14:11:36.613912+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:11:36.613912+0000","last_undegraded":"2024-09-19T14:11:36.613912+0000","last_fullsized":"2024-09-19T14:11:36.613912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:43.796231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'256","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.011948+0000","last_change":"2024-09-19T13:36:13.344037+0000","last_active":"2024-09-19T14:13:47.011948+0000","last_peered":"2024-09-19T14:13:47.011948+0000","last_clean":"2024-09-19T14:13:47.011948+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:13:47.011948+0000","last_undegraded":"2024-09-19T14:13:47.011948+0000","last_fullsized":"2024-09-19T14:13:47.011948+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:14.471458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19960,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":486,"num_write":232,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.734022+0000","last_change":"2024-09-19T13:36:15.347284+0000","last_active":"2024-09-19T14:11:41.734022+0000","last_peered":"2024-09-19T14:11:41.734022+0000","last_clean":"2024-09-19T14:11:41.734022+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:11:41.734022+0000","last_undegraded":"2024-09-19T14:11:41.734022+0000","last_fullsized":"2024-09-19T14:11:41.734022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:45.336194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'126","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.815901+0000","last_change":"2024-09-19T13:36:17.358825+0000","last_active":"2024-09-19T14:12:14.815901+0000","last_peered":"2024-09-19T14:12:14.815901+0000","last_clean":"2024-09-19T14:12:14.815901+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:12:14.815901+0000","last_undegraded":"2024-09-19T14:12:14.815901+0000","last_fullsized":"2024-09-19T14:12:14.815901+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:26.627242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1168","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.469596+0000","last_change":"2024-09-19T13:36:09.338739+0000","last_active":"2024-09-19T14:12:12.469596+0000","last_peered":"2024-09-19T14:12:12.469596+0000","last_clean":"2024-09-19T14:12:12.469596+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:12:12.469596+0000","last_undegraded":"2024-09-19T14:12:12.469596+0000","last_fullsized":"2024-09-19T14:12:12.469596+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:57.267957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'234","reported_seq":884,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.245753+0000","last_change":"2024-09-19T13:36:07.804201+0000","last_active":"2024-09-19T14:12:01.245753+0000","last_peered":"2024-09-19T14:12:01.245753+0000","last_clean":"2024-09-19T14:12:01.245753+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:12:01.245753+0000","last_undegraded":"2024-09-19T14:12:01.245753+0000","last_fullsized":"2024-09-19T14:12:01.245753+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:17.647156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511506,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":113129,"num_write":1043,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747369+0000","last_change":"2024-09-19T13:36:00.854514+0000","last_active":"2024-09-19T14:11:36.747369+0000","last_peered":"2024-09-19T14:11:36.747369+0000","last_clean":"2024-09-19T14:11:36.747369+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:11:36.747369+0000","last_undegraded":"2024-09-19T14:11:36.747369+0000","last_fullsized":"2024-09-19T14:11:36.747369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:14.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723266+0000","last_change":"2024-09-19T13:36:11.336803+0000","last_active":"2024-09-19T14:11:36.723266+0000","last_peered":"2024-09-19T14:11:36.723266+0000","last_clean":"2024-09-19T14:11:36.723266+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:11:36.723266+0000","last_undegraded":"2024-09-19T14:11:36.723266+0000","last_fullsized":"2024-09-19T14:11:36.723266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:07.018411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'145","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.356860+0000","last_change":"2024-09-19T13:36:13.678497+0000","last_active":"2024-09-19T14:12:27.356860+0000","last_peered":"2024-09-19T14:12:27.356860+0000","last_clean":"2024-09-19T14:12:27.356860+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:12:27.356860+0000","last_undegraded":"2024-09-19T14:12:27.356860+0000","last_fullsized":"2024-09-19T14:12:27.356860+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.504350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'785","reported_seq":2494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.049041+0000","last_change":"2024-09-19T13:36:15.349702+0000","last_active":"2024-09-19T14:13:47.049041+0000","last_peered":"2024-09-19T14:13:47.049041+0000","last_clean":"2024-09-19T14:13:47.049041+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:13:47.049041+0000","last_undegraded":"2024-09-19T14:13:47.049041+0000","last_fullsized":"2024-09-19T14:13:47.049041+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.512113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'139","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.173795+0000","last_change":"2024-09-19T13:36:17.364028+0000","last_active":"2024-09-19T14:12:26.173795+0000","last_peered":"2024-09-19T14:12:26.173795+0000","last_clean":"2024-09-19T14:12:26.173795+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:12:26.173795+0000","last_undegraded":"2024-09-19T14:12:26.173795+0000","last_fullsized":"2024-09-19T14:12:26.173795+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:00.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226434+0000","last_change":"2024-09-19T13:36:09.334788+0000","last_active":"2024-09-19T14:12:13.226434+0000","last_peered":"2024-09-19T14:12:13.226434+0000","last_clean":"2024-09-19T14:12:13.226434+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:12:13.226434+0000","last_undegraded":"2024-09-19T14:12:13.226434+0000","last_fullsized":"2024-09-19T14:12:13.226434+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'207","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.234573+0000","last_change":"2024-09-19T13:36:07.809079+0000","last_active":"2024-09-19T14:11:34.234573+0000","last_peered":"2024-09-19T14:11:34.234573+0000","last_clean":"2024-09-19T14:11:34.234573+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:11:34.234573+0000","last_undegraded":"2024-09-19T14:11:34.234573+0000","last_fullsized":"2024-09-19T14:11:34.234573+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5892174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":8334,"num_write":1021,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.641430+0000","last_change":"2024-09-19T13:36:00.763660+0000","last_active":"2024-09-19T14:10:41.641430+0000","last_peered":"2024-09-19T14:10:41.641430+0000","last_clean":"2024-09-19T14:10:41.641430+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:10:41.641430+0000","last_undegraded":"2024-09-19T14:10:41.641430+0000","last_fullsized":"2024-09-19T14:10:41.641430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:18.186285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733201+0000","last_change":"2024-09-19T13:36:11.329844+0000","last_active":"2024-09-19T14:11:36.733201+0000","last_peered":"2024-09-19T14:11:36.733201+0000","last_clean":"2024-09-19T14:11:36.733201+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:11:36.733201+0000","last_undegraded":"2024-09-19T14:11:36.733201+0000","last_fullsized":"2024-09-19T14:11:36.733201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:37.515612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'87","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.941455+0000","last_change":"2024-09-19T13:36:13.343716+0000","last_active":"2024-09-19T14:11:55.941455+0000","last_peered":"2024-09-19T14:11:55.941455+0000","last_clean":"2024-09-19T14:11:55.941455+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:11:55.941455+0000","last_undegraded":"2024-09-19T14:11:55.941455+0000","last_fullsized":"2024-09-19T14:11:55.941455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'792","reported_seq":2373,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.053372+0000","last_change":"2024-09-19T13:36:15.350187+0000","last_active":"2024-09-19T14:13:47.053372+0000","last_peered":"2024-09-19T14:13:47.053372+0000","last_clean":"2024-09-19T14:13:47.053372+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:13:47.053372+0000","last_undegraded":"2024-09-19T14:13:47.053372+0000","last_fullsized":"2024-09-19T14:13:47.053372+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.788209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'291","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:04.821247+0000","last_change":"2024-09-19T13:36:17.362227+0000","last_active":"2024-09-19T14:12:04.821247+0000","last_peered":"2024-09-19T14:12:04.821247+0000","last_clean":"2024-09-19T14:12:04.821247+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:12:04.821247+0000","last_undegraded":"2024-09-19T14:12:04.821247+0000","last_fullsized":"2024-09-19T14:12:04.821247+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:31.124289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'722","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758644+0000","last_change":"2024-09-19T13:36:09.334632+0000","last_active":"2024-09-19T14:12:27.758644+0000","last_peered":"2024-09-19T14:12:27.758644+0000","last_clean":"2024-09-19T14:12:27.758644+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:12:27.758644+0000","last_undegraded":"2024-09-19T14:12:27.758644+0000","last_fullsized":"2024-09-19T14:12:27.758644+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:08.592744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'221","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.297525+0000","last_change":"2024-09-19T13:36:07.811604+0000","last_active":"2024-09-19T14:11:55.297525+0000","last_peered":"2024-09-19T14:11:55.297525+0000","last_clean":"2024-09-19T14:11:55.297525+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:11:55.297525+0000","last_undegraded":"2024-09-19T14:11:55.297525+0000","last_fullsized":"2024-09-19T14:11:55.297525+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:27.180358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5253664,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":595,"num_read_kb":41557,"num_write":1057,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.716308+0000","last_change":"2024-09-19T13:36:00.816633+0000","last_active":"2024-09-19T14:10:41.716308+0000","last_peered":"2024-09-19T14:10:41.716308+0000","last_clean":"2024-09-19T14:10:41.716308+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:10:41.716308+0000","last_undegraded":"2024-09-19T14:10:41.716308+0000","last_fullsized":"2024-09-19T14:10:41.716308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:57.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.721729+0000","last_change":"2024-09-19T13:36:11.334617+0000","last_active":"2024-09-19T14:10:16.721729+0000","last_peered":"2024-09-19T14:10:16.721729+0000","last_clean":"2024-09-19T14:10:16.721729+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:10:16.721729+0000","last_undegraded":"2024-09-19T14:10:16.721729+0000","last_fullsized":"2024-09-19T14:10:16.721729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:31.167102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'292","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.006705+0000","last_change":"2024-09-19T13:36:13.678434+0000","last_active":"2024-09-19T14:13:47.006705+0000","last_peered":"2024-09-19T14:13:47.006705+0000","last_clean":"2024-09-19T14:13:47.006705+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:13:47.006705+0000","last_undegraded":"2024-09-19T14:13:47.006705+0000","last_fullsized":"2024-09-19T14:13:47.006705+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:14.308303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":405,"num_read_kb":503,"num_write":198,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.733909+0000","last_change":"2024-09-19T13:36:15.348438+0000","last_active":"2024-09-19T14:11:41.733909+0000","last_peered":"2024-09-19T14:11:41.733909+0000","last_clean":"2024-09-19T14:11:41.733909+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:11:41.733909+0000","last_undegraded":"2024-09-19T14:11:41.733909+0000","last_fullsized":"2024-09-19T14:11:41.733909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:32.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'160","reported_seq":653,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.232087+0000","last_change":"2024-09-19T13:36:17.358950+0000","last_active":"2024-09-19T14:12:27.232087+0000","last_peered":"2024-09-19T14:12:27.232087+0000","last_clean":"2024-09-19T14:12:27.232087+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:12:27.232087+0000","last_undegraded":"2024-09-19T14:12:27.232087+0000","last_fullsized":"2024-09-19T14:12:27.232087+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:09.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'143","reported_seq":706,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.863516+0000","last_change":"2024-09-19T13:36:17.361305+0000","last_active":"2024-09-19T14:12:27.863516+0000","last_peered":"2024-09-19T14:12:27.863516+0000","last_clean":"2024-09-19T14:12:27.863516+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:12:27.863516+0000","last_undegraded":"2024-09-19T14:12:27.863516+0000","last_fullsized":"2024-09-19T14:12:27.863516+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:26.500978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'776","reported_seq":2472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819999+0000","last_change":"2024-09-19T13:36:09.330532+0000","last_active":"2024-09-19T14:12:14.819999+0000","last_peered":"2024-09-19T14:12:14.819999+0000","last_clean":"2024-09-19T14:12:14.819999+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:12:14.819999+0000","last_undegraded":"2024-09-19T14:12:14.819999+0000","last_fullsized":"2024-09-19T14:12:14.819999+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:28.861247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'194","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.113365+0000","last_change":"2024-09-19T13:36:07.807459+0000","last_active":"2024-09-19T14:12:26.113365+0000","last_peered":"2024-09-19T14:12:26.113365+0000","last_clean":"2024-09-19T14:12:26.113365+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:12:26.113365+0000","last_undegraded":"2024-09-19T14:12:26.113365+0000","last_fullsized":"2024-09-19T14:12:26.113365+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:55.208501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899947,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":792,"num_read_kb":235834,"num_write":979,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645462+0000","last_change":"2024-09-19T13:36:11.335979+0000","last_active":"2024-09-19T14:11:11.645462+0000","last_peered":"2024-09-19T14:11:11.645462+0000","last_clean":"2024-09-19T14:11:11.645462+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:11:11.645462+0000","last_undegraded":"2024-09-19T14:11:11.645462+0000","last_fullsized":"2024-09-19T14:11:11.645462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:55.864456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'135","reported_seq":692,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.626321+0000","last_change":"2024-09-19T13:36:13.342360+0000","last_active":"2024-09-19T14:13:36.626321+0000","last_peered":"2024-09-19T14:13:36.626321+0000","last_clean":"2024-09-19T14:13:36.626321+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:13:36.626321+0000","last_undegraded":"2024-09-19T14:13:36.626321+0000","last_fullsized":"2024-09-19T14:13:36.626321+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:00.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11918,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":245,"num_write":98,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730499+0000","last_change":"2024-09-19T13:36:15.347213+0000","last_active":"2024-09-19T14:11:16.730499+0000","last_peered":"2024-09-19T14:11:16.730499+0000","last_clean":"2024-09-19T14:11:16.730499+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:11:16.730499+0000","last_undegraded":"2024-09-19T14:11:16.730499+0000","last_fullsized":"2024-09-19T14:11:16.730499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:56.274514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'125","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.583991+0000","last_change":"2024-09-19T13:36:17.361898+0000","last_active":"2024-09-19T14:12:27.583991+0000","last_peered":"2024-09-19T14:12:27.583991+0000","last_clean":"2024-09-19T14:12:27.583991+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:12:27.583991+0000","last_undegraded":"2024-09-19T14:12:27.583991+0000","last_fullsized":"2024-09-19T14:12:27.583991+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:32.112739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'450","reported_seq":2133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.856226+0000","last_change":"2024-09-19T13:36:09.341398+0000","last_active":"2024-09-19T14:13:45.856226+0000","last_peered":"2024-09-19T14:13:45.856226+0000","last_clean":"2024-09-19T14:13:45.856226+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:13:45.856226+0000","last_undegraded":"2024-09-19T14:13:45.856226+0000","last_fullsized":"2024-09-19T14:13:45.856226+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:27.435893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'202","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.567284+0000","last_change":"2024-09-19T13:36:44.400759+0000","last_active":"2024-09-19T14:11:55.567284+0000","last_peered":"2024-09-19T14:11:55.567284+0000","last_clean":"2024-09-19T14:11:55.567284+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:11:55.567284+0000","last_undegraded":"2024-09-19T14:11:55.567284+0000","last_fullsized":"2024-09-19T14:11:55.567284+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:53.572285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567557,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":556,"num_read_kb":26124,"num_write":1059,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.729952+0000","last_change":"2024-09-19T13:36:11.337455+0000","last_active":"2024-09-19T14:11:11.729952+0000","last_peered":"2024-09-19T14:11:11.729952+0000","last_clean":"2024-09-19T14:11:11.729952+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:11:11.729952+0000","last_undegraded":"2024-09-19T14:11:11.729952+0000","last_fullsized":"2024-09-19T14:11:11.729952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:12.668776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":538,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.243489+0000","last_change":"2024-09-19T13:36:13.343393+0000","last_active":"2024-09-19T14:11:58.243489+0000","last_peered":"2024-09-19T14:11:58.243489+0000","last_clean":"2024-09-19T14:11:58.243489+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:11:58.243489+0000","last_undegraded":"2024-09-19T14:11:58.243489+0000","last_fullsized":"2024-09-19T14:11:58.243489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:39.552041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.744597+0000","last_change":"2024-09-19T13:36:15.353524+0000","last_active":"2024-09-19T14:11:16.744597+0000","last_peered":"2024-09-19T14:11:16.744597+0000","last_clean":"2024-09-19T14:11:16.744597+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:11:16.744597+0000","last_undegraded":"2024-09-19T14:11:16.744597+0000","last_fullsized":"2024-09-19T14:11:16.744597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:39.216630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'216","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.357835+0000","last_change":"2024-09-19T13:36:17.356683+0000","last_active":"2024-09-19T14:12:27.357835+0000","last_peered":"2024-09-19T14:12:27.357835+0000","last_clean":"2024-09-19T14:12:27.357835+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:12:27.357835+0000","last_undegraded":"2024-09-19T14:12:27.357835+0000","last_fullsized":"2024-09-19T14:12:27.357835+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:18.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'397","reported_seq":1840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171074+0000","last_change":"2024-09-19T13:36:09.334800+0000","last_active":"2024-09-19T14:12:15.171074+0000","last_peered":"2024-09-19T14:12:15.171074+0000","last_clean":"2024-09-19T14:12:15.171074+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:12:15.171074+0000","last_undegraded":"2024-09-19T14:12:15.171074+0000","last_fullsized":"2024-09-19T14:12:15.171074+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:14.288345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'211","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:00.123029+0000","last_change":"2024-09-19T13:36:07.810838+0000","last_active":"2024-09-19T14:12:00.123029+0000","last_peered":"2024-09-19T14:12:00.123029+0000","last_clean":"2024-09-19T14:12:00.123029+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:12:00.123029+0000","last_undegraded":"2024-09-19T14:12:00.123029+0000","last_fullsized":"2024-09-19T14:12:00.123029+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:49.405832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":16519,"num_write":1035,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743810+0000","last_change":"2024-09-19T13:36:11.336061+0000","last_active":"2024-09-19T14:11:11.743810+0000","last_peered":"2024-09-19T14:11:11.743810+0000","last_clean":"2024-09-19T14:11:11.743810+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:11:11.743810+0000","last_undegraded":"2024-09-19T14:11:11.743810+0000","last_fullsized":"2024-09-19T14:11:11.743810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:12.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'140","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.626354+0000","last_change":"2024-09-19T13:36:13.342506+0000","last_active":"2024-09-19T14:13:36.626354+0000","last_peered":"2024-09-19T14:13:36.626354+0000","last_clean":"2024-09-19T14:13:36.626354+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:13:36.626354+0000","last_undegraded":"2024-09-19T14:13:36.626354+0000","last_fullsized":"2024-09-19T14:13:36.626354+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6169,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":179,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720728+0000","last_change":"2024-09-19T13:36:15.349264+0000","last_active":"2024-09-19T14:11:16.720728+0000","last_peered":"2024-09-19T14:11:16.720728+0000","last_clean":"2024-09-19T14:11:16.720728+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:11:16.720728+0000","last_undegraded":"2024-09-19T14:11:16.720728+0000","last_fullsized":"2024-09-19T14:11:16.720728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.086503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'180","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.817537+0000","last_change":"2024-09-19T13:36:17.359223+0000","last_active":"2024-09-19T14:12:14.817537+0000","last_peered":"2024-09-19T14:12:14.817537+0000","last_clean":"2024-09-19T14:12:14.817537+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:12:14.817537+0000","last_undegraded":"2024-09-19T14:12:14.817537+0000","last_fullsized":"2024-09-19T14:12:14.817537+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:10.712355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'407","reported_seq":1890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857973+0000","last_change":"2024-09-19T13:36:09.347751+0000","last_active":"2024-09-19T14:13:45.857973+0000","last_peered":"2024-09-19T14:13:45.857973+0000","last_clean":"2024-09-19T14:13:45.857973+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:13:45.857973+0000","last_undegraded":"2024-09-19T14:13:45.857973+0000","last_fullsized":"2024-09-19T14:13:45.857973+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:52.995531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'219","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.603441+0000","last_change":"2024-09-19T13:36:07.810378+0000","last_active":"2024-09-19T14:11:23.603441+0000","last_peered":"2024-09-19T14:11:23.603441+0000","last_clean":"2024-09-19T14:11:23.603441+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:11:23.603441+0000","last_undegraded":"2024-09-19T14:11:23.603441+0000","last_fullsized":"2024-09-19T14:11:23.603441+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:11.342159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10525266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":42518,"num_write":1081,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.720199+0000","last_change":"2024-09-19T13:36:11.338516+0000","last_active":"2024-09-19T14:11:11.720199+0000","last_peered":"2024-09-19T14:11:11.720199+0000","last_clean":"2024-09-19T14:11:11.720199+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:11:11.720199+0000","last_undegraded":"2024-09-19T14:11:11.720199+0000","last_fullsized":"2024-09-19T14:11:11.720199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:01:07.656648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'125","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.765349+0000","last_change":"2024-09-19T13:36:13.348210+0000","last_active":"2024-09-19T14:13:36.765349+0000","last_peered":"2024-09-19T14:13:36.765349+0000","last_clean":"2024-09-19T14:13:36.765349+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:13:36.765349+0000","last_undegraded":"2024-09-19T14:13:36.765349+0000","last_fullsized":"2024-09-19T14:13:36.765349+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:04.880223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12423,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":215,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611560+0000","last_change":"2024-09-19T13:36:15.353429+0000","last_active":"2024-09-19T14:11:16.611560+0000","last_peered":"2024-09-19T14:11:16.611560+0000","last_clean":"2024-09-19T14:11:16.611560+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:11:16.611560+0000","last_undegraded":"2024-09-19T14:11:16.611560+0000","last_fullsized":"2024-09-19T14:11:16.611560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'841","reported_seq":2324,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859435+0000","last_change":"2024-09-19T13:36:09.338894+0000","last_active":"2024-09-19T14:13:45.859435+0000","last_peered":"2024-09-19T14:13:45.859435+0000","last_clean":"2024-09-19T14:13:45.859435+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:13:45.859435+0000","last_undegraded":"2024-09-19T14:13:45.859435+0000","last_fullsized":"2024-09-19T14:13:45.859435+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:00.425682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'208","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.498765+0000","last_change":"2024-09-19T13:36:07.802099+0000","last_active":"2024-09-19T14:11:31.498765+0000","last_peered":"2024-09-19T14:11:31.498765+0000","last_clean":"2024-09-19T14:11:31.498765+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:11:31.498765+0000","last_undegraded":"2024-09-19T14:11:31.498765+0000","last_fullsized":"2024-09-19T14:11:31.498765+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:50.286421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5579919,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":34256,"num_write":1032,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619281+0000","last_change":"2024-09-19T13:36:11.339451+0000","last_active":"2024-09-19T14:12:16.619281+0000","last_peered":"2024-09-19T14:12:16.619281+0000","last_clean":"2024-09-19T14:12:16.619281+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:12:16.619281+0000","last_undegraded":"2024-09-19T14:12:16.619281+0000","last_fullsized":"2024-09-19T14:12:16.619281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:18.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'178","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.003432+0000","last_change":"2024-09-19T13:36:13.344513+0000","last_active":"2024-09-19T14:13:47.003432+0000","last_peered":"2024-09-19T14:13:47.003432+0000","last_clean":"2024-09-19T14:13:47.003432+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:13:47.003432+0000","last_undegraded":"2024-09-19T14:13:47.003432+0000","last_fullsized":"2024-09-19T14:13:47.003432+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:22.941079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19597,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":275,"num_read_kb":396,"num_write":172,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.609853+0000","last_change":"2024-09-19T13:36:15.354407+0000","last_active":"2024-09-19T14:11:16.609853+0000","last_peered":"2024-09-19T14:11:16.609853+0000","last_clean":"2024-09-19T14:11:16.609853+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:11:16.609853+0000","last_undegraded":"2024-09-19T14:11:16.609853+0000","last_fullsized":"2024-09-19T14:11:16.609853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'194","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.814286+0000","last_change":"2024-09-19T13:36:17.363573+0000","last_active":"2024-09-19T14:12:27.814286+0000","last_peered":"2024-09-19T14:12:27.814286+0000","last_clean":"2024-09-19T14:12:27.814286+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:12:27.814286+0000","last_undegraded":"2024-09-19T14:12:27.814286+0000","last_fullsized":"2024-09-19T14:12:27.814286+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:53.961300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619272+0000","last_change":"2024-09-19T13:36:09.334303+0000","last_active":"2024-09-19T14:12:16.619272+0000","last_peered":"2024-09-19T14:12:16.619272+0000","last_clean":"2024-09-19T14:12:16.619272+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:12:16.619272+0000","last_undegraded":"2024-09-19T14:12:16.619272+0000","last_fullsized":"2024-09-19T14:12:16.619272+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:28.147108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'186","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.488395+0000","last_change":"2024-09-19T13:36:07.808757+0000","last_active":"2024-09-19T14:12:03.488395+0000","last_peered":"2024-09-19T14:12:03.488395+0000","last_clean":"2024-09-19T14:12:03.488395+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:12:03.488395+0000","last_undegraded":"2024-09-19T14:12:03.488395+0000","last_fullsized":"2024-09-19T14:12:03.488395+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:21.182962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12605672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":902,"num_read_kb":49787,"num_write":932,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723358+0000","last_change":"2024-09-19T13:36:11.339099+0000","last_active":"2024-09-19T14:11:36.723358+0000","last_peered":"2024-09-19T14:11:36.723358+0000","last_clean":"2024-09-19T14:11:36.723358+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:11:36.723358+0000","last_undegraded":"2024-09-19T14:11:36.723358+0000","last_fullsized":"2024-09-19T14:11:36.723358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:44.638696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'127","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.767011+0000","last_change":"2024-09-19T13:36:13.351689+0000","last_active":"2024-09-19T14:13:46.767011+0000","last_peered":"2024-09-19T14:13:46.767011+0000","last_clean":"2024-09-19T14:13:46.767011+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:13:46.767011+0000","last_undegraded":"2024-09-19T14:13:46.767011+0000","last_fullsized":"2024-09-19T14:13:46.767011+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:59.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":174,"num_read_kb":165,"num_write":108,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645982+0000","last_change":"2024-09-19T13:36:15.352438+0000","last_active":"2024-09-19T14:11:16.645982+0000","last_peered":"2024-09-19T14:11:16.645982+0000","last_clean":"2024-09-19T14:11:16.645982+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:11:16.645982+0000","last_undegraded":"2024-09-19T14:11:16.645982+0000","last_fullsized":"2024-09-19T14:11:16.645982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:36.174138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'153","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:05.915979+0000","last_change":"2024-09-19T13:36:17.361800+0000","last_active":"2024-09-19T14:12:05.915979+0000","last_peered":"2024-09-19T14:12:05.915979+0000","last_clean":"2024-09-19T14:12:05.915979+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:12:05.915979+0000","last_undegraded":"2024-09-19T14:12:05.915979+0000","last_fullsized":"2024-09-19T14:12:05.915979+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:05.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'363","reported_seq":1760,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758484+0000","last_change":"2024-09-19T13:36:09.347725+0000","last_active":"2024-09-19T14:12:27.758484+0000","last_peered":"2024-09-19T14:12:27.758484+0000","last_clean":"2024-09-19T14:12:27.758484+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:12:27.758484+0000","last_undegraded":"2024-09-19T14:12:27.758484+0000","last_fullsized":"2024-09-19T14:12:27.758484+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:58.075633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'200","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.856602+0000","last_change":"2024-09-19T13:36:07.804673+0000","last_active":"2024-09-19T14:12:11.856602+0000","last_peered":"2024-09-19T14:12:11.856602+0000","last_clean":"2024-09-19T14:12:11.856602+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:12:11.856602+0000","last_undegraded":"2024-09-19T14:12:11.856602+0000","last_fullsized":"2024-09-19T14:12:11.856602+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:43.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535766,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":634,"num_read_kb":98647,"num_write":930,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730104+0000","last_change":"2024-09-19T13:36:11.336450+0000","last_active":"2024-09-19T14:11:11.730104+0000","last_peered":"2024-09-19T14:11:11.730104+0000","last_clean":"2024-09-19T14:11:11.730104+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:11:11.730104+0000","last_undegraded":"2024-09-19T14:11:11.730104+0000","last_fullsized":"2024-09-19T14:11:11.730104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:28.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'119","reported_seq":678,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.627635+0000","last_change":"2024-09-19T13:36:13.679719+0000","last_active":"2024-09-19T14:13:46.627635+0000","last_peered":"2024-09-19T14:13:46.627635+0000","last_clean":"2024-09-19T14:13:46.627635+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:13:46.627635+0000","last_undegraded":"2024-09-19T14:13:46.627635+0000","last_fullsized":"2024-09-19T14:13:46.627635+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":78,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.638419+0000","last_change":"2024-09-19T13:36:15.346362+0000","last_active":"2024-09-19T14:10:21.638419+0000","last_peered":"2024-09-19T14:10:21.638419+0000","last_clean":"2024-09-19T14:10:21.638419+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:10:21.638419+0000","last_undegraded":"2024-09-19T14:10:21.638419+0000","last_fullsized":"2024-09-19T14:10:21.638419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:04.233453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'110","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.035975+0000","last_change":"2024-09-19T13:36:17.358911+0000","last_active":"2024-09-19T14:13:47.035975+0000","last_peered":"2024-09-19T14:13:47.035975+0000","last_clean":"2024-09-19T14:13:47.035975+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:13:47.035975+0000","last_undegraded":"2024-09-19T14:13:47.035975+0000","last_fullsized":"2024-09-19T14:13:47.035975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:09.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'864","reported_seq":2572,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759017+0000","last_change":"2024-09-19T13:36:09.328018+0000","last_active":"2024-09-19T14:12:27.759017+0000","last_peered":"2024-09-19T14:12:27.759017+0000","last_clean":"2024-09-19T14:12:27.759017+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:12:27.759017+0000","last_undegraded":"2024-09-19T14:12:27.759017+0000","last_fullsized":"2024-09-19T14:12:27.759017+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:01.380904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'234","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:33.181002+0000","last_change":"2024-09-19T13:36:07.810852+0000","last_active":"2024-09-19T14:11:33.181002+0000","last_peered":"2024-09-19T14:11:33.181002+0000","last_clean":"2024-09-19T14:11:33.181002+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:11:33.181002+0000","last_undegraded":"2024-09-19T14:11:33.181002+0000","last_fullsized":"2024-09-19T14:11:33.181002+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:23.670171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283729,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":17644,"num_write":968,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645501+0000","last_change":"2024-09-19T13:36:11.341498+0000","last_active":"2024-09-19T14:11:11.645501+0000","last_peered":"2024-09-19T14:11:11.645501+0000","last_clean":"2024-09-19T14:11:11.645501+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:11:11.645501+0000","last_undegraded":"2024-09-19T14:11:11.645501+0000","last_fullsized":"2024-09-19T14:11:11.645501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:07.914209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'73","reported_seq":581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.472240+0000","last_change":"2024-09-19T13:36:13.678466+0000","last_active":"2024-09-19T14:12:12.472240+0000","last_peered":"2024-09-19T14:12:12.472240+0000","last_clean":"2024-09-19T14:12:12.472240+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:12:12.472240+0000","last_undegraded":"2024-09-19T14:12:12.472240+0000","last_fullsized":"2024-09-19T14:12:12.472240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.085161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'776","reported_seq":4106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.047599+0000","last_change":"2024-09-19T13:36:15.350958+0000","last_active":"2024-09-19T14:13:47.047599+0000","last_peered":"2024-09-19T14:13:47.047599+0000","last_clean":"2024-09-19T14:13:47.047599+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:13:47.047599+0000","last_undegraded":"2024-09-19T14:13:47.047599+0000","last_fullsized":"2024-09-19T14:13:47.047599+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.003728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'116","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.815973+0000","last_change":"2024-09-19T13:36:17.363671+0000","last_active":"2024-09-19T14:12:27.815973+0000","last_peered":"2024-09-19T14:12:27.815973+0000","last_clean":"2024-09-19T14:12:27.815973+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:12:27.815973+0000","last_undegraded":"2024-09-19T14:12:27.815973+0000","last_fullsized":"2024-09-19T14:12:27.815973+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'835","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.844154+0000","last_change":"2024-09-19T13:36:09.338783+0000","last_active":"2024-09-19T14:12:03.844154+0000","last_peered":"2024-09-19T14:12:03.844154+0000","last_clean":"2024-09-19T14:12:03.844154+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:12:03.844154+0000","last_undegraded":"2024-09-19T14:12:03.844154+0000","last_fullsized":"2024-09-19T14:12:03.844154+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:11.912759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'176","reported_seq":753,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:00.741944+0000","last_change":"2024-09-19T13:36:07.814956+0000","last_active":"2024-09-19T14:12:00.741944+0000","last_peered":"2024-09-19T14:12:00.741944+0000","last_clean":"2024-09-19T14:12:00.741944+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:12:00.741944+0000","last_undegraded":"2024-09-19T14:12:00.741944+0000","last_fullsized":"2024-09-19T14:12:00.741944+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:59.519413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":5488,"num_write":866,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743900+0000","last_change":"2024-09-19T13:36:11.339110+0000","last_active":"2024-09-19T14:11:11.743900+0000","last_peered":"2024-09-19T14:11:11.743900+0000","last_clean":"2024-09-19T14:11:11.743900+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:11:11.743900+0000","last_undegraded":"2024-09-19T14:11:11.743900+0000","last_fullsized":"2024-09-19T14:11:11.743900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:19.072017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'143","reported_seq":703,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:36.619894+0000","last_change":"2024-09-19T13:36:13.345724+0000","last_active":"2024-09-19T14:12:36.619894+0000","last_peered":"2024-09-19T14:12:36.619894+0000","last_clean":"2024-09-19T14:12:36.619894+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:12:36.619894+0000","last_undegraded":"2024-09-19T14:12:36.619894+0000","last_fullsized":"2024-09-19T14:12:36.619894+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:09.615248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11294,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":179,"num_read_kb":233,"num_write":98,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601159+0000","last_change":"2024-09-19T13:36:15.348860+0000","last_active":"2024-09-19T14:10:06.601159+0000","last_peered":"2024-09-19T14:10:06.601159+0000","last_clean":"2024-09-19T14:10:06.601159+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:10:06.601159+0000","last_undegraded":"2024-09-19T14:10:06.601159+0000","last_fullsized":"2024-09-19T14:10:06.601159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:42.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'111","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.467492+0000","last_change":"2024-09-19T13:36:17.357887+0000","last_active":"2024-09-19T14:12:12.467492+0000","last_peered":"2024-09-19T14:12:12.467492+0000","last_clean":"2024-09-19T14:12:12.467492+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:12:12.467492+0000","last_undegraded":"2024-09-19T14:12:12.467492+0000","last_fullsized":"2024-09-19T14:12:12.467492+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:57.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2548,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758795+0000","last_change":"2024-09-19T13:36:09.339435+0000","last_active":"2024-09-19T14:12:27.758795+0000","last_peered":"2024-09-19T14:12:27.758795+0000","last_clean":"2024-09-19T14:12:27.758795+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:12:27.758795+0000","last_undegraded":"2024-09-19T14:12:27.758795+0000","last_fullsized":"2024-09-19T14:12:27.758795+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:54.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'233","reported_seq":885,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:10.871720+0000","last_change":"2024-09-19T13:36:07.814402+0000","last_active":"2024-09-19T14:12:10.871720+0000","last_peered":"2024-09-19T14:12:10.871720+0000","last_clean":"2024-09-19T14:12:10.871720+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:12:10.871720+0000","last_undegraded":"2024-09-19T14:12:10.871720+0000","last_fullsized":"2024-09-19T14:12:10.871720+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.518831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19036554,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":601,"num_read_kb":59575,"num_write":1076,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.609332+0000","last_change":"2024-09-19T13:36:11.336616+0000","last_active":"2024-09-19T14:11:11.609332+0000","last_peered":"2024-09-19T14:11:11.609332+0000","last_clean":"2024-09-19T14:11:11.609332+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:11:11.609332+0000","last_undegraded":"2024-09-19T14:11:11.609332+0000","last_fullsized":"2024-09-19T14:11:11.609332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:30.775102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'128","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.621099+0000","last_change":"2024-09-19T13:36:13.344971+0000","last_active":"2024-09-19T14:12:31.621099+0000","last_peered":"2024-09-19T14:12:31.621099+0000","last_clean":"2024-09-19T14:12:31.621099+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:12:31.621099+0000","last_undegraded":"2024-09-19T14:12:31.621099+0000","last_fullsized":"2024-09-19T14:12:31.621099+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:03.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":144,"num_read_kb":190,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.711890+0000","last_change":"2024-09-19T13:36:15.353381+0000","last_active":"2024-09-19T14:10:11.711890+0000","last_peered":"2024-09-19T14:10:11.711890+0000","last_clean":"2024-09-19T14:10:11.711890+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:10:11.711890+0000","last_undegraded":"2024-09-19T14:10:11.711890+0000","last_fullsized":"2024-09-19T14:10:11.711890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.838545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'82","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:08.528868+0000","last_change":"2024-09-19T13:36:17.361965+0000","last_active":"2024-09-19T14:12:08.528868+0000","last_peered":"2024-09-19T14:12:08.528868+0000","last_clean":"2024-09-19T14:12:08.528868+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:12:08.528868+0000","last_undegraded":"2024-09-19T14:12:08.528868+0000","last_fullsized":"2024-09-19T14:12:08.528868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:25.682631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'388","reported_seq":1821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859075+0000","last_change":"2024-09-19T13:36:09.341541+0000","last_active":"2024-09-19T14:13:45.859075+0000","last_peered":"2024-09-19T14:13:45.859075+0000","last_clean":"2024-09-19T14:13:45.859075+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:13:45.859075+0000","last_undegraded":"2024-09-19T14:13:45.859075+0000","last_fullsized":"2024-09-19T14:13:45.859075+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:38.682073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'199","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.164446+0000","last_change":"2024-09-19T13:36:44.400469+0000","last_active":"2024-09-19T14:12:13.164446+0000","last_peered":"2024-09-19T14:12:13.164446+0000","last_clean":"2024-09-19T14:12:13.164446+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:12:13.164446+0000","last_undegraded":"2024-09-19T14:12:13.164446+0000","last_fullsized":"2024-09-19T14:12:13.164446+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:06.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898702,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":9219,"num_write":928,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719839+0000","last_change":"2024-09-19T13:36:11.334533+0000","last_active":"2024-09-19T14:10:01.719839+0000","last_peered":"2024-09-19T14:10:01.719839+0000","last_clean":"2024-09-19T14:10:01.719839+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:10:01.719839+0000","last_undegraded":"2024-09-19T14:10:01.719839+0000","last_fullsized":"2024-09-19T14:10:01.719839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'111","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.627563+0000","last_change":"2024-09-19T13:36:13.346260+0000","last_active":"2024-09-19T14:13:46.627563+0000","last_peered":"2024-09-19T14:13:46.627563+0000","last_clean":"2024-09-19T14:13:46.627563+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:13:46.627563+0000","last_undegraded":"2024-09-19T14:13:46.627563+0000","last_fullsized":"2024-09-19T14:13:46.627563+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:37.266432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":195,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730630+0000","last_change":"2024-09-19T13:36:15.348740+0000","last_active":"2024-09-19T14:11:16.730630+0000","last_peered":"2024-09-19T14:11:16.730630+0000","last_clean":"2024-09-19T14:11:16.730630+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:11:16.730630+0000","last_undegraded":"2024-09-19T14:11:16.730630+0000","last_fullsized":"2024-09-19T14:11:16.730630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:00.693042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'161","reported_seq":1613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.352324+0000","last_change":"2024-09-19T13:36:17.359613+0000","last_active":"2024-09-19T14:12:27.352324+0000","last_peered":"2024-09-19T14:12:27.352324+0000","last_clean":"2024-09-19T14:12:27.352324+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:12:27.352324+0000","last_undegraded":"2024-09-19T14:12:27.352324+0000","last_fullsized":"2024-09-19T14:12:27.352324+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:03.545885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1270","reported_seq":2983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882294+0000","last_change":"2024-09-19T13:36:09.338262+0000","last_active":"2024-09-19T14:12:15.882294+0000","last_peered":"2024-09-19T14:12:15.882294+0000","last_clean":"2024-09-19T14:12:15.882294+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:12:15.882294+0000","last_undegraded":"2024-09-19T14:12:15.882294+0000","last_fullsized":"2024-09-19T14:12:15.882294+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:47.191145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'204","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727812+0000","last_change":"2024-09-19T13:36:07.813158+0000","last_active":"2024-09-19T14:12:25.727812+0000","last_peered":"2024-09-19T14:12:25.727812+0000","last_clean":"2024-09-19T14:12:25.727812+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:12:25.727812+0000","last_undegraded":"2024-09-19T14:12:25.727812+0000","last_fullsized":"2024-09-19T14:12:25.727812+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:46.920199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6558355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":101743,"num_write":1007,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.636111+0000","last_change":"2024-09-19T13:36:11.338136+0000","last_active":"2024-09-19T14:10:06.636111+0000","last_peered":"2024-09-19T14:10:06.636111+0000","last_clean":"2024-09-19T14:10:06.636111+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:10:06.636111+0000","last_undegraded":"2024-09-19T14:10:06.636111+0000","last_fullsized":"2024-09-19T14:10:06.636111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:55.192579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'155","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.752326+0000","last_change":"2024-09-19T13:36:13.345467+0000","last_active":"2024-09-19T14:13:46.752326+0000","last_peered":"2024-09-19T14:13:46.752326+0000","last_clean":"2024-09-19T14:13:46.752326+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:13:46.752326+0000","last_undegraded":"2024-09-19T14:13:46.752326+0000","last_fullsized":"2024-09-19T14:13:46.752326+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":282,"num_write":118,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611550+0000","last_change":"2024-09-19T13:36:15.349620+0000","last_active":"2024-09-19T14:11:16.611550+0000","last_peered":"2024-09-19T14:11:16.611550+0000","last_clean":"2024-09-19T14:11:16.611550+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:11:16.611550+0000","last_undegraded":"2024-09-19T14:11:16.611550+0000","last_fullsized":"2024-09-19T14:11:16.611550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.666417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'158","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855539+0000","last_change":"2024-09-19T13:36:17.360385+0000","last_active":"2024-09-19T14:13:45.855539+0000","last_peered":"2024-09-19T14:13:45.855539+0000","last_clean":"2024-09-19T14:13:45.855539+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:13:45.855539+0000","last_undegraded":"2024-09-19T14:13:45.855539+0000","last_fullsized":"2024-09-19T14:13:45.855539+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:56.457101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'835","reported_seq":2511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354875+0000","last_change":"2024-09-19T13:36:09.340041+0000","last_active":"2024-09-19T14:12:27.354875+0000","last_peered":"2024-09-19T14:12:27.354875+0000","last_clean":"2024-09-19T14:12:27.354875+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:12:27.354875+0000","last_undegraded":"2024-09-19T14:12:27.354875+0000","last_fullsized":"2024-09-19T14:12:27.354875+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.813909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'243","reported_seq":934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.413480+0000","last_change":"2024-09-19T13:36:07.816141+0000","last_active":"2024-09-19T14:11:59.413480+0000","last_peered":"2024-09-19T14:11:59.413480+0000","last_clean":"2024-09-19T14:11:59.413480+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:11:59.413480+0000","last_undegraded":"2024-09-19T14:11:59.413480+0000","last_fullsized":"2024-09-19T14:11:59.413480+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:19.313544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6958799,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":884,"num_read_kb":7647,"num_write":1097,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759140+0000","last_change":"2024-09-19T13:36:09.327555+0000","last_active":"2024-09-19T14:12:27.759140+0000","last_peered":"2024-09-19T14:12:27.759140+0000","last_clean":"2024-09-19T14:12:27.759140+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:12:27.759140+0000","last_undegraded":"2024-09-19T14:12:27.759140+0000","last_fullsized":"2024-09-19T14:12:27.759140+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:05.495968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'214","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818398+0000","last_change":"2024-09-19T13:36:44.477056+0000","last_active":"2024-09-19T14:11:36.818398+0000","last_peered":"2024-09-19T14:11:36.818398+0000","last_clean":"2024-09-19T14:11:36.818398+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:11:36.818398+0000","last_undegraded":"2024-09-19T14:11:36.818398+0000","last_fullsized":"2024-09-19T14:11:36.818398+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:33.685772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":556,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":9780,"num_write":1044,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'454","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.864388+0000","last_change":"2024-09-19T13:36:09.336079+0000","last_active":"2024-09-19T14:13:45.864388+0000","last_peered":"2024-09-19T14:13:45.864388+0000","last_clean":"2024-09-19T14:13:45.864388+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:13:45.864388+0000","last_undegraded":"2024-09-19T14:13:45.864388+0000","last_fullsized":"2024-09-19T14:13:45.864388+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:37.224054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'206","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.496205+0000","last_change":"2024-09-19T13:36:07.813078+0000","last_active":"2024-09-19T14:12:11.496205+0000","last_peered":"2024-09-19T14:12:11.496205+0000","last_clean":"2024-09-19T14:12:11.496205+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:12:11.496205+0000","last_undegraded":"2024-09-19T14:12:11.496205+0000","last_fullsized":"2024-09-19T14:12:11.496205+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:50:05.153900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569610,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":41340,"num_write":994,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'834","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171315+0000","last_change":"2024-09-19T13:36:09.337109+0000","last_active":"2024-09-19T14:12:15.171315+0000","last_peered":"2024-09-19T14:12:15.171315+0000","last_clean":"2024-09-19T14:12:15.171315+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:12:15.171315+0000","last_undegraded":"2024-09-19T14:12:15.171315+0000","last_fullsized":"2024-09-19T14:12:15.171315+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:35.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'341","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.655125+0000","last_change":"2024-09-19T13:36:07.799742+0000","last_active":"2024-09-19T14:13:41.655125+0000","last_peered":"2024-09-19T14:13:41.655125+0000","last_clean":"2024-09-19T14:13:41.655125+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:13:41.655125+0000","last_undegraded":"2024-09-19T14:13:41.655125+0000","last_fullsized":"2024-09-19T14:13:41.655125+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:24.145889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031324,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":982,"num_read_kb":17821,"num_write":1246,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1313","reported_seq":2966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.881914+0000","last_change":"2024-09-19T13:36:09.337337+0000","last_active":"2024-09-19T14:12:15.881914+0000","last_peered":"2024-09-19T14:12:15.881914+0000","last_clean":"2024-09-19T14:12:15.881914+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:12:15.881914+0000","last_undegraded":"2024-09-19T14:12:15.881914+0000","last_fullsized":"2024-09-19T14:12:15.881914+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:42.621753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'181","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.215253+0000","last_change":"2024-09-19T13:36:07.799229+0000","last_active":"2024-09-19T14:12:06.215253+0000","last_peered":"2024-09-19T14:12:06.215253+0000","last_clean":"2024-09-19T14:12:06.215253+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:12:06.215253+0000","last_undegraded":"2024-09-19T14:12:06.215253+0000","last_fullsized":"2024-09-19T14:12:06.215253+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:58.585027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22190415,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":35047,"num_write":884,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'459","reported_seq":2150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.394101+0000","last_change":"2024-09-19T13:36:09.337422+0000","last_active":"2024-09-19T14:12:14.394101+0000","last_peered":"2024-09-19T14:12:14.394101+0000","last_clean":"2024-09-19T14:12:14.394101+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:12:14.394101+0000","last_undegraded":"2024-09-19T14:12:14.394101+0000","last_fullsized":"2024-09-19T14:12:14.394101+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:01.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'260","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.483590+0000","last_change":"2024-09-19T13:36:07.807531+0000","last_active":"2024-09-19T14:12:15.483590+0000","last_peered":"2024-09-19T14:12:15.483590+0000","last_clean":"2024-09-19T14:12:15.483590+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:12:15.483590+0000","last_undegraded":"2024-09-19T14:12:15.483590+0000","last_fullsized":"2024-09-19T14:12:15.483590+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:04.888500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'504","reported_seq":2120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176086+0000","last_change":"2024-09-19T13:36:09.345213+0000","last_active":"2024-09-19T14:12:26.176086+0000","last_peered":"2024-09-19T14:12:26.176086+0000","last_clean":"2024-09-19T14:12:26.176086+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:12:26.176086+0000","last_undegraded":"2024-09-19T14:12:26.176086+0000","last_fullsized":"2024-09-19T14:12:26.176086+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:29.948161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'206","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:37.059809+0000","last_change":"2024-09-19T13:36:07.807149+0000","last_active":"2024-09-19T14:13:37.059809+0000","last_peered":"2024-09-19T14:13:37.059809+0000","last_clean":"2024-09-19T14:13:37.059809+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:13:37.059809+0000","last_undegraded":"2024-09-19T14:13:37.059809+0000","last_fullsized":"2024-09-19T14:13:37.059809+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":13493,"num_write":1004,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'441","reported_seq":1912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857244+0000","last_change":"2024-09-19T13:36:09.339640+0000","last_active":"2024-09-19T14:13:45.857244+0000","last_peered":"2024-09-19T14:13:45.857244+0000","last_clean":"2024-09-19T14:13:45.857244+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:13:45.857244+0000","last_undegraded":"2024-09-19T14:13:45.857244+0000","last_fullsized":"2024-09-19T14:13:45.857244+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:04.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'235","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:38.916973+0000","last_change":"2024-09-19T13:36:07.799033+0000","last_active":"2024-09-19T14:13:38.916973+0000","last_peered":"2024-09-19T14:13:38.916973+0000","last_clean":"2024-09-19T14:13:38.916973+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:13:38.916973+0000","last_undegraded":"2024-09-19T14:13:38.916973+0000","last_fullsized":"2024-09-19T14:13:38.916973+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:19.554246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":12697,"num_write":1148,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'795","reported_seq":2305,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354863+0000","last_change":"2024-09-19T13:36:09.334668+0000","last_active":"2024-09-19T14:12:27.354863+0000","last_peered":"2024-09-19T14:12:27.354863+0000","last_clean":"2024-09-19T14:12:27.354863+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:12:27.354863+0000","last_undegraded":"2024-09-19T14:12:27.354863+0000","last_fullsized":"2024-09-19T14:12:27.354863+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:41.139613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'187","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:24.204718+0000","last_change":"2024-09-19T13:36:07.810286+0000","last_active":"2024-09-19T14:11:24.204718+0000","last_peered":"2024-09-19T14:11:24.204718+0000","last_clean":"2024-09-19T14:11:24.204718+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:11:24.204718+0000","last_undegraded":"2024-09-19T14:11:24.204718+0000","last_fullsized":"2024-09-19T14:11:24.204718+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.597999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":31169,"num_write":925,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'408","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355318+0000","last_change":"2024-09-19T13:36:09.330316+0000","last_active":"2024-09-19T14:12:27.355318+0000","last_peered":"2024-09-19T14:12:27.355318+0000","last_clean":"2024-09-19T14:12:27.355318+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:12:27.355318+0000","last_undegraded":"2024-09-19T14:12:27.355318+0000","last_fullsized":"2024-09-19T14:12:27.355318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:07.464094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'215","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727427+0000","last_change":"2024-09-19T13:36:07.798277+0000","last_active":"2024-09-19T14:12:25.727427+0000","last_peered":"2024-09-19T14:12:25.727427+0000","last_clean":"2024-09-19T14:12:25.727427+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:12:25.727427+0000","last_undegraded":"2024-09-19T14:12:25.727427+0000","last_fullsized":"2024-09-19T14:12:25.727427+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:15.349763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956151,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":31236,"num_write":1020,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'415","reported_seq":1917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.927264+0000","last_change":"2024-09-19T13:36:09.335622+0000","last_active":"2024-09-19T14:12:13.927264+0000","last_peered":"2024-09-19T14:12:13.927264+0000","last_clean":"2024-09-19T14:12:13.927264+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:12:13.927264+0000","last_undegraded":"2024-09-19T14:12:13.927264+0000","last_fullsized":"2024-09-19T14:12:13.927264+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:17:53.466085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'289","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:19.110439+0000","last_change":"2024-09-19T13:36:07.810715+0000","last_active":"2024-09-19T14:11:19.110439+0000","last_peered":"2024-09-19T14:11:19.110439+0000","last_clean":"2024-09-19T14:11:19.110439+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:11:19.110439+0000","last_undegraded":"2024-09-19T14:11:19.110439+0000","last_fullsized":"2024-09-19T14:11:19.110439+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:31.514058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27201,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":11922,"num_write":1197,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'363","reported_seq":1800,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.169773+0000","last_change":"2024-09-19T13:36:09.337015+0000","last_active":"2024-09-19T14:12:26.169773+0000","last_peered":"2024-09-19T14:12:26.169773+0000","last_clean":"2024-09-19T14:12:26.169773+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:12:26.169773+0000","last_undegraded":"2024-09-19T14:12:26.169773+0000","last_fullsized":"2024-09-19T14:12:26.169773+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:30.671479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'209","reported_seq":882,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:45.071355+0000","last_change":"2024-09-19T13:36:07.814269+0000","last_active":"2024-09-19T14:11:45.071355+0000","last_peered":"2024-09-19T14:11:45.071355+0000","last_clean":"2024-09-19T14:11:45.071355+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:11:45.071355+0000","last_undegraded":"2024-09-19T14:11:45.071355+0000","last_fullsized":"2024-09-19T14:11:45.071355+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:15.947998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5413251,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":98527,"num_write":1021,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'868","reported_seq":2495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819671+0000","last_change":"2024-09-19T13:36:09.338093+0000","last_active":"2024-09-19T14:12:14.819671+0000","last_peered":"2024-09-19T14:12:14.819671+0000","last_clean":"2024-09-19T14:12:14.819671+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:12:14.819671+0000","last_undegraded":"2024-09-19T14:12:14.819671+0000","last_fullsized":"2024-09-19T14:12:14.819671+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:05.996200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'239","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.238395+0000","last_change":"2024-09-19T13:36:07.814412+0000","last_active":"2024-09-19T14:11:59.238395+0000","last_peered":"2024-09-19T14:11:59.238395+0000","last_clean":"2024-09-19T14:11:59.238395+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:11:59.238395+0000","last_undegraded":"2024-09-19T14:11:59.238395+0000","last_fullsized":"2024-09-19T14:11:59.238395+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:00.783704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3437313,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":9315,"num_write":1045,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.874456+0000","last_change":"2024-09-19T13:36:09.341212+0000","last_active":"2024-09-19T14:12:15.874456+0000","last_peered":"2024-09-19T14:12:15.874456+0000","last_clean":"2024-09-19T14:12:15.874456+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:12:15.874456+0000","last_undegraded":"2024-09-19T14:12:15.874456+0000","last_fullsized":"2024-09-19T14:12:15.874456+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:57.018874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'247","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733913+0000","last_change":"2024-09-19T13:36:07.807328+0000","last_active":"2024-09-19T14:10:06.733913+0000","last_peered":"2024-09-19T14:10:06.733913+0000","last_clean":"2024-09-19T14:10:06.733913+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:10:06.733913+0000","last_undegraded":"2024-09-19T14:10:06.733913+0000","last_fullsized":"2024-09-19T14:10:06.733913+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:08.421022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9310237,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":13968,"num_write":1073,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'506","reported_seq":2122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.600040+0000","last_change":"2024-09-19T13:36:09.336661+0000","last_active":"2024-09-19T14:12:13.600040+0000","last_peered":"2024-09-19T14:12:13.600040+0000","last_clean":"2024-09-19T14:12:13.600040+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:12:13.600040+0000","last_undegraded":"2024-09-19T14:12:13.600040+0000","last_fullsized":"2024-09-19T14:12:13.600040+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:04.813825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'220","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.567382+0000","last_change":"2024-09-19T13:36:07.808201+0000","last_active":"2024-09-19T14:11:55.567382+0000","last_peered":"2024-09-19T14:11:55.567382+0000","last_clean":"2024-09-19T14:11:55.567382+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:11:55.567382+0000","last_undegraded":"2024-09-19T14:11:55.567382+0000","last_fullsized":"2024-09-19T14:11:55.567382+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:55.157068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534349,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":75622,"num_write":969,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'448","reported_seq":1944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758451+0000","last_change":"2024-09-19T13:36:09.337955+0000","last_active":"2024-09-19T14:12:27.758451+0000","last_peered":"2024-09-19T14:12:27.758451+0000","last_clean":"2024-09-19T14:12:27.758451+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:12:27.758451+0000","last_undegraded":"2024-09-19T14:12:27.758451+0000","last_fullsized":"2024-09-19T14:12:27.758451+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:36.790174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'197","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.547310+0000","last_change":"2024-09-19T13:36:07.810689+0000","last_active":"2024-09-19T14:12:13.547310+0000","last_peered":"2024-09-19T14:12:13.547310+0000","last_clean":"2024-09-19T14:12:13.547310+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:12:13.547310+0000","last_undegraded":"2024-09-19T14:12:13.547310+0000","last_fullsized":"2024-09-19T14:12:13.547310+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:59.845601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324671,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":10629,"num_write":1011,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'191","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.376741+0000","last_change":"2024-09-19T13:36:07.816743+0000","last_active":"2024-09-19T14:12:07.376741+0000","last_peered":"2024-09-19T14:12:07.376741+0000","last_clean":"2024-09-19T14:12:07.376741+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:12:07.376741+0000","last_undegraded":"2024-09-19T14:12:07.376741+0000","last_fullsized":"2024-09-19T14:12:07.376741+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.831713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4409468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":6982,"num_write":946,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'984","reported_seq":2906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176238+0000","last_change":"2024-09-19T13:36:09.340334+0000","last_active":"2024-09-19T14:12:26.176238+0000","last_peered":"2024-09-19T14:12:26.176238+0000","last_clean":"2024-09-19T14:12:26.176238+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:12:26.176238+0000","last_undegraded":"2024-09-19T14:12:26.176238+0000","last_fullsized":"2024-09-19T14:12:26.176238+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:50.291927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'226","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:10.172942+0000","last_change":"2024-09-19T13:36:07.805884+0000","last_active":"2024-09-19T14:12:10.172942+0000","last_peered":"2024-09-19T14:12:10.172942+0000","last_clean":"2024-09-19T14:12:10.172942+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:12:10.172942+0000","last_undegraded":"2024-09-19T14:12:10.172942+0000","last_fullsized":"2024-09-19T14:12:10.172942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:43.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7246065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":719,"num_read_kb":54230,"num_write":1170,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'386","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.347586+0000","last_change":"2024-09-19T13:36:09.336829+0000","last_active":"2024-09-19T14:12:27.347586+0000","last_peered":"2024-09-19T14:12:27.347586+0000","last_clean":"2024-09-19T14:12:27.347586+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:12:27.347586+0000","last_undegraded":"2024-09-19T14:12:27.347586+0000","last_fullsized":"2024-09-19T14:12:27.347586+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:29.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1682,"ondisk_log_size":1682,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":614,"ondisk_log_size":614,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":405878,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7581,"num_read_kb":9313,"num_write":5135,"num_write_kb":2593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":189930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1879,"ondisk_log_size":1879,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2397,"num_read_kb":2862,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4236,"ondisk_log_size":4236,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":487465899,"num_objects":412,"num_object_clones":0,"num_object_copies":824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":0,"num_read":38487,"num_read_kb":2616691,"num_write":63619,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":976797696,"data_stored":974931798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4246,"ondisk_log_size":4246,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63610923,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":117,"num_read_kb":176453,"num_write":136,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127229952,"data_stored":127221846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63610923,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":115,"num_read_kb":179418,"num_write":136,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127229952,"data_stored":127221846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542608,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359656,"kb_used_data":143832,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94012184,"statfs":{"total":96636764160,"available":96268476416,"internally_reserved":0,"allocated":147283968,"data_stored":145414466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220985802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542609,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364772,"kb_used_data":153108,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94007068,"statfs":{"total":96636764160,"available":96263237632,"internally_reserved":0,"allocated":156782592,"data_stored":155158296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229244,"kb_used_data":139820,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94142596,"statfs":{"total":96636764160,"available":96402018304,"internally_reserved":0,"allocated":143175680,"data_stored":141307822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542612,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255312,"kb_used_data":179712,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94116528,"statfs":{"total":96636764160,"available":96375324672,"internally_reserved":0,"allocated":184025088,"data_stored":182276595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542610,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405664,"kb_used_data":175952,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93966176,"statfs":{"total":96636764160,"available":96221364224,"internally_reserved":0,"allocated":180174848,"data_stored":178395336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161904,"kb_used_data":98784,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94209936,"statfs":{"total":96636764160,"available":96470974464,"internally_reserved":0,"allocated":101154816,"data_stored":99542049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262920,"kb_used_data":141560,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94108920,"statfs":{"total":96636764160,"available":96367534080,"internally_reserved":0,"allocated":144957440,"data_stored":143275793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542610,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429088,"kb_used_data":199376,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93942752,"statfs":{"total":96636764160,"available":96197378048,"internally_reserved":0,"allocated":204161024,"data_stored":202300137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155848704,"data_stored":155531495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":87781376,"data_stored":87605617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83361792,"data_stored":83206147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":139661312,"data_stored":139427172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":156217344,"data_stored":155923322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":120438784,"data_stored":120161976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":105390080,"data_stored":105253044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":128098304,"data_stored":127823025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":22615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":30215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":25850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":12834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":45848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":30308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23117097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5827243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8978432,"data_stored":8976178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13742080,"data_stored":13740281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9502720,"data_stored":9500759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27852800,"data_stored":27850546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15839232,"data_stored":15837433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23658496,"data_stored":23656242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5351673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:14:18.902 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:14:19.237 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:14:19.251 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:14:19.253 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1406,"stamp":"2024-09-19T14:14:17.707646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615701328,"num_objects":912,"num_object_clones":0,"num_object_copies":1824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":295721,"num_read_kb":3210662,"num_write":145183,"num_write_kb":2512502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13898,"ondisk_log_size":13898,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2468560,"kb_used_data":1232144,"kb_used_omap":12,"kb_used_meta":1236275,"kb_avail":752506160,"statfs":{"total":773094113280,"available":770566307840,"internally_reserved":0,"allocated":1261715456,"data_stored":1247670494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1265946160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004936"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.604790+0000","last_change":"2024-09-19T14:03:08.839286+0000","last_active":"2024-09-19T14:10:41.604790+0000","last_peered":"2024-09-19T14:10:41.604790+0000","last_clean":"2024-09-19T14:10:41.604790+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:10:41.604790+0000","last_undegraded":"2024-09-19T14:10:41.604790+0000","last_fullsized":"2024-09-19T14:10:41.604790+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:42.826327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.602224+0000","last_change":"2024-09-19T13:52:51.581992+0000","last_active":"2024-09-19T14:10:21.602224+0000","last_peered":"2024-09-19T14:10:21.602224+0000","last_clean":"2024-09-19T14:10:21.602224+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:10:21.602224+0000","last_undegraded":"2024-09-19T14:10:21.602224+0000","last_fullsized":"2024-09-19T14:10:21.602224+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:21.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722729+0000","last_change":"2024-09-19T13:52:48.556806+0000","last_active":"2024-09-19T14:10:21.722729+0000","last_peered":"2024-09-19T14:10:21.722729+0000","last_clean":"2024-09-19T14:10:21.722729+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:10:21.722729+0000","last_undegraded":"2024-09-19T14:10:21.722729+0000","last_fullsized":"2024-09-19T14:10:21.722729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:12.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.618002+0000","last_change":"2024-09-19T13:51:15.739764+0000","last_active":"2024-09-19T14:12:06.618002+0000","last_peered":"2024-09-19T14:12:06.618002+0000","last_clean":"2024-09-19T14:12:06.618002+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:12:06.618002+0000","last_undegraded":"2024-09-19T14:12:06.618002+0000","last_fullsized":"2024-09-19T14:12:06.618002+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:19.998068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.811878+0000","last_change":"2024-09-19T14:03:08.835558+0000","last_active":"2024-09-19T14:10:41.811878+0000","last_peered":"2024-09-19T14:10:41.811878+0000","last_clean":"2024-09-19T14:10:41.811878+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:10:41.811878+0000","last_undegraded":"2024-09-19T14:10:41.811878+0000","last_fullsized":"2024-09-19T14:10:41.811878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:48.618379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723070+0000","last_change":"2024-09-19T13:52:51.587845+0000","last_active":"2024-09-19T14:10:21.723070+0000","last_peered":"2024-09-19T14:10:21.723070+0000","last_clean":"2024-09-19T14:10:21.723070+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:10:21.723070+0000","last_undegraded":"2024-09-19T14:10:21.723070+0000","last_fullsized":"2024-09-19T14:10:21.723070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:46.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.638390+0000","last_change":"2024-09-19T13:52:48.554640+0000","last_active":"2024-09-19T14:10:21.638390+0000","last_peered":"2024-09-19T14:10:21.638390+0000","last_clean":"2024-09-19T14:10:21.638390+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:10:21.638390+0000","last_undegraded":"2024-09-19T14:10:21.638390+0000","last_fullsized":"2024-09-19T14:10:21.638390+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:35.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.816386+0000","last_change":"2024-09-19T13:51:15.745607+0000","last_active":"2024-09-19T14:11:16.816386+0000","last_peered":"2024-09-19T14:11:16.816386+0000","last_clean":"2024-09-19T14:11:16.816386+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:11:16.816386+0000","last_undegraded":"2024-09-19T14:11:16.816386+0000","last_fullsized":"2024-09-19T14:11:16.816386+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.713992+0000","last_change":"2024-09-19T14:03:08.837569+0000","last_active":"2024-09-19T14:10:26.713992+0000","last_peered":"2024-09-19T14:10:26.713992+0000","last_clean":"2024-09-19T14:10:26.713992+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:10:26.713992+0000","last_undegraded":"2024-09-19T14:10:26.713992+0000","last_fullsized":"2024-09-19T14:10:26.713992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:12.734099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.614000+0000","last_change":"2024-09-19T13:52:51.586976+0000","last_active":"2024-09-19T14:11:36.614000+0000","last_peered":"2024-09-19T14:11:36.614000+0000","last_clean":"2024-09-19T14:11:36.614000+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:11:36.614000+0000","last_undegraded":"2024-09-19T14:11:36.614000+0000","last_fullsized":"2024-09-19T14:11:36.614000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:28.946709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813410+0000","last_change":"2024-09-19T13:52:48.554485+0000","last_active":"2024-09-19T14:10:51.813410+0000","last_peered":"2024-09-19T14:10:51.813410+0000","last_clean":"2024-09-19T14:10:51.813410+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:10:51.813410+0000","last_undegraded":"2024-09-19T14:10:51.813410+0000","last_fullsized":"2024-09-19T14:10:51.813410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:12.978118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611594+0000","last_change":"2024-09-19T13:51:15.737359+0000","last_active":"2024-09-19T14:11:16.611594+0000","last_peered":"2024-09-19T14:11:16.611594+0000","last_clean":"2024-09-19T14:11:16.611594+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:11:16.611594+0000","last_undegraded":"2024-09-19T14:11:16.611594+0000","last_fullsized":"2024-09-19T14:11:16.611594+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:50.162815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723353+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:10:26.723353+0000","last_peered":"2024-09-19T14:10:26.723353+0000","last_clean":"2024-09-19T14:10:26.723353+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:10:26.723353+0000","last_undegraded":"2024-09-19T14:10:26.723353+0000","last_fullsized":"2024-09-19T14:10:26.723353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.363715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.727658+0000","last_change":"2024-09-19T13:52:51.581539+0000","last_active":"2024-09-19T14:10:56.727658+0000","last_peered":"2024-09-19T14:10:56.727658+0000","last_clean":"2024-09-19T14:10:56.727658+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:10:56.727658+0000","last_undegraded":"2024-09-19T14:10:56.727658+0000","last_fullsized":"2024-09-19T14:10:56.727658+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:52.537771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733334+0000","last_change":"2024-09-19T13:52:48.553843+0000","last_active":"2024-09-19T14:11:36.733334+0000","last_peered":"2024-09-19T14:11:36.733334+0000","last_clean":"2024-09-19T14:11:36.733334+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:11:36.733334+0000","last_undegraded":"2024-09-19T14:11:36.733334+0000","last_fullsized":"2024-09-19T14:11:36.733334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:42.945314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730599+0000","last_change":"2024-09-19T13:51:15.746581+0000","last_active":"2024-09-19T14:11:16.730599+0000","last_peered":"2024-09-19T14:11:16.730599+0000","last_clean":"2024-09-19T14:11:16.730599+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:11:16.730599+0000","last_undegraded":"2024-09-19T14:11:16.730599+0000","last_fullsized":"2024-09-19T14:11:16.730599+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:13.432237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730008+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:11:11.730008+0000","last_peered":"2024-09-19T14:11:11.730008+0000","last_clean":"2024-09-19T14:11:11.730008+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:11:11.730008+0000","last_undegraded":"2024-09-19T14:11:11.730008+0000","last_fullsized":"2024-09-19T14:11:11.730008+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.597736+0000","last_change":"2024-09-19T13:53:44.846213+0000","last_active":"2024-09-19T14:09:51.597736+0000","last_peered":"2024-09-19T14:09:51.597736+0000","last_clean":"2024-09-19T14:09:51.597736+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:09:51.597736+0000","last_undegraded":"2024-09-19T14:09:51.597736+0000","last_fullsized":"2024-09-19T14:09:51.597736+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:34.290843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'4","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.598177+0000","last_change":"2024-09-19T13:52:48.552836+0000","last_active":"2024-09-19T14:09:46.598177+0000","last_peered":"2024-09-19T14:09:46.598177+0000","last_clean":"2024-09-19T14:09:46.598177+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:09:46.598177+0000","last_undegraded":"2024-09-19T14:09:46.598177+0000","last_fullsized":"2024-09-19T14:09:46.598177+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:10.701239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12817,"num_write":4,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730570+0000","last_change":"2024-09-19T13:51:15.743989+0000","last_active":"2024-09-19T14:11:16.730570+0000","last_peered":"2024-09-19T14:11:16.730570+0000","last_clean":"2024-09-19T14:11:16.730570+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:11:16.730570+0000","last_undegraded":"2024-09-19T14:11:16.730570+0000","last_fullsized":"2024-09-19T14:11:16.730570+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:33.192776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647908+0000","last_change":"2024-09-19T14:03:08.837855+0000","last_active":"2024-09-19T14:11:31.647908+0000","last_peered":"2024-09-19T14:11:31.647908+0000","last_clean":"2024-09-19T14:11:31.647908+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:11:31.647908+0000","last_undegraded":"2024-09-19T14:11:31.647908+0000","last_fullsized":"2024-09-19T14:11:31.647908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:17.620266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.708338+0000","last_change":"2024-09-19T13:52:51.576379+0000","last_active":"2024-09-19T14:09:46.708338+0000","last_peered":"2024-09-19T14:09:46.708338+0000","last_clean":"2024-09-19T14:09:46.708338+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:09:46.708338+0000","last_undegraded":"2024-09-19T14:09:46.708338+0000","last_fullsized":"2024-09-19T14:09:46.708338+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:14.311651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.718219+0000","last_change":"2024-09-19T13:52:48.553148+0000","last_active":"2024-09-19T14:09:51.718219+0000","last_peered":"2024-09-19T14:09:51.718219+0000","last_clean":"2024-09-19T14:09:51.718219+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:09:51.718219+0000","last_undegraded":"2024-09-19T14:09:51.718219+0000","last_fullsized":"2024-09-19T14:09:51.718219+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:55.422175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720708+0000","last_change":"2024-09-19T13:51:15.746742+0000","last_active":"2024-09-19T14:11:16.720708+0000","last_peered":"2024-09-19T14:11:16.720708+0000","last_clean":"2024-09-19T14:11:16.720708+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:11:16.720708+0000","last_undegraded":"2024-09-19T14:11:16.720708+0000","last_fullsized":"2024-09-19T14:11:16.720708+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:30.998138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739569+0000","last_change":"2024-09-19T14:03:08.842863+0000","last_active":"2024-09-19T14:10:41.739569+0000","last_peered":"2024-09-19T14:10:41.739569+0000","last_clean":"2024-09-19T14:10:41.739569+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:10:41.739569+0000","last_undegraded":"2024-09-19T14:10:41.739569+0000","last_fullsized":"2024-09-19T14:10:41.739569+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:07.703304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.713321+0000","last_change":"2024-09-19T13:52:51.577966+0000","last_active":"2024-09-19T14:10:21.713321+0000","last_peered":"2024-09-19T14:10:21.713321+0000","last_clean":"2024-09-19T14:10:21.713321+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:10:21.713321+0000","last_undegraded":"2024-09-19T14:10:21.713321+0000","last_fullsized":"2024-09-19T14:10:21.713321+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:07.818951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723019+0000","last_change":"2024-09-19T13:52:48.556329+0000","last_active":"2024-09-19T14:10:21.723019+0000","last_peered":"2024-09-19T14:10:21.723019+0000","last_clean":"2024-09-19T14:10:21.723019+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:10:21.723019+0000","last_undegraded":"2024-09-19T14:10:21.723019+0000","last_fullsized":"2024-09-19T14:10:21.723019+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:39.632455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":103,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.222490+0000","last_change":"2024-09-19T13:51:15.738677+0000","last_active":"2024-09-19T14:11:23.222490+0000","last_peered":"2024-09-19T14:11:23.222490+0000","last_clean":"2024-09-19T14:11:23.222490+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:11:23.222490+0000","last_undegraded":"2024-09-19T14:11:23.222490+0000","last_fullsized":"2024-09-19T14:11:23.222490+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:11.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739606+0000","last_change":"2024-09-19T14:03:08.844476+0000","last_active":"2024-09-19T14:10:41.739606+0000","last_peered":"2024-09-19T14:10:41.739606+0000","last_clean":"2024-09-19T14:10:41.739606+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:10:41.739606+0000","last_undegraded":"2024-09-19T14:10:41.739606+0000","last_fullsized":"2024-09-19T14:10:41.739606+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:07.162545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722684+0000","last_change":"2024-09-19T13:52:51.580942+0000","last_active":"2024-09-19T14:10:21.722684+0000","last_peered":"2024-09-19T14:10:21.722684+0000","last_clean":"2024-09-19T14:10:21.722684+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:10:21.722684+0000","last_undegraded":"2024-09-19T14:10:21.722684+0000","last_fullsized":"2024-09-19T14:10:21.722684+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:13.538115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":6,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.603559+0000","last_change":"2024-09-19T13:52:48.559959+0000","last_active":"2024-09-19T14:10:21.603559+0000","last_peered":"2024-09-19T14:10:21.603559+0000","last_clean":"2024-09-19T14:10:21.603559+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:10:21.603559+0000","last_undegraded":"2024-09-19T14:10:21.603559+0000","last_fullsized":"2024-09-19T14:10:21.603559+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:01.163462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.640638+0000","last_change":"2024-09-19T13:51:15.740479+0000","last_active":"2024-09-19T14:10:36.640638+0000","last_peered":"2024-09-19T14:10:36.640638+0000","last_clean":"2024-09-19T14:10:36.640638+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:10:36.640638+0000","last_undegraded":"2024-09-19T14:10:36.640638+0000","last_fullsized":"2024-09-19T14:10:36.640638+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:23.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636875+0000","last_change":"2024-09-19T14:03:08.839816+0000","last_active":"2024-09-19T14:10:11.636875+0000","last_peered":"2024-09-19T14:10:11.636875+0000","last_clean":"2024-09-19T14:10:11.636875+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:10:11.636875+0000","last_undegraded":"2024-09-19T14:10:11.636875+0000","last_fullsized":"2024-09-19T14:10:11.636875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:56.109994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717106+0000","last_change":"2024-09-19T13:52:51.579222+0000","last_active":"2024-09-19T14:09:46.717106+0000","last_peered":"2024-09-19T14:09:46.717106+0000","last_clean":"2024-09-19T14:09:46.717106+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:09:46.717106+0000","last_undegraded":"2024-09-19T14:09:46.717106+0000","last_fullsized":"2024-09-19T14:09:46.717106+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:47.019906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'8","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.612336+0000","last_change":"2024-09-19T13:52:48.554787+0000","last_active":"2024-09-19T14:11:36.612336+0000","last_peered":"2024-09-19T14:11:36.612336+0000","last_clean":"2024-09-19T14:11:36.612336+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:11:36.612336+0000","last_undegraded":"2024-09-19T14:11:36.612336+0000","last_fullsized":"2024-09-19T14:11:36.612336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:28.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.128068+0000","last_change":"2024-09-19T13:51:15.739410+0000","last_active":"2024-09-19T14:12:01.128068+0000","last_peered":"2024-09-19T14:12:01.128068+0000","last_clean":"2024-09-19T14:12:01.128068+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:12:01.128068+0000","last_undegraded":"2024-09-19T14:12:01.128068+0000","last_fullsized":"2024-09-19T14:12:01.128068+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:59.512917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.807924+0000","last_change":"2024-09-19T14:03:08.841302+0000","last_active":"2024-09-19T14:10:11.807924+0000","last_peered":"2024-09-19T14:10:11.807924+0000","last_clean":"2024-09-19T14:10:11.807924+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:10:11.807924+0000","last_undegraded":"2024-09-19T14:10:11.807924+0000","last_fullsized":"2024-09-19T14:10:11.807924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:41.250326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733241+0000","last_change":"2024-09-19T13:52:51.578766+0000","last_active":"2024-09-19T14:11:36.733241+0000","last_peered":"2024-09-19T14:11:36.733241+0000","last_clean":"2024-09-19T14:11:36.733241+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:11:36.733241+0000","last_undegraded":"2024-09-19T14:11:36.733241+0000","last_fullsized":"2024-09-19T14:11:36.733241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:06.602738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'1","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.730748+0000","last_change":"2024-09-19T13:52:48.554709+0000","last_active":"2024-09-19T14:09:46.730748+0000","last_peered":"2024-09-19T14:09:46.730748+0000","last_clean":"2024-09-19T14:09:46.730748+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:09:46.730748+0000","last_undegraded":"2024-09-19T14:09:46.730748+0000","last_fullsized":"2024-09-19T14:09:46.730748+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:18.382465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60368,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.724834+0000","last_change":"2024-09-19T13:51:15.744268+0000","last_active":"2024-09-19T14:10:36.724834+0000","last_peered":"2024-09-19T14:10:36.724834+0000","last_clean":"2024-09-19T14:10:36.724834+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:10:36.724834+0000","last_undegraded":"2024-09-19T14:10:36.724834+0000","last_fullsized":"2024-09-19T14:10:36.724834+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:44.697556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734779+0000","last_change":"2024-09-19T14:03:08.840741+0000","last_active":"2024-09-19T14:10:11.734779+0000","last_peered":"2024-09-19T14:10:11.734779+0000","last_clean":"2024-09-19T14:10:11.734779+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:10:11.734779+0000","last_undegraded":"2024-09-19T14:10:11.734779+0000","last_fullsized":"2024-09-19T14:10:11.734779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:28.511196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717148+0000","last_change":"2024-09-19T13:52:51.576629+0000","last_active":"2024-09-19T14:09:46.717148+0000","last_peered":"2024-09-19T14:09:46.717148+0000","last_clean":"2024-09-19T14:09:46.717148+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:09:46.717148+0000","last_undegraded":"2024-09-19T14:09:46.717148+0000","last_fullsized":"2024-09-19T14:09:46.717148+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:12.831765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'1","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.804394+0000","last_change":"2024-09-19T13:52:48.558114+0000","last_active":"2024-09-19T14:09:46.804394+0000","last_peered":"2024-09-19T14:09:46.804394+0000","last_clean":"2024-09-19T14:09:46.804394+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:09:46.804394+0000","last_undegraded":"2024-09-19T14:09:46.804394+0000","last_fullsized":"2024-09-19T14:09:46.804394+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:06.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.811335+0000","last_change":"2024-09-19T13:51:15.739232+0000","last_active":"2024-09-19T14:10:36.811335+0000","last_peered":"2024-09-19T14:10:36.811335+0000","last_clean":"2024-09-19T14:10:36.811335+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:10:36.811335+0000","last_undegraded":"2024-09-19T14:10:36.811335+0000","last_fullsized":"2024-09-19T14:10:36.811335+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:51.455590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600709+0000","last_change":"2024-09-19T14:03:08.838834+0000","last_active":"2024-09-19T14:10:11.600709+0000","last_peered":"2024-09-19T14:10:11.600709+0000","last_clean":"2024-09-19T14:10:11.600709+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:10:11.600709+0000","last_undegraded":"2024-09-19T14:10:11.600709+0000","last_fullsized":"2024-09-19T14:10:11.600709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:03.093578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717534+0000","last_change":"2024-09-19T13:52:51.583920+0000","last_active":"2024-09-19T14:09:46.717534+0000","last_peered":"2024-09-19T14:09:46.717534+0000","last_clean":"2024-09-19T14:09:46.717534+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:09:46.717534+0000","last_undegraded":"2024-09-19T14:09:46.717534+0000","last_fullsized":"2024-09-19T14:09:46.717534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:36.896326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'7","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.598296+0000","last_change":"2024-09-19T13:52:48.555699+0000","last_active":"2024-09-19T14:09:46.598296+0000","last_peered":"2024-09-19T14:09:46.598296+0000","last_clean":"2024-09-19T14:09:46.598296+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:09:46.598296+0000","last_undegraded":"2024-09-19T14:09:46.598296+0000","last_fullsized":"2024-09-19T14:09:46.598296+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:08.653057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.732994+0000","last_change":"2024-09-19T13:51:15.743134+0000","last_active":"2024-09-19T14:10:01.732994+0000","last_peered":"2024-09-19T14:10:01.732994+0000","last_clean":"2024-09-19T14:10:01.732994+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:10:01.732994+0000","last_undegraded":"2024-09-19T14:10:01.732994+0000","last_fullsized":"2024-09-19T14:10:01.732994+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:20.033888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723447+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:10:26.723447+0000","last_peered":"2024-09-19T14:10:26.723447+0000","last_clean":"2024-09-19T14:10:26.723447+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:10:26.723447+0000","last_undegraded":"2024-09-19T14:10:26.723447+0000","last_fullsized":"2024-09-19T14:10:26.723447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:46.882911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'13","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647858+0000","last_change":"2024-09-19T13:52:51.584825+0000","last_active":"2024-09-19T14:11:31.647858+0000","last_peered":"2024-09-19T14:11:31.647858+0000","last_clean":"2024-09-19T14:11:31.647858+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:11:31.647858+0000","last_undegraded":"2024-09-19T14:11:31.647858+0000","last_fullsized":"2024-09-19T14:11:31.647858+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:27.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11793,"num_write":33,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732335+0000","last_change":"2024-09-19T13:52:48.558319+0000","last_active":"2024-09-19T14:11:31.732335+0000","last_peered":"2024-09-19T14:11:31.732335+0000","last_clean":"2024-09-19T14:11:31.732335+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:11:31.732335+0000","last_undegraded":"2024-09-19T14:11:31.732335+0000","last_fullsized":"2024-09-19T14:11:31.732335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:02.238052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.235548+0000","last_change":"2024-09-19T13:51:15.743038+0000","last_active":"2024-09-19T14:11:22.235548+0000","last_peered":"2024-09-19T14:11:22.235548+0000","last_clean":"2024-09-19T14:11:22.235548+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:11:22.235548+0000","last_undegraded":"2024-09-19T14:11:22.235548+0000","last_fullsized":"2024-09-19T14:11:22.235548+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:09.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.604316+0000","last_change":"2024-09-19T14:03:08.842157+0000","last_active":"2024-09-19T14:10:26.604316+0000","last_peered":"2024-09-19T14:10:26.604316+0000","last_clean":"2024-09-19T14:10:26.604316+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:10:26.604316+0000","last_undegraded":"2024-09-19T14:10:26.604316+0000","last_fullsized":"2024-09-19T14:10:26.604316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647830+0000","last_change":"2024-09-19T13:52:51.582431+0000","last_active":"2024-09-19T14:11:31.647830+0000","last_peered":"2024-09-19T14:11:31.647830+0000","last_clean":"2024-09-19T14:11:31.647830+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:11:31.647830+0000","last_undegraded":"2024-09-19T14:11:31.647830+0000","last_fullsized":"2024-09-19T14:11:31.647830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:56.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732554+0000","last_change":"2024-09-19T13:52:48.558710+0000","last_active":"2024-09-19T14:11:31.732554+0000","last_peered":"2024-09-19T14:11:31.732554+0000","last_clean":"2024-09-19T14:11:31.732554+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:11:31.732554+0000","last_undegraded":"2024-09-19T14:11:31.732554+0000","last_fullsized":"2024-09-19T14:11:31.732554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:43.224289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599659+0000","last_change":"2024-09-19T13:51:15.739209+0000","last_active":"2024-09-19T14:09:56.599659+0000","last_peered":"2024-09-19T14:09:56.599659+0000","last_clean":"2024-09-19T14:09:56.599659+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:09:56.599659+0000","last_undegraded":"2024-09-19T14:09:56.599659+0000","last_fullsized":"2024-09-19T14:09:56.599659+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:48.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602888+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:10:16.602888+0000","last_peered":"2024-09-19T14:10:16.602888+0000","last_clean":"2024-09-19T14:10:16.602888+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:10:16.602888+0000","last_undegraded":"2024-09-19T14:10:16.602888+0000","last_fullsized":"2024-09-19T14:10:16.602888+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:48.528788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732599+0000","last_change":"2024-09-19T13:52:51.580249+0000","last_active":"2024-09-19T14:11:31.732599+0000","last_peered":"2024-09-19T14:11:31.732599+0000","last_clean":"2024-09-19T14:11:31.732599+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:11:31.732599+0000","last_undegraded":"2024-09-19T14:11:31.732599+0000","last_fullsized":"2024-09-19T14:11:31.732599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:23.302145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722601+0000","last_change":"2024-09-19T13:52:48.548153+0000","last_active":"2024-09-19T14:11:31.722601+0000","last_peered":"2024-09-19T14:11:31.722601+0000","last_clean":"2024-09-19T14:11:31.722601+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:11:31.722601+0000","last_undegraded":"2024-09-19T14:11:31.722601+0000","last_fullsized":"2024-09-19T14:11:31.722601+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:48.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":214,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718953+0000","last_change":"2024-09-19T13:51:15.736147+0000","last_active":"2024-09-19T14:09:56.718953+0000","last_peered":"2024-09-19T14:09:56.718953+0000","last_clean":"2024-09-19T14:09:56.718953+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:09:56.718953+0000","last_undegraded":"2024-09-19T14:09:56.718953+0000","last_fullsized":"2024-09-19T14:09:56.718953+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:46:19.842918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723422+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:10:26.723422+0000","last_peered":"2024-09-19T14:10:26.723422+0000","last_clean":"2024-09-19T14:10:26.723422+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:10:26.723422+0000","last_undegraded":"2024-09-19T14:10:26.723422+0000","last_fullsized":"2024-09-19T14:10:26.723422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:18.667527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722586+0000","last_change":"2024-09-19T13:52:51.585924+0000","last_active":"2024-09-19T14:11:31.722586+0000","last_peered":"2024-09-19T14:11:31.722586+0000","last_clean":"2024-09-19T14:11:31.722586+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:11:31.722586+0000","last_undegraded":"2024-09-19T14:11:31.722586+0000","last_fullsized":"2024-09-19T14:11:31.722586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:33.073773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18432,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'8","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611549+0000","last_change":"2024-09-19T13:52:48.547186+0000","last_active":"2024-09-19T14:11:31.611549+0000","last_peered":"2024-09-19T14:11:31.611549+0000","last_clean":"2024-09-19T14:11:31.611549+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:11:31.611549+0000","last_undegraded":"2024-09-19T14:11:31.611549+0000","last_fullsized":"2024-09-19T14:11:31.611549+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:31.825750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339881,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":26674,"num_write":8,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.377489+0000","last_change":"2024-09-19T13:51:15.745411+0000","last_active":"2024-09-19T14:12:01.377489+0000","last_peered":"2024-09-19T14:12:01.377489+0000","last_clean":"2024-09-19T14:12:01.377489+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:12:01.377489+0000","last_undegraded":"2024-09-19T14:12:01.377489+0000","last_fullsized":"2024-09-19T14:12:01.377489+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:56.436504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820573+0000","last_change":"2024-09-19T14:03:08.839556+0000","last_active":"2024-09-19T14:11:51.820573+0000","last_peered":"2024-09-19T14:11:51.820573+0000","last_clean":"2024-09-19T14:11:51.820573+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:11:51.820573+0000","last_undegraded":"2024-09-19T14:11:51.820573+0000","last_fullsized":"2024-09-19T14:11:51.820573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:45.080550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'6","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726983+0000","last_change":"2024-09-19T13:52:51.578477+0000","last_active":"2024-09-19T14:10:51.726983+0000","last_peered":"2024-09-19T14:10:51.726983+0000","last_clean":"2024-09-19T14:10:51.726983+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:10:51.726983+0000","last_undegraded":"2024-09-19T14:10:51.726983+0000","last_fullsized":"2024-09-19T14:10:51.726983+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:50.156854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'1","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740989+0000","last_change":"2024-09-19T13:52:48.558154+0000","last_active":"2024-09-19T14:10:51.740989+0000","last_peered":"2024-09-19T14:10:51.740989+0000","last_clean":"2024-09-19T14:10:51.740989+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:10:51.740989+0000","last_undegraded":"2024-09-19T14:10:51.740989+0000","last_fullsized":"2024-09-19T14:10:51.740989+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:17.554459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733289+0000","last_change":"2024-09-19T13:51:15.743194+0000","last_active":"2024-09-19T14:11:36.733289+0000","last_peered":"2024-09-19T14:11:36.733289+0000","last_clean":"2024-09-19T14:11:36.733289+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:11:36.733289+0000","last_undegraded":"2024-09-19T14:11:36.733289+0000","last_fullsized":"2024-09-19T14:11:36.733289+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:50.338128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732215+0000","last_change":"2024-09-19T14:03:08.841430+0000","last_active":"2024-09-19T14:09:56.732215+0000","last_peered":"2024-09-19T14:09:56.732215+0000","last_clean":"2024-09-19T14:09:56.732215+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:09:56.732215+0000","last_undegraded":"2024-09-19T14:09:56.732215+0000","last_fullsized":"2024-09-19T14:09:56.732215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:02.341745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726947+0000","last_change":"2024-09-19T13:52:51.585844+0000","last_active":"2024-09-19T14:10:51.726947+0000","last_peered":"2024-09-19T14:10:51.726947+0000","last_clean":"2024-09-19T14:10:51.726947+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:10:51.726947+0000","last_undegraded":"2024-09-19T14:10:51.726947+0000","last_fullsized":"2024-09-19T14:10:51.726947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:51.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813367+0000","last_change":"2024-09-19T13:52:48.558799+0000","last_active":"2024-09-19T14:10:51.813367+0000","last_peered":"2024-09-19T14:10:51.813367+0000","last_clean":"2024-09-19T14:10:51.813367+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:10:51.813367+0000","last_undegraded":"2024-09-19T14:10:51.813367+0000","last_fullsized":"2024-09-19T14:10:51.813367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:02.090671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.123898+0000","last_change":"2024-09-19T13:51:15.747319+0000","last_active":"2024-09-19T14:12:01.123898+0000","last_peered":"2024-09-19T14:12:01.123898+0000","last_clean":"2024-09-19T14:12:01.123898+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:12:01.123898+0000","last_undegraded":"2024-09-19T14:12:01.123898+0000","last_fullsized":"2024-09-19T14:12:01.123898+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:36.553112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.725348+0000","last_change":"2024-09-19T14:03:08.837522+0000","last_active":"2024-09-19T14:11:51.725348+0000","last_peered":"2024-09-19T14:11:51.725348+0000","last_clean":"2024-09-19T14:11:51.725348+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:11:51.725348+0000","last_undegraded":"2024-09-19T14:11:51.725348+0000","last_fullsized":"2024-09-19T14:11:51.725348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:20.683332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643598+0000","last_change":"2024-09-19T13:52:51.586120+0000","last_active":"2024-09-19T14:10:56.643598+0000","last_peered":"2024-09-19T14:10:56.643598+0000","last_clean":"2024-09-19T14:10:56.643598+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:10:56.643598+0000","last_undegraded":"2024-09-19T14:10:56.643598+0000","last_fullsized":"2024-09-19T14:10:56.643598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:59.884434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.607991+0000","last_change":"2024-09-19T13:52:48.554380+0000","last_active":"2024-09-19T14:10:51.607991+0000","last_peered":"2024-09-19T14:10:51.607991+0000","last_clean":"2024-09-19T14:10:51.607991+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:10:51.607991+0000","last_undegraded":"2024-09-19T14:10:51.607991+0000","last_fullsized":"2024-09-19T14:10:51.607991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:07.309256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722642+0000","last_change":"2024-09-19T13:51:15.747867+0000","last_active":"2024-09-19T14:11:31.722642+0000","last_peered":"2024-09-19T14:11:31.722642+0000","last_clean":"2024-09-19T14:11:31.722642+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:11:31.722642+0000","last_undegraded":"2024-09-19T14:11:31.722642+0000","last_fullsized":"2024-09-19T14:11:31.722642+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749807+0000","last_change":"2024-09-19T14:03:08.841866+0000","last_active":"2024-09-19T14:11:51.749807+0000","last_peered":"2024-09-19T14:11:51.749807+0000","last_clean":"2024-09-19T14:11:51.749807+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:11:51.749807+0000","last_undegraded":"2024-09-19T14:11:51.749807+0000","last_fullsized":"2024-09-19T14:11:51.749807+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:36.658533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727005+0000","last_change":"2024-09-19T13:52:51.582164+0000","last_active":"2024-09-19T14:10:51.727005+0000","last_peered":"2024-09-19T14:10:51.727005+0000","last_clean":"2024-09-19T14:10:51.727005+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:10:51.727005+0000","last_undegraded":"2024-09-19T14:10:51.727005+0000","last_fullsized":"2024-09-19T14:10:51.727005+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:27.713291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'7","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643565+0000","last_change":"2024-09-19T13:52:48.547009+0000","last_active":"2024-09-19T14:10:56.643565+0000","last_peered":"2024-09-19T14:10:56.643565+0000","last_clean":"2024-09-19T14:10:56.643565+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:10:56.643565+0000","last_undegraded":"2024-09-19T14:10:56.643565+0000","last_fullsized":"2024-09-19T14:10:56.643565+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:40.726822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.310015+0000","last_change":"2024-09-19T13:51:15.740368+0000","last_active":"2024-09-19T14:11:59.310015+0000","last_peered":"2024-09-19T14:11:59.310015+0000","last_clean":"2024-09-19T14:11:59.310015+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:11:59.310015+0000","last_undegraded":"2024-09-19T14:11:59.310015+0000","last_fullsized":"2024-09-19T14:11:59.310015+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.326002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718769+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:09:56.718769+0000","last_peered":"2024-09-19T14:09:56.718769+0000","last_clean":"2024-09-19T14:09:56.718769+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:09:56.718769+0000","last_undegraded":"2024-09-19T14:09:56.718769+0000","last_fullsized":"2024-09-19T14:09:56.718769+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:23.564561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'3","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721393+0000","last_change":"2024-09-19T13:52:51.584114+0000","last_active":"2024-09-19T14:10:11.721393+0000","last_peered":"2024-09-19T14:10:11.721393+0000","last_clean":"2024-09-19T14:10:11.721393+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:10:11.721393+0000","last_undegraded":"2024-09-19T14:10:11.721393+0000","last_fullsized":"2024-09-19T14:10:11.721393+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:15.511565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.601992+0000","last_change":"2024-09-19T13:52:48.555321+0000","last_active":"2024-09-19T14:10:11.601992+0000","last_peered":"2024-09-19T14:10:11.601992+0000","last_clean":"2024-09-19T14:10:11.601992+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:10:11.601992+0000","last_undegraded":"2024-09-19T14:10:11.601992+0000","last_fullsized":"2024-09-19T14:10:11.601992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:35.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613130+0000","last_change":"2024-09-19T13:51:15.743442+0000","last_active":"2024-09-19T14:11:31.613130+0000","last_peered":"2024-09-19T14:11:31.613130+0000","last_clean":"2024-09-19T14:11:31.613130+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:11:31.613130+0000","last_undegraded":"2024-09-19T14:11:31.613130+0000","last_fullsized":"2024-09-19T14:11:31.613130+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:06.945466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.733045+0000","last_change":"2024-09-19T14:03:08.843681+0000","last_active":"2024-09-19T14:10:01.733045+0000","last_peered":"2024-09-19T14:10:01.733045+0000","last_clean":"2024-09-19T14:10:01.733045+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:10:01.733045+0000","last_undegraded":"2024-09-19T14:10:01.733045+0000","last_fullsized":"2024-09-19T14:10:01.733045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:00.158335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734797+0000","last_change":"2024-09-19T13:52:51.586345+0000","last_active":"2024-09-19T14:10:11.734797+0000","last_peered":"2024-09-19T14:10:11.734797+0000","last_clean":"2024-09-19T14:10:11.734797+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:10:11.734797+0000","last_undegraded":"2024-09-19T14:10:11.734797+0000","last_fullsized":"2024-09-19T14:10:11.734797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.184586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636840+0000","last_change":"2024-09-19T13:52:48.546287+0000","last_active":"2024-09-19T14:10:11.636840+0000","last_peered":"2024-09-19T14:10:11.636840+0000","last_clean":"2024-09-19T14:10:11.636840+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:10:11.636840+0000","last_undegraded":"2024-09-19T14:10:11.636840+0000","last_fullsized":"2024-09-19T14:10:11.636840+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:25.721235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:13.401604+0000","last_change":"2024-09-19T13:51:15.743432+0000","last_active":"2024-09-19T14:11:13.401604+0000","last_peered":"2024-09-19T14:11:13.401604+0000","last_clean":"2024-09-19T14:11:13.401604+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:11:13.401604+0000","last_undegraded":"2024-09-19T14:11:13.401604+0000","last_fullsized":"2024-09-19T14:11:13.401604+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:33.234941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732266+0000","last_change":"2024-09-19T14:03:08.842574+0000","last_active":"2024-09-19T14:09:56.732266+0000","last_peered":"2024-09-19T14:09:56.732266+0000","last_clean":"2024-09-19T14:09:56.732266+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:09:56.732266+0000","last_undegraded":"2024-09-19T14:09:56.732266+0000","last_fullsized":"2024-09-19T14:09:56.732266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:57.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.642788+0000","last_change":"2024-09-19T13:52:51.583284+0000","last_active":"2024-09-19T14:10:51.642788+0000","last_peered":"2024-09-19T14:10:51.642788+0000","last_clean":"2024-09-19T14:10:51.642788+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:10:51.642788+0000","last_undegraded":"2024-09-19T14:10:51.642788+0000","last_fullsized":"2024-09-19T14:10:51.642788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:42.843357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602834+0000","last_change":"2024-09-19T13:52:48.557637+0000","last_active":"2024-09-19T14:10:16.602834+0000","last_peered":"2024-09-19T14:10:16.602834+0000","last_clean":"2024-09-19T14:10:16.602834+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:10:16.602834+0000","last_undegraded":"2024-09-19T14:10:16.602834+0000","last_fullsized":"2024-09-19T14:10:16.602834+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:06.589139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.726202+0000","last_change":"2024-09-19T13:51:15.742226+0000","last_active":"2024-09-19T14:10:46.726202+0000","last_peered":"2024-09-19T14:10:46.726202+0000","last_clean":"2024-09-19T14:10:46.726202+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:10:46.726202+0000","last_undegraded":"2024-09-19T14:10:46.726202+0000","last_fullsized":"2024-09-19T14:10:46.726202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:54.177354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599771+0000","last_change":"2024-09-19T14:03:08.836511+0000","last_active":"2024-09-19T14:09:56.599771+0000","last_peered":"2024-09-19T14:09:56.599771+0000","last_clean":"2024-09-19T14:09:56.599771+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:09:56.599771+0000","last_undegraded":"2024-09-19T14:09:56.599771+0000","last_fullsized":"2024-09-19T14:09:56.599771+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:37.198257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.735788+0000","last_change":"2024-09-19T13:52:51.586838+0000","last_active":"2024-09-19T14:10:16.735788+0000","last_peered":"2024-09-19T14:10:16.735788+0000","last_clean":"2024-09-19T14:10:16.735788+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:10:16.735788+0000","last_undegraded":"2024-09-19T14:10:16.735788+0000","last_fullsized":"2024-09-19T14:10:16.735788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:15.962404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727446+0000","last_change":"2024-09-19T13:52:48.556403+0000","last_active":"2024-09-19T14:10:51.727446+0000","last_peered":"2024-09-19T14:10:51.727446+0000","last_clean":"2024-09-19T14:10:51.727446+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:10:51.727446+0000","last_undegraded":"2024-09-19T14:10:51.727446+0000","last_fullsized":"2024-09-19T14:10:51.727446+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:20.551373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.716860+0000","last_change":"2024-09-19T13:51:15.746021+0000","last_active":"2024-09-19T14:10:46.716860+0000","last_peered":"2024-09-19T14:10:46.716860+0000","last_clean":"2024-09-19T14:10:46.716860+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:10:46.716860+0000","last_undegraded":"2024-09-19T14:10:46.716860+0000","last_fullsized":"2024-09-19T14:10:46.716860+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:23.497158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.746520+0000","last_change":"2024-09-19T14:03:08.843561+0000","last_active":"2024-09-19T14:11:31.746520+0000","last_peered":"2024-09-19T14:11:31.746520+0000","last_clean":"2024-09-19T14:11:31.746520+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:11:31.746520+0000","last_undegraded":"2024-09-19T14:11:31.746520+0000","last_fullsized":"2024-09-19T14:11:31.746520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:24.992091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614667+0000","last_change":"2024-09-19T13:52:51.586079+0000","last_active":"2024-09-19T14:11:41.614667+0000","last_peered":"2024-09-19T14:11:41.614667+0000","last_clean":"2024-09-19T14:11:41.614667+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:11:41.614667+0000","last_undegraded":"2024-09-19T14:11:41.614667+0000","last_fullsized":"2024-09-19T14:11:41.614667+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:06.216009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747325+0000","last_change":"2024-09-19T13:52:48.554440+0000","last_active":"2024-09-19T14:11:36.747325+0000","last_peered":"2024-09-19T14:11:36.747325+0000","last_clean":"2024-09-19T14:11:36.747325+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:11:36.747325+0000","last_undegraded":"2024-09-19T14:11:36.747325+0000","last_fullsized":"2024-09-19T14:11:36.747325+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:31.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.607300+0000","last_change":"2024-09-19T13:51:15.740499+0000","last_active":"2024-09-19T14:10:46.607300+0000","last_peered":"2024-09-19T14:10:46.607300+0000","last_clean":"2024-09-19T14:10:46.607300+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:10:46.607300+0000","last_undegraded":"2024-09-19T14:10:46.607300+0000","last_fullsized":"2024-09-19T14:10:46.607300+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:10.208746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611531+0000","last_change":"2024-09-19T14:03:08.840165+0000","last_active":"2024-09-19T14:11:31.611531+0000","last_peered":"2024-09-19T14:11:31.611531+0000","last_clean":"2024-09-19T14:11:31.611531+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:11:31.611531+0000","last_undegraded":"2024-09-19T14:11:31.611531+0000","last_fullsized":"2024-09-19T14:11:31.611531+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:26.897102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613946+0000","last_change":"2024-09-19T13:52:51.587531+0000","last_active":"2024-09-19T14:11:36.613946+0000","last_peered":"2024-09-19T14:11:36.613946+0000","last_clean":"2024-09-19T14:11:36.613946+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:11:36.613946+0000","last_undegraded":"2024-09-19T14:11:36.613946+0000","last_fullsized":"2024-09-19T14:11:36.613946+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:31.550230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818442+0000","last_change":"2024-09-19T13:52:48.558491+0000","last_active":"2024-09-19T14:11:36.818442+0000","last_peered":"2024-09-19T14:11:36.818442+0000","last_clean":"2024-09-19T14:11:36.818442+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:11:36.818442+0000","last_undegraded":"2024-09-19T14:11:36.818442+0000","last_fullsized":"2024-09-19T14:11:36.818442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:47.947923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.610873+0000","last_change":"2024-09-19T13:51:15.745899+0000","last_active":"2024-09-19T14:11:11.610873+0000","last_peered":"2024-09-19T14:11:11.610873+0000","last_clean":"2024-09-19T14:11:11.610873+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:11:11.610873+0000","last_undegraded":"2024-09-19T14:11:11.610873+0000","last_fullsized":"2024-09-19T14:11:11.610873+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:38.734235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645917+0000","last_change":"2024-09-19T14:03:08.834382+0000","last_active":"2024-09-19T14:11:16.645917+0000","last_peered":"2024-09-19T14:11:16.645917+0000","last_clean":"2024-09-19T14:11:16.645917+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:11:16.645917+0000","last_undegraded":"2024-09-19T14:11:16.645917+0000","last_fullsized":"2024-09-19T14:11:16.645917+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:23.550035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734947+0000","last_change":"2024-09-19T13:52:51.587324+0000","last_active":"2024-09-19T14:10:11.734947+0000","last_peered":"2024-09-19T14:10:11.734947+0000","last_clean":"2024-09-19T14:10:11.734947+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:10:11.734947+0000","last_undegraded":"2024-09-19T14:10:11.734947+0000","last_fullsized":"2024-09-19T14:10:11.734947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:31.730122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600809+0000","last_change":"2024-09-19T13:52:48.553095+0000","last_active":"2024-09-19T14:10:11.600809+0000","last_peered":"2024-09-19T14:10:11.600809+0000","last_clean":"2024-09-19T14:10:11.600809+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:10:11.600809+0000","last_undegraded":"2024-09-19T14:10:11.600809+0000","last_fullsized":"2024-09-19T14:10:11.600809+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:06.522712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752646+0000","last_change":"2024-09-19T13:51:15.745034+0000","last_active":"2024-09-19T14:12:11.752646+0000","last_peered":"2024-09-19T14:12:11.752646+0000","last_clean":"2024-09-19T14:12:11.752646+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:12:11.752646+0000","last_undegraded":"2024-09-19T14:12:11.752646+0000","last_fullsized":"2024-09-19T14:12:11.752646+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.684247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732364+0000","last_change":"2024-09-19T14:03:08.839316+0000","last_active":"2024-09-19T14:11:31.732364+0000","last_peered":"2024-09-19T14:11:31.732364+0000","last_clean":"2024-09-19T14:11:31.732364+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:11:31.732364+0000","last_undegraded":"2024-09-19T14:11:31.732364+0000","last_fullsized":"2024-09-19T14:11:31.732364+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:47.115178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721502+0000","last_change":"2024-09-19T13:52:51.583041+0000","last_active":"2024-09-19T14:10:11.721502+0000","last_peered":"2024-09-19T14:10:11.721502+0000","last_clean":"2024-09-19T14:10:11.721502+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:10:11.721502+0000","last_undegraded":"2024-09-19T14:10:11.721502+0000","last_fullsized":"2024-09-19T14:10:11.721502+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:32.304868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'1","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734967+0000","last_change":"2024-09-19T13:52:48.558143+0000","last_active":"2024-09-19T14:10:11.734967+0000","last_peered":"2024-09-19T14:10:11.734967+0000","last_clean":"2024-09-19T14:10:11.734967+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:10:11.734967+0000","last_undegraded":"2024-09-19T14:10:11.734967+0000","last_fullsized":"2024-09-19T14:10:11.734967+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:09.148223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.652462+0000","last_change":"2024-09-19T13:51:15.746992+0000","last_active":"2024-09-19T14:12:06.652462+0000","last_peered":"2024-09-19T14:12:06.652462+0000","last_clean":"2024-09-19T14:12:06.652462+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:12:06.652462+0000","last_undegraded":"2024-09-19T14:12:06.652462+0000","last_fullsized":"2024-09-19T14:12:06.652462+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:59.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820648+0000","last_change":"2024-09-19T14:03:08.835971+0000","last_active":"2024-09-19T14:11:51.820648+0000","last_peered":"2024-09-19T14:11:51.820648+0000","last_clean":"2024-09-19T14:11:51.820648+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:11:51.820648+0000","last_undegraded":"2024-09-19T14:11:51.820648+0000","last_fullsized":"2024-09-19T14:11:51.820648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:49.881174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648494+0000","last_change":"2024-09-19T13:52:51.582819+0000","last_active":"2024-09-19T14:11:36.648494+0000","last_peered":"2024-09-19T14:11:36.648494+0000","last_clean":"2024-09-19T14:11:36.648494+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:11:36.648494+0000","last_undegraded":"2024-09-19T14:11:36.648494+0000","last_fullsized":"2024-09-19T14:11:36.648494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:43.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.741650+0000","last_change":"2024-09-19T13:52:48.556826+0000","last_active":"2024-09-19T14:10:56.741650+0000","last_peered":"2024-09-19T14:10:56.741650+0000","last_clean":"2024-09-19T14:10:56.741650+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:10:56.741650+0000","last_undegraded":"2024-09-19T14:10:56.741650+0000","last_fullsized":"2024-09-19T14:10:56.741650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:39.933207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.616079+0000","last_change":"2024-09-19T13:51:15.742662+0000","last_active":"2024-09-19T14:12:06.616079+0000","last_peered":"2024-09-19T14:12:06.616079+0000","last_clean":"2024-09-19T14:12:06.616079+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:12:06.616079+0000","last_undegraded":"2024-09-19T14:12:06.616079+0000","last_fullsized":"2024-09-19T14:12:06.616079+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:47.205807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.616208+0000","last_change":"2024-09-19T14:03:08.837483+0000","last_active":"2024-09-19T14:11:51.616208+0000","last_peered":"2024-09-19T14:11:51.616208+0000","last_clean":"2024-09-19T14:11:51.616208+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:11:51.616208+0000","last_undegraded":"2024-09-19T14:11:51.616208+0000","last_fullsized":"2024-09-19T14:11:51.616208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:43.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.607103+0000","last_change":"2024-09-19T13:52:51.582481+0000","last_active":"2024-09-19T14:10:56.607103+0000","last_peered":"2024-09-19T14:10:56.607103+0000","last_clean":"2024-09-19T14:10:56.607103+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:10:56.607103+0000","last_undegraded":"2024-09-19T14:10:56.607103+0000","last_fullsized":"2024-09-19T14:10:56.607103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.118790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747273+0000","last_change":"2024-09-19T13:52:48.558237+0000","last_active":"2024-09-19T14:11:36.747273+0000","last_peered":"2024-09-19T14:11:36.747273+0000","last_clean":"2024-09-19T14:11:36.747273+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:11:36.747273+0000","last_undegraded":"2024-09-19T14:11:36.747273+0000","last_fullsized":"2024-09-19T14:11:36.747273+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:14.742516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.737132+0000","last_change":"2024-09-19T13:51:15.739439+0000","last_active":"2024-09-19T14:12:06.737132+0000","last_peered":"2024-09-19T14:12:06.737132+0000","last_clean":"2024-09-19T14:12:06.737132+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:12:06.737132+0000","last_undegraded":"2024-09-19T14:12:06.737132+0000","last_fullsized":"2024-09-19T14:12:06.737132+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:29.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613161+0000","last_change":"2024-09-19T14:03:08.843652+0000","last_active":"2024-09-19T14:11:31.613161+0000","last_peered":"2024-09-19T14:11:31.613161+0000","last_clean":"2024-09-19T14:11:31.613161+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:11:31.613161+0000","last_undegraded":"2024-09-19T14:11:31.613161+0000","last_fullsized":"2024-09-19T14:11:31.613161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:18.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'6","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723289+0000","last_change":"2024-09-19T13:52:51.584999+0000","last_active":"2024-09-19T14:11:36.723289+0000","last_peered":"2024-09-19T14:11:36.723289+0000","last_clean":"2024-09-19T14:11:36.723289+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:11:36.723289+0000","last_undegraded":"2024-09-19T14:11:36.723289+0000","last_fullsized":"2024-09-19T14:11:36.723289+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:06.878095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21053,"num_write":11,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648525+0000","last_change":"2024-09-19T13:52:48.554967+0000","last_active":"2024-09-19T14:11:36.648525+0000","last_peered":"2024-09-19T14:11:36.648525+0000","last_clean":"2024-09-19T14:11:36.648525+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:11:36.648525+0000","last_undegraded":"2024-09-19T14:11:36.648525+0000","last_fullsized":"2024-09-19T14:11:36.648525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:11.689955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.726954+0000","last_change":"2024-09-19T13:51:15.746342+0000","last_active":"2024-09-19T14:12:06.726954+0000","last_peered":"2024-09-19T14:12:06.726954+0000","last_clean":"2024-09-19T14:12:06.726954+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:12:06.726954+0000","last_undegraded":"2024-09-19T14:12:06.726954+0000","last_fullsized":"2024-09-19T14:12:06.726954+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:44.550078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747359+0000","last_change":"2024-09-19T14:03:08.842987+0000","last_active":"2024-09-19T14:11:36.747359+0000","last_peered":"2024-09-19T14:11:36.747359+0000","last_clean":"2024-09-19T14:11:36.747359+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:11:36.747359+0000","last_undegraded":"2024-09-19T14:11:36.747359+0000","last_fullsized":"2024-09-19T14:11:36.747359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:51.898754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733214+0000","last_change":"2024-09-19T13:52:51.581838+0000","last_active":"2024-09-19T14:11:36.733214+0000","last_peered":"2024-09-19T14:11:36.733214+0000","last_clean":"2024-09-19T14:11:36.733214+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:11:36.733214+0000","last_undegraded":"2024-09-19T14:11:36.733214+0000","last_fullsized":"2024-09-19T14:11:36.733214+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:20.245214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108793,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":214,"num_write":2,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723307+0000","last_change":"2024-09-19T13:52:48.546981+0000","last_active":"2024-09-19T14:11:36.723307+0000","last_peered":"2024-09-19T14:11:36.723307+0000","last_clean":"2024-09-19T14:11:36.723307+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:11:36.723307+0000","last_undegraded":"2024-09-19T14:11:36.723307+0000","last_fullsized":"2024-09-19T14:11:36.723307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:09.807617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.748475+0000","last_change":"2024-09-19T13:51:15.745532+0000","last_active":"2024-09-19T14:11:22.748475+0000","last_peered":"2024-09-19T14:11:22.748475+0000","last_clean":"2024-09-19T14:11:22.748475+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:11:22.748475+0000","last_undegraded":"2024-09-19T14:11:22.748475+0000","last_fullsized":"2024-09-19T14:11:22.748475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:14.528177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'190","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.408408+0000","last_change":"2024-09-19T13:36:07.808934+0000","last_active":"2024-09-19T14:12:12.408408+0000","last_peered":"2024-09-19T14:12:12.408408+0000","last_clean":"2024-09-19T14:12:12.408408+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:12:12.408408+0000","last_undegraded":"2024-09-19T14:12:12.408408+0000","last_fullsized":"2024-09-19T14:12:12.408408+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:00.228367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7200863,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":14767,"num_write":954,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'808","reported_seq":2383,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544116+0000","last_change":"2024-09-19T13:36:09.334352+0000","last_active":"2024-09-19T14:12:15.544116+0000","last_peered":"2024-09-19T14:12:15.544116+0000","last_clean":"2024-09-19T14:12:15.544116+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:12:15.544116+0000","last_undegraded":"2024-09-19T14:12:15.544116+0000","last_fullsized":"2024-09-19T14:12:15.544116+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:03.775963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648600+0000","last_change":"2024-09-19T13:36:07.810255+0000","last_active":"2024-09-19T14:11:36.648600+0000","last_peered":"2024-09-19T14:11:36.648600+0000","last_clean":"2024-09-19T14:11:36.648600+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:11:36.648600+0000","last_undegraded":"2024-09-19T14:11:36.648600+0000","last_fullsized":"2024-09-19T14:11:36.648600+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:57.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":5759,"num_write":872,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'700","reported_seq":2388,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607197+0000","last_change":"2024-09-19T13:36:09.341109+0000","last_active":"2024-09-19T14:12:13.607197+0000","last_peered":"2024-09-19T14:12:13.607197+0000","last_clean":"2024-09-19T14:12:13.607197+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:12:13.607197+0000","last_undegraded":"2024-09-19T14:12:13.607197+0000","last_fullsized":"2024-09-19T14:12:13.607197+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.137955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'219","reported_seq":847,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613967+0000","last_change":"2024-09-19T13:36:07.802705+0000","last_active":"2024-09-19T14:11:36.613967+0000","last_peered":"2024-09-19T14:11:36.613967+0000","last_clean":"2024-09-19T14:11:36.613967+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:11:36.613967+0000","last_undegraded":"2024-09-19T14:11:36.613967+0000","last_fullsized":"2024-09-19T14:11:36.613967+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.788681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":12221,"num_write":1123,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'389","reported_seq":1859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260118+0000","last_change":"2024-09-19T13:36:09.331848+0000","last_active":"2024-09-19T14:12:20.260118+0000","last_peered":"2024-09-19T14:12:20.260118+0000","last_clean":"2024-09-19T14:12:20.260118+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:12:20.260118+0000","last_undegraded":"2024-09-19T14:12:20.260118+0000","last_fullsized":"2024-09-19T14:12:20.260118+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:25:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'216","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.617260+0000","last_change":"2024-09-19T13:36:07.812873+0000","last_active":"2024-09-19T14:12:16.617260+0000","last_peered":"2024-09-19T14:12:16.617260+0000","last_clean":"2024-09-19T14:12:16.617260+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:12:16.617260+0000","last_undegraded":"2024-09-19T14:12:16.617260+0000","last_fullsized":"2024-09-19T14:12:16.617260+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:44.575892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471640,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":9100,"num_write":1123,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'993","reported_seq":2638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.225812+0000","last_change":"2024-09-19T13:36:44.400454+0000","last_active":"2024-09-19T14:12:13.225812+0000","last_peered":"2024-09-19T14:12:13.225812+0000","last_clean":"2024-09-19T14:12:13.225812+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:12:13.225812+0000","last_undegraded":"2024-09-19T14:12:13.225812+0000","last_fullsized":"2024-09-19T14:12:13.225812+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.890102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'193","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.004337+0000","last_change":"2024-09-19T13:36:07.808137+0000","last_active":"2024-09-19T14:12:07.004337+0000","last_peered":"2024-09-19T14:12:07.004337+0000","last_clean":"2024-09-19T14:12:07.004337+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:12:07.004337+0000","last_undegraded":"2024-09-19T14:12:07.004337+0000","last_fullsized":"2024-09-19T14:12:07.004337+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:25.229167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439926,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":134002,"num_write":940,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'557","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176066+0000","last_change":"2024-09-19T13:36:09.334428+0000","last_active":"2024-09-19T14:12:26.176066+0000","last_peered":"2024-09-19T14:12:26.176066+0000","last_clean":"2024-09-19T14:12:26.176066+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:12:26.176066+0000","last_undegraded":"2024-09-19T14:12:26.176066+0000","last_fullsized":"2024-09-19T14:12:26.176066+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:02.385725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'189","reported_seq":762,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.695601+0000","last_change":"2024-09-19T13:36:07.816316+0000","last_active":"2024-09-19T14:11:31.695601+0000","last_peered":"2024-09-19T14:11:31.695601+0000","last_clean":"2024-09-19T14:11:31.695601+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:11:31.695601+0000","last_undegraded":"2024-09-19T14:11:31.695601+0000","last_fullsized":"2024-09-19T14:11:31.695601+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.797797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":377,"num_write":870,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'835","reported_seq":2442,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544277+0000","last_change":"2024-09-19T13:36:09.333458+0000","last_active":"2024-09-19T14:12:15.544277+0000","last_peered":"2024-09-19T14:12:15.544277+0000","last_clean":"2024-09-19T14:12:15.544277+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:12:15.544277+0000","last_undegraded":"2024-09-19T14:12:15.544277+0000","last_fullsized":"2024-09-19T14:12:15.544277+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.936303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'185","reported_seq":783,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:33.178972+0000","last_change":"2024-09-19T13:36:07.816581+0000","last_active":"2024-09-19T14:11:33.178972+0000","last_peered":"2024-09-19T14:11:33.178972+0000","last_clean":"2024-09-19T14:11:33.178972+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:11:33.178972+0000","last_undegraded":"2024-09-19T14:11:33.178972+0000","last_fullsized":"2024-09-19T14:11:33.178972+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:11.595208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7227774,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":7782,"num_write":889,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'502","reported_seq":2283,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226009+0000","last_change":"2024-09-19T13:36:09.343477+0000","last_active":"2024-09-19T14:12:13.226009+0000","last_peered":"2024-09-19T14:12:13.226009+0000","last_clean":"2024-09-19T14:12:13.226009+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:12:13.226009+0000","last_undegraded":"2024-09-19T14:12:13.226009+0000","last_fullsized":"2024-09-19T14:12:13.226009+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'191","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:29.597137+0000","last_change":"2024-09-19T13:36:07.807757+0000","last_active":"2024-09-19T14:11:29.597137+0000","last_peered":"2024-09-19T14:11:29.597137+0000","last_clean":"2024-09-19T14:11:29.597137+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:11:29.597137+0000","last_undegraded":"2024-09-19T14:11:29.597137+0000","last_fullsized":"2024-09-19T14:11:29.597137+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:20.739883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534370,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1086,"num_read_kb":38780,"num_write":952,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'842","reported_seq":2345,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819911+0000","last_change":"2024-09-19T13:36:09.343462+0000","last_active":"2024-09-19T14:12:14.819911+0000","last_peered":"2024-09-19T14:12:14.819911+0000","last_clean":"2024-09-19T14:12:14.819911+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:12:14.819911+0000","last_undegraded":"2024-09-19T14:12:14.819911+0000","last_fullsized":"2024-09-19T14:12:14.819911+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:58.095506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'549","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171201+0000","last_change":"2024-09-19T13:36:09.331543+0000","last_active":"2024-09-19T14:12:15.171201+0000","last_peered":"2024-09-19T14:12:15.171201+0000","last_clean":"2024-09-19T14:12:15.171201+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:12:15.171201+0000","last_undegraded":"2024-09-19T14:12:15.171201+0000","last_fullsized":"2024-09-19T14:12:15.171201+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.041550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'185","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:30.861841+0000","last_change":"2024-09-19T13:36:07.812427+0000","last_active":"2024-09-19T14:11:30.861841+0000","last_peered":"2024-09-19T14:11:30.861841+0000","last_clean":"2024-09-19T14:11:30.861841+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:11:30.861841+0000","last_undegraded":"2024-09-19T14:11:30.861841+0000","last_fullsized":"2024-09-19T14:11:30.861841+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:24.508499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12224342,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":11511,"num_write":890,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'380","reported_seq":1872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355286+0000","last_change":"2024-09-19T13:36:09.341235+0000","last_active":"2024-09-19T14:12:27.355286+0000","last_peered":"2024-09-19T14:12:27.355286+0000","last_clean":"2024-09-19T14:12:27.355286+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:12:27.355286+0000","last_undegraded":"2024-09-19T14:12:27.355286+0000","last_fullsized":"2024-09-19T14:12:27.355286+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:22.590894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'187","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.001105+0000","last_change":"2024-09-19T13:36:07.811910+0000","last_active":"2024-09-19T14:11:59.001105+0000","last_peered":"2024-09-19T14:11:59.001105+0000","last_clean":"2024-09-19T14:11:59.001105+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:11:59.001105+0000","last_undegraded":"2024-09-19T14:11:59.001105+0000","last_fullsized":"2024-09-19T14:11:59.001105+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:59.243018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277338,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":26719,"num_write":909,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'556","reported_seq":2179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882271+0000","last_change":"2024-09-19T13:36:09.336283+0000","last_active":"2024-09-19T14:12:15.882271+0000","last_peered":"2024-09-19T14:12:15.882271+0000","last_clean":"2024-09-19T14:12:15.882271+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:12:15.882271+0000","last_undegraded":"2024-09-19T14:12:15.882271+0000","last_fullsized":"2024-09-19T14:12:15.882271+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:45.974339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'215","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:09.696524+0000","last_change":"2024-09-19T13:36:44.401303+0000","last_active":"2024-09-19T14:12:09.696524+0000","last_peered":"2024-09-19T14:12:09.696524+0000","last_clean":"2024-09-19T14:12:09.696524+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:12:09.696524+0000","last_undegraded":"2024-09-19T14:12:09.696524+0000","last_fullsized":"2024-09-19T14:12:09.696524+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:04.996764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14025071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":619,"num_read_kb":31849,"num_write":1135,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'377","reported_seq":1908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260138+0000","last_change":"2024-09-19T13:36:09.337079+0000","last_active":"2024-09-19T14:12:20.260138+0000","last_peered":"2024-09-19T14:12:20.260138+0000","last_clean":"2024-09-19T14:12:20.260138+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:12:20.260138+0000","last_undegraded":"2024-09-19T14:12:20.260138+0000","last_fullsized":"2024-09-19T14:12:20.260138+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:50.941135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'202","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.779251+0000","last_change":"2024-09-19T13:36:07.806856+0000","last_active":"2024-09-19T14:12:12.779251+0000","last_peered":"2024-09-19T14:12:12.779251+0000","last_clean":"2024-09-19T14:12:12.779251+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:12:12.779251+0000","last_undegraded":"2024-09-19T14:12:12.779251+0000","last_fullsized":"2024-09-19T14:12:12.779251+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:01.787704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5491166,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":559,"num_read_kb":49502,"num_write":985,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'390","reported_seq":1995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176428+0000","last_change":"2024-09-19T13:36:09.324663+0000","last_active":"2024-09-19T14:12:26.176428+0000","last_peered":"2024-09-19T14:12:26.176428+0000","last_clean":"2024-09-19T14:12:26.176428+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:12:26.176428+0000","last_undegraded":"2024-09-19T14:12:26.176428+0000","last_fullsized":"2024-09-19T14:12:26.176428+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:16.398494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'190","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.103953+0000","last_change":"2024-09-19T13:36:07.807094+0000","last_active":"2024-09-19T14:13:45.103953+0000","last_peered":"2024-09-19T14:13:45.103953+0000","last_clean":"2024-09-19T14:13:45.103953+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:13:45.103953+0000","last_undegraded":"2024-09-19T14:13:45.103953+0000","last_fullsized":"2024-09-19T14:13:45.103953+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:17.714362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11536576,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":176003,"num_write":885,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'907","reported_seq":2603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176234+0000","last_change":"2024-09-19T13:36:09.331135+0000","last_active":"2024-09-19T14:12:26.176234+0000","last_peered":"2024-09-19T14:12:26.176234+0000","last_clean":"2024-09-19T14:12:26.176234+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:12:26.176234+0000","last_undegraded":"2024-09-19T14:12:26.176234+0000","last_fullsized":"2024-09-19T14:12:26.176234+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:01.836377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'239","reported_seq":900,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727853+0000","last_change":"2024-09-19T13:36:07.813101+0000","last_active":"2024-09-19T14:12:25.727853+0000","last_peered":"2024-09-19T14:12:25.727853+0000","last_clean":"2024-09-19T14:12:25.727853+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:12:25.727853+0000","last_undegraded":"2024-09-19T14:12:25.727853+0000","last_fullsized":"2024-09-19T14:12:25.727853+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:17.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33577113,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":112164,"num_write":1130,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'136","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.817689+0000","last_change":"2024-09-19T13:36:17.363690+0000","last_active":"2024-09-19T14:12:27.817689+0000","last_peered":"2024-09-19T14:12:27.817689+0000","last_clean":"2024-09-19T14:12:27.817689+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:12:27.817689+0000","last_undegraded":"2024-09-19T14:12:27.817689+0000","last_fullsized":"2024-09-19T14:12:27.817689+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:29.851738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'815","reported_seq":2311,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260090+0000","last_change":"2024-09-19T13:36:09.344275+0000","last_active":"2024-09-19T14:12:20.260090+0000","last_peered":"2024-09-19T14:12:20.260090+0000","last_clean":"2024-09-19T14:12:20.260090+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:12:20.260090+0000","last_undegraded":"2024-09-19T14:12:20.260090+0000","last_fullsized":"2024-09-19T14:12:20.260090+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:38.192022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'172","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.769129+0000","last_change":"2024-09-19T13:36:07.808149+0000","last_active":"2024-09-19T14:12:25.769129+0000","last_peered":"2024-09-19T14:12:25.769129+0000","last_clean":"2024-09-19T14:12:25.769129+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:12:25.769129+0000","last_undegraded":"2024-09-19T14:12:25.769129+0000","last_fullsized":"2024-09-19T14:12:25.769129+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:33.668595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12628349,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":648,"num_read_kb":47147,"num_write":842,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599370+0000","last_change":"2024-09-19T13:36:11.340404+0000","last_active":"2024-09-19T14:10:01.599370+0000","last_peered":"2024-09-19T14:10:01.599370+0000","last_clean":"2024-09-19T14:10:01.599370+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:10:01.599370+0000","last_undegraded":"2024-09-19T14:10:01.599370+0000","last_fullsized":"2024-09-19T14:10:01.599370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.755867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'190","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.621211+0000","last_change":"2024-09-19T13:36:13.346842+0000","last_active":"2024-09-19T14:12:31.621211+0000","last_peered":"2024-09-19T14:12:31.621211+0000","last_clean":"2024-09-19T14:12:31.621211+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:12:31.621211+0000","last_undegraded":"2024-09-19T14:12:31.621211+0000","last_fullsized":"2024-09-19T14:12:31.621211+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:09.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":253,"num_read_kb":352,"num_write":152,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733994+0000","last_change":"2024-09-19T13:36:15.353039+0000","last_active":"2024-09-19T14:10:06.733994+0000","last_peered":"2024-09-19T14:10:06.733994+0000","last_clean":"2024-09-19T14:10:06.733994+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:10:06.733994+0000","last_undegraded":"2024-09-19T14:10:06.733994+0000","last_fullsized":"2024-09-19T14:10:06.733994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:40.506433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2504","reported_seq":4316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.251946+0000","last_change":"2024-09-19T13:36:17.362187+0000","last_active":"2024-09-19T14:12:26.251946+0000","last_peered":"2024-09-19T14:12:26.251946+0000","last_clean":"2024-09-19T14:12:26.251946+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:12:26.251946+0000","last_undegraded":"2024-09-19T14:12:26.251946+0000","last_fullsized":"2024-09-19T14:12:26.251946+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:08.218008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'475","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819729+0000","last_change":"2024-09-19T13:36:09.335816+0000","last_active":"2024-09-19T14:12:14.819729+0000","last_peered":"2024-09-19T14:12:14.819729+0000","last_clean":"2024-09-19T14:12:14.819729+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:12:14.819729+0000","last_undegraded":"2024-09-19T14:12:14.819729+0000","last_fullsized":"2024-09-19T14:12:14.819729+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:08.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'168","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.882445+0000","last_change":"2024-09-19T13:36:07.812428+0000","last_active":"2024-09-19T14:11:58.882445+0000","last_peered":"2024-09-19T14:11:58.882445+0000","last_clean":"2024-09-19T14:11:58.882445+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:11:58.882445+0000","last_undegraded":"2024-09-19T14:11:58.882445+0000","last_fullsized":"2024-09-19T14:11:58.882445+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:55.799082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":369,"num_read_kb":36151,"num_write":773,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730615+0000","last_change":"2024-09-19T13:36:11.336313+0000","last_active":"2024-09-19T14:11:16.730615+0000","last_peered":"2024-09-19T14:11:16.730615+0000","last_clean":"2024-09-19T14:11:16.730615+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:11:16.730615+0000","last_undegraded":"2024-09-19T14:11:16.730615+0000","last_fullsized":"2024-09-19T14:11:16.730615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'78","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.395391+0000","last_change":"2024-09-19T13:36:13.337644+0000","last_active":"2024-09-19T14:12:14.395391+0000","last_peered":"2024-09-19T14:12:14.395391+0000","last_clean":"2024-09-19T14:12:14.395391+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:12:14.395391+0000","last_undegraded":"2024-09-19T14:12:14.395391+0000","last_fullsized":"2024-09-19T14:12:14.395391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.720756+0000","last_change":"2024-09-19T13:36:15.349335+0000","last_active":"2024-09-19T14:10:06.720756+0000","last_peered":"2024-09-19T14:10:06.720756+0000","last_clean":"2024-09-19T14:10:06.720756+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:10:06.720756+0000","last_undegraded":"2024-09-19T14:10:06.720756+0000","last_fullsized":"2024-09-19T14:10:06.720756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:03.785626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'134","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.878009+0000","last_change":"2024-09-19T13:36:17.360523+0000","last_active":"2024-09-19T14:12:15.878009+0000","last_peered":"2024-09-19T14:12:15.878009+0000","last_clean":"2024-09-19T14:12:15.878009+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:12:15.878009+0000","last_undegraded":"2024-09-19T14:12:15.878009+0000","last_fullsized":"2024-09-19T14:12:15.878009+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:18.406844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'833","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.865020+0000","last_change":"2024-09-19T13:36:09.338236+0000","last_active":"2024-09-19T14:13:45.865020+0000","last_peered":"2024-09-19T14:13:45.865020+0000","last_clean":"2024-09-19T14:13:45.865020+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:13:45.865020+0000","last_undegraded":"2024-09-19T14:13:45.865020+0000","last_fullsized":"2024-09-19T14:13:45.865020+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:40.242627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'163","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.361325+0000","last_change":"2024-09-19T13:36:07.806261+0000","last_active":"2024-09-19T14:11:34.361325+0000","last_peered":"2024-09-19T14:11:34.361325+0000","last_clean":"2024-09-19T14:11:34.361325+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:11:34.361325+0000","last_undegraded":"2024-09-19T14:11:34.361325+0000","last_fullsized":"2024-09-19T14:11:34.361325+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:30.372295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11079321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":63998,"num_write":815,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719618+0000","last_change":"2024-09-19T13:36:11.337174+0000","last_active":"2024-09-19T14:10:01.719618+0000","last_peered":"2024-09-19T14:10:01.719618+0000","last_clean":"2024-09-19T14:10:01.719618+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:10:01.719618+0000","last_undegraded":"2024-09-19T14:10:01.719618+0000","last_fullsized":"2024-09-19T14:10:01.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:56.806199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'103","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.682418+0000","last_change":"2024-09-19T13:36:13.342093+0000","last_active":"2024-09-19T14:12:06.682418+0000","last_peered":"2024-09-19T14:12:06.682418+0000","last_clean":"2024-09-19T14:12:06.682418+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:12:06.682418+0000","last_undegraded":"2024-09-19T14:12:06.682418+0000","last_fullsized":"2024-09-19T14:12:06.682418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.319447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'760","reported_seq":2062,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.050138+0000","last_change":"2024-09-19T13:36:15.353722+0000","last_active":"2024-09-19T14:13:47.050138+0000","last_peered":"2024-09-19T14:13:47.050138+0000","last_clean":"2024-09-19T14:13:47.050138+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:13:47.050138+0000","last_undegraded":"2024-09-19T14:13:47.050138+0000","last_fullsized":"2024-09-19T14:13:47.050138+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:26.683896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'275","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.861063+0000","last_change":"2024-09-19T13:36:17.362162+0000","last_active":"2024-09-19T14:12:27.861063+0000","last_peered":"2024-09-19T14:12:27.861063+0000","last_clean":"2024-09-19T14:12:27.861063+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:12:27.861063+0000","last_undegraded":"2024-09-19T14:12:27.861063+0000","last_fullsized":"2024-09-19T14:12:27.861063+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:30.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'431","reported_seq":1979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607238+0000","last_change":"2024-09-19T13:36:09.336191+0000","last_active":"2024-09-19T14:12:13.607238+0000","last_peered":"2024-09-19T14:12:13.607238+0000","last_clean":"2024-09-19T14:12:13.607238+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:12:13.607238+0000","last_undegraded":"2024-09-19T14:12:13.607238+0000","last_fullsized":"2024-09-19T14:12:13.607238+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:03.461778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'175","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.158614+0000","last_change":"2024-09-19T13:36:07.816563+0000","last_active":"2024-09-19T14:12:11.158614+0000","last_peered":"2024-09-19T14:12:11.158614+0000","last_clean":"2024-09-19T14:12:11.158614+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:12:11.158614+0000","last_undegraded":"2024-09-19T14:12:11.158614+0000","last_fullsized":"2024-09-19T14:12:11.158614+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:45.659866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21324016,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":442,"num_read_kb":22529,"num_write":867,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599419+0000","last_change":"2024-09-19T13:36:11.335988+0000","last_active":"2024-09-19T14:10:01.599419+0000","last_peered":"2024-09-19T14:10:01.599419+0000","last_clean":"2024-09-19T14:10:01.599419+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:10:01.599419+0000","last_undegraded":"2024-09-19T14:10:01.599419+0000","last_fullsized":"2024-09-19T14:10:01.599419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:16.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'111","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.755401+0000","last_change":"2024-09-19T13:36:13.678694+0000","last_active":"2024-09-19T14:12:31.755401+0000","last_peered":"2024-09-19T14:12:31.755401+0000","last_clean":"2024-09-19T14:12:31.755401+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:12:31.755401+0000","last_undegraded":"2024-09-19T14:12:31.755401+0000","last_fullsized":"2024-09-19T14:12:31.755401+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":236,"num_write":88,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'791","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.054231+0000","last_change":"2024-09-19T13:36:15.347048+0000","last_active":"2024-09-19T14:13:47.054231+0000","last_peered":"2024-09-19T14:13:47.054231+0000","last_clean":"2024-09-19T14:13:47.054231+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:13:47.054231+0000","last_undegraded":"2024-09-19T14:13:47.054231+0000","last_fullsized":"2024-09-19T14:13:47.054231+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:55.442266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'450","reported_seq":2022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226765+0000","last_change":"2024-09-19T13:36:09.334631+0000","last_active":"2024-09-19T14:12:13.226765+0000","last_peered":"2024-09-19T14:12:13.226765+0000","last_clean":"2024-09-19T14:12:13.226765+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:12:13.226765+0000","last_undegraded":"2024-09-19T14:12:13.226765+0000","last_fullsized":"2024-09-19T14:12:13.226765+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:01.778994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'232","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.304893+0000","last_change":"2024-09-19T13:36:07.809526+0000","last_active":"2024-09-19T14:12:01.304893+0000","last_peered":"2024-09-19T14:12:01.304893+0000","last_clean":"2024-09-19T14:12:01.304893+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:12:01.304893+0000","last_undegraded":"2024-09-19T14:12:01.304893+0000","last_fullsized":"2024-09-19T14:12:01.304893+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:56.101821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059510,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":46832,"num_write":1026,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740936+0000","last_change":"2024-09-19T13:36:11.332976+0000","last_active":"2024-09-19T14:10:51.740936+0000","last_peered":"2024-09-19T14:10:51.740936+0000","last_clean":"2024-09-19T14:10:51.740936+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:10:51.740936+0000","last_undegraded":"2024-09-19T14:10:51.740936+0000","last_fullsized":"2024-09-19T14:10:51.740936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:44.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'185","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:11.624593+0000","last_change":"2024-09-19T13:36:13.679868+0000","last_active":"2024-09-19T14:13:11.624593+0000","last_peered":"2024-09-19T14:13:11.624593+0000","last_clean":"2024-09-19T14:13:11.624593+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:13:11.624593+0000","last_undegraded":"2024-09-19T14:13:11.624593+0000","last_fullsized":"2024-09-19T14:13:11.624593+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:05.662964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":296,"num_write":138,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.635466+0000","last_change":"2024-09-19T13:36:15.351051+0000","last_active":"2024-09-19T14:10:01.635466+0000","last_peered":"2024-09-19T14:10:01.635466+0000","last_clean":"2024-09-19T14:10:01.635466+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:10:01.635466+0000","last_undegraded":"2024-09-19T14:10:01.635466+0000","last_fullsized":"2024-09-19T14:10:01.635466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:18.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'538","reported_seq":1352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.036523+0000","last_change":"2024-09-19T13:36:17.360774+0000","last_active":"2024-09-19T14:13:47.036523+0000","last_peered":"2024-09-19T14:13:47.036523+0000","last_clean":"2024-09-19T14:13:47.036523+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:13:47.036523+0000","last_undegraded":"2024-09-19T14:13:47.036523+0000","last_fullsized":"2024-09-19T14:13:47.036523+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355481+0000","last_change":"2024-09-19T13:36:09.332369+0000","last_active":"2024-09-19T14:12:27.355481+0000","last_peered":"2024-09-19T14:12:27.355481+0000","last_clean":"2024-09-19T14:12:27.355481+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:12:27.355481+0000","last_undegraded":"2024-09-19T14:12:27.355481+0000","last_fullsized":"2024-09-19T14:12:27.355481+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:59.620240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'197","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:29.355415+0000","last_change":"2024-09-19T13:36:07.806031+0000","last_active":"2024-09-19T14:11:29.355415+0000","last_peered":"2024-09-19T14:11:29.355415+0000","last_clean":"2024-09-19T14:11:29.355415+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:11:29.355415+0000","last_undegraded":"2024-09-19T14:11:29.355415+0000","last_fullsized":"2024-09-19T14:11:29.355415+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:23.397652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5298782,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":505,"num_read_kb":31454,"num_write":891,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"34'3","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.756819+0000","last_change":"2024-09-19T13:36:11.333511+0000","last_active":"2024-09-19T14:13:46.756819+0000","last_peered":"2024-09-19T14:13:46.756819+0000","last_clean":"2024-09-19T14:13:46.756819+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:13:46.756819+0000","last_undegraded":"2024-09-19T14:13:46.756819+0000","last_fullsized":"2024-09-19T14:13:46.756819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:38.186843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'122","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738418+0000","last_change":"2024-09-19T13:36:13.346402+0000","last_active":"2024-09-19T14:12:16.738418+0000","last_peered":"2024-09-19T14:12:16.738418+0000","last_clean":"2024-09-19T14:12:16.738418+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:12:16.738418+0000","last_undegraded":"2024-09-19T14:12:16.738418+0000","last_fullsized":"2024-09-19T14:12:16.738418+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:23.310060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":221,"num_write":80,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:01.728430+0000","last_change":"2024-09-19T13:36:15.346352+0000","last_active":"2024-09-19T14:11:01.728430+0000","last_peered":"2024-09-19T14:11:01.728430+0000","last_clean":"2024-09-19T14:11:01.728430+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:11:01.728430+0000","last_undegraded":"2024-09-19T14:11:01.728430+0000","last_fullsized":"2024-09-19T14:11:01.728430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:31.554437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'173","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.844081+0000","last_change":"2024-09-19T13:36:17.360996+0000","last_active":"2024-09-19T14:13:36.844081+0000","last_peered":"2024-09-19T14:13:36.844081+0000","last_clean":"2024-09-19T14:13:36.844081+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:13:36.844081+0000","last_undegraded":"2024-09-19T14:13:36.844081+0000","last_fullsized":"2024-09-19T14:13:36.844081+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:40.718784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'343","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.175897+0000","last_change":"2024-09-19T13:36:44.478051+0000","last_active":"2024-09-19T14:12:26.175897+0000","last_peered":"2024-09-19T14:12:26.175897+0000","last_clean":"2024-09-19T14:12:26.175897+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:12:26.175897+0000","last_undegraded":"2024-09-19T14:12:26.175897+0000","last_fullsized":"2024-09-19T14:12:26.175897+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:28:06.614029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'234","reported_seq":1057,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.697721+0000","last_change":"2024-09-19T13:36:07.812190+0000","last_active":"2024-09-19T14:12:03.697721+0000","last_peered":"2024-09-19T14:12:03.697721+0000","last_clean":"2024-09-19T14:12:03.697721+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:12:03.697721+0000","last_undegraded":"2024-09-19T14:12:03.697721+0000","last_fullsized":"2024-09-19T14:12:03.697721+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:32.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17101928,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1167,"num_read_kb":168929,"num_write":1048,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805690+0000","last_change":"2024-09-19T13:36:11.333725+0000","last_active":"2024-09-19T14:09:56.805690+0000","last_peered":"2024-09-19T14:09:56.805690+0000","last_clean":"2024-09-19T14:09:56.805690+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:09:56.805690+0000","last_undegraded":"2024-09-19T14:09:56.805690+0000","last_fullsized":"2024-09-19T14:09:56.805690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:01.253625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'157","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.866319+0000","last_change":"2024-09-19T13:36:13.348257+0000","last_active":"2024-09-19T14:13:45.866319+0000","last_peered":"2024-09-19T14:13:45.866319+0000","last_clean":"2024-09-19T14:13:45.866319+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:13:45.866319+0000","last_undegraded":"2024-09-19T14:13:45.866319+0000","last_fullsized":"2024-09-19T14:13:45.866319+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:53.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":224,"num_write":106,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'801","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.055129+0000","last_change":"2024-09-19T13:36:15.347632+0000","last_active":"2024-09-19T14:13:47.055129+0000","last_peered":"2024-09-19T14:13:47.055129+0000","last_clean":"2024-09-19T14:13:47.055129+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:13:47.055129+0000","last_undegraded":"2024-09-19T14:13:47.055129+0000","last_fullsized":"2024-09-19T14:13:47.055129+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:07.500173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.860638+0000","last_change":"2024-09-19T13:36:17.360696+0000","last_active":"2024-09-19T14:13:45.860638+0000","last_peered":"2024-09-19T14:13:45.860638+0000","last_clean":"2024-09-19T14:13:45.860638+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:13:45.860638+0000","last_undegraded":"2024-09-19T14:13:45.860638+0000","last_fullsized":"2024-09-19T14:13:45.860638+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:33.562231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'423","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.167396+0000","last_change":"2024-09-19T13:36:09.341941+0000","last_active":"2024-09-19T14:12:26.167396+0000","last_peered":"2024-09-19T14:12:26.167396+0000","last_clean":"2024-09-19T14:12:26.167396+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:12:26.167396+0000","last_undegraded":"2024-09-19T14:12:26.167396+0000","last_fullsized":"2024-09-19T14:12:26.167396+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:51.059363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'202","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.616585+0000","last_change":"2024-09-19T13:36:07.809548+0000","last_active":"2024-09-19T14:12:11.616585+0000","last_peered":"2024-09-19T14:12:11.616585+0000","last_clean":"2024-09-19T14:12:11.616585+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:12:11.616585+0000","last_undegraded":"2024-09-19T14:12:11.616585+0000","last_fullsized":"2024-09-19T14:12:11.616585+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:50.752222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9447432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":50665,"num_write":1022,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813329+0000","last_change":"2024-09-19T13:36:11.328331+0000","last_active":"2024-09-19T14:10:51.813329+0000","last_peered":"2024-09-19T14:10:51.813329+0000","last_clean":"2024-09-19T14:10:51.813329+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:10:51.813329+0000","last_undegraded":"2024-09-19T14:10:51.813329+0000","last_fullsized":"2024-09-19T14:10:51.813329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:34.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'182","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.001238+0000","last_change":"2024-09-19T13:36:13.346349+0000","last_active":"2024-09-19T14:13:47.001238+0000","last_peered":"2024-09-19T14:13:47.001238+0000","last_clean":"2024-09-19T14:13:47.001238+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:13:47.001238+0000","last_undegraded":"2024-09-19T14:13:47.001238+0000","last_fullsized":"2024-09-19T14:13:47.001238+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:53.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":249,"num_read_kb":370,"num_write":122,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.814113+0000","last_change":"2024-09-19T13:36:15.353964+0000","last_active":"2024-09-19T14:10:56.814113+0000","last_peered":"2024-09-19T14:10:56.814113+0000","last_clean":"2024-09-19T14:10:56.814113+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:10:56.814113+0000","last_undegraded":"2024-09-19T14:10:56.814113+0000","last_fullsized":"2024-09-19T14:10:56.814113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:04.430132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'170","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.168956+0000","last_change":"2024-09-19T13:36:17.362550+0000","last_active":"2024-09-19T14:12:15.168956+0000","last_peered":"2024-09-19T14:12:15.168956+0000","last_clean":"2024-09-19T14:12:15.168956+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:12:15.168956+0000","last_undegraded":"2024-09-19T14:12:15.168956+0000","last_fullsized":"2024-09-19T14:12:15.168956+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:34.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1295","reported_seq":3068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.858675+0000","last_change":"2024-09-19T13:36:09.334870+0000","last_active":"2024-09-19T14:13:45.858675+0000","last_peered":"2024-09-19T14:13:45.858675+0000","last_clean":"2024-09-19T14:13:45.858675+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:13:45.858675+0000","last_undegraded":"2024-09-19T14:13:45.858675+0000","last_fullsized":"2024-09-19T14:13:45.858675+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:57.257237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'184","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.685114+0000","last_change":"2024-09-19T13:36:07.799829+0000","last_active":"2024-09-19T14:11:34.685114+0000","last_peered":"2024-09-19T14:11:34.685114+0000","last_clean":"2024-09-19T14:11:34.685114+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:11:34.685114+0000","last_undegraded":"2024-09-19T14:11:34.685114+0000","last_fullsized":"2024-09-19T14:11:34.685114+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17713223,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":441,"num_read_kb":2025,"num_write":899,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805745+0000","last_change":"2024-09-19T13:36:11.338782+0000","last_active":"2024-09-19T14:09:56.805745+0000","last_peered":"2024-09-19T14:09:56.805745+0000","last_clean":"2024-09-19T14:09:56.805745+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:09:56.805745+0000","last_undegraded":"2024-09-19T14:09:56.805745+0000","last_fullsized":"2024-09-19T14:09:56.805745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:16.443904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'142","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.115082+0000","last_change":"2024-09-19T13:36:13.344371+0000","last_active":"2024-09-19T14:12:26.115082+0000","last_peered":"2024-09-19T14:12:26.115082+0000","last_clean":"2024-09-19T14:12:26.115082+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:12:26.115082+0000","last_undegraded":"2024-09-19T14:12:26.115082+0000","last_fullsized":"2024-09-19T14:12:26.115082+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:58.796476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11393,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":257,"num_write":156,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601278+0000","last_change":"2024-09-19T13:36:15.348413+0000","last_active":"2024-09-19T14:10:06.601278+0000","last_peered":"2024-09-19T14:10:06.601278+0000","last_clean":"2024-09-19T14:10:06.601278+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:10:06.601278+0000","last_undegraded":"2024-09-19T14:10:06.601278+0000","last_fullsized":"2024-09-19T14:10:06.601278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.820957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'118","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.738924+0000","last_change":"2024-09-19T13:36:17.364393+0000","last_active":"2024-09-19T14:12:21.738924+0000","last_peered":"2024-09-19T14:12:21.738924+0000","last_clean":"2024-09-19T14:12:21.738924+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:12:21.738924+0000","last_undegraded":"2024-09-19T14:12:21.738924+0000","last_fullsized":"2024-09-19T14:12:21.738924+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:02.719840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'468","reported_seq":2089,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.926778+0000","last_change":"2024-09-19T13:36:09.329775+0000","last_active":"2024-09-19T14:12:13.926778+0000","last_peered":"2024-09-19T14:12:13.926778+0000","last_clean":"2024-09-19T14:12:13.926778+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:12:13.926778+0000","last_undegraded":"2024-09-19T14:12:13.926778+0000","last_fullsized":"2024-09-19T14:12:13.926778+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:15.175433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'213","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.023429+0000","last_change":"2024-09-19T13:36:07.814623+0000","last_active":"2024-09-19T14:11:55.023429+0000","last_peered":"2024-09-19T14:11:55.023429+0000","last_clean":"2024-09-19T14:11:55.023429+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:11:55.023429+0000","last_undegraded":"2024-09-19T14:11:55.023429+0000","last_fullsized":"2024-09-19T14:11:55.023429+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:56.724159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9464391,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":62927,"num_write":1021,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.634762+0000","last_change":"2024-09-19T13:36:11.336246+0000","last_active":"2024-09-19T14:09:56.634762+0000","last_peered":"2024-09-19T14:09:56.634762+0000","last_clean":"2024-09-19T14:09:56.634762+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:09:56.634762+0000","last_undegraded":"2024-09-19T14:09:56.634762+0000","last_fullsized":"2024-09-19T14:09:56.634762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:18.982990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'142","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.823060+0000","last_change":"2024-09-19T13:36:13.343683+0000","last_active":"2024-09-19T14:12:16.823060+0000","last_peered":"2024-09-19T14:12:16.823060+0000","last_clean":"2024-09-19T14:12:16.823060+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:12:16.823060+0000","last_undegraded":"2024-09-19T14:12:16.823060+0000","last_fullsized":"2024-09-19T14:12:16.823060+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.516524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":173,"num_write":90,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'733","reported_seq":2197,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.051292+0000","last_change":"2024-09-19T13:36:15.350112+0000","last_active":"2024-09-19T14:13:47.051292+0000","last_peered":"2024-09-19T14:13:47.051292+0000","last_clean":"2024-09-19T14:13:47.051292+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:13:47.051292+0000","last_undegraded":"2024-09-19T14:13:47.051292+0000","last_fullsized":"2024-09-19T14:13:47.051292+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.284435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'119","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.540330+0000","last_change":"2024-09-19T13:36:17.355488+0000","last_active":"2024-09-19T14:12:15.540330+0000","last_peered":"2024-09-19T14:12:15.540330+0000","last_clean":"2024-09-19T14:12:15.540330+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:12:15.540330+0000","last_undegraded":"2024-09-19T14:12:15.540330+0000","last_fullsized":"2024-09-19T14:12:15.540330+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.296270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1573","reported_seq":3192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.346545+0000","last_change":"2024-09-19T13:36:09.332881+0000","last_active":"2024-09-19T14:12:27.346545+0000","last_peered":"2024-09-19T14:12:27.346545+0000","last_clean":"2024-09-19T14:12:27.346545+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:12:27.346545+0000","last_undegraded":"2024-09-19T14:12:27.346545+0000","last_fullsized":"2024-09-19T14:12:27.346545+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:05.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'194","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.823808+0000","last_change":"2024-09-19T13:36:07.800961+0000","last_active":"2024-09-19T14:11:58.823808+0000","last_peered":"2024-09-19T14:11:58.823808+0000","last_clean":"2024-09-19T14:11:58.823808+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:11:58.823808+0000","last_undegraded":"2024-09-19T14:11:58.823808+0000","last_fullsized":"2024-09-19T14:11:58.823808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5742454,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":26305,"num_write":897,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"34'6","reported_seq":1916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.767074+0000","last_change":"2024-09-19T13:36:11.338913+0000","last_active":"2024-09-19T14:13:46.767074+0000","last_peered":"2024-09-19T14:13:46.767074+0000","last_clean":"2024-09-19T14:13:46.767074+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:13:46.767074+0000","last_undegraded":"2024-09-19T14:13:46.767074+0000","last_fullsized":"2024-09-19T14:13:46.767074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:36.373641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1673,"num_read_kb":2140,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'75","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.605372+0000","last_change":"2024-09-19T13:36:13.678517+0000","last_active":"2024-09-19T14:11:59.605372+0000","last_peered":"2024-09-19T14:11:59.605372+0000","last_clean":"2024-09-19T14:11:59.605372+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:11:59.605372+0000","last_undegraded":"2024-09-19T14:11:59.605372+0000","last_fullsized":"2024-09-19T14:11:59.605372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:55.910454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'776","reported_seq":4734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.052375+0000","last_change":"2024-09-19T13:36:15.352291+0000","last_active":"2024-09-19T14:13:47.052375+0000","last_peered":"2024-09-19T14:13:47.052375+0000","last_clean":"2024-09-19T14:13:47.052375+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:13:47.052375+0000","last_undegraded":"2024-09-19T14:13:47.052375+0000","last_fullsized":"2024-09-19T14:13:47.052375+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:43.392004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'128","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.409862+0000","last_change":"2024-09-19T13:36:17.360266+0000","last_active":"2024-09-19T14:12:26.409862+0000","last_peered":"2024-09-19T14:12:26.409862+0000","last_clean":"2024-09-19T14:12:26.409862+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:12:26.409862+0000","last_undegraded":"2024-09-19T14:12:26.409862+0000","last_fullsized":"2024-09-19T14:12:26.409862+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:17.091973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'908","reported_seq":2529,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.393463+0000","last_change":"2024-09-19T13:36:09.345481+0000","last_active":"2024-09-19T14:12:14.393463+0000","last_peered":"2024-09-19T14:12:14.393463+0000","last_clean":"2024-09-19T14:12:14.393463+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:12:14.393463+0000","last_undegraded":"2024-09-19T14:12:14.393463+0000","last_fullsized":"2024-09-19T14:12:14.393463+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:16.331902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'179","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:32.410844+0000","last_change":"2024-09-19T13:36:07.803394+0000","last_active":"2024-09-19T14:11:32.410844+0000","last_peered":"2024-09-19T14:11:32.410844+0000","last_clean":"2024-09-19T14:11:32.410844+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:11:32.410844+0000","last_undegraded":"2024-09-19T14:11:32.410844+0000","last_fullsized":"2024-09-19T14:11:32.410844+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:45.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.719129+0000","last_change":"2024-09-19T13:36:11.334156+0000","last_active":"2024-09-19T14:09:56.719129+0000","last_peered":"2024-09-19T14:09:56.719129+0000","last_clean":"2024-09-19T14:09:56.719129+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:09:56.719129+0000","last_undegraded":"2024-09-19T14:09:56.719129+0000","last_fullsized":"2024-09-19T14:09:56.719129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:26.831809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'191","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:50.254879+0000","last_change":"2024-09-19T13:36:13.346678+0000","last_active":"2024-09-19T14:12:50.254879+0000","last_peered":"2024-09-19T14:12:50.254879+0000","last_clean":"2024-09-19T14:12:50.254879+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:12:50.254879+0000","last_undegraded":"2024-09-19T14:12:50.254879+0000","last_fullsized":"2024-09-19T14:12:50.254879+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:27.806745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":857,"num_read_kb":894,"num_write":1378,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.710550+0000","last_change":"2024-09-19T13:36:15.349430+0000","last_active":"2024-09-19T14:10:01.710550+0000","last_peered":"2024-09-19T14:10:01.710550+0000","last_clean":"2024-09-19T14:10:01.710550+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:10:01.710550+0000","last_undegraded":"2024-09-19T14:10:01.710550+0000","last_fullsized":"2024-09-19T14:10:01.710550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:55.349813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'116","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.223769+0000","last_change":"2024-09-19T13:36:17.354159+0000","last_active":"2024-09-19T14:12:13.223769+0000","last_peered":"2024-09-19T14:12:13.223769+0000","last_clean":"2024-09-19T14:12:13.223769+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:12:13.223769+0000","last_undegraded":"2024-09-19T14:12:13.223769+0000","last_fullsized":"2024-09-19T14:12:13.223769+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:21.937480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176339+0000","last_change":"2024-09-19T13:36:09.335373+0000","last_active":"2024-09-19T14:12:26.176339+0000","last_peered":"2024-09-19T14:12:26.176339+0000","last_clean":"2024-09-19T14:12:26.176339+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:12:26.176339+0000","last_undegraded":"2024-09-19T14:12:26.176339+0000","last_fullsized":"2024-09-19T14:12:26.176339+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:13.238868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.751980+0000","last_change":"2024-09-19T13:35:53.209257+0000","last_active":"2024-09-19T14:12:06.751980+0000","last_peered":"2024-09-19T14:12:06.751980+0000","last_clean":"2024-09-19T14:12:06.751980+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:12:06.751980+0000","last_undegraded":"2024-09-19T14:12:06.751980+0000","last_fullsized":"2024-09-19T14:12:06.751980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_clean_scrub_stamp":"2024-09-19T13:35:51.725320+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:26.239545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610925+0000","last_change":"2024-09-19T13:36:00.766592+0000","last_active":"2024-09-19T14:11:26.610925+0000","last_peered":"2024-09-19T14:11:26.610925+0000","last_clean":"2024-09-19T14:11:26.610925+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:11:26.610925+0000","last_undegraded":"2024-09-19T14:11:26.610925+0000","last_fullsized":"2024-09-19T14:11:26.610925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:27.934615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'221","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.567842+0000","last_change":"2024-09-19T13:36:07.812870+0000","last_active":"2024-09-19T14:12:07.567842+0000","last_peered":"2024-09-19T14:12:07.567842+0000","last_clean":"2024-09-19T14:12:07.567842+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:12:07.567842+0000","last_undegraded":"2024-09-19T14:12:07.567842+0000","last_fullsized":"2024-09-19T14:12:07.567842+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745515,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":4141,"num_write":1066,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747345+0000","last_change":"2024-09-19T13:36:11.335928+0000","last_active":"2024-09-19T14:11:36.747345+0000","last_peered":"2024-09-19T14:11:36.747345+0000","last_clean":"2024-09-19T14:11:36.747345+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:11:36.747345+0000","last_undegraded":"2024-09-19T14:11:36.747345+0000","last_fullsized":"2024-09-19T14:11:36.747345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:19.656066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'323","reported_seq":997,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.020740+0000","last_change":"2024-09-19T13:36:13.348035+0000","last_active":"2024-09-19T14:13:47.020740+0000","last_peered":"2024-09-19T14:13:47.020740+0000","last_clean":"2024-09-19T14:13:47.020740+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:13:47.020740+0000","last_undegraded":"2024-09-19T14:13:47.020740+0000","last_fullsized":"2024-09-19T14:13:47.020740+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:31.984054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":882,"num_write":520,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.608712+0000","last_change":"2024-09-19T13:36:15.353267+0000","last_active":"2024-09-19T14:10:56.608712+0000","last_peered":"2024-09-19T14:10:56.608712+0000","last_clean":"2024-09-19T14:10:56.608712+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:10:56.608712+0000","last_undegraded":"2024-09-19T14:10:56.608712+0000","last_fullsized":"2024-09-19T14:10:56.608712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:16.239382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'189","reported_seq":879,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.764923+0000","last_change":"2024-09-19T13:36:17.356980+0000","last_active":"2024-09-19T14:12:27.764923+0000","last_peered":"2024-09-19T14:12:27.764923+0000","last_clean":"2024-09-19T14:12:27.764923+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:12:27.764923+0000","last_undegraded":"2024-09-19T14:12:27.764923+0000","last_fullsized":"2024-09-19T14:12:27.764923+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:00.567870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'974","reported_seq":2577,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855901+0000","last_change":"2024-09-19T13:36:09.343922+0000","last_active":"2024-09-19T14:13:45.855901+0000","last_peered":"2024-09-19T14:13:45.855901+0000","last_clean":"2024-09-19T14:13:45.855901+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:13:45.855901+0000","last_undegraded":"2024-09-19T14:13:45.855901+0000","last_fullsized":"2024-09-19T14:13:45.855901+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:14.020473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752563+0000","last_change":"2024-09-19T13:36:00.854468+0000","last_active":"2024-09-19T14:12:11.752563+0000","last_peered":"2024-09-19T14:12:11.752563+0000","last_clean":"2024-09-19T14:12:11.752563+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:12:11.752563+0000","last_undegraded":"2024-09-19T14:12:11.752563+0000","last_fullsized":"2024-09-19T14:12:11.752563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:35.110401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'205","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.871425+0000","last_change":"2024-09-19T13:36:07.802200+0000","last_active":"2024-09-19T14:12:13.871425+0000","last_peered":"2024-09-19T14:12:13.871425+0000","last_clean":"2024-09-19T14:12:13.871425+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:12:13.871425+0000","last_undegraded":"2024-09-19T14:12:13.871425+0000","last_fullsized":"2024-09-19T14:12:13.871425+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.035934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7278941,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":568,"num_read_kb":42960,"num_write":977,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.606429+0000","last_change":"2024-09-19T13:36:11.337197+0000","last_active":"2024-09-19T14:10:51.606429+0000","last_peered":"2024-09-19T14:10:51.606429+0000","last_clean":"2024-09-19T14:10:51.606429+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:10:51.606429+0000","last_undegraded":"2024-09-19T14:10:51.606429+0000","last_fullsized":"2024-09-19T14:10:51.606429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:00.715855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'809","reported_seq":2176,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.046671+0000","last_change":"2024-09-19T13:36:13.344429+0000","last_active":"2024-09-19T14:13:47.046671+0000","last_peered":"2024-09-19T14:13:47.046671+0000","last_clean":"2024-09-19T14:13:47.046671+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:13:47.046671+0000","last_undegraded":"2024-09-19T14:13:47.046671+0000","last_fullsized":"2024-09-19T14:13:47.046671+0000","mapping_epoch":28,"log_start":"260'700","ondisk_log_start":"260'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:47.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32444,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1113,"num_read_kb":1259,"num_write":234,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749934+0000","last_change":"2024-09-19T13:36:15.355170+0000","last_active":"2024-09-19T14:11:51.749934+0000","last_peered":"2024-09-19T14:11:51.749934+0000","last_clean":"2024-09-19T14:11:51.749934+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:11:51.749934+0000","last_undegraded":"2024-09-19T14:11:51.749934+0000","last_fullsized":"2024-09-19T14:11:51.749934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:24.165465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'128","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.807878+0000","last_change":"2024-09-19T13:36:17.353025+0000","last_active":"2024-09-19T14:13:45.807878+0000","last_peered":"2024-09-19T14:13:45.807878+0000","last_clean":"2024-09-19T14:13:45.807878+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:13:45.807878+0000","last_undegraded":"2024-09-19T14:13:45.807878+0000","last_fullsized":"2024-09-19T14:13:45.807878+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:31.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'770","reported_seq":2365,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226542+0000","last_change":"2024-09-19T13:36:09.335144+0000","last_active":"2024-09-19T14:12:13.226542+0000","last_peered":"2024-09-19T14:12:13.226542+0000","last_clean":"2024-09-19T14:12:13.226542+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:12:13.226542+0000","last_undegraded":"2024-09-19T14:12:13.226542+0000","last_fullsized":"2024-09-19T14:12:13.226542+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:14.738804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.817492+0000","last_change":"2024-09-19T13:36:00.763165+0000","last_active":"2024-09-19T14:11:26.817492+0000","last_peered":"2024-09-19T14:11:26.817492+0000","last_clean":"2024-09-19T14:11:26.817492+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:11:26.817492+0000","last_undegraded":"2024-09-19T14:11:26.817492+0000","last_fullsized":"2024-09-19T14:11:26.817492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:42.369963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'173","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.653405+0000","last_change":"2024-09-19T13:36:07.803619+0000","last_active":"2024-09-19T14:12:16.653405+0000","last_peered":"2024-09-19T14:12:16.653405+0000","last_clean":"2024-09-19T14:12:16.653405+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:12:16.653405+0000","last_undegraded":"2024-09-19T14:12:16.653405+0000","last_fullsized":"2024-09-19T14:12:16.653405+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:55.600380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10583521,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":421,"num_read_kb":6136,"num_write":872,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813393+0000","last_change":"2024-09-19T13:36:11.334995+0000","last_active":"2024-09-19T14:10:51.813393+0000","last_peered":"2024-09-19T14:10:51.813393+0000","last_clean":"2024-09-19T14:10:51.813393+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:10:51.813393+0000","last_undegraded":"2024-09-19T14:10:51.813393+0000","last_fullsized":"2024-09-19T14:10:51.813393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:49.486350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'201","reported_seq":1189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.151581+0000","last_change":"2024-09-19T13:36:13.678601+0000","last_active":"2024-09-19T14:13:47.151581+0000","last_peered":"2024-09-19T14:13:47.151581+0000","last_clean":"2024-09-19T14:13:47.151581+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:13:47.151581+0000","last_undegraded":"2024-09-19T14:13:47.151581+0000","last_fullsized":"2024-09-19T14:13:47.151581+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:44.121580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614634+0000","last_change":"2024-09-19T13:36:15.350412+0000","last_active":"2024-09-19T14:11:41.614634+0000","last_peered":"2024-09-19T14:11:41.614634+0000","last_clean":"2024-09-19T14:11:41.614634+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:11:41.614634+0000","last_undegraded":"2024-09-19T14:11:41.614634+0000","last_fullsized":"2024-09-19T14:11:41.614634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:44.795963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.456924+0000","last_change":"2024-09-19T13:36:17.363655+0000","last_active":"2024-09-19T14:12:27.456924+0000","last_peered":"2024-09-19T14:12:27.456924+0000","last_clean":"2024-09-19T14:12:27.456924+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:12:27.456924+0000","last_undegraded":"2024-09-19T14:12:27.456924+0000","last_fullsized":"2024-09-19T14:12:27.456924+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:54.511400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'351","reported_seq":1871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759134+0000","last_change":"2024-09-19T13:36:09.326835+0000","last_active":"2024-09-19T14:12:27.759134+0000","last_peered":"2024-09-19T14:12:27.759134+0000","last_clean":"2024-09-19T14:12:27.759134+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:12:27.759134+0000","last_undegraded":"2024-09-19T14:12:27.759134+0000","last_fullsized":"2024-09-19T14:12:27.759134+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:36.883583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610896+0000","last_change":"2024-09-19T13:36:00.767107+0000","last_active":"2024-09-19T14:11:26.610896+0000","last_peered":"2024-09-19T14:11:26.610896+0000","last_clean":"2024-09-19T14:11:26.610896+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:11:26.610896+0000","last_undegraded":"2024-09-19T14:11:26.610896+0000","last_fullsized":"2024-09-19T14:11:26.610896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:58.438229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'215","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733263+0000","last_change":"2024-09-19T13:36:07.801289+0000","last_active":"2024-09-19T14:11:36.733263+0000","last_peered":"2024-09-19T14:11:36.733263+0000","last_clean":"2024-09-19T14:11:36.733263+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:11:36.733263+0000","last_undegraded":"2024-09-19T14:11:36.733263+0000","last_fullsized":"2024-09-19T14:11:36.733263+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247065,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":5690,"num_write":1064,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614656+0000","last_change":"2024-09-19T13:36:11.337905+0000","last_active":"2024-09-19T14:11:41.614656+0000","last_peered":"2024-09-19T14:11:41.614656+0000","last_clean":"2024-09-19T14:11:41.614656+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:11:41.614656+0000","last_undegraded":"2024-09-19T14:11:41.614656+0000","last_fullsized":"2024-09-19T14:11:41.614656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:00.320875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'106","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622447+0000","last_change":"2024-09-19T13:36:13.341625+0000","last_active":"2024-09-19T14:13:06.622447+0000","last_peered":"2024-09-19T14:13:06.622447+0000","last_clean":"2024-09-19T14:13:06.622447+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:13:06.622447+0000","last_undegraded":"2024-09-19T14:13:06.622447+0000","last_fullsized":"2024-09-19T14:13:06.622447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:24.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.718378+0000","last_change":"2024-09-19T13:36:15.348466+0000","last_active":"2024-09-19T14:10:56.718378+0000","last_peered":"2024-09-19T14:10:56.718378+0000","last_clean":"2024-09-19T14:10:56.718378+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:10:56.718378+0000","last_undegraded":"2024-09-19T14:10:56.718378+0000","last_fullsized":"2024-09-19T14:10:56.718378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:41.097287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'106","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.019026+0000","last_change":"2024-09-19T13:36:17.362663+0000","last_active":"2024-09-19T14:12:27.019026+0000","last_peered":"2024-09-19T14:12:27.019026+0000","last_clean":"2024-09-19T14:12:27.019026+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:12:27.019026+0000","last_undegraded":"2024-09-19T14:12:27.019026+0000","last_fullsized":"2024-09-19T14:12:27.019026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:27.259346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'599","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260112+0000","last_change":"2024-09-19T13:36:09.342497+0000","last_active":"2024-09-19T14:12:20.260112+0000","last_peered":"2024-09-19T14:12:20.260112+0000","last_clean":"2024-09-19T14:12:20.260112+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:12:20.260112+0000","last_undegraded":"2024-09-19T14:12:20.260112+0000","last_fullsized":"2024-09-19T14:12:20.260112+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:24.198820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'199","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.820141+0000","last_change":"2024-09-19T13:36:07.809389+0000","last_active":"2024-09-19T14:12:15.820141+0000","last_peered":"2024-09-19T14:12:15.820141+0000","last_clean":"2024-09-19T14:12:15.820141+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:12:15.820141+0000","last_undegraded":"2024-09-19T14:12:15.820141+0000","last_fullsized":"2024-09-19T14:12:15.820141+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:41.507863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70057,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":569,"num_read_kb":24801,"num_write":993,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.647184+0000","last_change":"2024-09-19T13:36:00.763237+0000","last_active":"2024-09-19T14:11:26.647184+0000","last_peered":"2024-09-19T14:11:26.647184+0000","last_clean":"2024-09-19T14:11:26.647184+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:11:26.647184+0000","last_undegraded":"2024-09-19T14:11:26.647184+0000","last_fullsized":"2024-09-19T14:11:26.647184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:36.142012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613912+0000","last_change":"2024-09-19T13:36:11.333288+0000","last_active":"2024-09-19T14:11:36.613912+0000","last_peered":"2024-09-19T14:11:36.613912+0000","last_clean":"2024-09-19T14:11:36.613912+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:11:36.613912+0000","last_undegraded":"2024-09-19T14:11:36.613912+0000","last_fullsized":"2024-09-19T14:11:36.613912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:43.796231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'256","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.011948+0000","last_change":"2024-09-19T13:36:13.344037+0000","last_active":"2024-09-19T14:13:47.011948+0000","last_peered":"2024-09-19T14:13:47.011948+0000","last_clean":"2024-09-19T14:13:47.011948+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:13:47.011948+0000","last_undegraded":"2024-09-19T14:13:47.011948+0000","last_fullsized":"2024-09-19T14:13:47.011948+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:14.471458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19960,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":486,"num_write":232,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.734022+0000","last_change":"2024-09-19T13:36:15.347284+0000","last_active":"2024-09-19T14:11:41.734022+0000","last_peered":"2024-09-19T14:11:41.734022+0000","last_clean":"2024-09-19T14:11:41.734022+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:11:41.734022+0000","last_undegraded":"2024-09-19T14:11:41.734022+0000","last_fullsized":"2024-09-19T14:11:41.734022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:45.336194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'126","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.815901+0000","last_change":"2024-09-19T13:36:17.358825+0000","last_active":"2024-09-19T14:12:14.815901+0000","last_peered":"2024-09-19T14:12:14.815901+0000","last_clean":"2024-09-19T14:12:14.815901+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:12:14.815901+0000","last_undegraded":"2024-09-19T14:12:14.815901+0000","last_fullsized":"2024-09-19T14:12:14.815901+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:26.627242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1168","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.469596+0000","last_change":"2024-09-19T13:36:09.338739+0000","last_active":"2024-09-19T14:12:12.469596+0000","last_peered":"2024-09-19T14:12:12.469596+0000","last_clean":"2024-09-19T14:12:12.469596+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:12:12.469596+0000","last_undegraded":"2024-09-19T14:12:12.469596+0000","last_fullsized":"2024-09-19T14:12:12.469596+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:57.267957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'234","reported_seq":884,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.245753+0000","last_change":"2024-09-19T13:36:07.804201+0000","last_active":"2024-09-19T14:12:01.245753+0000","last_peered":"2024-09-19T14:12:01.245753+0000","last_clean":"2024-09-19T14:12:01.245753+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:12:01.245753+0000","last_undegraded":"2024-09-19T14:12:01.245753+0000","last_fullsized":"2024-09-19T14:12:01.245753+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:17.647156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511506,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":113129,"num_write":1043,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747369+0000","last_change":"2024-09-19T13:36:00.854514+0000","last_active":"2024-09-19T14:11:36.747369+0000","last_peered":"2024-09-19T14:11:36.747369+0000","last_clean":"2024-09-19T14:11:36.747369+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:11:36.747369+0000","last_undegraded":"2024-09-19T14:11:36.747369+0000","last_fullsized":"2024-09-19T14:11:36.747369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:14.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723266+0000","last_change":"2024-09-19T13:36:11.336803+0000","last_active":"2024-09-19T14:11:36.723266+0000","last_peered":"2024-09-19T14:11:36.723266+0000","last_clean":"2024-09-19T14:11:36.723266+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:11:36.723266+0000","last_undegraded":"2024-09-19T14:11:36.723266+0000","last_fullsized":"2024-09-19T14:11:36.723266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:07.018411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'145","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.356860+0000","last_change":"2024-09-19T13:36:13.678497+0000","last_active":"2024-09-19T14:12:27.356860+0000","last_peered":"2024-09-19T14:12:27.356860+0000","last_clean":"2024-09-19T14:12:27.356860+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:12:27.356860+0000","last_undegraded":"2024-09-19T14:12:27.356860+0000","last_fullsized":"2024-09-19T14:12:27.356860+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.504350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'785","reported_seq":2494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.049041+0000","last_change":"2024-09-19T13:36:15.349702+0000","last_active":"2024-09-19T14:13:47.049041+0000","last_peered":"2024-09-19T14:13:47.049041+0000","last_clean":"2024-09-19T14:13:47.049041+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:13:47.049041+0000","last_undegraded":"2024-09-19T14:13:47.049041+0000","last_fullsized":"2024-09-19T14:13:47.049041+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.512113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'139","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.173795+0000","last_change":"2024-09-19T13:36:17.364028+0000","last_active":"2024-09-19T14:12:26.173795+0000","last_peered":"2024-09-19T14:12:26.173795+0000","last_clean":"2024-09-19T14:12:26.173795+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:12:26.173795+0000","last_undegraded":"2024-09-19T14:12:26.173795+0000","last_fullsized":"2024-09-19T14:12:26.173795+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:00.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226434+0000","last_change":"2024-09-19T13:36:09.334788+0000","last_active":"2024-09-19T14:12:13.226434+0000","last_peered":"2024-09-19T14:12:13.226434+0000","last_clean":"2024-09-19T14:12:13.226434+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:12:13.226434+0000","last_undegraded":"2024-09-19T14:12:13.226434+0000","last_fullsized":"2024-09-19T14:12:13.226434+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'207","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.234573+0000","last_change":"2024-09-19T13:36:07.809079+0000","last_active":"2024-09-19T14:11:34.234573+0000","last_peered":"2024-09-19T14:11:34.234573+0000","last_clean":"2024-09-19T14:11:34.234573+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:11:34.234573+0000","last_undegraded":"2024-09-19T14:11:34.234573+0000","last_fullsized":"2024-09-19T14:11:34.234573+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5892174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":8334,"num_write":1021,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.641430+0000","last_change":"2024-09-19T13:36:00.763660+0000","last_active":"2024-09-19T14:10:41.641430+0000","last_peered":"2024-09-19T14:10:41.641430+0000","last_clean":"2024-09-19T14:10:41.641430+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:10:41.641430+0000","last_undegraded":"2024-09-19T14:10:41.641430+0000","last_fullsized":"2024-09-19T14:10:41.641430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:18.186285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733201+0000","last_change":"2024-09-19T13:36:11.329844+0000","last_active":"2024-09-19T14:11:36.733201+0000","last_peered":"2024-09-19T14:11:36.733201+0000","last_clean":"2024-09-19T14:11:36.733201+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:11:36.733201+0000","last_undegraded":"2024-09-19T14:11:36.733201+0000","last_fullsized":"2024-09-19T14:11:36.733201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:37.515612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'87","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.941455+0000","last_change":"2024-09-19T13:36:13.343716+0000","last_active":"2024-09-19T14:11:55.941455+0000","last_peered":"2024-09-19T14:11:55.941455+0000","last_clean":"2024-09-19T14:11:55.941455+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:11:55.941455+0000","last_undegraded":"2024-09-19T14:11:55.941455+0000","last_fullsized":"2024-09-19T14:11:55.941455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'792","reported_seq":2373,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.053372+0000","last_change":"2024-09-19T13:36:15.350187+0000","last_active":"2024-09-19T14:13:47.053372+0000","last_peered":"2024-09-19T14:13:47.053372+0000","last_clean":"2024-09-19T14:13:47.053372+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:13:47.053372+0000","last_undegraded":"2024-09-19T14:13:47.053372+0000","last_fullsized":"2024-09-19T14:13:47.053372+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.788209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'291","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:04.821247+0000","last_change":"2024-09-19T13:36:17.362227+0000","last_active":"2024-09-19T14:12:04.821247+0000","last_peered":"2024-09-19T14:12:04.821247+0000","last_clean":"2024-09-19T14:12:04.821247+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:12:04.821247+0000","last_undegraded":"2024-09-19T14:12:04.821247+0000","last_fullsized":"2024-09-19T14:12:04.821247+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:31.124289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'722","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758644+0000","last_change":"2024-09-19T13:36:09.334632+0000","last_active":"2024-09-19T14:12:27.758644+0000","last_peered":"2024-09-19T14:12:27.758644+0000","last_clean":"2024-09-19T14:12:27.758644+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:12:27.758644+0000","last_undegraded":"2024-09-19T14:12:27.758644+0000","last_fullsized":"2024-09-19T14:12:27.758644+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:08.592744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'221","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.297525+0000","last_change":"2024-09-19T13:36:07.811604+0000","last_active":"2024-09-19T14:11:55.297525+0000","last_peered":"2024-09-19T14:11:55.297525+0000","last_clean":"2024-09-19T14:11:55.297525+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:11:55.297525+0000","last_undegraded":"2024-09-19T14:11:55.297525+0000","last_fullsized":"2024-09-19T14:11:55.297525+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:27.180358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5253664,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":595,"num_read_kb":41557,"num_write":1057,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.716308+0000","last_change":"2024-09-19T13:36:00.816633+0000","last_active":"2024-09-19T14:10:41.716308+0000","last_peered":"2024-09-19T14:10:41.716308+0000","last_clean":"2024-09-19T14:10:41.716308+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:10:41.716308+0000","last_undegraded":"2024-09-19T14:10:41.716308+0000","last_fullsized":"2024-09-19T14:10:41.716308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:57.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.721729+0000","last_change":"2024-09-19T13:36:11.334617+0000","last_active":"2024-09-19T14:10:16.721729+0000","last_peered":"2024-09-19T14:10:16.721729+0000","last_clean":"2024-09-19T14:10:16.721729+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:10:16.721729+0000","last_undegraded":"2024-09-19T14:10:16.721729+0000","last_fullsized":"2024-09-19T14:10:16.721729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:31.167102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'292","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.006705+0000","last_change":"2024-09-19T13:36:13.678434+0000","last_active":"2024-09-19T14:13:47.006705+0000","last_peered":"2024-09-19T14:13:47.006705+0000","last_clean":"2024-09-19T14:13:47.006705+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:13:47.006705+0000","last_undegraded":"2024-09-19T14:13:47.006705+0000","last_fullsized":"2024-09-19T14:13:47.006705+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:14.308303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":405,"num_read_kb":503,"num_write":198,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.733909+0000","last_change":"2024-09-19T13:36:15.348438+0000","last_active":"2024-09-19T14:11:41.733909+0000","last_peered":"2024-09-19T14:11:41.733909+0000","last_clean":"2024-09-19T14:11:41.733909+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:11:41.733909+0000","last_undegraded":"2024-09-19T14:11:41.733909+0000","last_fullsized":"2024-09-19T14:11:41.733909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:32.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'160","reported_seq":653,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.232087+0000","last_change":"2024-09-19T13:36:17.358950+0000","last_active":"2024-09-19T14:12:27.232087+0000","last_peered":"2024-09-19T14:12:27.232087+0000","last_clean":"2024-09-19T14:12:27.232087+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:12:27.232087+0000","last_undegraded":"2024-09-19T14:12:27.232087+0000","last_fullsized":"2024-09-19T14:12:27.232087+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:09.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'143","reported_seq":706,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.863516+0000","last_change":"2024-09-19T13:36:17.361305+0000","last_active":"2024-09-19T14:12:27.863516+0000","last_peered":"2024-09-19T14:12:27.863516+0000","last_clean":"2024-09-19T14:12:27.863516+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:12:27.863516+0000","last_undegraded":"2024-09-19T14:12:27.863516+0000","last_fullsized":"2024-09-19T14:12:27.863516+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:26.500978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'776","reported_seq":2472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819999+0000","last_change":"2024-09-19T13:36:09.330532+0000","last_active":"2024-09-19T14:12:14.819999+0000","last_peered":"2024-09-19T14:12:14.819999+0000","last_clean":"2024-09-19T14:12:14.819999+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:12:14.819999+0000","last_undegraded":"2024-09-19T14:12:14.819999+0000","last_fullsized":"2024-09-19T14:12:14.819999+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:28.861247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'194","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.113365+0000","last_change":"2024-09-19T13:36:07.807459+0000","last_active":"2024-09-19T14:12:26.113365+0000","last_peered":"2024-09-19T14:12:26.113365+0000","last_clean":"2024-09-19T14:12:26.113365+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:12:26.113365+0000","last_undegraded":"2024-09-19T14:12:26.113365+0000","last_fullsized":"2024-09-19T14:12:26.113365+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:55.208501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899947,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":792,"num_read_kb":235834,"num_write":979,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645462+0000","last_change":"2024-09-19T13:36:11.335979+0000","last_active":"2024-09-19T14:11:11.645462+0000","last_peered":"2024-09-19T14:11:11.645462+0000","last_clean":"2024-09-19T14:11:11.645462+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:11:11.645462+0000","last_undegraded":"2024-09-19T14:11:11.645462+0000","last_fullsized":"2024-09-19T14:11:11.645462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:55.864456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'135","reported_seq":692,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.626321+0000","last_change":"2024-09-19T13:36:13.342360+0000","last_active":"2024-09-19T14:13:36.626321+0000","last_peered":"2024-09-19T14:13:36.626321+0000","last_clean":"2024-09-19T14:13:36.626321+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:13:36.626321+0000","last_undegraded":"2024-09-19T14:13:36.626321+0000","last_fullsized":"2024-09-19T14:13:36.626321+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:00.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11918,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":245,"num_write":98,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730499+0000","last_change":"2024-09-19T13:36:15.347213+0000","last_active":"2024-09-19T14:11:16.730499+0000","last_peered":"2024-09-19T14:11:16.730499+0000","last_clean":"2024-09-19T14:11:16.730499+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:11:16.730499+0000","last_undegraded":"2024-09-19T14:11:16.730499+0000","last_fullsized":"2024-09-19T14:11:16.730499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:56.274514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'125","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.583991+0000","last_change":"2024-09-19T13:36:17.361898+0000","last_active":"2024-09-19T14:12:27.583991+0000","last_peered":"2024-09-19T14:12:27.583991+0000","last_clean":"2024-09-19T14:12:27.583991+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:12:27.583991+0000","last_undegraded":"2024-09-19T14:12:27.583991+0000","last_fullsized":"2024-09-19T14:12:27.583991+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:32.112739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'450","reported_seq":2133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.856226+0000","last_change":"2024-09-19T13:36:09.341398+0000","last_active":"2024-09-19T14:13:45.856226+0000","last_peered":"2024-09-19T14:13:45.856226+0000","last_clean":"2024-09-19T14:13:45.856226+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:13:45.856226+0000","last_undegraded":"2024-09-19T14:13:45.856226+0000","last_fullsized":"2024-09-19T14:13:45.856226+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:27.435893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'202","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.567284+0000","last_change":"2024-09-19T13:36:44.400759+0000","last_active":"2024-09-19T14:11:55.567284+0000","last_peered":"2024-09-19T14:11:55.567284+0000","last_clean":"2024-09-19T14:11:55.567284+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:11:55.567284+0000","last_undegraded":"2024-09-19T14:11:55.567284+0000","last_fullsized":"2024-09-19T14:11:55.567284+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:53.572285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567557,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":556,"num_read_kb":26124,"num_write":1059,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.729952+0000","last_change":"2024-09-19T13:36:11.337455+0000","last_active":"2024-09-19T14:11:11.729952+0000","last_peered":"2024-09-19T14:11:11.729952+0000","last_clean":"2024-09-19T14:11:11.729952+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:11:11.729952+0000","last_undegraded":"2024-09-19T14:11:11.729952+0000","last_fullsized":"2024-09-19T14:11:11.729952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:12.668776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":538,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.243489+0000","last_change":"2024-09-19T13:36:13.343393+0000","last_active":"2024-09-19T14:11:58.243489+0000","last_peered":"2024-09-19T14:11:58.243489+0000","last_clean":"2024-09-19T14:11:58.243489+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:11:58.243489+0000","last_undegraded":"2024-09-19T14:11:58.243489+0000","last_fullsized":"2024-09-19T14:11:58.243489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:39.552041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.744597+0000","last_change":"2024-09-19T13:36:15.353524+0000","last_active":"2024-09-19T14:11:16.744597+0000","last_peered":"2024-09-19T14:11:16.744597+0000","last_clean":"2024-09-19T14:11:16.744597+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:11:16.744597+0000","last_undegraded":"2024-09-19T14:11:16.744597+0000","last_fullsized":"2024-09-19T14:11:16.744597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:39.216630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'216","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.357835+0000","last_change":"2024-09-19T13:36:17.356683+0000","last_active":"2024-09-19T14:12:27.357835+0000","last_peered":"2024-09-19T14:12:27.357835+0000","last_clean":"2024-09-19T14:12:27.357835+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:12:27.357835+0000","last_undegraded":"2024-09-19T14:12:27.357835+0000","last_fullsized":"2024-09-19T14:12:27.357835+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:18.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'397","reported_seq":1840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171074+0000","last_change":"2024-09-19T13:36:09.334800+0000","last_active":"2024-09-19T14:12:15.171074+0000","last_peered":"2024-09-19T14:12:15.171074+0000","last_clean":"2024-09-19T14:12:15.171074+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:12:15.171074+0000","last_undegraded":"2024-09-19T14:12:15.171074+0000","last_fullsized":"2024-09-19T14:12:15.171074+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:14.288345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'211","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:00.123029+0000","last_change":"2024-09-19T13:36:07.810838+0000","last_active":"2024-09-19T14:12:00.123029+0000","last_peered":"2024-09-19T14:12:00.123029+0000","last_clean":"2024-09-19T14:12:00.123029+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:12:00.123029+0000","last_undegraded":"2024-09-19T14:12:00.123029+0000","last_fullsized":"2024-09-19T14:12:00.123029+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:49.405832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":16519,"num_write":1035,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743810+0000","last_change":"2024-09-19T13:36:11.336061+0000","last_active":"2024-09-19T14:11:11.743810+0000","last_peered":"2024-09-19T14:11:11.743810+0000","last_clean":"2024-09-19T14:11:11.743810+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:11:11.743810+0000","last_undegraded":"2024-09-19T14:11:11.743810+0000","last_fullsized":"2024-09-19T14:11:11.743810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:12.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'140","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.626354+0000","last_change":"2024-09-19T13:36:13.342506+0000","last_active":"2024-09-19T14:13:36.626354+0000","last_peered":"2024-09-19T14:13:36.626354+0000","last_clean":"2024-09-19T14:13:36.626354+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:13:36.626354+0000","last_undegraded":"2024-09-19T14:13:36.626354+0000","last_fullsized":"2024-09-19T14:13:36.626354+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6169,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":179,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720728+0000","last_change":"2024-09-19T13:36:15.349264+0000","last_active":"2024-09-19T14:11:16.720728+0000","last_peered":"2024-09-19T14:11:16.720728+0000","last_clean":"2024-09-19T14:11:16.720728+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:11:16.720728+0000","last_undegraded":"2024-09-19T14:11:16.720728+0000","last_fullsized":"2024-09-19T14:11:16.720728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.086503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'180","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.817537+0000","last_change":"2024-09-19T13:36:17.359223+0000","last_active":"2024-09-19T14:12:14.817537+0000","last_peered":"2024-09-19T14:12:14.817537+0000","last_clean":"2024-09-19T14:12:14.817537+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:12:14.817537+0000","last_undegraded":"2024-09-19T14:12:14.817537+0000","last_fullsized":"2024-09-19T14:12:14.817537+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:10.712355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'407","reported_seq":1890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857973+0000","last_change":"2024-09-19T13:36:09.347751+0000","last_active":"2024-09-19T14:13:45.857973+0000","last_peered":"2024-09-19T14:13:45.857973+0000","last_clean":"2024-09-19T14:13:45.857973+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:13:45.857973+0000","last_undegraded":"2024-09-19T14:13:45.857973+0000","last_fullsized":"2024-09-19T14:13:45.857973+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:52.995531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'219","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.603441+0000","last_change":"2024-09-19T13:36:07.810378+0000","last_active":"2024-09-19T14:11:23.603441+0000","last_peered":"2024-09-19T14:11:23.603441+0000","last_clean":"2024-09-19T14:11:23.603441+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:11:23.603441+0000","last_undegraded":"2024-09-19T14:11:23.603441+0000","last_fullsized":"2024-09-19T14:11:23.603441+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:11.342159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10525266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":42518,"num_write":1081,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.720199+0000","last_change":"2024-09-19T13:36:11.338516+0000","last_active":"2024-09-19T14:11:11.720199+0000","last_peered":"2024-09-19T14:11:11.720199+0000","last_clean":"2024-09-19T14:11:11.720199+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:11:11.720199+0000","last_undegraded":"2024-09-19T14:11:11.720199+0000","last_fullsized":"2024-09-19T14:11:11.720199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:01:07.656648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'125","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.765349+0000","last_change":"2024-09-19T13:36:13.348210+0000","last_active":"2024-09-19T14:13:36.765349+0000","last_peered":"2024-09-19T14:13:36.765349+0000","last_clean":"2024-09-19T14:13:36.765349+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:13:36.765349+0000","last_undegraded":"2024-09-19T14:13:36.765349+0000","last_fullsized":"2024-09-19T14:13:36.765349+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:04.880223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12423,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":215,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611560+0000","last_change":"2024-09-19T13:36:15.353429+0000","last_active":"2024-09-19T14:11:16.611560+0000","last_peered":"2024-09-19T14:11:16.611560+0000","last_clean":"2024-09-19T14:11:16.611560+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:11:16.611560+0000","last_undegraded":"2024-09-19T14:11:16.611560+0000","last_fullsized":"2024-09-19T14:11:16.611560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'841","reported_seq":2324,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859435+0000","last_change":"2024-09-19T13:36:09.338894+0000","last_active":"2024-09-19T14:13:45.859435+0000","last_peered":"2024-09-19T14:13:45.859435+0000","last_clean":"2024-09-19T14:13:45.859435+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:13:45.859435+0000","last_undegraded":"2024-09-19T14:13:45.859435+0000","last_fullsized":"2024-09-19T14:13:45.859435+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:00.425682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'208","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.498765+0000","last_change":"2024-09-19T13:36:07.802099+0000","last_active":"2024-09-19T14:11:31.498765+0000","last_peered":"2024-09-19T14:11:31.498765+0000","last_clean":"2024-09-19T14:11:31.498765+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:11:31.498765+0000","last_undegraded":"2024-09-19T14:11:31.498765+0000","last_fullsized":"2024-09-19T14:11:31.498765+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:50.286421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5579919,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":34256,"num_write":1032,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619281+0000","last_change":"2024-09-19T13:36:11.339451+0000","last_active":"2024-09-19T14:12:16.619281+0000","last_peered":"2024-09-19T14:12:16.619281+0000","last_clean":"2024-09-19T14:12:16.619281+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:12:16.619281+0000","last_undegraded":"2024-09-19T14:12:16.619281+0000","last_fullsized":"2024-09-19T14:12:16.619281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:18.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'178","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.003432+0000","last_change":"2024-09-19T13:36:13.344513+0000","last_active":"2024-09-19T14:13:47.003432+0000","last_peered":"2024-09-19T14:13:47.003432+0000","last_clean":"2024-09-19T14:13:47.003432+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:13:47.003432+0000","last_undegraded":"2024-09-19T14:13:47.003432+0000","last_fullsized":"2024-09-19T14:13:47.003432+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:22.941079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19597,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":275,"num_read_kb":396,"num_write":172,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.609853+0000","last_change":"2024-09-19T13:36:15.354407+0000","last_active":"2024-09-19T14:11:16.609853+0000","last_peered":"2024-09-19T14:11:16.609853+0000","last_clean":"2024-09-19T14:11:16.609853+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:11:16.609853+0000","last_undegraded":"2024-09-19T14:11:16.609853+0000","last_fullsized":"2024-09-19T14:11:16.609853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'194","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.814286+0000","last_change":"2024-09-19T13:36:17.363573+0000","last_active":"2024-09-19T14:12:27.814286+0000","last_peered":"2024-09-19T14:12:27.814286+0000","last_clean":"2024-09-19T14:12:27.814286+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:12:27.814286+0000","last_undegraded":"2024-09-19T14:12:27.814286+0000","last_fullsized":"2024-09-19T14:12:27.814286+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:53.961300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619272+0000","last_change":"2024-09-19T13:36:09.334303+0000","last_active":"2024-09-19T14:12:16.619272+0000","last_peered":"2024-09-19T14:12:16.619272+0000","last_clean":"2024-09-19T14:12:16.619272+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:12:16.619272+0000","last_undegraded":"2024-09-19T14:12:16.619272+0000","last_fullsized":"2024-09-19T14:12:16.619272+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:28.147108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'186","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.488395+0000","last_change":"2024-09-19T13:36:07.808757+0000","last_active":"2024-09-19T14:12:03.488395+0000","last_peered":"2024-09-19T14:12:03.488395+0000","last_clean":"2024-09-19T14:12:03.488395+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:12:03.488395+0000","last_undegraded":"2024-09-19T14:12:03.488395+0000","last_fullsized":"2024-09-19T14:12:03.488395+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:21.182962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12605672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":902,"num_read_kb":49787,"num_write":932,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723358+0000","last_change":"2024-09-19T13:36:11.339099+0000","last_active":"2024-09-19T14:11:36.723358+0000","last_peered":"2024-09-19T14:11:36.723358+0000","last_clean":"2024-09-19T14:11:36.723358+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:11:36.723358+0000","last_undegraded":"2024-09-19T14:11:36.723358+0000","last_fullsized":"2024-09-19T14:11:36.723358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:44.638696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'127","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.767011+0000","last_change":"2024-09-19T13:36:13.351689+0000","last_active":"2024-09-19T14:13:46.767011+0000","last_peered":"2024-09-19T14:13:46.767011+0000","last_clean":"2024-09-19T14:13:46.767011+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:13:46.767011+0000","last_undegraded":"2024-09-19T14:13:46.767011+0000","last_fullsized":"2024-09-19T14:13:46.767011+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:59.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":174,"num_read_kb":165,"num_write":108,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645982+0000","last_change":"2024-09-19T13:36:15.352438+0000","last_active":"2024-09-19T14:11:16.645982+0000","last_peered":"2024-09-19T14:11:16.645982+0000","last_clean":"2024-09-19T14:11:16.645982+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:11:16.645982+0000","last_undegraded":"2024-09-19T14:11:16.645982+0000","last_fullsized":"2024-09-19T14:11:16.645982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:36.174138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'153","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:05.915979+0000","last_change":"2024-09-19T13:36:17.361800+0000","last_active":"2024-09-19T14:12:05.915979+0000","last_peered":"2024-09-19T14:12:05.915979+0000","last_clean":"2024-09-19T14:12:05.915979+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:12:05.915979+0000","last_undegraded":"2024-09-19T14:12:05.915979+0000","last_fullsized":"2024-09-19T14:12:05.915979+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:05.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'363","reported_seq":1760,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758484+0000","last_change":"2024-09-19T13:36:09.347725+0000","last_active":"2024-09-19T14:12:27.758484+0000","last_peered":"2024-09-19T14:12:27.758484+0000","last_clean":"2024-09-19T14:12:27.758484+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:12:27.758484+0000","last_undegraded":"2024-09-19T14:12:27.758484+0000","last_fullsized":"2024-09-19T14:12:27.758484+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:58.075633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'200","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.856602+0000","last_change":"2024-09-19T13:36:07.804673+0000","last_active":"2024-09-19T14:12:11.856602+0000","last_peered":"2024-09-19T14:12:11.856602+0000","last_clean":"2024-09-19T14:12:11.856602+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:12:11.856602+0000","last_undegraded":"2024-09-19T14:12:11.856602+0000","last_fullsized":"2024-09-19T14:12:11.856602+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:43.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535766,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":634,"num_read_kb":98647,"num_write":930,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730104+0000","last_change":"2024-09-19T13:36:11.336450+0000","last_active":"2024-09-19T14:11:11.730104+0000","last_peered":"2024-09-19T14:11:11.730104+0000","last_clean":"2024-09-19T14:11:11.730104+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:11:11.730104+0000","last_undegraded":"2024-09-19T14:11:11.730104+0000","last_fullsized":"2024-09-19T14:11:11.730104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:28.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'119","reported_seq":678,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.627635+0000","last_change":"2024-09-19T13:36:13.679719+0000","last_active":"2024-09-19T14:13:46.627635+0000","last_peered":"2024-09-19T14:13:46.627635+0000","last_clean":"2024-09-19T14:13:46.627635+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:13:46.627635+0000","last_undegraded":"2024-09-19T14:13:46.627635+0000","last_fullsized":"2024-09-19T14:13:46.627635+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":78,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.638419+0000","last_change":"2024-09-19T13:36:15.346362+0000","last_active":"2024-09-19T14:10:21.638419+0000","last_peered":"2024-09-19T14:10:21.638419+0000","last_clean":"2024-09-19T14:10:21.638419+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:10:21.638419+0000","last_undegraded":"2024-09-19T14:10:21.638419+0000","last_fullsized":"2024-09-19T14:10:21.638419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:04.233453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'110","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.035975+0000","last_change":"2024-09-19T13:36:17.358911+0000","last_active":"2024-09-19T14:13:47.035975+0000","last_peered":"2024-09-19T14:13:47.035975+0000","last_clean":"2024-09-19T14:13:47.035975+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:13:47.035975+0000","last_undegraded":"2024-09-19T14:13:47.035975+0000","last_fullsized":"2024-09-19T14:13:47.035975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:09.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'864","reported_seq":2572,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759017+0000","last_change":"2024-09-19T13:36:09.328018+0000","last_active":"2024-09-19T14:12:27.759017+0000","last_peered":"2024-09-19T14:12:27.759017+0000","last_clean":"2024-09-19T14:12:27.759017+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:12:27.759017+0000","last_undegraded":"2024-09-19T14:12:27.759017+0000","last_fullsized":"2024-09-19T14:12:27.759017+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:01.380904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'234","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:33.181002+0000","last_change":"2024-09-19T13:36:07.810852+0000","last_active":"2024-09-19T14:11:33.181002+0000","last_peered":"2024-09-19T14:11:33.181002+0000","last_clean":"2024-09-19T14:11:33.181002+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:11:33.181002+0000","last_undegraded":"2024-09-19T14:11:33.181002+0000","last_fullsized":"2024-09-19T14:11:33.181002+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:23.670171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283729,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":17644,"num_write":968,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645501+0000","last_change":"2024-09-19T13:36:11.341498+0000","last_active":"2024-09-19T14:11:11.645501+0000","last_peered":"2024-09-19T14:11:11.645501+0000","last_clean":"2024-09-19T14:11:11.645501+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:11:11.645501+0000","last_undegraded":"2024-09-19T14:11:11.645501+0000","last_fullsized":"2024-09-19T14:11:11.645501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:07.914209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'73","reported_seq":581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.472240+0000","last_change":"2024-09-19T13:36:13.678466+0000","last_active":"2024-09-19T14:12:12.472240+0000","last_peered":"2024-09-19T14:12:12.472240+0000","last_clean":"2024-09-19T14:12:12.472240+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:12:12.472240+0000","last_undegraded":"2024-09-19T14:12:12.472240+0000","last_fullsized":"2024-09-19T14:12:12.472240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.085161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'776","reported_seq":4106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.047599+0000","last_change":"2024-09-19T13:36:15.350958+0000","last_active":"2024-09-19T14:13:47.047599+0000","last_peered":"2024-09-19T14:13:47.047599+0000","last_clean":"2024-09-19T14:13:47.047599+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:13:47.047599+0000","last_undegraded":"2024-09-19T14:13:47.047599+0000","last_fullsized":"2024-09-19T14:13:47.047599+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.003728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'116","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.815973+0000","last_change":"2024-09-19T13:36:17.363671+0000","last_active":"2024-09-19T14:12:27.815973+0000","last_peered":"2024-09-19T14:12:27.815973+0000","last_clean":"2024-09-19T14:12:27.815973+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:12:27.815973+0000","last_undegraded":"2024-09-19T14:12:27.815973+0000","last_fullsized":"2024-09-19T14:12:27.815973+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'835","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.844154+0000","last_change":"2024-09-19T13:36:09.338783+0000","last_active":"2024-09-19T14:12:03.844154+0000","last_peered":"2024-09-19T14:12:03.844154+0000","last_clean":"2024-09-19T14:12:03.844154+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:12:03.844154+0000","last_undegraded":"2024-09-19T14:12:03.844154+0000","last_fullsized":"2024-09-19T14:12:03.844154+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:11.912759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'176","reported_seq":753,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:00.741944+0000","last_change":"2024-09-19T13:36:07.814956+0000","last_active":"2024-09-19T14:12:00.741944+0000","last_peered":"2024-09-19T14:12:00.741944+0000","last_clean":"2024-09-19T14:12:00.741944+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:12:00.741944+0000","last_undegraded":"2024-09-19T14:12:00.741944+0000","last_fullsized":"2024-09-19T14:12:00.741944+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:59.519413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":5488,"num_write":866,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743900+0000","last_change":"2024-09-19T13:36:11.339110+0000","last_active":"2024-09-19T14:11:11.743900+0000","last_peered":"2024-09-19T14:11:11.743900+0000","last_clean":"2024-09-19T14:11:11.743900+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:11:11.743900+0000","last_undegraded":"2024-09-19T14:11:11.743900+0000","last_fullsized":"2024-09-19T14:11:11.743900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:19.072017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'143","reported_seq":703,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:36.619894+0000","last_change":"2024-09-19T13:36:13.345724+0000","last_active":"2024-09-19T14:12:36.619894+0000","last_peered":"2024-09-19T14:12:36.619894+0000","last_clean":"2024-09-19T14:12:36.619894+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:12:36.619894+0000","last_undegraded":"2024-09-19T14:12:36.619894+0000","last_fullsized":"2024-09-19T14:12:36.619894+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:09.615248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11294,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":179,"num_read_kb":233,"num_write":98,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601159+0000","last_change":"2024-09-19T13:36:15.348860+0000","last_active":"2024-09-19T14:10:06.601159+0000","last_peered":"2024-09-19T14:10:06.601159+0000","last_clean":"2024-09-19T14:10:06.601159+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:10:06.601159+0000","last_undegraded":"2024-09-19T14:10:06.601159+0000","last_fullsized":"2024-09-19T14:10:06.601159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:42.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'111","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.467492+0000","last_change":"2024-09-19T13:36:17.357887+0000","last_active":"2024-09-19T14:12:12.467492+0000","last_peered":"2024-09-19T14:12:12.467492+0000","last_clean":"2024-09-19T14:12:12.467492+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:12:12.467492+0000","last_undegraded":"2024-09-19T14:12:12.467492+0000","last_fullsized":"2024-09-19T14:12:12.467492+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:57.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2548,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758795+0000","last_change":"2024-09-19T13:36:09.339435+0000","last_active":"2024-09-19T14:12:27.758795+0000","last_peered":"2024-09-19T14:12:27.758795+0000","last_clean":"2024-09-19T14:12:27.758795+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:12:27.758795+0000","last_undegraded":"2024-09-19T14:12:27.758795+0000","last_fullsized":"2024-09-19T14:12:27.758795+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:54.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'233","reported_seq":885,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:10.871720+0000","last_change":"2024-09-19T13:36:07.814402+0000","last_active":"2024-09-19T14:12:10.871720+0000","last_peered":"2024-09-19T14:12:10.871720+0000","last_clean":"2024-09-19T14:12:10.871720+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:12:10.871720+0000","last_undegraded":"2024-09-19T14:12:10.871720+0000","last_fullsized":"2024-09-19T14:12:10.871720+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.518831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19036554,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":601,"num_read_kb":59575,"num_write":1076,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.609332+0000","last_change":"2024-09-19T13:36:11.336616+0000","last_active":"2024-09-19T14:11:11.609332+0000","last_peered":"2024-09-19T14:11:11.609332+0000","last_clean":"2024-09-19T14:11:11.609332+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:11:11.609332+0000","last_undegraded":"2024-09-19T14:11:11.609332+0000","last_fullsized":"2024-09-19T14:11:11.609332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:30.775102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'128","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.621099+0000","last_change":"2024-09-19T13:36:13.344971+0000","last_active":"2024-09-19T14:12:31.621099+0000","last_peered":"2024-09-19T14:12:31.621099+0000","last_clean":"2024-09-19T14:12:31.621099+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:12:31.621099+0000","last_undegraded":"2024-09-19T14:12:31.621099+0000","last_fullsized":"2024-09-19T14:12:31.621099+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:03.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":144,"num_read_kb":190,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.711890+0000","last_change":"2024-09-19T13:36:15.353381+0000","last_active":"2024-09-19T14:10:11.711890+0000","last_peered":"2024-09-19T14:10:11.711890+0000","last_clean":"2024-09-19T14:10:11.711890+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:10:11.711890+0000","last_undegraded":"2024-09-19T14:10:11.711890+0000","last_fullsized":"2024-09-19T14:10:11.711890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.838545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'82","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:08.528868+0000","last_change":"2024-09-19T13:36:17.361965+0000","last_active":"2024-09-19T14:12:08.528868+0000","last_peered":"2024-09-19T14:12:08.528868+0000","last_clean":"2024-09-19T14:12:08.528868+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:12:08.528868+0000","last_undegraded":"2024-09-19T14:12:08.528868+0000","last_fullsized":"2024-09-19T14:12:08.528868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:25.682631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'388","reported_seq":1821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859075+0000","last_change":"2024-09-19T13:36:09.341541+0000","last_active":"2024-09-19T14:13:45.859075+0000","last_peered":"2024-09-19T14:13:45.859075+0000","last_clean":"2024-09-19T14:13:45.859075+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:13:45.859075+0000","last_undegraded":"2024-09-19T14:13:45.859075+0000","last_fullsized":"2024-09-19T14:13:45.859075+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:38.682073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'199","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.164446+0000","last_change":"2024-09-19T13:36:44.400469+0000","last_active":"2024-09-19T14:12:13.164446+0000","last_peered":"2024-09-19T14:12:13.164446+0000","last_clean":"2024-09-19T14:12:13.164446+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:12:13.164446+0000","last_undegraded":"2024-09-19T14:12:13.164446+0000","last_fullsized":"2024-09-19T14:12:13.164446+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:06.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898702,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":9219,"num_write":928,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719839+0000","last_change":"2024-09-19T13:36:11.334533+0000","last_active":"2024-09-19T14:10:01.719839+0000","last_peered":"2024-09-19T14:10:01.719839+0000","last_clean":"2024-09-19T14:10:01.719839+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:10:01.719839+0000","last_undegraded":"2024-09-19T14:10:01.719839+0000","last_fullsized":"2024-09-19T14:10:01.719839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'111","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.627563+0000","last_change":"2024-09-19T13:36:13.346260+0000","last_active":"2024-09-19T14:13:46.627563+0000","last_peered":"2024-09-19T14:13:46.627563+0000","last_clean":"2024-09-19T14:13:46.627563+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:13:46.627563+0000","last_undegraded":"2024-09-19T14:13:46.627563+0000","last_fullsized":"2024-09-19T14:13:46.627563+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:37.266432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":195,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730630+0000","last_change":"2024-09-19T13:36:15.348740+0000","last_active":"2024-09-19T14:11:16.730630+0000","last_peered":"2024-09-19T14:11:16.730630+0000","last_clean":"2024-09-19T14:11:16.730630+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:11:16.730630+0000","last_undegraded":"2024-09-19T14:11:16.730630+0000","last_fullsized":"2024-09-19T14:11:16.730630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:00.693042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'161","reported_seq":1613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.352324+0000","last_change":"2024-09-19T13:36:17.359613+0000","last_active":"2024-09-19T14:12:27.352324+0000","last_peered":"2024-09-19T14:12:27.352324+0000","last_clean":"2024-09-19T14:12:27.352324+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:12:27.352324+0000","last_undegraded":"2024-09-19T14:12:27.352324+0000","last_fullsized":"2024-09-19T14:12:27.352324+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:03.545885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1270","reported_seq":2983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882294+0000","last_change":"2024-09-19T13:36:09.338262+0000","last_active":"2024-09-19T14:12:15.882294+0000","last_peered":"2024-09-19T14:12:15.882294+0000","last_clean":"2024-09-19T14:12:15.882294+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:12:15.882294+0000","last_undegraded":"2024-09-19T14:12:15.882294+0000","last_fullsized":"2024-09-19T14:12:15.882294+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:47.191145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'204","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727812+0000","last_change":"2024-09-19T13:36:07.813158+0000","last_active":"2024-09-19T14:12:25.727812+0000","last_peered":"2024-09-19T14:12:25.727812+0000","last_clean":"2024-09-19T14:12:25.727812+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:12:25.727812+0000","last_undegraded":"2024-09-19T14:12:25.727812+0000","last_fullsized":"2024-09-19T14:12:25.727812+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:46.920199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6558355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":101743,"num_write":1007,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.636111+0000","last_change":"2024-09-19T13:36:11.338136+0000","last_active":"2024-09-19T14:10:06.636111+0000","last_peered":"2024-09-19T14:10:06.636111+0000","last_clean":"2024-09-19T14:10:06.636111+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:10:06.636111+0000","last_undegraded":"2024-09-19T14:10:06.636111+0000","last_fullsized":"2024-09-19T14:10:06.636111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:55.192579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'155","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.752326+0000","last_change":"2024-09-19T13:36:13.345467+0000","last_active":"2024-09-19T14:13:46.752326+0000","last_peered":"2024-09-19T14:13:46.752326+0000","last_clean":"2024-09-19T14:13:46.752326+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:13:46.752326+0000","last_undegraded":"2024-09-19T14:13:46.752326+0000","last_fullsized":"2024-09-19T14:13:46.752326+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":282,"num_write":118,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611550+0000","last_change":"2024-09-19T13:36:15.349620+0000","last_active":"2024-09-19T14:11:16.611550+0000","last_peered":"2024-09-19T14:11:16.611550+0000","last_clean":"2024-09-19T14:11:16.611550+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:11:16.611550+0000","last_undegraded":"2024-09-19T14:11:16.611550+0000","last_fullsized":"2024-09-19T14:11:16.611550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.666417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'158","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855539+0000","last_change":"2024-09-19T13:36:17.360385+0000","last_active":"2024-09-19T14:13:45.855539+0000","last_peered":"2024-09-19T14:13:45.855539+0000","last_clean":"2024-09-19T14:13:45.855539+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:13:45.855539+0000","last_undegraded":"2024-09-19T14:13:45.855539+0000","last_fullsized":"2024-09-19T14:13:45.855539+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:56.457101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'835","reported_seq":2511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354875+0000","last_change":"2024-09-19T13:36:09.340041+0000","last_active":"2024-09-19T14:12:27.354875+0000","last_peered":"2024-09-19T14:12:27.354875+0000","last_clean":"2024-09-19T14:12:27.354875+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:12:27.354875+0000","last_undegraded":"2024-09-19T14:12:27.354875+0000","last_fullsized":"2024-09-19T14:12:27.354875+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.813909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'243","reported_seq":934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.413480+0000","last_change":"2024-09-19T13:36:07.816141+0000","last_active":"2024-09-19T14:11:59.413480+0000","last_peered":"2024-09-19T14:11:59.413480+0000","last_clean":"2024-09-19T14:11:59.413480+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:11:59.413480+0000","last_undegraded":"2024-09-19T14:11:59.413480+0000","last_fullsized":"2024-09-19T14:11:59.413480+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:19.313544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6958799,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":884,"num_read_kb":7647,"num_write":1097,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759140+0000","last_change":"2024-09-19T13:36:09.327555+0000","last_active":"2024-09-19T14:12:27.759140+0000","last_peered":"2024-09-19T14:12:27.759140+0000","last_clean":"2024-09-19T14:12:27.759140+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:12:27.759140+0000","last_undegraded":"2024-09-19T14:12:27.759140+0000","last_fullsized":"2024-09-19T14:12:27.759140+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:05.495968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'214","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818398+0000","last_change":"2024-09-19T13:36:44.477056+0000","last_active":"2024-09-19T14:11:36.818398+0000","last_peered":"2024-09-19T14:11:36.818398+0000","last_clean":"2024-09-19T14:11:36.818398+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:11:36.818398+0000","last_undegraded":"2024-09-19T14:11:36.818398+0000","last_fullsized":"2024-09-19T14:11:36.818398+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:33.685772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":556,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":9780,"num_write":1044,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'454","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.864388+0000","last_change":"2024-09-19T13:36:09.336079+0000","last_active":"2024-09-19T14:13:45.864388+0000","last_peered":"2024-09-19T14:13:45.864388+0000","last_clean":"2024-09-19T14:13:45.864388+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:13:45.864388+0000","last_undegraded":"2024-09-19T14:13:45.864388+0000","last_fullsized":"2024-09-19T14:13:45.864388+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:37.224054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'206","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.496205+0000","last_change":"2024-09-19T13:36:07.813078+0000","last_active":"2024-09-19T14:12:11.496205+0000","last_peered":"2024-09-19T14:12:11.496205+0000","last_clean":"2024-09-19T14:12:11.496205+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:12:11.496205+0000","last_undegraded":"2024-09-19T14:12:11.496205+0000","last_fullsized":"2024-09-19T14:12:11.496205+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:50:05.153900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569610,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":41340,"num_write":994,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'834","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171315+0000","last_change":"2024-09-19T13:36:09.337109+0000","last_active":"2024-09-19T14:12:15.171315+0000","last_peered":"2024-09-19T14:12:15.171315+0000","last_clean":"2024-09-19T14:12:15.171315+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:12:15.171315+0000","last_undegraded":"2024-09-19T14:12:15.171315+0000","last_fullsized":"2024-09-19T14:12:15.171315+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:35.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'341","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.655125+0000","last_change":"2024-09-19T13:36:07.799742+0000","last_active":"2024-09-19T14:13:41.655125+0000","last_peered":"2024-09-19T14:13:41.655125+0000","last_clean":"2024-09-19T14:13:41.655125+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:13:41.655125+0000","last_undegraded":"2024-09-19T14:13:41.655125+0000","last_fullsized":"2024-09-19T14:13:41.655125+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:24.145889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031324,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":982,"num_read_kb":17821,"num_write":1246,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1313","reported_seq":2966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.881914+0000","last_change":"2024-09-19T13:36:09.337337+0000","last_active":"2024-09-19T14:12:15.881914+0000","last_peered":"2024-09-19T14:12:15.881914+0000","last_clean":"2024-09-19T14:12:15.881914+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:12:15.881914+0000","last_undegraded":"2024-09-19T14:12:15.881914+0000","last_fullsized":"2024-09-19T14:12:15.881914+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:42.621753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'181","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.215253+0000","last_change":"2024-09-19T13:36:07.799229+0000","last_active":"2024-09-19T14:12:06.215253+0000","last_peered":"2024-09-19T14:12:06.215253+0000","last_clean":"2024-09-19T14:12:06.215253+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:12:06.215253+0000","last_undegraded":"2024-09-19T14:12:06.215253+0000","last_fullsized":"2024-09-19T14:12:06.215253+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:58.585027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22190415,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":35047,"num_write":884,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'459","reported_seq":2150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.394101+0000","last_change":"2024-09-19T13:36:09.337422+0000","last_active":"2024-09-19T14:12:14.394101+0000","last_peered":"2024-09-19T14:12:14.394101+0000","last_clean":"2024-09-19T14:12:14.394101+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:12:14.394101+0000","last_undegraded":"2024-09-19T14:12:14.394101+0000","last_fullsized":"2024-09-19T14:12:14.394101+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:01.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'260","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.483590+0000","last_change":"2024-09-19T13:36:07.807531+0000","last_active":"2024-09-19T14:12:15.483590+0000","last_peered":"2024-09-19T14:12:15.483590+0000","last_clean":"2024-09-19T14:12:15.483590+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:12:15.483590+0000","last_undegraded":"2024-09-19T14:12:15.483590+0000","last_fullsized":"2024-09-19T14:12:15.483590+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:04.888500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'504","reported_seq":2120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176086+0000","last_change":"2024-09-19T13:36:09.345213+0000","last_active":"2024-09-19T14:12:26.176086+0000","last_peered":"2024-09-19T14:12:26.176086+0000","last_clean":"2024-09-19T14:12:26.176086+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:12:26.176086+0000","last_undegraded":"2024-09-19T14:12:26.176086+0000","last_fullsized":"2024-09-19T14:12:26.176086+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:29.948161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'206","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:37.059809+0000","last_change":"2024-09-19T13:36:07.807149+0000","last_active":"2024-09-19T14:13:37.059809+0000","last_peered":"2024-09-19T14:13:37.059809+0000","last_clean":"2024-09-19T14:13:37.059809+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:13:37.059809+0000","last_undegraded":"2024-09-19T14:13:37.059809+0000","last_fullsized":"2024-09-19T14:13:37.059809+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":13493,"num_write":1004,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'441","reported_seq":1912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857244+0000","last_change":"2024-09-19T13:36:09.339640+0000","last_active":"2024-09-19T14:13:45.857244+0000","last_peered":"2024-09-19T14:13:45.857244+0000","last_clean":"2024-09-19T14:13:45.857244+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:13:45.857244+0000","last_undegraded":"2024-09-19T14:13:45.857244+0000","last_fullsized":"2024-09-19T14:13:45.857244+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:04.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'235","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:38.916973+0000","last_change":"2024-09-19T13:36:07.799033+0000","last_active":"2024-09-19T14:13:38.916973+0000","last_peered":"2024-09-19T14:13:38.916973+0000","last_clean":"2024-09-19T14:13:38.916973+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:13:38.916973+0000","last_undegraded":"2024-09-19T14:13:38.916973+0000","last_fullsized":"2024-09-19T14:13:38.916973+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:19.554246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":12697,"num_write":1148,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'795","reported_seq":2305,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354863+0000","last_change":"2024-09-19T13:36:09.334668+0000","last_active":"2024-09-19T14:12:27.354863+0000","last_peered":"2024-09-19T14:12:27.354863+0000","last_clean":"2024-09-19T14:12:27.354863+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:12:27.354863+0000","last_undegraded":"2024-09-19T14:12:27.354863+0000","last_fullsized":"2024-09-19T14:12:27.354863+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:41.139613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'187","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:24.204718+0000","last_change":"2024-09-19T13:36:07.810286+0000","last_active":"2024-09-19T14:11:24.204718+0000","last_peered":"2024-09-19T14:11:24.204718+0000","last_clean":"2024-09-19T14:11:24.204718+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:11:24.204718+0000","last_undegraded":"2024-09-19T14:11:24.204718+0000","last_fullsized":"2024-09-19T14:11:24.204718+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.597999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":31169,"num_write":925,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'408","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355318+0000","last_change":"2024-09-19T13:36:09.330316+0000","last_active":"2024-09-19T14:12:27.355318+0000","last_peered":"2024-09-19T14:12:27.355318+0000","last_clean":"2024-09-19T14:12:27.355318+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:12:27.355318+0000","last_undegraded":"2024-09-19T14:12:27.355318+0000","last_fullsized":"2024-09-19T14:12:27.355318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:07.464094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'215","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727427+0000","last_change":"2024-09-19T13:36:07.798277+0000","last_active":"2024-09-19T14:12:25.727427+0000","last_peered":"2024-09-19T14:12:25.727427+0000","last_clean":"2024-09-19T14:12:25.727427+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:12:25.727427+0000","last_undegraded":"2024-09-19T14:12:25.727427+0000","last_fullsized":"2024-09-19T14:12:25.727427+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:15.349763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956151,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":31236,"num_write":1020,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'415","reported_seq":1917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.927264+0000","last_change":"2024-09-19T13:36:09.335622+0000","last_active":"2024-09-19T14:12:13.927264+0000","last_peered":"2024-09-19T14:12:13.927264+0000","last_clean":"2024-09-19T14:12:13.927264+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:12:13.927264+0000","last_undegraded":"2024-09-19T14:12:13.927264+0000","last_fullsized":"2024-09-19T14:12:13.927264+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:17:53.466085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'289","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:19.110439+0000","last_change":"2024-09-19T13:36:07.810715+0000","last_active":"2024-09-19T14:11:19.110439+0000","last_peered":"2024-09-19T14:11:19.110439+0000","last_clean":"2024-09-19T14:11:19.110439+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:11:19.110439+0000","last_undegraded":"2024-09-19T14:11:19.110439+0000","last_fullsized":"2024-09-19T14:11:19.110439+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:31.514058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27201,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":11922,"num_write":1197,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'363","reported_seq":1800,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.169773+0000","last_change":"2024-09-19T13:36:09.337015+0000","last_active":"2024-09-19T14:12:26.169773+0000","last_peered":"2024-09-19T14:12:26.169773+0000","last_clean":"2024-09-19T14:12:26.169773+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:12:26.169773+0000","last_undegraded":"2024-09-19T14:12:26.169773+0000","last_fullsized":"2024-09-19T14:12:26.169773+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:30.671479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'209","reported_seq":882,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:45.071355+0000","last_change":"2024-09-19T13:36:07.814269+0000","last_active":"2024-09-19T14:11:45.071355+0000","last_peered":"2024-09-19T14:11:45.071355+0000","last_clean":"2024-09-19T14:11:45.071355+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:11:45.071355+0000","last_undegraded":"2024-09-19T14:11:45.071355+0000","last_fullsized":"2024-09-19T14:11:45.071355+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:15.947998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5413251,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":98527,"num_write":1021,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'868","reported_seq":2495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819671+0000","last_change":"2024-09-19T13:36:09.338093+0000","last_active":"2024-09-19T14:12:14.819671+0000","last_peered":"2024-09-19T14:12:14.819671+0000","last_clean":"2024-09-19T14:12:14.819671+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:12:14.819671+0000","last_undegraded":"2024-09-19T14:12:14.819671+0000","last_fullsized":"2024-09-19T14:12:14.819671+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:05.996200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'239","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.238395+0000","last_change":"2024-09-19T13:36:07.814412+0000","last_active":"2024-09-19T14:11:59.238395+0000","last_peered":"2024-09-19T14:11:59.238395+0000","last_clean":"2024-09-19T14:11:59.238395+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:11:59.238395+0000","last_undegraded":"2024-09-19T14:11:59.238395+0000","last_fullsized":"2024-09-19T14:11:59.238395+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:00.783704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3437313,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":9315,"num_write":1045,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.874456+0000","last_change":"2024-09-19T13:36:09.341212+0000","last_active":"2024-09-19T14:12:15.874456+0000","last_peered":"2024-09-19T14:12:15.874456+0000","last_clean":"2024-09-19T14:12:15.874456+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:12:15.874456+0000","last_undegraded":"2024-09-19T14:12:15.874456+0000","last_fullsized":"2024-09-19T14:12:15.874456+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:57.018874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'247","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733913+0000","last_change":"2024-09-19T13:36:07.807328+0000","last_active":"2024-09-19T14:10:06.733913+0000","last_peered":"2024-09-19T14:10:06.733913+0000","last_clean":"2024-09-19T14:10:06.733913+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:10:06.733913+0000","last_undegraded":"2024-09-19T14:10:06.733913+0000","last_fullsized":"2024-09-19T14:10:06.733913+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:08.421022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9310237,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":13968,"num_write":1073,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'506","reported_seq":2122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.600040+0000","last_change":"2024-09-19T13:36:09.336661+0000","last_active":"2024-09-19T14:12:13.600040+0000","last_peered":"2024-09-19T14:12:13.600040+0000","last_clean":"2024-09-19T14:12:13.600040+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:12:13.600040+0000","last_undegraded":"2024-09-19T14:12:13.600040+0000","last_fullsized":"2024-09-19T14:12:13.600040+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:04.813825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'220","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.567382+0000","last_change":"2024-09-19T13:36:07.808201+0000","last_active":"2024-09-19T14:11:55.567382+0000","last_peered":"2024-09-19T14:11:55.567382+0000","last_clean":"2024-09-19T14:11:55.567382+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:11:55.567382+0000","last_undegraded":"2024-09-19T14:11:55.567382+0000","last_fullsized":"2024-09-19T14:11:55.567382+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:55.157068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534349,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":75622,"num_write":969,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'448","reported_seq":1944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758451+0000","last_change":"2024-09-19T13:36:09.337955+0000","last_active":"2024-09-19T14:12:27.758451+0000","last_peered":"2024-09-19T14:12:27.758451+0000","last_clean":"2024-09-19T14:12:27.758451+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:12:27.758451+0000","last_undegraded":"2024-09-19T14:12:27.758451+0000","last_fullsized":"2024-09-19T14:12:27.758451+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:36.790174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'197","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.547310+0000","last_change":"2024-09-19T13:36:07.810689+0000","last_active":"2024-09-19T14:12:13.547310+0000","last_peered":"2024-09-19T14:12:13.547310+0000","last_clean":"2024-09-19T14:12:13.547310+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:12:13.547310+0000","last_undegraded":"2024-09-19T14:12:13.547310+0000","last_fullsized":"2024-09-19T14:12:13.547310+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:59.845601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324671,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":10629,"num_write":1011,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'191","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.376741+0000","last_change":"2024-09-19T13:36:07.816743+0000","last_active":"2024-09-19T14:12:07.376741+0000","last_peered":"2024-09-19T14:12:07.376741+0000","last_clean":"2024-09-19T14:12:07.376741+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:12:07.376741+0000","last_undegraded":"2024-09-19T14:12:07.376741+0000","last_fullsized":"2024-09-19T14:12:07.376741+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.831713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4409468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":6982,"num_write":946,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'984","reported_seq":2906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176238+0000","last_change":"2024-09-19T13:36:09.340334+0000","last_active":"2024-09-19T14:12:26.176238+0000","last_peered":"2024-09-19T14:12:26.176238+0000","last_clean":"2024-09-19T14:12:26.176238+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:12:26.176238+0000","last_undegraded":"2024-09-19T14:12:26.176238+0000","last_fullsized":"2024-09-19T14:12:26.176238+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:50.291927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'226","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:10.172942+0000","last_change":"2024-09-19T13:36:07.805884+0000","last_active":"2024-09-19T14:12:10.172942+0000","last_peered":"2024-09-19T14:12:10.172942+0000","last_clean":"2024-09-19T14:12:10.172942+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:12:10.172942+0000","last_undegraded":"2024-09-19T14:12:10.172942+0000","last_fullsized":"2024-09-19T14:12:10.172942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:43.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7246065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":719,"num_read_kb":54230,"num_write":1170,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'386","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.347586+0000","last_change":"2024-09-19T13:36:09.336829+0000","last_active":"2024-09-19T14:12:27.347586+0000","last_peered":"2024-09-19T14:12:27.347586+0000","last_clean":"2024-09-19T14:12:27.347586+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:12:27.347586+0000","last_undegraded":"2024-09-19T14:12:27.347586+0000","last_fullsized":"2024-09-19T14:12:27.347586+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:29.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1682,"ondisk_log_size":1682,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":614,"ondisk_log_size":614,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":405878,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7581,"num_read_kb":9313,"num_write":5135,"num_write_kb":2593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":189930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1879,"ondisk_log_size":1879,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2397,"num_read_kb":2862,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4236,"ondisk_log_size":4236,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":487465899,"num_objects":412,"num_object_clones":0,"num_object_copies":824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":0,"num_read":38487,"num_read_kb":2616691,"num_write":63619,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":976797696,"data_stored":974931798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4246,"ondisk_log_size":4246,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63610923,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":117,"num_read_kb":176453,"num_write":136,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127229952,"data_stored":127221846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63610923,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":115,"num_read_kb":179418,"num_write":136,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127229952,"data_stored":127221846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542608,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359656,"kb_used_data":143832,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94012184,"statfs":{"total":96636764160,"available":96268476416,"internally_reserved":0,"allocated":147283968,"data_stored":145414466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220985802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542609,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364772,"kb_used_data":153108,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94007068,"statfs":{"total":96636764160,"available":96263237632,"internally_reserved":0,"allocated":156782592,"data_stored":155158296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229244,"kb_used_data":139820,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94142596,"statfs":{"total":96636764160,"available":96402018304,"internally_reserved":0,"allocated":143175680,"data_stored":141307822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542612,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255312,"kb_used_data":179712,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94116528,"statfs":{"total":96636764160,"available":96375324672,"internally_reserved":0,"allocated":184025088,"data_stored":182276595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542610,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405664,"kb_used_data":175952,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93966176,"statfs":{"total":96636764160,"available":96221364224,"internally_reserved":0,"allocated":180174848,"data_stored":178395336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161904,"kb_used_data":98784,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94209936,"statfs":{"total":96636764160,"available":96470974464,"internally_reserved":0,"allocated":101154816,"data_stored":99542049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262920,"kb_used_data":141560,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94108920,"statfs":{"total":96636764160,"available":96367534080,"internally_reserved":0,"allocated":144957440,"data_stored":143275793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542610,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429088,"kb_used_data":199376,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93942752,"statfs":{"total":96636764160,"available":96197378048,"internally_reserved":0,"allocated":204161024,"data_stored":202300137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155848704,"data_stored":155531495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":87781376,"data_stored":87605617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83361792,"data_stored":83206147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":139661312,"data_stored":139427172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":156217344,"data_stored":155923322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":120438784,"data_stored":120161976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":105390080,"data_stored":105253044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":128098304,"data_stored":127823025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":22615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":30215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":25850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":12834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":45848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":30308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23117097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5827243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8978432,"data_stored":8976178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13742080,"data_stored":13740281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9502720,"data_stored":9500759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27852800,"data_stored":27850546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15839232,"data_stored":15837433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23658496,"data_stored":23656242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5351673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:14:19.267 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T14:14:19.267 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:14:19.590 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:14:19.602 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:14:19.604 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1406,"stamp":"2024-09-19T14:14:17.707646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615701328,"num_objects":912,"num_object_clones":0,"num_object_copies":1824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":912,"num_whiteouts":0,"num_read":295721,"num_read_kb":3210662,"num_write":145183,"num_write_kb":2512502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13898,"ondisk_log_size":13898,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2468560,"kb_used_data":1232144,"kb_used_omap":12,"kb_used_meta":1236275,"kb_avail":752506160,"statfs":{"total":773094113280,"available":770566307840,"internally_reserved":0,"allocated":1261715456,"data_stored":1247670494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1265946160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004936"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.604790+0000","last_change":"2024-09-19T14:03:08.839286+0000","last_active":"2024-09-19T14:10:41.604790+0000","last_peered":"2024-09-19T14:10:41.604790+0000","last_clean":"2024-09-19T14:10:41.604790+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:10:41.604790+0000","last_undegraded":"2024-09-19T14:10:41.604790+0000","last_fullsized":"2024-09-19T14:10:41.604790+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:42.826327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.602224+0000","last_change":"2024-09-19T13:52:51.581992+0000","last_active":"2024-09-19T14:10:21.602224+0000","last_peered":"2024-09-19T14:10:21.602224+0000","last_clean":"2024-09-19T14:10:21.602224+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:10:21.602224+0000","last_undegraded":"2024-09-19T14:10:21.602224+0000","last_fullsized":"2024-09-19T14:10:21.602224+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:21.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722729+0000","last_change":"2024-09-19T13:52:48.556806+0000","last_active":"2024-09-19T14:10:21.722729+0000","last_peered":"2024-09-19T14:10:21.722729+0000","last_clean":"2024-09-19T14:10:21.722729+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:10:21.722729+0000","last_undegraded":"2024-09-19T14:10:21.722729+0000","last_fullsized":"2024-09-19T14:10:21.722729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:12.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.618002+0000","last_change":"2024-09-19T13:51:15.739764+0000","last_active":"2024-09-19T14:12:06.618002+0000","last_peered":"2024-09-19T14:12:06.618002+0000","last_clean":"2024-09-19T14:12:06.618002+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:12:06.618002+0000","last_undegraded":"2024-09-19T14:12:06.618002+0000","last_fullsized":"2024-09-19T14:12:06.618002+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:19.998068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.811878+0000","last_change":"2024-09-19T14:03:08.835558+0000","last_active":"2024-09-19T14:10:41.811878+0000","last_peered":"2024-09-19T14:10:41.811878+0000","last_clean":"2024-09-19T14:10:41.811878+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:10:41.811878+0000","last_undegraded":"2024-09-19T14:10:41.811878+0000","last_fullsized":"2024-09-19T14:10:41.811878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:48.618379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723070+0000","last_change":"2024-09-19T13:52:51.587845+0000","last_active":"2024-09-19T14:10:21.723070+0000","last_peered":"2024-09-19T14:10:21.723070+0000","last_clean":"2024-09-19T14:10:21.723070+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:10:21.723070+0000","last_undegraded":"2024-09-19T14:10:21.723070+0000","last_fullsized":"2024-09-19T14:10:21.723070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:46.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":11264,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.638390+0000","last_change":"2024-09-19T13:52:48.554640+0000","last_active":"2024-09-19T14:10:21.638390+0000","last_peered":"2024-09-19T14:10:21.638390+0000","last_clean":"2024-09-19T14:10:21.638390+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:10:21.638390+0000","last_undegraded":"2024-09-19T14:10:21.638390+0000","last_fullsized":"2024-09-19T14:10:21.638390+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:35.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.816386+0000","last_change":"2024-09-19T13:51:15.745607+0000","last_active":"2024-09-19T14:11:16.816386+0000","last_peered":"2024-09-19T14:11:16.816386+0000","last_clean":"2024-09-19T14:11:16.816386+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:11:16.816386+0000","last_undegraded":"2024-09-19T14:11:16.816386+0000","last_fullsized":"2024-09-19T14:11:16.816386+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.713992+0000","last_change":"2024-09-19T14:03:08.837569+0000","last_active":"2024-09-19T14:10:26.713992+0000","last_peered":"2024-09-19T14:10:26.713992+0000","last_clean":"2024-09-19T14:10:26.713992+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:10:26.713992+0000","last_undegraded":"2024-09-19T14:10:26.713992+0000","last_fullsized":"2024-09-19T14:10:26.713992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:12.734099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.614000+0000","last_change":"2024-09-19T13:52:51.586976+0000","last_active":"2024-09-19T14:11:36.614000+0000","last_peered":"2024-09-19T14:11:36.614000+0000","last_clean":"2024-09-19T14:11:36.614000+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:11:36.614000+0000","last_undegraded":"2024-09-19T14:11:36.614000+0000","last_fullsized":"2024-09-19T14:11:36.614000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:28.946709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813410+0000","last_change":"2024-09-19T13:52:48.554485+0000","last_active":"2024-09-19T14:10:51.813410+0000","last_peered":"2024-09-19T14:10:51.813410+0000","last_clean":"2024-09-19T14:10:51.813410+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:10:51.813410+0000","last_undegraded":"2024-09-19T14:10:51.813410+0000","last_fullsized":"2024-09-19T14:10:51.813410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:12.978118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611594+0000","last_change":"2024-09-19T13:51:15.737359+0000","last_active":"2024-09-19T14:11:16.611594+0000","last_peered":"2024-09-19T14:11:16.611594+0000","last_clean":"2024-09-19T14:11:16.611594+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:11:16.611594+0000","last_undegraded":"2024-09-19T14:11:16.611594+0000","last_fullsized":"2024-09-19T14:11:16.611594+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:50.162815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723353+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:10:26.723353+0000","last_peered":"2024-09-19T14:10:26.723353+0000","last_clean":"2024-09-19T14:10:26.723353+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:10:26.723353+0000","last_undegraded":"2024-09-19T14:10:26.723353+0000","last_fullsized":"2024-09-19T14:10:26.723353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.363715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.727658+0000","last_change":"2024-09-19T13:52:51.581539+0000","last_active":"2024-09-19T14:10:56.727658+0000","last_peered":"2024-09-19T14:10:56.727658+0000","last_clean":"2024-09-19T14:10:56.727658+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:10:56.727658+0000","last_undegraded":"2024-09-19T14:10:56.727658+0000","last_fullsized":"2024-09-19T14:10:56.727658+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:52.537771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733334+0000","last_change":"2024-09-19T13:52:48.553843+0000","last_active":"2024-09-19T14:11:36.733334+0000","last_peered":"2024-09-19T14:11:36.733334+0000","last_clean":"2024-09-19T14:11:36.733334+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:11:36.733334+0000","last_undegraded":"2024-09-19T14:11:36.733334+0000","last_fullsized":"2024-09-19T14:11:36.733334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:42.945314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730599+0000","last_change":"2024-09-19T13:51:15.746581+0000","last_active":"2024-09-19T14:11:16.730599+0000","last_peered":"2024-09-19T14:11:16.730599+0000","last_clean":"2024-09-19T14:11:16.730599+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:11:16.730599+0000","last_undegraded":"2024-09-19T14:11:16.730599+0000","last_fullsized":"2024-09-19T14:11:16.730599+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:13.432237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730008+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:11:11.730008+0000","last_peered":"2024-09-19T14:11:11.730008+0000","last_clean":"2024-09-19T14:11:11.730008+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:11:11.730008+0000","last_undegraded":"2024-09-19T14:11:11.730008+0000","last_fullsized":"2024-09-19T14:11:11.730008+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.597736+0000","last_change":"2024-09-19T13:53:44.846213+0000","last_active":"2024-09-19T14:09:51.597736+0000","last_peered":"2024-09-19T14:09:51.597736+0000","last_clean":"2024-09-19T14:09:51.597736+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:09:51.597736+0000","last_undegraded":"2024-09-19T14:09:51.597736+0000","last_fullsized":"2024-09-19T14:09:51.597736+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:34.290843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'4","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.598177+0000","last_change":"2024-09-19T13:52:48.552836+0000","last_active":"2024-09-19T14:09:46.598177+0000","last_peered":"2024-09-19T14:09:46.598177+0000","last_clean":"2024-09-19T14:09:46.598177+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:09:46.598177+0000","last_undegraded":"2024-09-19T14:09:46.598177+0000","last_fullsized":"2024-09-19T14:09:46.598177+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:10.701239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12817,"num_write":4,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730570+0000","last_change":"2024-09-19T13:51:15.743989+0000","last_active":"2024-09-19T14:11:16.730570+0000","last_peered":"2024-09-19T14:11:16.730570+0000","last_clean":"2024-09-19T14:11:16.730570+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:11:16.730570+0000","last_undegraded":"2024-09-19T14:11:16.730570+0000","last_fullsized":"2024-09-19T14:11:16.730570+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:33.192776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647908+0000","last_change":"2024-09-19T14:03:08.837855+0000","last_active":"2024-09-19T14:11:31.647908+0000","last_peered":"2024-09-19T14:11:31.647908+0000","last_clean":"2024-09-19T14:11:31.647908+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:11:31.647908+0000","last_undegraded":"2024-09-19T14:11:31.647908+0000","last_fullsized":"2024-09-19T14:11:31.647908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:17.620266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.708338+0000","last_change":"2024-09-19T13:52:51.576379+0000","last_active":"2024-09-19T14:09:46.708338+0000","last_peered":"2024-09-19T14:09:46.708338+0000","last_clean":"2024-09-19T14:09:46.708338+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:09:46.708338+0000","last_undegraded":"2024-09-19T14:09:46.708338+0000","last_fullsized":"2024-09-19T14:09:46.708338+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:14.311651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.718219+0000","last_change":"2024-09-19T13:52:48.553148+0000","last_active":"2024-09-19T14:09:51.718219+0000","last_peered":"2024-09-19T14:09:51.718219+0000","last_clean":"2024-09-19T14:09:51.718219+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:09:51.718219+0000","last_undegraded":"2024-09-19T14:09:51.718219+0000","last_fullsized":"2024-09-19T14:09:51.718219+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:55.422175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720708+0000","last_change":"2024-09-19T13:51:15.746742+0000","last_active":"2024-09-19T14:11:16.720708+0000","last_peered":"2024-09-19T14:11:16.720708+0000","last_clean":"2024-09-19T14:11:16.720708+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:11:16.720708+0000","last_undegraded":"2024-09-19T14:11:16.720708+0000","last_fullsized":"2024-09-19T14:11:16.720708+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:30.998138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739569+0000","last_change":"2024-09-19T14:03:08.842863+0000","last_active":"2024-09-19T14:10:41.739569+0000","last_peered":"2024-09-19T14:10:41.739569+0000","last_clean":"2024-09-19T14:10:41.739569+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:10:41.739569+0000","last_undegraded":"2024-09-19T14:10:41.739569+0000","last_fullsized":"2024-09-19T14:10:41.739569+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:07.703304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.713321+0000","last_change":"2024-09-19T13:52:51.577966+0000","last_active":"2024-09-19T14:10:21.713321+0000","last_peered":"2024-09-19T14:10:21.713321+0000","last_clean":"2024-09-19T14:10:21.713321+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:10:21.713321+0000","last_undegraded":"2024-09-19T14:10:21.713321+0000","last_fullsized":"2024-09-19T14:10:21.713321+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:07.818951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723019+0000","last_change":"2024-09-19T13:52:48.556329+0000","last_active":"2024-09-19T14:10:21.723019+0000","last_peered":"2024-09-19T14:10:21.723019+0000","last_clean":"2024-09-19T14:10:21.723019+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:10:21.723019+0000","last_undegraded":"2024-09-19T14:10:21.723019+0000","last_fullsized":"2024-09-19T14:10:21.723019+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:39.632455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":103,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.222490+0000","last_change":"2024-09-19T13:51:15.738677+0000","last_active":"2024-09-19T14:11:23.222490+0000","last_peered":"2024-09-19T14:11:23.222490+0000","last_clean":"2024-09-19T14:11:23.222490+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:11:23.222490+0000","last_undegraded":"2024-09-19T14:11:23.222490+0000","last_fullsized":"2024-09-19T14:11:23.222490+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:11.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739606+0000","last_change":"2024-09-19T14:03:08.844476+0000","last_active":"2024-09-19T14:10:41.739606+0000","last_peered":"2024-09-19T14:10:41.739606+0000","last_clean":"2024-09-19T14:10:41.739606+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:10:41.739606+0000","last_undegraded":"2024-09-19T14:10:41.739606+0000","last_fullsized":"2024-09-19T14:10:41.739606+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:07.162545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722684+0000","last_change":"2024-09-19T13:52:51.580942+0000","last_active":"2024-09-19T14:10:21.722684+0000","last_peered":"2024-09-19T14:10:21.722684+0000","last_clean":"2024-09-19T14:10:21.722684+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:10:21.722684+0000","last_undegraded":"2024-09-19T14:10:21.722684+0000","last_fullsized":"2024-09-19T14:10:21.722684+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:13.538115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":17408,"num_write":6,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.603559+0000","last_change":"2024-09-19T13:52:48.559959+0000","last_active":"2024-09-19T14:10:21.603559+0000","last_peered":"2024-09-19T14:10:21.603559+0000","last_clean":"2024-09-19T14:10:21.603559+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:10:21.603559+0000","last_undegraded":"2024-09-19T14:10:21.603559+0000","last_fullsized":"2024-09-19T14:10:21.603559+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:01.163462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.640638+0000","last_change":"2024-09-19T13:51:15.740479+0000","last_active":"2024-09-19T14:10:36.640638+0000","last_peered":"2024-09-19T14:10:36.640638+0000","last_clean":"2024-09-19T14:10:36.640638+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:10:36.640638+0000","last_undegraded":"2024-09-19T14:10:36.640638+0000","last_fullsized":"2024-09-19T14:10:36.640638+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:23.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636875+0000","last_change":"2024-09-19T14:03:08.839816+0000","last_active":"2024-09-19T14:10:11.636875+0000","last_peered":"2024-09-19T14:10:11.636875+0000","last_clean":"2024-09-19T14:10:11.636875+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:10:11.636875+0000","last_undegraded":"2024-09-19T14:10:11.636875+0000","last_fullsized":"2024-09-19T14:10:11.636875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:56.109994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717106+0000","last_change":"2024-09-19T13:52:51.579222+0000","last_active":"2024-09-19T14:09:46.717106+0000","last_peered":"2024-09-19T14:09:46.717106+0000","last_clean":"2024-09-19T14:09:46.717106+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:09:46.717106+0000","last_undegraded":"2024-09-19T14:09:46.717106+0000","last_fullsized":"2024-09-19T14:09:46.717106+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:47.019906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'8","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.612336+0000","last_change":"2024-09-19T13:52:48.554787+0000","last_active":"2024-09-19T14:11:36.612336+0000","last_peered":"2024-09-19T14:11:36.612336+0000","last_clean":"2024-09-19T14:11:36.612336+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:11:36.612336+0000","last_undegraded":"2024-09-19T14:11:36.612336+0000","last_fullsized":"2024-09-19T14:11:36.612336+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:28.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.128068+0000","last_change":"2024-09-19T13:51:15.739410+0000","last_active":"2024-09-19T14:12:01.128068+0000","last_peered":"2024-09-19T14:12:01.128068+0000","last_clean":"2024-09-19T14:12:01.128068+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:12:01.128068+0000","last_undegraded":"2024-09-19T14:12:01.128068+0000","last_fullsized":"2024-09-19T14:12:01.128068+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:59.512917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.807924+0000","last_change":"2024-09-19T14:03:08.841302+0000","last_active":"2024-09-19T14:10:11.807924+0000","last_peered":"2024-09-19T14:10:11.807924+0000","last_clean":"2024-09-19T14:10:11.807924+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:10:11.807924+0000","last_undegraded":"2024-09-19T14:10:11.807924+0000","last_fullsized":"2024-09-19T14:10:11.807924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:41.250326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733241+0000","last_change":"2024-09-19T13:52:51.578766+0000","last_active":"2024-09-19T14:11:36.733241+0000","last_peered":"2024-09-19T14:11:36.733241+0000","last_clean":"2024-09-19T14:11:36.733241+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:11:36.733241+0000","last_undegraded":"2024-09-19T14:11:36.733241+0000","last_fullsized":"2024-09-19T14:11:36.733241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:06.602738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'1","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.730748+0000","last_change":"2024-09-19T13:52:48.554709+0000","last_active":"2024-09-19T14:09:46.730748+0000","last_peered":"2024-09-19T14:09:46.730748+0000","last_clean":"2024-09-19T14:09:46.730748+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:09:46.730748+0000","last_undegraded":"2024-09-19T14:09:46.730748+0000","last_fullsized":"2024-09-19T14:09:46.730748+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:18.382465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60368,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.724834+0000","last_change":"2024-09-19T13:51:15.744268+0000","last_active":"2024-09-19T14:10:36.724834+0000","last_peered":"2024-09-19T14:10:36.724834+0000","last_clean":"2024-09-19T14:10:36.724834+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:10:36.724834+0000","last_undegraded":"2024-09-19T14:10:36.724834+0000","last_fullsized":"2024-09-19T14:10:36.724834+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:44.697556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734779+0000","last_change":"2024-09-19T14:03:08.840741+0000","last_active":"2024-09-19T14:10:11.734779+0000","last_peered":"2024-09-19T14:10:11.734779+0000","last_clean":"2024-09-19T14:10:11.734779+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:10:11.734779+0000","last_undegraded":"2024-09-19T14:10:11.734779+0000","last_fullsized":"2024-09-19T14:10:11.734779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:28.511196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717148+0000","last_change":"2024-09-19T13:52:51.576629+0000","last_active":"2024-09-19T14:09:46.717148+0000","last_peered":"2024-09-19T14:09:46.717148+0000","last_clean":"2024-09-19T14:09:46.717148+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:09:46.717148+0000","last_undegraded":"2024-09-19T14:09:46.717148+0000","last_fullsized":"2024-09-19T14:09:46.717148+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:12.831765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'1","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.804394+0000","last_change":"2024-09-19T13:52:48.558114+0000","last_active":"2024-09-19T14:09:46.804394+0000","last_peered":"2024-09-19T14:09:46.804394+0000","last_clean":"2024-09-19T14:09:46.804394+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:09:46.804394+0000","last_undegraded":"2024-09-19T14:09:46.804394+0000","last_fullsized":"2024-09-19T14:09:46.804394+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:06.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.811335+0000","last_change":"2024-09-19T13:51:15.739232+0000","last_active":"2024-09-19T14:10:36.811335+0000","last_peered":"2024-09-19T14:10:36.811335+0000","last_clean":"2024-09-19T14:10:36.811335+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:10:36.811335+0000","last_undegraded":"2024-09-19T14:10:36.811335+0000","last_fullsized":"2024-09-19T14:10:36.811335+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:51.455590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600709+0000","last_change":"2024-09-19T14:03:08.838834+0000","last_active":"2024-09-19T14:10:11.600709+0000","last_peered":"2024-09-19T14:10:11.600709+0000","last_clean":"2024-09-19T14:10:11.600709+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:10:11.600709+0000","last_undegraded":"2024-09-19T14:10:11.600709+0000","last_fullsized":"2024-09-19T14:10:11.600709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:03.093578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717534+0000","last_change":"2024-09-19T13:52:51.583920+0000","last_active":"2024-09-19T14:09:46.717534+0000","last_peered":"2024-09-19T14:09:46.717534+0000","last_clean":"2024-09-19T14:09:46.717534+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:09:46.717534+0000","last_undegraded":"2024-09-19T14:09:46.717534+0000","last_fullsized":"2024-09-19T14:09:46.717534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:36.896326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'7","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.598296+0000","last_change":"2024-09-19T13:52:48.555699+0000","last_active":"2024-09-19T14:09:46.598296+0000","last_peered":"2024-09-19T14:09:46.598296+0000","last_clean":"2024-09-19T14:09:46.598296+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:09:46.598296+0000","last_undegraded":"2024-09-19T14:09:46.598296+0000","last_fullsized":"2024-09-19T14:09:46.598296+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:08.653057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.732994+0000","last_change":"2024-09-19T13:51:15.743134+0000","last_active":"2024-09-19T14:10:01.732994+0000","last_peered":"2024-09-19T14:10:01.732994+0000","last_clean":"2024-09-19T14:10:01.732994+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:10:01.732994+0000","last_undegraded":"2024-09-19T14:10:01.732994+0000","last_fullsized":"2024-09-19T14:10:01.732994+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:20.033888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723447+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:10:26.723447+0000","last_peered":"2024-09-19T14:10:26.723447+0000","last_clean":"2024-09-19T14:10:26.723447+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:10:26.723447+0000","last_undegraded":"2024-09-19T14:10:26.723447+0000","last_fullsized":"2024-09-19T14:10:26.723447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:46.882911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'13","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647858+0000","last_change":"2024-09-19T13:52:51.584825+0000","last_active":"2024-09-19T14:11:31.647858+0000","last_peered":"2024-09-19T14:11:31.647858+0000","last_clean":"2024-09-19T14:11:31.647858+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:11:31.647858+0000","last_undegraded":"2024-09-19T14:11:31.647858+0000","last_fullsized":"2024-09-19T14:11:31.647858+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:27.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":11793,"num_write":33,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732335+0000","last_change":"2024-09-19T13:52:48.558319+0000","last_active":"2024-09-19T14:11:31.732335+0000","last_peered":"2024-09-19T14:11:31.732335+0000","last_clean":"2024-09-19T14:11:31.732335+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:11:31.732335+0000","last_undegraded":"2024-09-19T14:11:31.732335+0000","last_fullsized":"2024-09-19T14:11:31.732335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:02.238052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.235548+0000","last_change":"2024-09-19T13:51:15.743038+0000","last_active":"2024-09-19T14:11:22.235548+0000","last_peered":"2024-09-19T14:11:22.235548+0000","last_clean":"2024-09-19T14:11:22.235548+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:11:22.235548+0000","last_undegraded":"2024-09-19T14:11:22.235548+0000","last_fullsized":"2024-09-19T14:11:22.235548+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:09.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.604316+0000","last_change":"2024-09-19T14:03:08.842157+0000","last_active":"2024-09-19T14:10:26.604316+0000","last_peered":"2024-09-19T14:10:26.604316+0000","last_clean":"2024-09-19T14:10:26.604316+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:10:26.604316+0000","last_undegraded":"2024-09-19T14:10:26.604316+0000","last_fullsized":"2024-09-19T14:10:26.604316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647830+0000","last_change":"2024-09-19T13:52:51.582431+0000","last_active":"2024-09-19T14:11:31.647830+0000","last_peered":"2024-09-19T14:11:31.647830+0000","last_clean":"2024-09-19T14:11:31.647830+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:11:31.647830+0000","last_undegraded":"2024-09-19T14:11:31.647830+0000","last_fullsized":"2024-09-19T14:11:31.647830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:56.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732554+0000","last_change":"2024-09-19T13:52:48.558710+0000","last_active":"2024-09-19T14:11:31.732554+0000","last_peered":"2024-09-19T14:11:31.732554+0000","last_clean":"2024-09-19T14:11:31.732554+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:11:31.732554+0000","last_undegraded":"2024-09-19T14:11:31.732554+0000","last_fullsized":"2024-09-19T14:11:31.732554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:43.224289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599659+0000","last_change":"2024-09-19T13:51:15.739209+0000","last_active":"2024-09-19T14:09:56.599659+0000","last_peered":"2024-09-19T14:09:56.599659+0000","last_clean":"2024-09-19T14:09:56.599659+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:09:56.599659+0000","last_undegraded":"2024-09-19T14:09:56.599659+0000","last_fullsized":"2024-09-19T14:09:56.599659+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:48.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602888+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:10:16.602888+0000","last_peered":"2024-09-19T14:10:16.602888+0000","last_clean":"2024-09-19T14:10:16.602888+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:10:16.602888+0000","last_undegraded":"2024-09-19T14:10:16.602888+0000","last_fullsized":"2024-09-19T14:10:16.602888+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:48.528788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732599+0000","last_change":"2024-09-19T13:52:51.580249+0000","last_active":"2024-09-19T14:11:31.732599+0000","last_peered":"2024-09-19T14:11:31.732599+0000","last_clean":"2024-09-19T14:11:31.732599+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:11:31.732599+0000","last_undegraded":"2024-09-19T14:11:31.732599+0000","last_fullsized":"2024-09-19T14:11:31.732599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:23.302145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722601+0000","last_change":"2024-09-19T13:52:48.548153+0000","last_active":"2024-09-19T14:11:31.722601+0000","last_peered":"2024-09-19T14:11:31.722601+0000","last_clean":"2024-09-19T14:11:31.722601+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:11:31.722601+0000","last_undegraded":"2024-09-19T14:11:31.722601+0000","last_fullsized":"2024-09-19T14:11:31.722601+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:48.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":214,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718953+0000","last_change":"2024-09-19T13:51:15.736147+0000","last_active":"2024-09-19T14:09:56.718953+0000","last_peered":"2024-09-19T14:09:56.718953+0000","last_clean":"2024-09-19T14:09:56.718953+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:09:56.718953+0000","last_undegraded":"2024-09-19T14:09:56.718953+0000","last_fullsized":"2024-09-19T14:09:56.718953+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:46:19.842918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723422+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:10:26.723422+0000","last_peered":"2024-09-19T14:10:26.723422+0000","last_clean":"2024-09-19T14:10:26.723422+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:10:26.723422+0000","last_undegraded":"2024-09-19T14:10:26.723422+0000","last_fullsized":"2024-09-19T14:10:26.723422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:18.667527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'4","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722586+0000","last_change":"2024-09-19T13:52:51.585924+0000","last_active":"2024-09-19T14:11:31.722586+0000","last_peered":"2024-09-19T14:11:31.722586+0000","last_clean":"2024-09-19T14:11:31.722586+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:11:31.722586+0000","last_undegraded":"2024-09-19T14:11:31.722586+0000","last_fullsized":"2024-09-19T14:11:31.722586+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:33.073773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18432,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'8","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611549+0000","last_change":"2024-09-19T13:52:48.547186+0000","last_active":"2024-09-19T14:11:31.611549+0000","last_peered":"2024-09-19T14:11:31.611549+0000","last_clean":"2024-09-19T14:11:31.611549+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:11:31.611549+0000","last_undegraded":"2024-09-19T14:11:31.611549+0000","last_fullsized":"2024-09-19T14:11:31.611549+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:31.825750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339881,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":26674,"num_write":8,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.377489+0000","last_change":"2024-09-19T13:51:15.745411+0000","last_active":"2024-09-19T14:12:01.377489+0000","last_peered":"2024-09-19T14:12:01.377489+0000","last_clean":"2024-09-19T14:12:01.377489+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:12:01.377489+0000","last_undegraded":"2024-09-19T14:12:01.377489+0000","last_fullsized":"2024-09-19T14:12:01.377489+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:56.436504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820573+0000","last_change":"2024-09-19T14:03:08.839556+0000","last_active":"2024-09-19T14:11:51.820573+0000","last_peered":"2024-09-19T14:11:51.820573+0000","last_clean":"2024-09-19T14:11:51.820573+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:11:51.820573+0000","last_undegraded":"2024-09-19T14:11:51.820573+0000","last_fullsized":"2024-09-19T14:11:51.820573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:45.080550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'6","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726983+0000","last_change":"2024-09-19T13:52:51.578477+0000","last_active":"2024-09-19T14:10:51.726983+0000","last_peered":"2024-09-19T14:10:51.726983+0000","last_clean":"2024-09-19T14:10:51.726983+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:10:51.726983+0000","last_undegraded":"2024-09-19T14:10:51.726983+0000","last_fullsized":"2024-09-19T14:10:51.726983+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:50.156854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":11,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'1","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740989+0000","last_change":"2024-09-19T13:52:48.558154+0000","last_active":"2024-09-19T14:10:51.740989+0000","last_peered":"2024-09-19T14:10:51.740989+0000","last_clean":"2024-09-19T14:10:51.740989+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:10:51.740989+0000","last_undegraded":"2024-09-19T14:10:51.740989+0000","last_fullsized":"2024-09-19T14:10:51.740989+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:17.554459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733289+0000","last_change":"2024-09-19T13:51:15.743194+0000","last_active":"2024-09-19T14:11:36.733289+0000","last_peered":"2024-09-19T14:11:36.733289+0000","last_clean":"2024-09-19T14:11:36.733289+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:11:36.733289+0000","last_undegraded":"2024-09-19T14:11:36.733289+0000","last_fullsized":"2024-09-19T14:11:36.733289+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:50.338128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732215+0000","last_change":"2024-09-19T14:03:08.841430+0000","last_active":"2024-09-19T14:09:56.732215+0000","last_peered":"2024-09-19T14:09:56.732215+0000","last_clean":"2024-09-19T14:09:56.732215+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:09:56.732215+0000","last_undegraded":"2024-09-19T14:09:56.732215+0000","last_fullsized":"2024-09-19T14:09:56.732215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:02.341745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726947+0000","last_change":"2024-09-19T13:52:51.585844+0000","last_active":"2024-09-19T14:10:51.726947+0000","last_peered":"2024-09-19T14:10:51.726947+0000","last_clean":"2024-09-19T14:10:51.726947+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:10:51.726947+0000","last_undegraded":"2024-09-19T14:10:51.726947+0000","last_fullsized":"2024-09-19T14:10:51.726947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:51.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813367+0000","last_change":"2024-09-19T13:52:48.558799+0000","last_active":"2024-09-19T14:10:51.813367+0000","last_peered":"2024-09-19T14:10:51.813367+0000","last_clean":"2024-09-19T14:10:51.813367+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:10:51.813367+0000","last_undegraded":"2024-09-19T14:10:51.813367+0000","last_fullsized":"2024-09-19T14:10:51.813367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:02.090671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.123898+0000","last_change":"2024-09-19T13:51:15.747319+0000","last_active":"2024-09-19T14:12:01.123898+0000","last_peered":"2024-09-19T14:12:01.123898+0000","last_clean":"2024-09-19T14:12:01.123898+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:12:01.123898+0000","last_undegraded":"2024-09-19T14:12:01.123898+0000","last_fullsized":"2024-09-19T14:12:01.123898+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:36.553112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.725348+0000","last_change":"2024-09-19T14:03:08.837522+0000","last_active":"2024-09-19T14:11:51.725348+0000","last_peered":"2024-09-19T14:11:51.725348+0000","last_clean":"2024-09-19T14:11:51.725348+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:11:51.725348+0000","last_undegraded":"2024-09-19T14:11:51.725348+0000","last_fullsized":"2024-09-19T14:11:51.725348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:20.683332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643598+0000","last_change":"2024-09-19T13:52:51.586120+0000","last_active":"2024-09-19T14:10:56.643598+0000","last_peered":"2024-09-19T14:10:56.643598+0000","last_clean":"2024-09-19T14:10:56.643598+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:10:56.643598+0000","last_undegraded":"2024-09-19T14:10:56.643598+0000","last_fullsized":"2024-09-19T14:10:56.643598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:59.884434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.607991+0000","last_change":"2024-09-19T13:52:48.554380+0000","last_active":"2024-09-19T14:10:51.607991+0000","last_peered":"2024-09-19T14:10:51.607991+0000","last_clean":"2024-09-19T14:10:51.607991+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:10:51.607991+0000","last_undegraded":"2024-09-19T14:10:51.607991+0000","last_fullsized":"2024-09-19T14:10:51.607991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:07.309256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722642+0000","last_change":"2024-09-19T13:51:15.747867+0000","last_active":"2024-09-19T14:11:31.722642+0000","last_peered":"2024-09-19T14:11:31.722642+0000","last_clean":"2024-09-19T14:11:31.722642+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:11:31.722642+0000","last_undegraded":"2024-09-19T14:11:31.722642+0000","last_fullsized":"2024-09-19T14:11:31.722642+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749807+0000","last_change":"2024-09-19T14:03:08.841866+0000","last_active":"2024-09-19T14:11:51.749807+0000","last_peered":"2024-09-19T14:11:51.749807+0000","last_clean":"2024-09-19T14:11:51.749807+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:11:51.749807+0000","last_undegraded":"2024-09-19T14:11:51.749807+0000","last_fullsized":"2024-09-19T14:11:51.749807+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:36.658533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727005+0000","last_change":"2024-09-19T13:52:51.582164+0000","last_active":"2024-09-19T14:10:51.727005+0000","last_peered":"2024-09-19T14:10:51.727005+0000","last_clean":"2024-09-19T14:10:51.727005+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:10:51.727005+0000","last_undegraded":"2024-09-19T14:10:51.727005+0000","last_fullsized":"2024-09-19T14:10:51.727005+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:27.713291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'7","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643565+0000","last_change":"2024-09-19T13:52:48.547009+0000","last_active":"2024-09-19T14:10:56.643565+0000","last_peered":"2024-09-19T14:10:56.643565+0000","last_clean":"2024-09-19T14:10:56.643565+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:10:56.643565+0000","last_undegraded":"2024-09-19T14:10:56.643565+0000","last_fullsized":"2024-09-19T14:10:56.643565+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:40.726822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.310015+0000","last_change":"2024-09-19T13:51:15.740368+0000","last_active":"2024-09-19T14:11:59.310015+0000","last_peered":"2024-09-19T14:11:59.310015+0000","last_clean":"2024-09-19T14:11:59.310015+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:11:59.310015+0000","last_undegraded":"2024-09-19T14:11:59.310015+0000","last_fullsized":"2024-09-19T14:11:59.310015+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.326002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718769+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:09:56.718769+0000","last_peered":"2024-09-19T14:09:56.718769+0000","last_clean":"2024-09-19T14:09:56.718769+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:09:56.718769+0000","last_undegraded":"2024-09-19T14:09:56.718769+0000","last_fullsized":"2024-09-19T14:09:56.718769+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:23.564561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'3","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721393+0000","last_change":"2024-09-19T13:52:51.584114+0000","last_active":"2024-09-19T14:10:11.721393+0000","last_peered":"2024-09-19T14:10:11.721393+0000","last_clean":"2024-09-19T14:10:11.721393+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:10:11.721393+0000","last_undegraded":"2024-09-19T14:10:11.721393+0000","last_fullsized":"2024-09-19T14:10:11.721393+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:15.511565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.601992+0000","last_change":"2024-09-19T13:52:48.555321+0000","last_active":"2024-09-19T14:10:11.601992+0000","last_peered":"2024-09-19T14:10:11.601992+0000","last_clean":"2024-09-19T14:10:11.601992+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:10:11.601992+0000","last_undegraded":"2024-09-19T14:10:11.601992+0000","last_fullsized":"2024-09-19T14:10:11.601992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:35.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613130+0000","last_change":"2024-09-19T13:51:15.743442+0000","last_active":"2024-09-19T14:11:31.613130+0000","last_peered":"2024-09-19T14:11:31.613130+0000","last_clean":"2024-09-19T14:11:31.613130+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:11:31.613130+0000","last_undegraded":"2024-09-19T14:11:31.613130+0000","last_fullsized":"2024-09-19T14:11:31.613130+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:06.945466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.733045+0000","last_change":"2024-09-19T14:03:08.843681+0000","last_active":"2024-09-19T14:10:01.733045+0000","last_peered":"2024-09-19T14:10:01.733045+0000","last_clean":"2024-09-19T14:10:01.733045+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:10:01.733045+0000","last_undegraded":"2024-09-19T14:10:01.733045+0000","last_fullsized":"2024-09-19T14:10:01.733045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:00.158335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734797+0000","last_change":"2024-09-19T13:52:51.586345+0000","last_active":"2024-09-19T14:10:11.734797+0000","last_peered":"2024-09-19T14:10:11.734797+0000","last_clean":"2024-09-19T14:10:11.734797+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:10:11.734797+0000","last_undegraded":"2024-09-19T14:10:11.734797+0000","last_fullsized":"2024-09-19T14:10:11.734797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.184586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636840+0000","last_change":"2024-09-19T13:52:48.546287+0000","last_active":"2024-09-19T14:10:11.636840+0000","last_peered":"2024-09-19T14:10:11.636840+0000","last_clean":"2024-09-19T14:10:11.636840+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:10:11.636840+0000","last_undegraded":"2024-09-19T14:10:11.636840+0000","last_fullsized":"2024-09-19T14:10:11.636840+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:25.721235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:13.401604+0000","last_change":"2024-09-19T13:51:15.743432+0000","last_active":"2024-09-19T14:11:13.401604+0000","last_peered":"2024-09-19T14:11:13.401604+0000","last_clean":"2024-09-19T14:11:13.401604+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:11:13.401604+0000","last_undegraded":"2024-09-19T14:11:13.401604+0000","last_fullsized":"2024-09-19T14:11:13.401604+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:33.234941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732266+0000","last_change":"2024-09-19T14:03:08.842574+0000","last_active":"2024-09-19T14:09:56.732266+0000","last_peered":"2024-09-19T14:09:56.732266+0000","last_clean":"2024-09-19T14:09:56.732266+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:09:56.732266+0000","last_undegraded":"2024-09-19T14:09:56.732266+0000","last_fullsized":"2024-09-19T14:09:56.732266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:57.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.642788+0000","last_change":"2024-09-19T13:52:51.583284+0000","last_active":"2024-09-19T14:10:51.642788+0000","last_peered":"2024-09-19T14:10:51.642788+0000","last_clean":"2024-09-19T14:10:51.642788+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:10:51.642788+0000","last_undegraded":"2024-09-19T14:10:51.642788+0000","last_fullsized":"2024-09-19T14:10:51.642788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:42.843357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602834+0000","last_change":"2024-09-19T13:52:48.557637+0000","last_active":"2024-09-19T14:10:16.602834+0000","last_peered":"2024-09-19T14:10:16.602834+0000","last_clean":"2024-09-19T14:10:16.602834+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:10:16.602834+0000","last_undegraded":"2024-09-19T14:10:16.602834+0000","last_fullsized":"2024-09-19T14:10:16.602834+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:06.589139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.726202+0000","last_change":"2024-09-19T13:51:15.742226+0000","last_active":"2024-09-19T14:10:46.726202+0000","last_peered":"2024-09-19T14:10:46.726202+0000","last_clean":"2024-09-19T14:10:46.726202+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:10:46.726202+0000","last_undegraded":"2024-09-19T14:10:46.726202+0000","last_fullsized":"2024-09-19T14:10:46.726202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:54.177354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599771+0000","last_change":"2024-09-19T14:03:08.836511+0000","last_active":"2024-09-19T14:09:56.599771+0000","last_peered":"2024-09-19T14:09:56.599771+0000","last_clean":"2024-09-19T14:09:56.599771+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:09:56.599771+0000","last_undegraded":"2024-09-19T14:09:56.599771+0000","last_fullsized":"2024-09-19T14:09:56.599771+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:37.198257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.735788+0000","last_change":"2024-09-19T13:52:51.586838+0000","last_active":"2024-09-19T14:10:16.735788+0000","last_peered":"2024-09-19T14:10:16.735788+0000","last_clean":"2024-09-19T14:10:16.735788+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:10:16.735788+0000","last_undegraded":"2024-09-19T14:10:16.735788+0000","last_fullsized":"2024-09-19T14:10:16.735788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:15.962404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727446+0000","last_change":"2024-09-19T13:52:48.556403+0000","last_active":"2024-09-19T14:10:51.727446+0000","last_peered":"2024-09-19T14:10:51.727446+0000","last_clean":"2024-09-19T14:10:51.727446+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:10:51.727446+0000","last_undegraded":"2024-09-19T14:10:51.727446+0000","last_fullsized":"2024-09-19T14:10:51.727446+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:20.551373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.716860+0000","last_change":"2024-09-19T13:51:15.746021+0000","last_active":"2024-09-19T14:10:46.716860+0000","last_peered":"2024-09-19T14:10:46.716860+0000","last_clean":"2024-09-19T14:10:46.716860+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:10:46.716860+0000","last_undegraded":"2024-09-19T14:10:46.716860+0000","last_fullsized":"2024-09-19T14:10:46.716860+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:23.497158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.746520+0000","last_change":"2024-09-19T14:03:08.843561+0000","last_active":"2024-09-19T14:11:31.746520+0000","last_peered":"2024-09-19T14:11:31.746520+0000","last_clean":"2024-09-19T14:11:31.746520+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:11:31.746520+0000","last_undegraded":"2024-09-19T14:11:31.746520+0000","last_fullsized":"2024-09-19T14:11:31.746520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:24.992091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614667+0000","last_change":"2024-09-19T13:52:51.586079+0000","last_active":"2024-09-19T14:11:41.614667+0000","last_peered":"2024-09-19T14:11:41.614667+0000","last_clean":"2024-09-19T14:11:41.614667+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:11:41.614667+0000","last_undegraded":"2024-09-19T14:11:41.614667+0000","last_fullsized":"2024-09-19T14:11:41.614667+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:06.216009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'2","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747325+0000","last_change":"2024-09-19T13:52:48.554440+0000","last_active":"2024-09-19T14:11:36.747325+0000","last_peered":"2024-09-19T14:11:36.747325+0000","last_clean":"2024-09-19T14:11:36.747325+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:11:36.747325+0000","last_undegraded":"2024-09-19T14:11:36.747325+0000","last_fullsized":"2024-09-19T14:11:36.747325+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:31.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.607300+0000","last_change":"2024-09-19T13:51:15.740499+0000","last_active":"2024-09-19T14:10:46.607300+0000","last_peered":"2024-09-19T14:10:46.607300+0000","last_clean":"2024-09-19T14:10:46.607300+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:10:46.607300+0000","last_undegraded":"2024-09-19T14:10:46.607300+0000","last_fullsized":"2024-09-19T14:10:46.607300+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:10.208746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611531+0000","last_change":"2024-09-19T14:03:08.840165+0000","last_active":"2024-09-19T14:11:31.611531+0000","last_peered":"2024-09-19T14:11:31.611531+0000","last_clean":"2024-09-19T14:11:31.611531+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:11:31.611531+0000","last_undegraded":"2024-09-19T14:11:31.611531+0000","last_fullsized":"2024-09-19T14:11:31.611531+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:26.897102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613946+0000","last_change":"2024-09-19T13:52:51.587531+0000","last_active":"2024-09-19T14:11:36.613946+0000","last_peered":"2024-09-19T14:11:36.613946+0000","last_clean":"2024-09-19T14:11:36.613946+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:11:36.613946+0000","last_undegraded":"2024-09-19T14:11:36.613946+0000","last_fullsized":"2024-09-19T14:11:36.613946+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:31.550230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818442+0000","last_change":"2024-09-19T13:52:48.558491+0000","last_active":"2024-09-19T14:11:36.818442+0000","last_peered":"2024-09-19T14:11:36.818442+0000","last_clean":"2024-09-19T14:11:36.818442+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:11:36.818442+0000","last_undegraded":"2024-09-19T14:11:36.818442+0000","last_fullsized":"2024-09-19T14:11:36.818442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:47.947923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.610873+0000","last_change":"2024-09-19T13:51:15.745899+0000","last_active":"2024-09-19T14:11:11.610873+0000","last_peered":"2024-09-19T14:11:11.610873+0000","last_clean":"2024-09-19T14:11:11.610873+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:11:11.610873+0000","last_undegraded":"2024-09-19T14:11:11.610873+0000","last_fullsized":"2024-09-19T14:11:11.610873+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:38.734235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645917+0000","last_change":"2024-09-19T14:03:08.834382+0000","last_active":"2024-09-19T14:11:16.645917+0000","last_peered":"2024-09-19T14:11:16.645917+0000","last_clean":"2024-09-19T14:11:16.645917+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:11:16.645917+0000","last_undegraded":"2024-09-19T14:11:16.645917+0000","last_fullsized":"2024-09-19T14:11:16.645917+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:23.550035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734947+0000","last_change":"2024-09-19T13:52:51.587324+0000","last_active":"2024-09-19T14:10:11.734947+0000","last_peered":"2024-09-19T14:10:11.734947+0000","last_clean":"2024-09-19T14:10:11.734947+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:10:11.734947+0000","last_undegraded":"2024-09-19T14:10:11.734947+0000","last_fullsized":"2024-09-19T14:10:11.734947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:31.730122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600809+0000","last_change":"2024-09-19T13:52:48.553095+0000","last_active":"2024-09-19T14:10:11.600809+0000","last_peered":"2024-09-19T14:10:11.600809+0000","last_clean":"2024-09-19T14:10:11.600809+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:10:11.600809+0000","last_undegraded":"2024-09-19T14:10:11.600809+0000","last_fullsized":"2024-09-19T14:10:11.600809+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:06.522712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752646+0000","last_change":"2024-09-19T13:51:15.745034+0000","last_active":"2024-09-19T14:12:11.752646+0000","last_peered":"2024-09-19T14:12:11.752646+0000","last_clean":"2024-09-19T14:12:11.752646+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:12:11.752646+0000","last_undegraded":"2024-09-19T14:12:11.752646+0000","last_fullsized":"2024-09-19T14:12:11.752646+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.684247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732364+0000","last_change":"2024-09-19T14:03:08.839316+0000","last_active":"2024-09-19T14:11:31.732364+0000","last_peered":"2024-09-19T14:11:31.732364+0000","last_clean":"2024-09-19T14:11:31.732364+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:11:31.732364+0000","last_undegraded":"2024-09-19T14:11:31.732364+0000","last_fullsized":"2024-09-19T14:11:31.732364+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:47.115178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721502+0000","last_change":"2024-09-19T13:52:51.583041+0000","last_active":"2024-09-19T14:10:11.721502+0000","last_peered":"2024-09-19T14:10:11.721502+0000","last_clean":"2024-09-19T14:10:11.721502+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:10:11.721502+0000","last_undegraded":"2024-09-19T14:10:11.721502+0000","last_fullsized":"2024-09-19T14:10:11.721502+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:32.304868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'1","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734967+0000","last_change":"2024-09-19T13:52:48.558143+0000","last_active":"2024-09-19T14:10:11.734967+0000","last_peered":"2024-09-19T14:10:11.734967+0000","last_clean":"2024-09-19T14:10:11.734967+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:10:11.734967+0000","last_undegraded":"2024-09-19T14:10:11.734967+0000","last_fullsized":"2024-09-19T14:10:11.734967+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:09.148223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.652462+0000","last_change":"2024-09-19T13:51:15.746992+0000","last_active":"2024-09-19T14:12:06.652462+0000","last_peered":"2024-09-19T14:12:06.652462+0000","last_clean":"2024-09-19T14:12:06.652462+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:12:06.652462+0000","last_undegraded":"2024-09-19T14:12:06.652462+0000","last_fullsized":"2024-09-19T14:12:06.652462+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:59.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820648+0000","last_change":"2024-09-19T14:03:08.835971+0000","last_active":"2024-09-19T14:11:51.820648+0000","last_peered":"2024-09-19T14:11:51.820648+0000","last_clean":"2024-09-19T14:11:51.820648+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:11:51.820648+0000","last_undegraded":"2024-09-19T14:11:51.820648+0000","last_fullsized":"2024-09-19T14:11:51.820648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:49.881174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648494+0000","last_change":"2024-09-19T13:52:51.582819+0000","last_active":"2024-09-19T14:11:36.648494+0000","last_peered":"2024-09-19T14:11:36.648494+0000","last_clean":"2024-09-19T14:11:36.648494+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:11:36.648494+0000","last_undegraded":"2024-09-19T14:11:36.648494+0000","last_fullsized":"2024-09-19T14:11:36.648494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:43.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.741650+0000","last_change":"2024-09-19T13:52:48.556826+0000","last_active":"2024-09-19T14:10:56.741650+0000","last_peered":"2024-09-19T14:10:56.741650+0000","last_clean":"2024-09-19T14:10:56.741650+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:10:56.741650+0000","last_undegraded":"2024-09-19T14:10:56.741650+0000","last_fullsized":"2024-09-19T14:10:56.741650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:39.933207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.616079+0000","last_change":"2024-09-19T13:51:15.742662+0000","last_active":"2024-09-19T14:12:06.616079+0000","last_peered":"2024-09-19T14:12:06.616079+0000","last_clean":"2024-09-19T14:12:06.616079+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:12:06.616079+0000","last_undegraded":"2024-09-19T14:12:06.616079+0000","last_fullsized":"2024-09-19T14:12:06.616079+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:47.205807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.616208+0000","last_change":"2024-09-19T14:03:08.837483+0000","last_active":"2024-09-19T14:11:51.616208+0000","last_peered":"2024-09-19T14:11:51.616208+0000","last_clean":"2024-09-19T14:11:51.616208+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:11:51.616208+0000","last_undegraded":"2024-09-19T14:11:51.616208+0000","last_fullsized":"2024-09-19T14:11:51.616208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:43.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.607103+0000","last_change":"2024-09-19T13:52:51.582481+0000","last_active":"2024-09-19T14:10:56.607103+0000","last_peered":"2024-09-19T14:10:56.607103+0000","last_clean":"2024-09-19T14:10:56.607103+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:10:56.607103+0000","last_undegraded":"2024-09-19T14:10:56.607103+0000","last_fullsized":"2024-09-19T14:10:56.607103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.118790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747273+0000","last_change":"2024-09-19T13:52:48.558237+0000","last_active":"2024-09-19T14:11:36.747273+0000","last_peered":"2024-09-19T14:11:36.747273+0000","last_clean":"2024-09-19T14:11:36.747273+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:11:36.747273+0000","last_undegraded":"2024-09-19T14:11:36.747273+0000","last_fullsized":"2024-09-19T14:11:36.747273+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:14.742516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.737132+0000","last_change":"2024-09-19T13:51:15.739439+0000","last_active":"2024-09-19T14:12:06.737132+0000","last_peered":"2024-09-19T14:12:06.737132+0000","last_clean":"2024-09-19T14:12:06.737132+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:12:06.737132+0000","last_undegraded":"2024-09-19T14:12:06.737132+0000","last_fullsized":"2024-09-19T14:12:06.737132+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:29.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613161+0000","last_change":"2024-09-19T14:03:08.843652+0000","last_active":"2024-09-19T14:11:31.613161+0000","last_peered":"2024-09-19T14:11:31.613161+0000","last_clean":"2024-09-19T14:11:31.613161+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:11:31.613161+0000","last_undegraded":"2024-09-19T14:11:31.613161+0000","last_fullsized":"2024-09-19T14:11:31.613161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:18.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'6","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723289+0000","last_change":"2024-09-19T13:52:51.584999+0000","last_active":"2024-09-19T14:11:36.723289+0000","last_peered":"2024-09-19T14:11:36.723289+0000","last_clean":"2024-09-19T14:11:36.723289+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:11:36.723289+0000","last_undegraded":"2024-09-19T14:11:36.723289+0000","last_fullsized":"2024-09-19T14:11:36.723289+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:06.878095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":21053,"num_write":11,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648525+0000","last_change":"2024-09-19T13:52:48.554967+0000","last_active":"2024-09-19T14:11:36.648525+0000","last_peered":"2024-09-19T14:11:36.648525+0000","last_clean":"2024-09-19T14:11:36.648525+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:11:36.648525+0000","last_undegraded":"2024-09-19T14:11:36.648525+0000","last_fullsized":"2024-09-19T14:11:36.648525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:11.689955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.726954+0000","last_change":"2024-09-19T13:51:15.746342+0000","last_active":"2024-09-19T14:12:06.726954+0000","last_peered":"2024-09-19T14:12:06.726954+0000","last_clean":"2024-09-19T14:12:06.726954+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:12:06.726954+0000","last_undegraded":"2024-09-19T14:12:06.726954+0000","last_fullsized":"2024-09-19T14:12:06.726954+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:44.550078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747359+0000","last_change":"2024-09-19T14:03:08.842987+0000","last_active":"2024-09-19T14:11:36.747359+0000","last_peered":"2024-09-19T14:11:36.747359+0000","last_clean":"2024-09-19T14:11:36.747359+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:11:36.747359+0000","last_undegraded":"2024-09-19T14:11:36.747359+0000","last_fullsized":"2024-09-19T14:11:36.747359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:51.898754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733214+0000","last_change":"2024-09-19T13:52:51.581838+0000","last_active":"2024-09-19T14:11:36.733214+0000","last_peered":"2024-09-19T14:11:36.733214+0000","last_clean":"2024-09-19T14:11:36.733214+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:11:36.733214+0000","last_undegraded":"2024-09-19T14:11:36.733214+0000","last_fullsized":"2024-09-19T14:11:36.733214+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:20.245214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108793,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":214,"num_write":2,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723307+0000","last_change":"2024-09-19T13:52:48.546981+0000","last_active":"2024-09-19T14:11:36.723307+0000","last_peered":"2024-09-19T14:11:36.723307+0000","last_clean":"2024-09-19T14:11:36.723307+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:11:36.723307+0000","last_undegraded":"2024-09-19T14:11:36.723307+0000","last_fullsized":"2024-09-19T14:11:36.723307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:09.807617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.748475+0000","last_change":"2024-09-19T13:51:15.745532+0000","last_active":"2024-09-19T14:11:22.748475+0000","last_peered":"2024-09-19T14:11:22.748475+0000","last_clean":"2024-09-19T14:11:22.748475+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:11:22.748475+0000","last_undegraded":"2024-09-19T14:11:22.748475+0000","last_fullsized":"2024-09-19T14:11:22.748475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:14.528177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'190","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.408408+0000","last_change":"2024-09-19T13:36:07.808934+0000","last_active":"2024-09-19T14:12:12.408408+0000","last_peered":"2024-09-19T14:12:12.408408+0000","last_clean":"2024-09-19T14:12:12.408408+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:12:12.408408+0000","last_undegraded":"2024-09-19T14:12:12.408408+0000","last_fullsized":"2024-09-19T14:12:12.408408+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:00.228367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7200863,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":14767,"num_write":954,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'808","reported_seq":2383,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544116+0000","last_change":"2024-09-19T13:36:09.334352+0000","last_active":"2024-09-19T14:12:15.544116+0000","last_peered":"2024-09-19T14:12:15.544116+0000","last_clean":"2024-09-19T14:12:15.544116+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:12:15.544116+0000","last_undegraded":"2024-09-19T14:12:15.544116+0000","last_fullsized":"2024-09-19T14:12:15.544116+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:03.775963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648600+0000","last_change":"2024-09-19T13:36:07.810255+0000","last_active":"2024-09-19T14:11:36.648600+0000","last_peered":"2024-09-19T14:11:36.648600+0000","last_clean":"2024-09-19T14:11:36.648600+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:11:36.648600+0000","last_undegraded":"2024-09-19T14:11:36.648600+0000","last_fullsized":"2024-09-19T14:11:36.648600+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:57.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":5759,"num_write":872,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'700","reported_seq":2388,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607197+0000","last_change":"2024-09-19T13:36:09.341109+0000","last_active":"2024-09-19T14:12:13.607197+0000","last_peered":"2024-09-19T14:12:13.607197+0000","last_clean":"2024-09-19T14:12:13.607197+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:12:13.607197+0000","last_undegraded":"2024-09-19T14:12:13.607197+0000","last_fullsized":"2024-09-19T14:12:13.607197+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.137955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'219","reported_seq":847,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613967+0000","last_change":"2024-09-19T13:36:07.802705+0000","last_active":"2024-09-19T14:11:36.613967+0000","last_peered":"2024-09-19T14:11:36.613967+0000","last_clean":"2024-09-19T14:11:36.613967+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:11:36.613967+0000","last_undegraded":"2024-09-19T14:11:36.613967+0000","last_fullsized":"2024-09-19T14:11:36.613967+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.788681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5592268,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":12221,"num_write":1123,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'389","reported_seq":1859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260118+0000","last_change":"2024-09-19T13:36:09.331848+0000","last_active":"2024-09-19T14:12:20.260118+0000","last_peered":"2024-09-19T14:12:20.260118+0000","last_clean":"2024-09-19T14:12:20.260118+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:12:20.260118+0000","last_undegraded":"2024-09-19T14:12:20.260118+0000","last_fullsized":"2024-09-19T14:12:20.260118+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:25:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'216","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.617260+0000","last_change":"2024-09-19T13:36:07.812873+0000","last_active":"2024-09-19T14:12:16.617260+0000","last_peered":"2024-09-19T14:12:16.617260+0000","last_clean":"2024-09-19T14:12:16.617260+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:12:16.617260+0000","last_undegraded":"2024-09-19T14:12:16.617260+0000","last_fullsized":"2024-09-19T14:12:16.617260+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:44.575892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3471640,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":586,"num_read_kb":9100,"num_write":1123,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'993","reported_seq":2638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.225812+0000","last_change":"2024-09-19T13:36:44.400454+0000","last_active":"2024-09-19T14:12:13.225812+0000","last_peered":"2024-09-19T14:12:13.225812+0000","last_clean":"2024-09-19T14:12:13.225812+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:12:13.225812+0000","last_undegraded":"2024-09-19T14:12:13.225812+0000","last_fullsized":"2024-09-19T14:12:13.225812+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.890102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'193","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.004337+0000","last_change":"2024-09-19T13:36:07.808137+0000","last_active":"2024-09-19T14:12:07.004337+0000","last_peered":"2024-09-19T14:12:07.004337+0000","last_clean":"2024-09-19T14:12:07.004337+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:12:07.004337+0000","last_undegraded":"2024-09-19T14:12:07.004337+0000","last_fullsized":"2024-09-19T14:12:07.004337+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:25.229167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439926,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":134002,"num_write":940,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'557","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176066+0000","last_change":"2024-09-19T13:36:09.334428+0000","last_active":"2024-09-19T14:12:26.176066+0000","last_peered":"2024-09-19T14:12:26.176066+0000","last_clean":"2024-09-19T14:12:26.176066+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:12:26.176066+0000","last_undegraded":"2024-09-19T14:12:26.176066+0000","last_fullsized":"2024-09-19T14:12:26.176066+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:02.385725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'189","reported_seq":762,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.695601+0000","last_change":"2024-09-19T13:36:07.816316+0000","last_active":"2024-09-19T14:11:31.695601+0000","last_peered":"2024-09-19T14:11:31.695601+0000","last_clean":"2024-09-19T14:11:31.695601+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:11:31.695601+0000","last_undegraded":"2024-09-19T14:11:31.695601+0000","last_fullsized":"2024-09-19T14:11:31.695601+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.797797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":377,"num_write":870,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'835","reported_seq":2442,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544277+0000","last_change":"2024-09-19T13:36:09.333458+0000","last_active":"2024-09-19T14:12:15.544277+0000","last_peered":"2024-09-19T14:12:15.544277+0000","last_clean":"2024-09-19T14:12:15.544277+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:12:15.544277+0000","last_undegraded":"2024-09-19T14:12:15.544277+0000","last_fullsized":"2024-09-19T14:12:15.544277+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.936303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'185","reported_seq":783,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:33.178972+0000","last_change":"2024-09-19T13:36:07.816581+0000","last_active":"2024-09-19T14:11:33.178972+0000","last_peered":"2024-09-19T14:11:33.178972+0000","last_clean":"2024-09-19T14:11:33.178972+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:11:33.178972+0000","last_undegraded":"2024-09-19T14:11:33.178972+0000","last_fullsized":"2024-09-19T14:11:33.178972+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:11.595208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7227774,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":7782,"num_write":889,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'502","reported_seq":2283,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226009+0000","last_change":"2024-09-19T13:36:09.343477+0000","last_active":"2024-09-19T14:12:13.226009+0000","last_peered":"2024-09-19T14:12:13.226009+0000","last_clean":"2024-09-19T14:12:13.226009+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:12:13.226009+0000","last_undegraded":"2024-09-19T14:12:13.226009+0000","last_fullsized":"2024-09-19T14:12:13.226009+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'191","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:29.597137+0000","last_change":"2024-09-19T13:36:07.807757+0000","last_active":"2024-09-19T14:11:29.597137+0000","last_peered":"2024-09-19T14:11:29.597137+0000","last_clean":"2024-09-19T14:11:29.597137+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:11:29.597137+0000","last_undegraded":"2024-09-19T14:11:29.597137+0000","last_fullsized":"2024-09-19T14:11:29.597137+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:20.739883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534370,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1086,"num_read_kb":38780,"num_write":952,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'842","reported_seq":2345,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819911+0000","last_change":"2024-09-19T13:36:09.343462+0000","last_active":"2024-09-19T14:12:14.819911+0000","last_peered":"2024-09-19T14:12:14.819911+0000","last_clean":"2024-09-19T14:12:14.819911+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:12:14.819911+0000","last_undegraded":"2024-09-19T14:12:14.819911+0000","last_fullsized":"2024-09-19T14:12:14.819911+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:58.095506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'549","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171201+0000","last_change":"2024-09-19T13:36:09.331543+0000","last_active":"2024-09-19T14:12:15.171201+0000","last_peered":"2024-09-19T14:12:15.171201+0000","last_clean":"2024-09-19T14:12:15.171201+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:12:15.171201+0000","last_undegraded":"2024-09-19T14:12:15.171201+0000","last_fullsized":"2024-09-19T14:12:15.171201+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.041550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'185","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:30.861841+0000","last_change":"2024-09-19T13:36:07.812427+0000","last_active":"2024-09-19T14:11:30.861841+0000","last_peered":"2024-09-19T14:11:30.861841+0000","last_clean":"2024-09-19T14:11:30.861841+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:11:30.861841+0000","last_undegraded":"2024-09-19T14:11:30.861841+0000","last_fullsized":"2024-09-19T14:11:30.861841+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:24.508499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12224342,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":11511,"num_write":890,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'380","reported_seq":1872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355286+0000","last_change":"2024-09-19T13:36:09.341235+0000","last_active":"2024-09-19T14:12:27.355286+0000","last_peered":"2024-09-19T14:12:27.355286+0000","last_clean":"2024-09-19T14:12:27.355286+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:12:27.355286+0000","last_undegraded":"2024-09-19T14:12:27.355286+0000","last_fullsized":"2024-09-19T14:12:27.355286+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:22.590894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'187","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.001105+0000","last_change":"2024-09-19T13:36:07.811910+0000","last_active":"2024-09-19T14:11:59.001105+0000","last_peered":"2024-09-19T14:11:59.001105+0000","last_clean":"2024-09-19T14:11:59.001105+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:11:59.001105+0000","last_undegraded":"2024-09-19T14:11:59.001105+0000","last_fullsized":"2024-09-19T14:11:59.001105+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:59.243018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7277338,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":26719,"num_write":909,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'556","reported_seq":2179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882271+0000","last_change":"2024-09-19T13:36:09.336283+0000","last_active":"2024-09-19T14:12:15.882271+0000","last_peered":"2024-09-19T14:12:15.882271+0000","last_clean":"2024-09-19T14:12:15.882271+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:12:15.882271+0000","last_undegraded":"2024-09-19T14:12:15.882271+0000","last_fullsized":"2024-09-19T14:12:15.882271+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:45.974339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'215","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:09.696524+0000","last_change":"2024-09-19T13:36:44.401303+0000","last_active":"2024-09-19T14:12:09.696524+0000","last_peered":"2024-09-19T14:12:09.696524+0000","last_clean":"2024-09-19T14:12:09.696524+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:12:09.696524+0000","last_undegraded":"2024-09-19T14:12:09.696524+0000","last_fullsized":"2024-09-19T14:12:09.696524+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:04.996764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14025071,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":619,"num_read_kb":31849,"num_write":1135,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'377","reported_seq":1908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260138+0000","last_change":"2024-09-19T13:36:09.337079+0000","last_active":"2024-09-19T14:12:20.260138+0000","last_peered":"2024-09-19T14:12:20.260138+0000","last_clean":"2024-09-19T14:12:20.260138+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:12:20.260138+0000","last_undegraded":"2024-09-19T14:12:20.260138+0000","last_fullsized":"2024-09-19T14:12:20.260138+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:50.941135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'202","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.779251+0000","last_change":"2024-09-19T13:36:07.806856+0000","last_active":"2024-09-19T14:12:12.779251+0000","last_peered":"2024-09-19T14:12:12.779251+0000","last_clean":"2024-09-19T14:12:12.779251+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:12:12.779251+0000","last_undegraded":"2024-09-19T14:12:12.779251+0000","last_fullsized":"2024-09-19T14:12:12.779251+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:01.787704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5491166,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":559,"num_read_kb":49502,"num_write":985,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'390","reported_seq":1995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176428+0000","last_change":"2024-09-19T13:36:09.324663+0000","last_active":"2024-09-19T14:12:26.176428+0000","last_peered":"2024-09-19T14:12:26.176428+0000","last_clean":"2024-09-19T14:12:26.176428+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:12:26.176428+0000","last_undegraded":"2024-09-19T14:12:26.176428+0000","last_fullsized":"2024-09-19T14:12:26.176428+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:16.398494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'190","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.103953+0000","last_change":"2024-09-19T13:36:07.807094+0000","last_active":"2024-09-19T14:13:45.103953+0000","last_peered":"2024-09-19T14:13:45.103953+0000","last_clean":"2024-09-19T14:13:45.103953+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:13:45.103953+0000","last_undegraded":"2024-09-19T14:13:45.103953+0000","last_fullsized":"2024-09-19T14:13:45.103953+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:17.714362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11536576,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":176003,"num_write":885,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'907","reported_seq":2603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176234+0000","last_change":"2024-09-19T13:36:09.331135+0000","last_active":"2024-09-19T14:12:26.176234+0000","last_peered":"2024-09-19T14:12:26.176234+0000","last_clean":"2024-09-19T14:12:26.176234+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:12:26.176234+0000","last_undegraded":"2024-09-19T14:12:26.176234+0000","last_fullsized":"2024-09-19T14:12:26.176234+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:01.836377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'239","reported_seq":900,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727853+0000","last_change":"2024-09-19T13:36:07.813101+0000","last_active":"2024-09-19T14:12:25.727853+0000","last_peered":"2024-09-19T14:12:25.727853+0000","last_clean":"2024-09-19T14:12:25.727853+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:12:25.727853+0000","last_undegraded":"2024-09-19T14:12:25.727853+0000","last_fullsized":"2024-09-19T14:12:25.727853+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:17.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33577113,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":592,"num_read_kb":112164,"num_write":1130,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'136","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.817689+0000","last_change":"2024-09-19T13:36:17.363690+0000","last_active":"2024-09-19T14:12:27.817689+0000","last_peered":"2024-09-19T14:12:27.817689+0000","last_clean":"2024-09-19T14:12:27.817689+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:12:27.817689+0000","last_undegraded":"2024-09-19T14:12:27.817689+0000","last_fullsized":"2024-09-19T14:12:27.817689+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:29.851738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'815","reported_seq":2311,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260090+0000","last_change":"2024-09-19T13:36:09.344275+0000","last_active":"2024-09-19T14:12:20.260090+0000","last_peered":"2024-09-19T14:12:20.260090+0000","last_clean":"2024-09-19T14:12:20.260090+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:12:20.260090+0000","last_undegraded":"2024-09-19T14:12:20.260090+0000","last_fullsized":"2024-09-19T14:12:20.260090+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:38.192022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'172","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.769129+0000","last_change":"2024-09-19T13:36:07.808149+0000","last_active":"2024-09-19T14:12:25.769129+0000","last_peered":"2024-09-19T14:12:25.769129+0000","last_clean":"2024-09-19T14:12:25.769129+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:12:25.769129+0000","last_undegraded":"2024-09-19T14:12:25.769129+0000","last_fullsized":"2024-09-19T14:12:25.769129+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:33.668595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12628349,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":648,"num_read_kb":47147,"num_write":842,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599370+0000","last_change":"2024-09-19T13:36:11.340404+0000","last_active":"2024-09-19T14:10:01.599370+0000","last_peered":"2024-09-19T14:10:01.599370+0000","last_clean":"2024-09-19T14:10:01.599370+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:10:01.599370+0000","last_undegraded":"2024-09-19T14:10:01.599370+0000","last_fullsized":"2024-09-19T14:10:01.599370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.755867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'190","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.621211+0000","last_change":"2024-09-19T13:36:13.346842+0000","last_active":"2024-09-19T14:12:31.621211+0000","last_peered":"2024-09-19T14:12:31.621211+0000","last_clean":"2024-09-19T14:12:31.621211+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:12:31.621211+0000","last_undegraded":"2024-09-19T14:12:31.621211+0000","last_fullsized":"2024-09-19T14:12:31.621211+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:09.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":253,"num_read_kb":352,"num_write":152,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733994+0000","last_change":"2024-09-19T13:36:15.353039+0000","last_active":"2024-09-19T14:10:06.733994+0000","last_peered":"2024-09-19T14:10:06.733994+0000","last_clean":"2024-09-19T14:10:06.733994+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:10:06.733994+0000","last_undegraded":"2024-09-19T14:10:06.733994+0000","last_fullsized":"2024-09-19T14:10:06.733994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:40.506433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2504","reported_seq":4316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.251946+0000","last_change":"2024-09-19T13:36:17.362187+0000","last_active":"2024-09-19T14:12:26.251946+0000","last_peered":"2024-09-19T14:12:26.251946+0000","last_clean":"2024-09-19T14:12:26.251946+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:12:26.251946+0000","last_undegraded":"2024-09-19T14:12:26.251946+0000","last_fullsized":"2024-09-19T14:12:26.251946+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:08.218008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'475","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819729+0000","last_change":"2024-09-19T13:36:09.335816+0000","last_active":"2024-09-19T14:12:14.819729+0000","last_peered":"2024-09-19T14:12:14.819729+0000","last_clean":"2024-09-19T14:12:14.819729+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:12:14.819729+0000","last_undegraded":"2024-09-19T14:12:14.819729+0000","last_fullsized":"2024-09-19T14:12:14.819729+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:08.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'168","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.882445+0000","last_change":"2024-09-19T13:36:07.812428+0000","last_active":"2024-09-19T14:11:58.882445+0000","last_peered":"2024-09-19T14:11:58.882445+0000","last_clean":"2024-09-19T14:11:58.882445+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:11:58.882445+0000","last_undegraded":"2024-09-19T14:11:58.882445+0000","last_fullsized":"2024-09-19T14:11:58.882445+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:55.799082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":369,"num_read_kb":36151,"num_write":773,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730615+0000","last_change":"2024-09-19T13:36:11.336313+0000","last_active":"2024-09-19T14:11:16.730615+0000","last_peered":"2024-09-19T14:11:16.730615+0000","last_clean":"2024-09-19T14:11:16.730615+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:11:16.730615+0000","last_undegraded":"2024-09-19T14:11:16.730615+0000","last_fullsized":"2024-09-19T14:11:16.730615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'78","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.395391+0000","last_change":"2024-09-19T13:36:13.337644+0000","last_active":"2024-09-19T14:12:14.395391+0000","last_peered":"2024-09-19T14:12:14.395391+0000","last_clean":"2024-09-19T14:12:14.395391+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:12:14.395391+0000","last_undegraded":"2024-09-19T14:12:14.395391+0000","last_fullsized":"2024-09-19T14:12:14.395391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.720756+0000","last_change":"2024-09-19T13:36:15.349335+0000","last_active":"2024-09-19T14:10:06.720756+0000","last_peered":"2024-09-19T14:10:06.720756+0000","last_clean":"2024-09-19T14:10:06.720756+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:10:06.720756+0000","last_undegraded":"2024-09-19T14:10:06.720756+0000","last_fullsized":"2024-09-19T14:10:06.720756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:03.785626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'134","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.878009+0000","last_change":"2024-09-19T13:36:17.360523+0000","last_active":"2024-09-19T14:12:15.878009+0000","last_peered":"2024-09-19T14:12:15.878009+0000","last_clean":"2024-09-19T14:12:15.878009+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:12:15.878009+0000","last_undegraded":"2024-09-19T14:12:15.878009+0000","last_fullsized":"2024-09-19T14:12:15.878009+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:18.406844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'833","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.865020+0000","last_change":"2024-09-19T13:36:09.338236+0000","last_active":"2024-09-19T14:13:45.865020+0000","last_peered":"2024-09-19T14:13:45.865020+0000","last_clean":"2024-09-19T14:13:45.865020+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:13:45.865020+0000","last_undegraded":"2024-09-19T14:13:45.865020+0000","last_fullsized":"2024-09-19T14:13:45.865020+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:40.242627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'163","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.361325+0000","last_change":"2024-09-19T13:36:07.806261+0000","last_active":"2024-09-19T14:11:34.361325+0000","last_peered":"2024-09-19T14:11:34.361325+0000","last_clean":"2024-09-19T14:11:34.361325+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:11:34.361325+0000","last_undegraded":"2024-09-19T14:11:34.361325+0000","last_fullsized":"2024-09-19T14:11:34.361325+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:30.372295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11079321,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":450,"num_read_kb":63998,"num_write":815,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719618+0000","last_change":"2024-09-19T13:36:11.337174+0000","last_active":"2024-09-19T14:10:01.719618+0000","last_peered":"2024-09-19T14:10:01.719618+0000","last_clean":"2024-09-19T14:10:01.719618+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:10:01.719618+0000","last_undegraded":"2024-09-19T14:10:01.719618+0000","last_fullsized":"2024-09-19T14:10:01.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:56.806199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'103","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.682418+0000","last_change":"2024-09-19T13:36:13.342093+0000","last_active":"2024-09-19T14:12:06.682418+0000","last_peered":"2024-09-19T14:12:06.682418+0000","last_clean":"2024-09-19T14:12:06.682418+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:12:06.682418+0000","last_undegraded":"2024-09-19T14:12:06.682418+0000","last_fullsized":"2024-09-19T14:12:06.682418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.319447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'760","reported_seq":2062,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.050138+0000","last_change":"2024-09-19T13:36:15.353722+0000","last_active":"2024-09-19T14:13:47.050138+0000","last_peered":"2024-09-19T14:13:47.050138+0000","last_clean":"2024-09-19T14:13:47.050138+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:13:47.050138+0000","last_undegraded":"2024-09-19T14:13:47.050138+0000","last_fullsized":"2024-09-19T14:13:47.050138+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:26.683896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'275","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.861063+0000","last_change":"2024-09-19T13:36:17.362162+0000","last_active":"2024-09-19T14:12:27.861063+0000","last_peered":"2024-09-19T14:12:27.861063+0000","last_clean":"2024-09-19T14:12:27.861063+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:12:27.861063+0000","last_undegraded":"2024-09-19T14:12:27.861063+0000","last_fullsized":"2024-09-19T14:12:27.861063+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:30.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'431","reported_seq":1979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607238+0000","last_change":"2024-09-19T13:36:09.336191+0000","last_active":"2024-09-19T14:12:13.607238+0000","last_peered":"2024-09-19T14:12:13.607238+0000","last_clean":"2024-09-19T14:12:13.607238+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:12:13.607238+0000","last_undegraded":"2024-09-19T14:12:13.607238+0000","last_fullsized":"2024-09-19T14:12:13.607238+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:03.461778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'175","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.158614+0000","last_change":"2024-09-19T13:36:07.816563+0000","last_active":"2024-09-19T14:12:11.158614+0000","last_peered":"2024-09-19T14:12:11.158614+0000","last_clean":"2024-09-19T14:12:11.158614+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:12:11.158614+0000","last_undegraded":"2024-09-19T14:12:11.158614+0000","last_fullsized":"2024-09-19T14:12:11.158614+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:45.659866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21324016,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":442,"num_read_kb":22529,"num_write":867,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599419+0000","last_change":"2024-09-19T13:36:11.335988+0000","last_active":"2024-09-19T14:10:01.599419+0000","last_peered":"2024-09-19T14:10:01.599419+0000","last_clean":"2024-09-19T14:10:01.599419+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:10:01.599419+0000","last_undegraded":"2024-09-19T14:10:01.599419+0000","last_fullsized":"2024-09-19T14:10:01.599419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:16.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'111","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.755401+0000","last_change":"2024-09-19T13:36:13.678694+0000","last_active":"2024-09-19T14:12:31.755401+0000","last_peered":"2024-09-19T14:12:31.755401+0000","last_clean":"2024-09-19T14:12:31.755401+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:12:31.755401+0000","last_undegraded":"2024-09-19T14:12:31.755401+0000","last_fullsized":"2024-09-19T14:12:31.755401+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13713,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":236,"num_write":88,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'791","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.054231+0000","last_change":"2024-09-19T13:36:15.347048+0000","last_active":"2024-09-19T14:13:47.054231+0000","last_peered":"2024-09-19T14:13:47.054231+0000","last_clean":"2024-09-19T14:13:47.054231+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:13:47.054231+0000","last_undegraded":"2024-09-19T14:13:47.054231+0000","last_fullsized":"2024-09-19T14:13:47.054231+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:55.442266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'450","reported_seq":2022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226765+0000","last_change":"2024-09-19T13:36:09.334631+0000","last_active":"2024-09-19T14:12:13.226765+0000","last_peered":"2024-09-19T14:12:13.226765+0000","last_clean":"2024-09-19T14:12:13.226765+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:12:13.226765+0000","last_undegraded":"2024-09-19T14:12:13.226765+0000","last_fullsized":"2024-09-19T14:12:13.226765+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:01.778994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'232","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.304893+0000","last_change":"2024-09-19T13:36:07.809526+0000","last_active":"2024-09-19T14:12:01.304893+0000","last_peered":"2024-09-19T14:12:01.304893+0000","last_clean":"2024-09-19T14:12:01.304893+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:12:01.304893+0000","last_undegraded":"2024-09-19T14:12:01.304893+0000","last_fullsized":"2024-09-19T14:12:01.304893+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:56.101821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059510,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":672,"num_read_kb":46832,"num_write":1026,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740936+0000","last_change":"2024-09-19T13:36:11.332976+0000","last_active":"2024-09-19T14:10:51.740936+0000","last_peered":"2024-09-19T14:10:51.740936+0000","last_clean":"2024-09-19T14:10:51.740936+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:10:51.740936+0000","last_undegraded":"2024-09-19T14:10:51.740936+0000","last_fullsized":"2024-09-19T14:10:51.740936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:44.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'185","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:11.624593+0000","last_change":"2024-09-19T13:36:13.679868+0000","last_active":"2024-09-19T14:13:11.624593+0000","last_peered":"2024-09-19T14:13:11.624593+0000","last_clean":"2024-09-19T14:13:11.624593+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:13:11.624593+0000","last_undegraded":"2024-09-19T14:13:11.624593+0000","last_fullsized":"2024-09-19T14:13:11.624593+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:05.662964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":244,"num_read_kb":296,"num_write":138,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.635466+0000","last_change":"2024-09-19T13:36:15.351051+0000","last_active":"2024-09-19T14:10:01.635466+0000","last_peered":"2024-09-19T14:10:01.635466+0000","last_clean":"2024-09-19T14:10:01.635466+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:10:01.635466+0000","last_undegraded":"2024-09-19T14:10:01.635466+0000","last_fullsized":"2024-09-19T14:10:01.635466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:18.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'538","reported_seq":1352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.036523+0000","last_change":"2024-09-19T13:36:17.360774+0000","last_active":"2024-09-19T14:13:47.036523+0000","last_peered":"2024-09-19T14:13:47.036523+0000","last_clean":"2024-09-19T14:13:47.036523+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:13:47.036523+0000","last_undegraded":"2024-09-19T14:13:47.036523+0000","last_fullsized":"2024-09-19T14:13:47.036523+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355481+0000","last_change":"2024-09-19T13:36:09.332369+0000","last_active":"2024-09-19T14:12:27.355481+0000","last_peered":"2024-09-19T14:12:27.355481+0000","last_clean":"2024-09-19T14:12:27.355481+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:12:27.355481+0000","last_undegraded":"2024-09-19T14:12:27.355481+0000","last_fullsized":"2024-09-19T14:12:27.355481+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:59.620240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'197","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:29.355415+0000","last_change":"2024-09-19T13:36:07.806031+0000","last_active":"2024-09-19T14:11:29.355415+0000","last_peered":"2024-09-19T14:11:29.355415+0000","last_clean":"2024-09-19T14:11:29.355415+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:11:29.355415+0000","last_undegraded":"2024-09-19T14:11:29.355415+0000","last_fullsized":"2024-09-19T14:11:29.355415+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:23.397652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5298782,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":505,"num_read_kb":31454,"num_write":891,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"34'3","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.756819+0000","last_change":"2024-09-19T13:36:11.333511+0000","last_active":"2024-09-19T14:13:46.756819+0000","last_peered":"2024-09-19T14:13:46.756819+0000","last_clean":"2024-09-19T14:13:46.756819+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:13:46.756819+0000","last_undegraded":"2024-09-19T14:13:46.756819+0000","last_fullsized":"2024-09-19T14:13:46.756819+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:38.186843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'122","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738418+0000","last_change":"2024-09-19T13:36:13.346402+0000","last_active":"2024-09-19T14:12:16.738418+0000","last_peered":"2024-09-19T14:12:16.738418+0000","last_clean":"2024-09-19T14:12:16.738418+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:12:16.738418+0000","last_undegraded":"2024-09-19T14:12:16.738418+0000","last_fullsized":"2024-09-19T14:12:16.738418+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:23.310060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11311,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":221,"num_write":80,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:01.728430+0000","last_change":"2024-09-19T13:36:15.346352+0000","last_active":"2024-09-19T14:11:01.728430+0000","last_peered":"2024-09-19T14:11:01.728430+0000","last_clean":"2024-09-19T14:11:01.728430+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:11:01.728430+0000","last_undegraded":"2024-09-19T14:11:01.728430+0000","last_fullsized":"2024-09-19T14:11:01.728430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:31.554437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'173","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.844081+0000","last_change":"2024-09-19T13:36:17.360996+0000","last_active":"2024-09-19T14:13:36.844081+0000","last_peered":"2024-09-19T14:13:36.844081+0000","last_clean":"2024-09-19T14:13:36.844081+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:13:36.844081+0000","last_undegraded":"2024-09-19T14:13:36.844081+0000","last_fullsized":"2024-09-19T14:13:36.844081+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:40.718784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'343","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.175897+0000","last_change":"2024-09-19T13:36:44.478051+0000","last_active":"2024-09-19T14:12:26.175897+0000","last_peered":"2024-09-19T14:12:26.175897+0000","last_clean":"2024-09-19T14:12:26.175897+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:12:26.175897+0000","last_undegraded":"2024-09-19T14:12:26.175897+0000","last_fullsized":"2024-09-19T14:12:26.175897+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:28:06.614029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'234","reported_seq":1057,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.697721+0000","last_change":"2024-09-19T13:36:07.812190+0000","last_active":"2024-09-19T14:12:03.697721+0000","last_peered":"2024-09-19T14:12:03.697721+0000","last_clean":"2024-09-19T14:12:03.697721+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:12:03.697721+0000","last_undegraded":"2024-09-19T14:12:03.697721+0000","last_fullsized":"2024-09-19T14:12:03.697721+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:32.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17101928,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1167,"num_read_kb":168929,"num_write":1048,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805690+0000","last_change":"2024-09-19T13:36:11.333725+0000","last_active":"2024-09-19T14:09:56.805690+0000","last_peered":"2024-09-19T14:09:56.805690+0000","last_clean":"2024-09-19T14:09:56.805690+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:09:56.805690+0000","last_undegraded":"2024-09-19T14:09:56.805690+0000","last_fullsized":"2024-09-19T14:09:56.805690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:01.253625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'157","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.866319+0000","last_change":"2024-09-19T13:36:13.348257+0000","last_active":"2024-09-19T14:13:45.866319+0000","last_peered":"2024-09-19T14:13:45.866319+0000","last_clean":"2024-09-19T14:13:45.866319+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:13:45.866319+0000","last_undegraded":"2024-09-19T14:13:45.866319+0000","last_fullsized":"2024-09-19T14:13:45.866319+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:53.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":224,"num_write":106,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'801","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.055129+0000","last_change":"2024-09-19T13:36:15.347632+0000","last_active":"2024-09-19T14:13:47.055129+0000","last_peered":"2024-09-19T14:13:47.055129+0000","last_clean":"2024-09-19T14:13:47.055129+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:13:47.055129+0000","last_undegraded":"2024-09-19T14:13:47.055129+0000","last_fullsized":"2024-09-19T14:13:47.055129+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:07.500173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.860638+0000","last_change":"2024-09-19T13:36:17.360696+0000","last_active":"2024-09-19T14:13:45.860638+0000","last_peered":"2024-09-19T14:13:45.860638+0000","last_clean":"2024-09-19T14:13:45.860638+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:13:45.860638+0000","last_undegraded":"2024-09-19T14:13:45.860638+0000","last_fullsized":"2024-09-19T14:13:45.860638+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:33.562231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'423","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.167396+0000","last_change":"2024-09-19T13:36:09.341941+0000","last_active":"2024-09-19T14:12:26.167396+0000","last_peered":"2024-09-19T14:12:26.167396+0000","last_clean":"2024-09-19T14:12:26.167396+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:12:26.167396+0000","last_undegraded":"2024-09-19T14:12:26.167396+0000","last_fullsized":"2024-09-19T14:12:26.167396+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:51.059363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'202","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.616585+0000","last_change":"2024-09-19T13:36:07.809548+0000","last_active":"2024-09-19T14:12:11.616585+0000","last_peered":"2024-09-19T14:12:11.616585+0000","last_clean":"2024-09-19T14:12:11.616585+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:12:11.616585+0000","last_undegraded":"2024-09-19T14:12:11.616585+0000","last_fullsized":"2024-09-19T14:12:11.616585+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:50.752222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9447432,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":540,"num_read_kb":50665,"num_write":1022,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813329+0000","last_change":"2024-09-19T13:36:11.328331+0000","last_active":"2024-09-19T14:10:51.813329+0000","last_peered":"2024-09-19T14:10:51.813329+0000","last_clean":"2024-09-19T14:10:51.813329+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:10:51.813329+0000","last_undegraded":"2024-09-19T14:10:51.813329+0000","last_fullsized":"2024-09-19T14:10:51.813329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:34.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'182","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.001238+0000","last_change":"2024-09-19T13:36:13.346349+0000","last_active":"2024-09-19T14:13:47.001238+0000","last_peered":"2024-09-19T14:13:47.001238+0000","last_clean":"2024-09-19T14:13:47.001238+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:13:47.001238+0000","last_undegraded":"2024-09-19T14:13:47.001238+0000","last_fullsized":"2024-09-19T14:13:47.001238+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:53.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":249,"num_read_kb":370,"num_write":122,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.814113+0000","last_change":"2024-09-19T13:36:15.353964+0000","last_active":"2024-09-19T14:10:56.814113+0000","last_peered":"2024-09-19T14:10:56.814113+0000","last_clean":"2024-09-19T14:10:56.814113+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:10:56.814113+0000","last_undegraded":"2024-09-19T14:10:56.814113+0000","last_fullsized":"2024-09-19T14:10:56.814113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:04.430132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'170","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.168956+0000","last_change":"2024-09-19T13:36:17.362550+0000","last_active":"2024-09-19T14:12:15.168956+0000","last_peered":"2024-09-19T14:12:15.168956+0000","last_clean":"2024-09-19T14:12:15.168956+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:12:15.168956+0000","last_undegraded":"2024-09-19T14:12:15.168956+0000","last_fullsized":"2024-09-19T14:12:15.168956+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:34.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1295","reported_seq":3068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.858675+0000","last_change":"2024-09-19T13:36:09.334870+0000","last_active":"2024-09-19T14:13:45.858675+0000","last_peered":"2024-09-19T14:13:45.858675+0000","last_clean":"2024-09-19T14:13:45.858675+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:13:45.858675+0000","last_undegraded":"2024-09-19T14:13:45.858675+0000","last_fullsized":"2024-09-19T14:13:45.858675+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:57.257237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'184","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.685114+0000","last_change":"2024-09-19T13:36:07.799829+0000","last_active":"2024-09-19T14:11:34.685114+0000","last_peered":"2024-09-19T14:11:34.685114+0000","last_clean":"2024-09-19T14:11:34.685114+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:11:34.685114+0000","last_undegraded":"2024-09-19T14:11:34.685114+0000","last_fullsized":"2024-09-19T14:11:34.685114+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17713223,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":441,"num_read_kb":2025,"num_write":899,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805745+0000","last_change":"2024-09-19T13:36:11.338782+0000","last_active":"2024-09-19T14:09:56.805745+0000","last_peered":"2024-09-19T14:09:56.805745+0000","last_clean":"2024-09-19T14:09:56.805745+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:09:56.805745+0000","last_undegraded":"2024-09-19T14:09:56.805745+0000","last_fullsized":"2024-09-19T14:09:56.805745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:16.443904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'142","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.115082+0000","last_change":"2024-09-19T13:36:13.344371+0000","last_active":"2024-09-19T14:12:26.115082+0000","last_peered":"2024-09-19T14:12:26.115082+0000","last_clean":"2024-09-19T14:12:26.115082+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:12:26.115082+0000","last_undegraded":"2024-09-19T14:12:26.115082+0000","last_fullsized":"2024-09-19T14:12:26.115082+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:58.796476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11393,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":194,"num_read_kb":257,"num_write":156,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601278+0000","last_change":"2024-09-19T13:36:15.348413+0000","last_active":"2024-09-19T14:10:06.601278+0000","last_peered":"2024-09-19T14:10:06.601278+0000","last_clean":"2024-09-19T14:10:06.601278+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:10:06.601278+0000","last_undegraded":"2024-09-19T14:10:06.601278+0000","last_fullsized":"2024-09-19T14:10:06.601278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.820957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'118","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.738924+0000","last_change":"2024-09-19T13:36:17.364393+0000","last_active":"2024-09-19T14:12:21.738924+0000","last_peered":"2024-09-19T14:12:21.738924+0000","last_clean":"2024-09-19T14:12:21.738924+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:12:21.738924+0000","last_undegraded":"2024-09-19T14:12:21.738924+0000","last_fullsized":"2024-09-19T14:12:21.738924+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:02.719840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'468","reported_seq":2089,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.926778+0000","last_change":"2024-09-19T13:36:09.329775+0000","last_active":"2024-09-19T14:12:13.926778+0000","last_peered":"2024-09-19T14:12:13.926778+0000","last_clean":"2024-09-19T14:12:13.926778+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:12:13.926778+0000","last_undegraded":"2024-09-19T14:12:13.926778+0000","last_fullsized":"2024-09-19T14:12:13.926778+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:15.175433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'213","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.023429+0000","last_change":"2024-09-19T13:36:07.814623+0000","last_active":"2024-09-19T14:11:55.023429+0000","last_peered":"2024-09-19T14:11:55.023429+0000","last_clean":"2024-09-19T14:11:55.023429+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:11:55.023429+0000","last_undegraded":"2024-09-19T14:11:55.023429+0000","last_fullsized":"2024-09-19T14:11:55.023429+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:56.724159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9464391,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":524,"num_read_kb":62927,"num_write":1021,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.634762+0000","last_change":"2024-09-19T13:36:11.336246+0000","last_active":"2024-09-19T14:09:56.634762+0000","last_peered":"2024-09-19T14:09:56.634762+0000","last_clean":"2024-09-19T14:09:56.634762+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:09:56.634762+0000","last_undegraded":"2024-09-19T14:09:56.634762+0000","last_fullsized":"2024-09-19T14:09:56.634762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:18.982990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'142","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.823060+0000","last_change":"2024-09-19T13:36:13.343683+0000","last_active":"2024-09-19T14:12:16.823060+0000","last_peered":"2024-09-19T14:12:16.823060+0000","last_clean":"2024-09-19T14:12:16.823060+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:12:16.823060+0000","last_undegraded":"2024-09-19T14:12:16.823060+0000","last_fullsized":"2024-09-19T14:12:16.823060+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.516524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6039,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":171,"num_read_kb":173,"num_write":90,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'733","reported_seq":2197,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.051292+0000","last_change":"2024-09-19T13:36:15.350112+0000","last_active":"2024-09-19T14:13:47.051292+0000","last_peered":"2024-09-19T14:13:47.051292+0000","last_clean":"2024-09-19T14:13:47.051292+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:13:47.051292+0000","last_undegraded":"2024-09-19T14:13:47.051292+0000","last_fullsized":"2024-09-19T14:13:47.051292+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.284435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'119","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.540330+0000","last_change":"2024-09-19T13:36:17.355488+0000","last_active":"2024-09-19T14:12:15.540330+0000","last_peered":"2024-09-19T14:12:15.540330+0000","last_clean":"2024-09-19T14:12:15.540330+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:12:15.540330+0000","last_undegraded":"2024-09-19T14:12:15.540330+0000","last_fullsized":"2024-09-19T14:12:15.540330+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.296270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1573","reported_seq":3192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.346545+0000","last_change":"2024-09-19T13:36:09.332881+0000","last_active":"2024-09-19T14:12:27.346545+0000","last_peered":"2024-09-19T14:12:27.346545+0000","last_clean":"2024-09-19T14:12:27.346545+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:12:27.346545+0000","last_undegraded":"2024-09-19T14:12:27.346545+0000","last_fullsized":"2024-09-19T14:12:27.346545+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:05.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'194","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.823808+0000","last_change":"2024-09-19T13:36:07.800961+0000","last_active":"2024-09-19T14:11:58.823808+0000","last_peered":"2024-09-19T14:11:58.823808+0000","last_clean":"2024-09-19T14:11:58.823808+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:11:58.823808+0000","last_undegraded":"2024-09-19T14:11:58.823808+0000","last_fullsized":"2024-09-19T14:11:58.823808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5742454,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":26305,"num_write":897,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"34'6","reported_seq":1916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.767074+0000","last_change":"2024-09-19T13:36:11.338913+0000","last_active":"2024-09-19T14:13:46.767074+0000","last_peered":"2024-09-19T14:13:46.767074+0000","last_clean":"2024-09-19T14:13:46.767074+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:13:46.767074+0000","last_undegraded":"2024-09-19T14:13:46.767074+0000","last_fullsized":"2024-09-19T14:13:46.767074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:36.373641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1673,"num_read_kb":2140,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'75","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.605372+0000","last_change":"2024-09-19T13:36:13.678517+0000","last_active":"2024-09-19T14:11:59.605372+0000","last_peered":"2024-09-19T14:11:59.605372+0000","last_clean":"2024-09-19T14:11:59.605372+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:11:59.605372+0000","last_undegraded":"2024-09-19T14:11:59.605372+0000","last_fullsized":"2024-09-19T14:11:59.605372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:55.910454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'776","reported_seq":4734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.052375+0000","last_change":"2024-09-19T13:36:15.352291+0000","last_active":"2024-09-19T14:13:47.052375+0000","last_peered":"2024-09-19T14:13:47.052375+0000","last_clean":"2024-09-19T14:13:47.052375+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:13:47.052375+0000","last_undegraded":"2024-09-19T14:13:47.052375+0000","last_fullsized":"2024-09-19T14:13:47.052375+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:43.392004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'128","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.409862+0000","last_change":"2024-09-19T13:36:17.360266+0000","last_active":"2024-09-19T14:12:26.409862+0000","last_peered":"2024-09-19T14:12:26.409862+0000","last_clean":"2024-09-19T14:12:26.409862+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:12:26.409862+0000","last_undegraded":"2024-09-19T14:12:26.409862+0000","last_fullsized":"2024-09-19T14:12:26.409862+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:17.091973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'908","reported_seq":2529,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.393463+0000","last_change":"2024-09-19T13:36:09.345481+0000","last_active":"2024-09-19T14:12:14.393463+0000","last_peered":"2024-09-19T14:12:14.393463+0000","last_clean":"2024-09-19T14:12:14.393463+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:12:14.393463+0000","last_undegraded":"2024-09-19T14:12:14.393463+0000","last_fullsized":"2024-09-19T14:12:14.393463+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:16.331902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'179","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:32.410844+0000","last_change":"2024-09-19T13:36:07.803394+0000","last_active":"2024-09-19T14:11:32.410844+0000","last_peered":"2024-09-19T14:11:32.410844+0000","last_clean":"2024-09-19T14:11:32.410844+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:11:32.410844+0000","last_undegraded":"2024-09-19T14:11:32.410844+0000","last_fullsized":"2024-09-19T14:11:32.410844+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:45.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.719129+0000","last_change":"2024-09-19T13:36:11.334156+0000","last_active":"2024-09-19T14:09:56.719129+0000","last_peered":"2024-09-19T14:09:56.719129+0000","last_clean":"2024-09-19T14:09:56.719129+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:09:56.719129+0000","last_undegraded":"2024-09-19T14:09:56.719129+0000","last_fullsized":"2024-09-19T14:09:56.719129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:26.831809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'191","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:50.254879+0000","last_change":"2024-09-19T13:36:13.346678+0000","last_active":"2024-09-19T14:12:50.254879+0000","last_peered":"2024-09-19T14:12:50.254879+0000","last_clean":"2024-09-19T14:12:50.254879+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:12:50.254879+0000","last_undegraded":"2024-09-19T14:12:50.254879+0000","last_fullsized":"2024-09-19T14:12:50.254879+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:27.806745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":857,"num_read_kb":894,"num_write":1378,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.710550+0000","last_change":"2024-09-19T13:36:15.349430+0000","last_active":"2024-09-19T14:10:01.710550+0000","last_peered":"2024-09-19T14:10:01.710550+0000","last_clean":"2024-09-19T14:10:01.710550+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:10:01.710550+0000","last_undegraded":"2024-09-19T14:10:01.710550+0000","last_fullsized":"2024-09-19T14:10:01.710550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:55.349813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'116","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.223769+0000","last_change":"2024-09-19T13:36:17.354159+0000","last_active":"2024-09-19T14:12:13.223769+0000","last_peered":"2024-09-19T14:12:13.223769+0000","last_clean":"2024-09-19T14:12:13.223769+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:12:13.223769+0000","last_undegraded":"2024-09-19T14:12:13.223769+0000","last_fullsized":"2024-09-19T14:12:13.223769+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:21.937480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176339+0000","last_change":"2024-09-19T13:36:09.335373+0000","last_active":"2024-09-19T14:12:26.176339+0000","last_peered":"2024-09-19T14:12:26.176339+0000","last_clean":"2024-09-19T14:12:26.176339+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:12:26.176339+0000","last_undegraded":"2024-09-19T14:12:26.176339+0000","last_fullsized":"2024-09-19T14:12:26.176339+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:13.238868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.751980+0000","last_change":"2024-09-19T13:35:53.209257+0000","last_active":"2024-09-19T14:12:06.751980+0000","last_peered":"2024-09-19T14:12:06.751980+0000","last_clean":"2024-09-19T14:12:06.751980+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:12:06.751980+0000","last_undegraded":"2024-09-19T14:12:06.751980+0000","last_fullsized":"2024-09-19T14:12:06.751980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_clean_scrub_stamp":"2024-09-19T13:35:51.725320+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:26.239545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610925+0000","last_change":"2024-09-19T13:36:00.766592+0000","last_active":"2024-09-19T14:11:26.610925+0000","last_peered":"2024-09-19T14:11:26.610925+0000","last_clean":"2024-09-19T14:11:26.610925+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:11:26.610925+0000","last_undegraded":"2024-09-19T14:11:26.610925+0000","last_fullsized":"2024-09-19T14:11:26.610925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:27.934615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'221","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.567842+0000","last_change":"2024-09-19T13:36:07.812870+0000","last_active":"2024-09-19T14:12:07.567842+0000","last_peered":"2024-09-19T14:12:07.567842+0000","last_clean":"2024-09-19T14:12:07.567842+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:12:07.567842+0000","last_undegraded":"2024-09-19T14:12:07.567842+0000","last_fullsized":"2024-09-19T14:12:07.567842+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1745515,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":558,"num_read_kb":4141,"num_write":1066,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747345+0000","last_change":"2024-09-19T13:36:11.335928+0000","last_active":"2024-09-19T14:11:36.747345+0000","last_peered":"2024-09-19T14:11:36.747345+0000","last_clean":"2024-09-19T14:11:36.747345+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:11:36.747345+0000","last_undegraded":"2024-09-19T14:11:36.747345+0000","last_fullsized":"2024-09-19T14:11:36.747345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:19.656066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'323","reported_seq":997,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.020740+0000","last_change":"2024-09-19T13:36:13.348035+0000","last_active":"2024-09-19T14:13:47.020740+0000","last_peered":"2024-09-19T14:13:47.020740+0000","last_clean":"2024-09-19T14:13:47.020740+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:13:47.020740+0000","last_undegraded":"2024-09-19T14:13:47.020740+0000","last_fullsized":"2024-09-19T14:13:47.020740+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:31.984054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":882,"num_write":520,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.608712+0000","last_change":"2024-09-19T13:36:15.353267+0000","last_active":"2024-09-19T14:10:56.608712+0000","last_peered":"2024-09-19T14:10:56.608712+0000","last_clean":"2024-09-19T14:10:56.608712+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:10:56.608712+0000","last_undegraded":"2024-09-19T14:10:56.608712+0000","last_fullsized":"2024-09-19T14:10:56.608712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:16.239382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'189","reported_seq":879,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.764923+0000","last_change":"2024-09-19T13:36:17.356980+0000","last_active":"2024-09-19T14:12:27.764923+0000","last_peered":"2024-09-19T14:12:27.764923+0000","last_clean":"2024-09-19T14:12:27.764923+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:12:27.764923+0000","last_undegraded":"2024-09-19T14:12:27.764923+0000","last_fullsized":"2024-09-19T14:12:27.764923+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:00.567870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'974","reported_seq":2577,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855901+0000","last_change":"2024-09-19T13:36:09.343922+0000","last_active":"2024-09-19T14:13:45.855901+0000","last_peered":"2024-09-19T14:13:45.855901+0000","last_clean":"2024-09-19T14:13:45.855901+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:13:45.855901+0000","last_undegraded":"2024-09-19T14:13:45.855901+0000","last_fullsized":"2024-09-19T14:13:45.855901+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:14.020473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752563+0000","last_change":"2024-09-19T13:36:00.854468+0000","last_active":"2024-09-19T14:12:11.752563+0000","last_peered":"2024-09-19T14:12:11.752563+0000","last_clean":"2024-09-19T14:12:11.752563+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:12:11.752563+0000","last_undegraded":"2024-09-19T14:12:11.752563+0000","last_fullsized":"2024-09-19T14:12:11.752563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:35.110401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'205","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.871425+0000","last_change":"2024-09-19T13:36:07.802200+0000","last_active":"2024-09-19T14:12:13.871425+0000","last_peered":"2024-09-19T14:12:13.871425+0000","last_clean":"2024-09-19T14:12:13.871425+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:12:13.871425+0000","last_undegraded":"2024-09-19T14:12:13.871425+0000","last_fullsized":"2024-09-19T14:12:13.871425+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.035934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7278941,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":568,"num_read_kb":42960,"num_write":977,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.606429+0000","last_change":"2024-09-19T13:36:11.337197+0000","last_active":"2024-09-19T14:10:51.606429+0000","last_peered":"2024-09-19T14:10:51.606429+0000","last_clean":"2024-09-19T14:10:51.606429+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:10:51.606429+0000","last_undegraded":"2024-09-19T14:10:51.606429+0000","last_fullsized":"2024-09-19T14:10:51.606429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:00.715855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'809","reported_seq":2176,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.046671+0000","last_change":"2024-09-19T13:36:13.344429+0000","last_active":"2024-09-19T14:13:47.046671+0000","last_peered":"2024-09-19T14:13:47.046671+0000","last_clean":"2024-09-19T14:13:47.046671+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:13:47.046671+0000","last_undegraded":"2024-09-19T14:13:47.046671+0000","last_fullsized":"2024-09-19T14:13:47.046671+0000","mapping_epoch":28,"log_start":"260'700","ondisk_log_start":"260'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:47.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32444,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1113,"num_read_kb":1259,"num_write":234,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749934+0000","last_change":"2024-09-19T13:36:15.355170+0000","last_active":"2024-09-19T14:11:51.749934+0000","last_peered":"2024-09-19T14:11:51.749934+0000","last_clean":"2024-09-19T14:11:51.749934+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:11:51.749934+0000","last_undegraded":"2024-09-19T14:11:51.749934+0000","last_fullsized":"2024-09-19T14:11:51.749934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:24.165465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'128","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.807878+0000","last_change":"2024-09-19T13:36:17.353025+0000","last_active":"2024-09-19T14:13:45.807878+0000","last_peered":"2024-09-19T14:13:45.807878+0000","last_clean":"2024-09-19T14:13:45.807878+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:13:45.807878+0000","last_undegraded":"2024-09-19T14:13:45.807878+0000","last_fullsized":"2024-09-19T14:13:45.807878+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:31.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'770","reported_seq":2365,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226542+0000","last_change":"2024-09-19T13:36:09.335144+0000","last_active":"2024-09-19T14:12:13.226542+0000","last_peered":"2024-09-19T14:12:13.226542+0000","last_clean":"2024-09-19T14:12:13.226542+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:12:13.226542+0000","last_undegraded":"2024-09-19T14:12:13.226542+0000","last_fullsized":"2024-09-19T14:12:13.226542+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:14.738804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.817492+0000","last_change":"2024-09-19T13:36:00.763165+0000","last_active":"2024-09-19T14:11:26.817492+0000","last_peered":"2024-09-19T14:11:26.817492+0000","last_clean":"2024-09-19T14:11:26.817492+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:11:26.817492+0000","last_undegraded":"2024-09-19T14:11:26.817492+0000","last_fullsized":"2024-09-19T14:11:26.817492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:42.369963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'173","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.653405+0000","last_change":"2024-09-19T13:36:07.803619+0000","last_active":"2024-09-19T14:12:16.653405+0000","last_peered":"2024-09-19T14:12:16.653405+0000","last_clean":"2024-09-19T14:12:16.653405+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:12:16.653405+0000","last_undegraded":"2024-09-19T14:12:16.653405+0000","last_fullsized":"2024-09-19T14:12:16.653405+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:55.600380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10583521,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":421,"num_read_kb":6136,"num_write":872,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813393+0000","last_change":"2024-09-19T13:36:11.334995+0000","last_active":"2024-09-19T14:10:51.813393+0000","last_peered":"2024-09-19T14:10:51.813393+0000","last_clean":"2024-09-19T14:10:51.813393+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:10:51.813393+0000","last_undegraded":"2024-09-19T14:10:51.813393+0000","last_fullsized":"2024-09-19T14:10:51.813393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:49.486350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'201","reported_seq":1189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.151581+0000","last_change":"2024-09-19T13:36:13.678601+0000","last_active":"2024-09-19T14:13:47.151581+0000","last_peered":"2024-09-19T14:13:47.151581+0000","last_clean":"2024-09-19T14:13:47.151581+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:13:47.151581+0000","last_undegraded":"2024-09-19T14:13:47.151581+0000","last_fullsized":"2024-09-19T14:13:47.151581+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:44.121580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614634+0000","last_change":"2024-09-19T13:36:15.350412+0000","last_active":"2024-09-19T14:11:41.614634+0000","last_peered":"2024-09-19T14:11:41.614634+0000","last_clean":"2024-09-19T14:11:41.614634+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:11:41.614634+0000","last_undegraded":"2024-09-19T14:11:41.614634+0000","last_fullsized":"2024-09-19T14:11:41.614634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:44.795963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.456924+0000","last_change":"2024-09-19T13:36:17.363655+0000","last_active":"2024-09-19T14:12:27.456924+0000","last_peered":"2024-09-19T14:12:27.456924+0000","last_clean":"2024-09-19T14:12:27.456924+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:12:27.456924+0000","last_undegraded":"2024-09-19T14:12:27.456924+0000","last_fullsized":"2024-09-19T14:12:27.456924+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:54.511400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'351","reported_seq":1871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759134+0000","last_change":"2024-09-19T13:36:09.326835+0000","last_active":"2024-09-19T14:12:27.759134+0000","last_peered":"2024-09-19T14:12:27.759134+0000","last_clean":"2024-09-19T14:12:27.759134+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:12:27.759134+0000","last_undegraded":"2024-09-19T14:12:27.759134+0000","last_fullsized":"2024-09-19T14:12:27.759134+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:36.883583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610896+0000","last_change":"2024-09-19T13:36:00.767107+0000","last_active":"2024-09-19T14:11:26.610896+0000","last_peered":"2024-09-19T14:11:26.610896+0000","last_clean":"2024-09-19T14:11:26.610896+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:11:26.610896+0000","last_undegraded":"2024-09-19T14:11:26.610896+0000","last_fullsized":"2024-09-19T14:11:26.610896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:58.438229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'215","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733263+0000","last_change":"2024-09-19T13:36:07.801289+0000","last_active":"2024-09-19T14:11:36.733263+0000","last_peered":"2024-09-19T14:11:36.733263+0000","last_clean":"2024-09-19T14:11:36.733263+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:11:36.733263+0000","last_undegraded":"2024-09-19T14:11:36.733263+0000","last_fullsized":"2024-09-19T14:11:36.733263+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247065,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":5690,"num_write":1064,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614656+0000","last_change":"2024-09-19T13:36:11.337905+0000","last_active":"2024-09-19T14:11:41.614656+0000","last_peered":"2024-09-19T14:11:41.614656+0000","last_clean":"2024-09-19T14:11:41.614656+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:11:41.614656+0000","last_undegraded":"2024-09-19T14:11:41.614656+0000","last_fullsized":"2024-09-19T14:11:41.614656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:00.320875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'106","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622447+0000","last_change":"2024-09-19T13:36:13.341625+0000","last_active":"2024-09-19T14:13:06.622447+0000","last_peered":"2024-09-19T14:13:06.622447+0000","last_clean":"2024-09-19T14:13:06.622447+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:13:06.622447+0000","last_undegraded":"2024-09-19T14:13:06.622447+0000","last_fullsized":"2024-09-19T14:13:06.622447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:24.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.718378+0000","last_change":"2024-09-19T13:36:15.348466+0000","last_active":"2024-09-19T14:10:56.718378+0000","last_peered":"2024-09-19T14:10:56.718378+0000","last_clean":"2024-09-19T14:10:56.718378+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:10:56.718378+0000","last_undegraded":"2024-09-19T14:10:56.718378+0000","last_fullsized":"2024-09-19T14:10:56.718378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:41.097287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'106","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.019026+0000","last_change":"2024-09-19T13:36:17.362663+0000","last_active":"2024-09-19T14:12:27.019026+0000","last_peered":"2024-09-19T14:12:27.019026+0000","last_clean":"2024-09-19T14:12:27.019026+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:12:27.019026+0000","last_undegraded":"2024-09-19T14:12:27.019026+0000","last_fullsized":"2024-09-19T14:12:27.019026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:27.259346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'599","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260112+0000","last_change":"2024-09-19T13:36:09.342497+0000","last_active":"2024-09-19T14:12:20.260112+0000","last_peered":"2024-09-19T14:12:20.260112+0000","last_clean":"2024-09-19T14:12:20.260112+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:12:20.260112+0000","last_undegraded":"2024-09-19T14:12:20.260112+0000","last_fullsized":"2024-09-19T14:12:20.260112+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:24.198820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'199","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.820141+0000","last_change":"2024-09-19T13:36:07.809389+0000","last_active":"2024-09-19T14:12:15.820141+0000","last_peered":"2024-09-19T14:12:15.820141+0000","last_clean":"2024-09-19T14:12:15.820141+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:12:15.820141+0000","last_undegraded":"2024-09-19T14:12:15.820141+0000","last_fullsized":"2024-09-19T14:12:15.820141+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:41.507863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70057,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":569,"num_read_kb":24801,"num_write":993,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.647184+0000","last_change":"2024-09-19T13:36:00.763237+0000","last_active":"2024-09-19T14:11:26.647184+0000","last_peered":"2024-09-19T14:11:26.647184+0000","last_clean":"2024-09-19T14:11:26.647184+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:11:26.647184+0000","last_undegraded":"2024-09-19T14:11:26.647184+0000","last_fullsized":"2024-09-19T14:11:26.647184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:36.142012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613912+0000","last_change":"2024-09-19T13:36:11.333288+0000","last_active":"2024-09-19T14:11:36.613912+0000","last_peered":"2024-09-19T14:11:36.613912+0000","last_clean":"2024-09-19T14:11:36.613912+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:11:36.613912+0000","last_undegraded":"2024-09-19T14:11:36.613912+0000","last_fullsized":"2024-09-19T14:11:36.613912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:43.796231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'256","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.011948+0000","last_change":"2024-09-19T13:36:13.344037+0000","last_active":"2024-09-19T14:13:47.011948+0000","last_peered":"2024-09-19T14:13:47.011948+0000","last_clean":"2024-09-19T14:13:47.011948+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:13:47.011948+0000","last_undegraded":"2024-09-19T14:13:47.011948+0000","last_fullsized":"2024-09-19T14:13:47.011948+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:14.471458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19960,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":486,"num_write":232,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.734022+0000","last_change":"2024-09-19T13:36:15.347284+0000","last_active":"2024-09-19T14:11:41.734022+0000","last_peered":"2024-09-19T14:11:41.734022+0000","last_clean":"2024-09-19T14:11:41.734022+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:11:41.734022+0000","last_undegraded":"2024-09-19T14:11:41.734022+0000","last_fullsized":"2024-09-19T14:11:41.734022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:45.336194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'126","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.815901+0000","last_change":"2024-09-19T13:36:17.358825+0000","last_active":"2024-09-19T14:12:14.815901+0000","last_peered":"2024-09-19T14:12:14.815901+0000","last_clean":"2024-09-19T14:12:14.815901+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:12:14.815901+0000","last_undegraded":"2024-09-19T14:12:14.815901+0000","last_fullsized":"2024-09-19T14:12:14.815901+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:26.627242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1168","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.469596+0000","last_change":"2024-09-19T13:36:09.338739+0000","last_active":"2024-09-19T14:12:12.469596+0000","last_peered":"2024-09-19T14:12:12.469596+0000","last_clean":"2024-09-19T14:12:12.469596+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:12:12.469596+0000","last_undegraded":"2024-09-19T14:12:12.469596+0000","last_fullsized":"2024-09-19T14:12:12.469596+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:57.267957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'234","reported_seq":884,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.245753+0000","last_change":"2024-09-19T13:36:07.804201+0000","last_active":"2024-09-19T14:12:01.245753+0000","last_peered":"2024-09-19T14:12:01.245753+0000","last_clean":"2024-09-19T14:12:01.245753+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:12:01.245753+0000","last_undegraded":"2024-09-19T14:12:01.245753+0000","last_fullsized":"2024-09-19T14:12:01.245753+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:17.647156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5511506,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":113129,"num_write":1043,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747369+0000","last_change":"2024-09-19T13:36:00.854514+0000","last_active":"2024-09-19T14:11:36.747369+0000","last_peered":"2024-09-19T14:11:36.747369+0000","last_clean":"2024-09-19T14:11:36.747369+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:11:36.747369+0000","last_undegraded":"2024-09-19T14:11:36.747369+0000","last_fullsized":"2024-09-19T14:11:36.747369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:14.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723266+0000","last_change":"2024-09-19T13:36:11.336803+0000","last_active":"2024-09-19T14:11:36.723266+0000","last_peered":"2024-09-19T14:11:36.723266+0000","last_clean":"2024-09-19T14:11:36.723266+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:11:36.723266+0000","last_undegraded":"2024-09-19T14:11:36.723266+0000","last_fullsized":"2024-09-19T14:11:36.723266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:07.018411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'145","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.356860+0000","last_change":"2024-09-19T13:36:13.678497+0000","last_active":"2024-09-19T14:12:27.356860+0000","last_peered":"2024-09-19T14:12:27.356860+0000","last_clean":"2024-09-19T14:12:27.356860+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:12:27.356860+0000","last_undegraded":"2024-09-19T14:12:27.356860+0000","last_fullsized":"2024-09-19T14:12:27.356860+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.504350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'785","reported_seq":2494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.049041+0000","last_change":"2024-09-19T13:36:15.349702+0000","last_active":"2024-09-19T14:13:47.049041+0000","last_peered":"2024-09-19T14:13:47.049041+0000","last_clean":"2024-09-19T14:13:47.049041+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:13:47.049041+0000","last_undegraded":"2024-09-19T14:13:47.049041+0000","last_fullsized":"2024-09-19T14:13:47.049041+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.512113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'139","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.173795+0000","last_change":"2024-09-19T13:36:17.364028+0000","last_active":"2024-09-19T14:12:26.173795+0000","last_peered":"2024-09-19T14:12:26.173795+0000","last_clean":"2024-09-19T14:12:26.173795+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:12:26.173795+0000","last_undegraded":"2024-09-19T14:12:26.173795+0000","last_fullsized":"2024-09-19T14:12:26.173795+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:00.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226434+0000","last_change":"2024-09-19T13:36:09.334788+0000","last_active":"2024-09-19T14:12:13.226434+0000","last_peered":"2024-09-19T14:12:13.226434+0000","last_clean":"2024-09-19T14:12:13.226434+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:12:13.226434+0000","last_undegraded":"2024-09-19T14:12:13.226434+0000","last_fullsized":"2024-09-19T14:12:13.226434+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'207","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:34.234573+0000","last_change":"2024-09-19T13:36:07.809079+0000","last_active":"2024-09-19T14:11:34.234573+0000","last_peered":"2024-09-19T14:11:34.234573+0000","last_clean":"2024-09-19T14:11:34.234573+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:11:34.234573+0000","last_undegraded":"2024-09-19T14:11:34.234573+0000","last_fullsized":"2024-09-19T14:11:34.234573+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5892174,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":8334,"num_write":1021,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.641430+0000","last_change":"2024-09-19T13:36:00.763660+0000","last_active":"2024-09-19T14:10:41.641430+0000","last_peered":"2024-09-19T14:10:41.641430+0000","last_clean":"2024-09-19T14:10:41.641430+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:10:41.641430+0000","last_undegraded":"2024-09-19T14:10:41.641430+0000","last_fullsized":"2024-09-19T14:10:41.641430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:18.186285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733201+0000","last_change":"2024-09-19T13:36:11.329844+0000","last_active":"2024-09-19T14:11:36.733201+0000","last_peered":"2024-09-19T14:11:36.733201+0000","last_clean":"2024-09-19T14:11:36.733201+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:11:36.733201+0000","last_undegraded":"2024-09-19T14:11:36.733201+0000","last_fullsized":"2024-09-19T14:11:36.733201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:37.515612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'87","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.941455+0000","last_change":"2024-09-19T13:36:13.343716+0000","last_active":"2024-09-19T14:11:55.941455+0000","last_peered":"2024-09-19T14:11:55.941455+0000","last_clean":"2024-09-19T14:11:55.941455+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:11:55.941455+0000","last_undegraded":"2024-09-19T14:11:55.941455+0000","last_fullsized":"2024-09-19T14:11:55.941455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'792","reported_seq":2373,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.053372+0000","last_change":"2024-09-19T13:36:15.350187+0000","last_active":"2024-09-19T14:13:47.053372+0000","last_peered":"2024-09-19T14:13:47.053372+0000","last_clean":"2024-09-19T14:13:47.053372+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:13:47.053372+0000","last_undegraded":"2024-09-19T14:13:47.053372+0000","last_fullsized":"2024-09-19T14:13:47.053372+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.788209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'291","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:04.821247+0000","last_change":"2024-09-19T13:36:17.362227+0000","last_active":"2024-09-19T14:12:04.821247+0000","last_peered":"2024-09-19T14:12:04.821247+0000","last_clean":"2024-09-19T14:12:04.821247+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:12:04.821247+0000","last_undegraded":"2024-09-19T14:12:04.821247+0000","last_fullsized":"2024-09-19T14:12:04.821247+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:31.124289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'722","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758644+0000","last_change":"2024-09-19T13:36:09.334632+0000","last_active":"2024-09-19T14:12:27.758644+0000","last_peered":"2024-09-19T14:12:27.758644+0000","last_clean":"2024-09-19T14:12:27.758644+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:12:27.758644+0000","last_undegraded":"2024-09-19T14:12:27.758644+0000","last_fullsized":"2024-09-19T14:12:27.758644+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:08.592744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'221","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.297525+0000","last_change":"2024-09-19T13:36:07.811604+0000","last_active":"2024-09-19T14:11:55.297525+0000","last_peered":"2024-09-19T14:11:55.297525+0000","last_clean":"2024-09-19T14:11:55.297525+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:11:55.297525+0000","last_undegraded":"2024-09-19T14:11:55.297525+0000","last_fullsized":"2024-09-19T14:11:55.297525+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:27.180358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5253664,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":595,"num_read_kb":41557,"num_write":1057,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.716308+0000","last_change":"2024-09-19T13:36:00.816633+0000","last_active":"2024-09-19T14:10:41.716308+0000","last_peered":"2024-09-19T14:10:41.716308+0000","last_clean":"2024-09-19T14:10:41.716308+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:10:41.716308+0000","last_undegraded":"2024-09-19T14:10:41.716308+0000","last_fullsized":"2024-09-19T14:10:41.716308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:57.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.721729+0000","last_change":"2024-09-19T13:36:11.334617+0000","last_active":"2024-09-19T14:10:16.721729+0000","last_peered":"2024-09-19T14:10:16.721729+0000","last_clean":"2024-09-19T14:10:16.721729+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:10:16.721729+0000","last_undegraded":"2024-09-19T14:10:16.721729+0000","last_fullsized":"2024-09-19T14:10:16.721729+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:31.167102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'292","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.006705+0000","last_change":"2024-09-19T13:36:13.678434+0000","last_active":"2024-09-19T14:13:47.006705+0000","last_peered":"2024-09-19T14:13:47.006705+0000","last_clean":"2024-09-19T14:13:47.006705+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:13:47.006705+0000","last_undegraded":"2024-09-19T14:13:47.006705+0000","last_fullsized":"2024-09-19T14:13:47.006705+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:14.308303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":405,"num_read_kb":503,"num_write":198,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.733909+0000","last_change":"2024-09-19T13:36:15.348438+0000","last_active":"2024-09-19T14:11:41.733909+0000","last_peered":"2024-09-19T14:11:41.733909+0000","last_clean":"2024-09-19T14:11:41.733909+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:11:41.733909+0000","last_undegraded":"2024-09-19T14:11:41.733909+0000","last_fullsized":"2024-09-19T14:11:41.733909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:32.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'160","reported_seq":653,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.232087+0000","last_change":"2024-09-19T13:36:17.358950+0000","last_active":"2024-09-19T14:12:27.232087+0000","last_peered":"2024-09-19T14:12:27.232087+0000","last_clean":"2024-09-19T14:12:27.232087+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:12:27.232087+0000","last_undegraded":"2024-09-19T14:12:27.232087+0000","last_fullsized":"2024-09-19T14:12:27.232087+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:09.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'143","reported_seq":706,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.863516+0000","last_change":"2024-09-19T13:36:17.361305+0000","last_active":"2024-09-19T14:12:27.863516+0000","last_peered":"2024-09-19T14:12:27.863516+0000","last_clean":"2024-09-19T14:12:27.863516+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:12:27.863516+0000","last_undegraded":"2024-09-19T14:12:27.863516+0000","last_fullsized":"2024-09-19T14:12:27.863516+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:26.500978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'776","reported_seq":2472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819999+0000","last_change":"2024-09-19T13:36:09.330532+0000","last_active":"2024-09-19T14:12:14.819999+0000","last_peered":"2024-09-19T14:12:14.819999+0000","last_clean":"2024-09-19T14:12:14.819999+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:12:14.819999+0000","last_undegraded":"2024-09-19T14:12:14.819999+0000","last_fullsized":"2024-09-19T14:12:14.819999+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:28.861247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'194","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.113365+0000","last_change":"2024-09-19T13:36:07.807459+0000","last_active":"2024-09-19T14:12:26.113365+0000","last_peered":"2024-09-19T14:12:26.113365+0000","last_clean":"2024-09-19T14:12:26.113365+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:12:26.113365+0000","last_undegraded":"2024-09-19T14:12:26.113365+0000","last_fullsized":"2024-09-19T14:12:26.113365+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:55.208501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899947,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":792,"num_read_kb":235834,"num_write":979,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645462+0000","last_change":"2024-09-19T13:36:11.335979+0000","last_active":"2024-09-19T14:11:11.645462+0000","last_peered":"2024-09-19T14:11:11.645462+0000","last_clean":"2024-09-19T14:11:11.645462+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:11:11.645462+0000","last_undegraded":"2024-09-19T14:11:11.645462+0000","last_fullsized":"2024-09-19T14:11:11.645462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:55.864456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'135","reported_seq":692,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.626321+0000","last_change":"2024-09-19T13:36:13.342360+0000","last_active":"2024-09-19T14:13:36.626321+0000","last_peered":"2024-09-19T14:13:36.626321+0000","last_clean":"2024-09-19T14:13:36.626321+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:13:36.626321+0000","last_undegraded":"2024-09-19T14:13:36.626321+0000","last_fullsized":"2024-09-19T14:13:36.626321+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:00.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11918,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":172,"num_read_kb":245,"num_write":98,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730499+0000","last_change":"2024-09-19T13:36:15.347213+0000","last_active":"2024-09-19T14:11:16.730499+0000","last_peered":"2024-09-19T14:11:16.730499+0000","last_clean":"2024-09-19T14:11:16.730499+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:11:16.730499+0000","last_undegraded":"2024-09-19T14:11:16.730499+0000","last_fullsized":"2024-09-19T14:11:16.730499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:56.274514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'125","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.583991+0000","last_change":"2024-09-19T13:36:17.361898+0000","last_active":"2024-09-19T14:12:27.583991+0000","last_peered":"2024-09-19T14:12:27.583991+0000","last_clean":"2024-09-19T14:12:27.583991+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:12:27.583991+0000","last_undegraded":"2024-09-19T14:12:27.583991+0000","last_fullsized":"2024-09-19T14:12:27.583991+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:32.112739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'450","reported_seq":2133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.856226+0000","last_change":"2024-09-19T13:36:09.341398+0000","last_active":"2024-09-19T14:13:45.856226+0000","last_peered":"2024-09-19T14:13:45.856226+0000","last_clean":"2024-09-19T14:13:45.856226+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:13:45.856226+0000","last_undegraded":"2024-09-19T14:13:45.856226+0000","last_fullsized":"2024-09-19T14:13:45.856226+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:27.435893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'202","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.567284+0000","last_change":"2024-09-19T13:36:44.400759+0000","last_active":"2024-09-19T14:11:55.567284+0000","last_peered":"2024-09-19T14:11:55.567284+0000","last_clean":"2024-09-19T14:11:55.567284+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:11:55.567284+0000","last_undegraded":"2024-09-19T14:11:55.567284+0000","last_fullsized":"2024-09-19T14:11:55.567284+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:53.572285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567557,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":556,"num_read_kb":26124,"num_write":1059,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.729952+0000","last_change":"2024-09-19T13:36:11.337455+0000","last_active":"2024-09-19T14:11:11.729952+0000","last_peered":"2024-09-19T14:11:11.729952+0000","last_clean":"2024-09-19T14:11:11.729952+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:11:11.729952+0000","last_undegraded":"2024-09-19T14:11:11.729952+0000","last_fullsized":"2024-09-19T14:11:11.729952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:12.668776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":538,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.243489+0000","last_change":"2024-09-19T13:36:13.343393+0000","last_active":"2024-09-19T14:11:58.243489+0000","last_peered":"2024-09-19T14:11:58.243489+0000","last_clean":"2024-09-19T14:11:58.243489+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:11:58.243489+0000","last_undegraded":"2024-09-19T14:11:58.243489+0000","last_fullsized":"2024-09-19T14:11:58.243489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:39.552041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.744597+0000","last_change":"2024-09-19T13:36:15.353524+0000","last_active":"2024-09-19T14:11:16.744597+0000","last_peered":"2024-09-19T14:11:16.744597+0000","last_clean":"2024-09-19T14:11:16.744597+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:11:16.744597+0000","last_undegraded":"2024-09-19T14:11:16.744597+0000","last_fullsized":"2024-09-19T14:11:16.744597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:39.216630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'216","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.357835+0000","last_change":"2024-09-19T13:36:17.356683+0000","last_active":"2024-09-19T14:12:27.357835+0000","last_peered":"2024-09-19T14:12:27.357835+0000","last_clean":"2024-09-19T14:12:27.357835+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:12:27.357835+0000","last_undegraded":"2024-09-19T14:12:27.357835+0000","last_fullsized":"2024-09-19T14:12:27.357835+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:18.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'397","reported_seq":1840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171074+0000","last_change":"2024-09-19T13:36:09.334800+0000","last_active":"2024-09-19T14:12:15.171074+0000","last_peered":"2024-09-19T14:12:15.171074+0000","last_clean":"2024-09-19T14:12:15.171074+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:12:15.171074+0000","last_undegraded":"2024-09-19T14:12:15.171074+0000","last_fullsized":"2024-09-19T14:12:15.171074+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:14.288345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'211","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:00.123029+0000","last_change":"2024-09-19T13:36:07.810838+0000","last_active":"2024-09-19T14:12:00.123029+0000","last_peered":"2024-09-19T14:12:00.123029+0000","last_clean":"2024-09-19T14:12:00.123029+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:12:00.123029+0000","last_undegraded":"2024-09-19T14:12:00.123029+0000","last_fullsized":"2024-09-19T14:12:00.123029+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:49.405832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324706,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":16519,"num_write":1035,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743810+0000","last_change":"2024-09-19T13:36:11.336061+0000","last_active":"2024-09-19T14:11:11.743810+0000","last_peered":"2024-09-19T14:11:11.743810+0000","last_clean":"2024-09-19T14:11:11.743810+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:11:11.743810+0000","last_undegraded":"2024-09-19T14:11:11.743810+0000","last_fullsized":"2024-09-19T14:11:11.743810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:12.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'140","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.626354+0000","last_change":"2024-09-19T13:36:13.342506+0000","last_active":"2024-09-19T14:13:36.626354+0000","last_peered":"2024-09-19T14:13:36.626354+0000","last_clean":"2024-09-19T14:13:36.626354+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:13:36.626354+0000","last_undegraded":"2024-09-19T14:13:36.626354+0000","last_fullsized":"2024-09-19T14:13:36.626354+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6169,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":179,"num_write":96,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720728+0000","last_change":"2024-09-19T13:36:15.349264+0000","last_active":"2024-09-19T14:11:16.720728+0000","last_peered":"2024-09-19T14:11:16.720728+0000","last_clean":"2024-09-19T14:11:16.720728+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:11:16.720728+0000","last_undegraded":"2024-09-19T14:11:16.720728+0000","last_fullsized":"2024-09-19T14:11:16.720728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.086503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'180","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.817537+0000","last_change":"2024-09-19T13:36:17.359223+0000","last_active":"2024-09-19T14:12:14.817537+0000","last_peered":"2024-09-19T14:12:14.817537+0000","last_clean":"2024-09-19T14:12:14.817537+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:12:14.817537+0000","last_undegraded":"2024-09-19T14:12:14.817537+0000","last_fullsized":"2024-09-19T14:12:14.817537+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:10.712355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'407","reported_seq":1890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857973+0000","last_change":"2024-09-19T13:36:09.347751+0000","last_active":"2024-09-19T14:13:45.857973+0000","last_peered":"2024-09-19T14:13:45.857973+0000","last_clean":"2024-09-19T14:13:45.857973+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:13:45.857973+0000","last_undegraded":"2024-09-19T14:13:45.857973+0000","last_fullsized":"2024-09-19T14:13:45.857973+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:52.995531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'219","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.603441+0000","last_change":"2024-09-19T13:36:07.810378+0000","last_active":"2024-09-19T14:11:23.603441+0000","last_peered":"2024-09-19T14:11:23.603441+0000","last_clean":"2024-09-19T14:11:23.603441+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:11:23.603441+0000","last_undegraded":"2024-09-19T14:11:23.603441+0000","last_fullsized":"2024-09-19T14:11:23.603441+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:11.342159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10525266,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":692,"num_read_kb":42518,"num_write":1081,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.720199+0000","last_change":"2024-09-19T13:36:11.338516+0000","last_active":"2024-09-19T14:11:11.720199+0000","last_peered":"2024-09-19T14:11:11.720199+0000","last_clean":"2024-09-19T14:11:11.720199+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:11:11.720199+0000","last_undegraded":"2024-09-19T14:11:11.720199+0000","last_fullsized":"2024-09-19T14:11:11.720199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:01:07.656648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'125","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.765349+0000","last_change":"2024-09-19T13:36:13.348210+0000","last_active":"2024-09-19T14:13:36.765349+0000","last_peered":"2024-09-19T14:13:36.765349+0000","last_clean":"2024-09-19T14:13:36.765349+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:13:36.765349+0000","last_undegraded":"2024-09-19T14:13:36.765349+0000","last_fullsized":"2024-09-19T14:13:36.765349+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:04.880223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12423,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":215,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611560+0000","last_change":"2024-09-19T13:36:15.353429+0000","last_active":"2024-09-19T14:11:16.611560+0000","last_peered":"2024-09-19T14:11:16.611560+0000","last_clean":"2024-09-19T14:11:16.611560+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:11:16.611560+0000","last_undegraded":"2024-09-19T14:11:16.611560+0000","last_fullsized":"2024-09-19T14:11:16.611560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'841","reported_seq":2324,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859435+0000","last_change":"2024-09-19T13:36:09.338894+0000","last_active":"2024-09-19T14:13:45.859435+0000","last_peered":"2024-09-19T14:13:45.859435+0000","last_clean":"2024-09-19T14:13:45.859435+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:13:45.859435+0000","last_undegraded":"2024-09-19T14:13:45.859435+0000","last_fullsized":"2024-09-19T14:13:45.859435+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:00.425682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'208","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.498765+0000","last_change":"2024-09-19T13:36:07.802099+0000","last_active":"2024-09-19T14:11:31.498765+0000","last_peered":"2024-09-19T14:11:31.498765+0000","last_clean":"2024-09-19T14:11:31.498765+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:11:31.498765+0000","last_undegraded":"2024-09-19T14:11:31.498765+0000","last_fullsized":"2024-09-19T14:11:31.498765+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:50.286421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5579919,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":34256,"num_write":1032,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619281+0000","last_change":"2024-09-19T13:36:11.339451+0000","last_active":"2024-09-19T14:12:16.619281+0000","last_peered":"2024-09-19T14:12:16.619281+0000","last_clean":"2024-09-19T14:12:16.619281+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:12:16.619281+0000","last_undegraded":"2024-09-19T14:12:16.619281+0000","last_fullsized":"2024-09-19T14:12:16.619281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:18.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'178","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.003432+0000","last_change":"2024-09-19T13:36:13.344513+0000","last_active":"2024-09-19T14:13:47.003432+0000","last_peered":"2024-09-19T14:13:47.003432+0000","last_clean":"2024-09-19T14:13:47.003432+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:13:47.003432+0000","last_undegraded":"2024-09-19T14:13:47.003432+0000","last_fullsized":"2024-09-19T14:13:47.003432+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:22.941079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19597,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":275,"num_read_kb":396,"num_write":172,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.609853+0000","last_change":"2024-09-19T13:36:15.354407+0000","last_active":"2024-09-19T14:11:16.609853+0000","last_peered":"2024-09-19T14:11:16.609853+0000","last_clean":"2024-09-19T14:11:16.609853+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:11:16.609853+0000","last_undegraded":"2024-09-19T14:11:16.609853+0000","last_fullsized":"2024-09-19T14:11:16.609853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'194","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.814286+0000","last_change":"2024-09-19T13:36:17.363573+0000","last_active":"2024-09-19T14:12:27.814286+0000","last_peered":"2024-09-19T14:12:27.814286+0000","last_clean":"2024-09-19T14:12:27.814286+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:12:27.814286+0000","last_undegraded":"2024-09-19T14:12:27.814286+0000","last_fullsized":"2024-09-19T14:12:27.814286+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:53.961300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619272+0000","last_change":"2024-09-19T13:36:09.334303+0000","last_active":"2024-09-19T14:12:16.619272+0000","last_peered":"2024-09-19T14:12:16.619272+0000","last_clean":"2024-09-19T14:12:16.619272+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:12:16.619272+0000","last_undegraded":"2024-09-19T14:12:16.619272+0000","last_fullsized":"2024-09-19T14:12:16.619272+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:28.147108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'186","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.488395+0000","last_change":"2024-09-19T13:36:07.808757+0000","last_active":"2024-09-19T14:12:03.488395+0000","last_peered":"2024-09-19T14:12:03.488395+0000","last_clean":"2024-09-19T14:12:03.488395+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:12:03.488395+0000","last_undegraded":"2024-09-19T14:12:03.488395+0000","last_fullsized":"2024-09-19T14:12:03.488395+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:21.182962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12605672,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":902,"num_read_kb":49787,"num_write":932,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723358+0000","last_change":"2024-09-19T13:36:11.339099+0000","last_active":"2024-09-19T14:11:36.723358+0000","last_peered":"2024-09-19T14:11:36.723358+0000","last_clean":"2024-09-19T14:11:36.723358+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:11:36.723358+0000","last_undegraded":"2024-09-19T14:11:36.723358+0000","last_fullsized":"2024-09-19T14:11:36.723358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:44.638696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'127","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.767011+0000","last_change":"2024-09-19T13:36:13.351689+0000","last_active":"2024-09-19T14:13:46.767011+0000","last_peered":"2024-09-19T14:13:46.767011+0000","last_clean":"2024-09-19T14:13:46.767011+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:13:46.767011+0000","last_undegraded":"2024-09-19T14:13:46.767011+0000","last_fullsized":"2024-09-19T14:13:46.767011+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:59.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":174,"num_read_kb":165,"num_write":108,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645982+0000","last_change":"2024-09-19T13:36:15.352438+0000","last_active":"2024-09-19T14:11:16.645982+0000","last_peered":"2024-09-19T14:11:16.645982+0000","last_clean":"2024-09-19T14:11:16.645982+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:11:16.645982+0000","last_undegraded":"2024-09-19T14:11:16.645982+0000","last_fullsized":"2024-09-19T14:11:16.645982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:36.174138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'153","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:05.915979+0000","last_change":"2024-09-19T13:36:17.361800+0000","last_active":"2024-09-19T14:12:05.915979+0000","last_peered":"2024-09-19T14:12:05.915979+0000","last_clean":"2024-09-19T14:12:05.915979+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:12:05.915979+0000","last_undegraded":"2024-09-19T14:12:05.915979+0000","last_fullsized":"2024-09-19T14:12:05.915979+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:05.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'363","reported_seq":1760,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758484+0000","last_change":"2024-09-19T13:36:09.347725+0000","last_active":"2024-09-19T14:12:27.758484+0000","last_peered":"2024-09-19T14:12:27.758484+0000","last_clean":"2024-09-19T14:12:27.758484+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:12:27.758484+0000","last_undegraded":"2024-09-19T14:12:27.758484+0000","last_fullsized":"2024-09-19T14:12:27.758484+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:58.075633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'200","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.856602+0000","last_change":"2024-09-19T13:36:07.804673+0000","last_active":"2024-09-19T14:12:11.856602+0000","last_peered":"2024-09-19T14:12:11.856602+0000","last_clean":"2024-09-19T14:12:11.856602+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:12:11.856602+0000","last_undegraded":"2024-09-19T14:12:11.856602+0000","last_fullsized":"2024-09-19T14:12:11.856602+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:43.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7535766,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":634,"num_read_kb":98647,"num_write":930,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730104+0000","last_change":"2024-09-19T13:36:11.336450+0000","last_active":"2024-09-19T14:11:11.730104+0000","last_peered":"2024-09-19T14:11:11.730104+0000","last_clean":"2024-09-19T14:11:11.730104+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:11:11.730104+0000","last_undegraded":"2024-09-19T14:11:11.730104+0000","last_fullsized":"2024-09-19T14:11:11.730104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:28.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'119","reported_seq":678,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.627635+0000","last_change":"2024-09-19T13:36:13.679719+0000","last_active":"2024-09-19T14:13:46.627635+0000","last_peered":"2024-09-19T14:13:46.627635+0000","last_clean":"2024-09-19T14:13:46.627635+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:13:46.627635+0000","last_undegraded":"2024-09-19T14:13:46.627635+0000","last_fullsized":"2024-09-19T14:13:46.627635+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":78,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.638419+0000","last_change":"2024-09-19T13:36:15.346362+0000","last_active":"2024-09-19T14:10:21.638419+0000","last_peered":"2024-09-19T14:10:21.638419+0000","last_clean":"2024-09-19T14:10:21.638419+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:10:21.638419+0000","last_undegraded":"2024-09-19T14:10:21.638419+0000","last_fullsized":"2024-09-19T14:10:21.638419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:04.233453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'110","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.035975+0000","last_change":"2024-09-19T13:36:17.358911+0000","last_active":"2024-09-19T14:13:47.035975+0000","last_peered":"2024-09-19T14:13:47.035975+0000","last_clean":"2024-09-19T14:13:47.035975+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:13:47.035975+0000","last_undegraded":"2024-09-19T14:13:47.035975+0000","last_fullsized":"2024-09-19T14:13:47.035975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:09.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'864","reported_seq":2572,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759017+0000","last_change":"2024-09-19T13:36:09.328018+0000","last_active":"2024-09-19T14:12:27.759017+0000","last_peered":"2024-09-19T14:12:27.759017+0000","last_clean":"2024-09-19T14:12:27.759017+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:12:27.759017+0000","last_undegraded":"2024-09-19T14:12:27.759017+0000","last_fullsized":"2024-09-19T14:12:27.759017+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:01.380904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'234","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:33.181002+0000","last_change":"2024-09-19T13:36:07.810852+0000","last_active":"2024-09-19T14:11:33.181002+0000","last_peered":"2024-09-19T14:11:33.181002+0000","last_clean":"2024-09-19T14:11:33.181002+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:11:33.181002+0000","last_undegraded":"2024-09-19T14:11:33.181002+0000","last_fullsized":"2024-09-19T14:11:33.181002+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:23.670171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":283729,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":574,"num_read_kb":17644,"num_write":968,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645501+0000","last_change":"2024-09-19T13:36:11.341498+0000","last_active":"2024-09-19T14:11:11.645501+0000","last_peered":"2024-09-19T14:11:11.645501+0000","last_clean":"2024-09-19T14:11:11.645501+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:11:11.645501+0000","last_undegraded":"2024-09-19T14:11:11.645501+0000","last_fullsized":"2024-09-19T14:11:11.645501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:07.914209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'73","reported_seq":581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.472240+0000","last_change":"2024-09-19T13:36:13.678466+0000","last_active":"2024-09-19T14:12:12.472240+0000","last_peered":"2024-09-19T14:12:12.472240+0000","last_clean":"2024-09-19T14:12:12.472240+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:12:12.472240+0000","last_undegraded":"2024-09-19T14:12:12.472240+0000","last_fullsized":"2024-09-19T14:12:12.472240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.085161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'776","reported_seq":4106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.047599+0000","last_change":"2024-09-19T13:36:15.350958+0000","last_active":"2024-09-19T14:13:47.047599+0000","last_peered":"2024-09-19T14:13:47.047599+0000","last_clean":"2024-09-19T14:13:47.047599+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:13:47.047599+0000","last_undegraded":"2024-09-19T14:13:47.047599+0000","last_fullsized":"2024-09-19T14:13:47.047599+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.003728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'116","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.815973+0000","last_change":"2024-09-19T13:36:17.363671+0000","last_active":"2024-09-19T14:12:27.815973+0000","last_peered":"2024-09-19T14:12:27.815973+0000","last_clean":"2024-09-19T14:12:27.815973+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:12:27.815973+0000","last_undegraded":"2024-09-19T14:12:27.815973+0000","last_fullsized":"2024-09-19T14:12:27.815973+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'835","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.844154+0000","last_change":"2024-09-19T13:36:09.338783+0000","last_active":"2024-09-19T14:12:03.844154+0000","last_peered":"2024-09-19T14:12:03.844154+0000","last_clean":"2024-09-19T14:12:03.844154+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:12:03.844154+0000","last_undegraded":"2024-09-19T14:12:03.844154+0000","last_fullsized":"2024-09-19T14:12:03.844154+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:11.912759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'176","reported_seq":753,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:00.741944+0000","last_change":"2024-09-19T13:36:07.814956+0000","last_active":"2024-09-19T14:12:00.741944+0000","last_peered":"2024-09-19T14:12:00.741944+0000","last_clean":"2024-09-19T14:12:00.741944+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:12:00.741944+0000","last_undegraded":"2024-09-19T14:12:00.741944+0000","last_fullsized":"2024-09-19T14:12:00.741944+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:59.519413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":5488,"num_write":866,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743900+0000","last_change":"2024-09-19T13:36:11.339110+0000","last_active":"2024-09-19T14:11:11.743900+0000","last_peered":"2024-09-19T14:11:11.743900+0000","last_clean":"2024-09-19T14:11:11.743900+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:11:11.743900+0000","last_undegraded":"2024-09-19T14:11:11.743900+0000","last_fullsized":"2024-09-19T14:11:11.743900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:19.072017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'143","reported_seq":703,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:36.619894+0000","last_change":"2024-09-19T13:36:13.345724+0000","last_active":"2024-09-19T14:12:36.619894+0000","last_peered":"2024-09-19T14:12:36.619894+0000","last_clean":"2024-09-19T14:12:36.619894+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:12:36.619894+0000","last_undegraded":"2024-09-19T14:12:36.619894+0000","last_fullsized":"2024-09-19T14:12:36.619894+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:09.615248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11294,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":179,"num_read_kb":233,"num_write":98,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601159+0000","last_change":"2024-09-19T13:36:15.348860+0000","last_active":"2024-09-19T14:10:06.601159+0000","last_peered":"2024-09-19T14:10:06.601159+0000","last_clean":"2024-09-19T14:10:06.601159+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:10:06.601159+0000","last_undegraded":"2024-09-19T14:10:06.601159+0000","last_fullsized":"2024-09-19T14:10:06.601159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:42.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'111","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.467492+0000","last_change":"2024-09-19T13:36:17.357887+0000","last_active":"2024-09-19T14:12:12.467492+0000","last_peered":"2024-09-19T14:12:12.467492+0000","last_clean":"2024-09-19T14:12:12.467492+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:12:12.467492+0000","last_undegraded":"2024-09-19T14:12:12.467492+0000","last_fullsized":"2024-09-19T14:12:12.467492+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:57.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2548,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758795+0000","last_change":"2024-09-19T13:36:09.339435+0000","last_active":"2024-09-19T14:12:27.758795+0000","last_peered":"2024-09-19T14:12:27.758795+0000","last_clean":"2024-09-19T14:12:27.758795+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:12:27.758795+0000","last_undegraded":"2024-09-19T14:12:27.758795+0000","last_fullsized":"2024-09-19T14:12:27.758795+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:54.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'233","reported_seq":885,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:10.871720+0000","last_change":"2024-09-19T13:36:07.814402+0000","last_active":"2024-09-19T14:12:10.871720+0000","last_peered":"2024-09-19T14:12:10.871720+0000","last_clean":"2024-09-19T14:12:10.871720+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:12:10.871720+0000","last_undegraded":"2024-09-19T14:12:10.871720+0000","last_fullsized":"2024-09-19T14:12:10.871720+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.518831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19036554,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":601,"num_read_kb":59575,"num_write":1076,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.609332+0000","last_change":"2024-09-19T13:36:11.336616+0000","last_active":"2024-09-19T14:11:11.609332+0000","last_peered":"2024-09-19T14:11:11.609332+0000","last_clean":"2024-09-19T14:11:11.609332+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:11:11.609332+0000","last_undegraded":"2024-09-19T14:11:11.609332+0000","last_fullsized":"2024-09-19T14:11:11.609332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:30.775102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'128","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.621099+0000","last_change":"2024-09-19T13:36:13.344971+0000","last_active":"2024-09-19T14:12:31.621099+0000","last_peered":"2024-09-19T14:12:31.621099+0000","last_clean":"2024-09-19T14:12:31.621099+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:12:31.621099+0000","last_undegraded":"2024-09-19T14:12:31.621099+0000","last_fullsized":"2024-09-19T14:12:31.621099+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:03.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":144,"num_read_kb":190,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.711890+0000","last_change":"2024-09-19T13:36:15.353381+0000","last_active":"2024-09-19T14:10:11.711890+0000","last_peered":"2024-09-19T14:10:11.711890+0000","last_clean":"2024-09-19T14:10:11.711890+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:10:11.711890+0000","last_undegraded":"2024-09-19T14:10:11.711890+0000","last_fullsized":"2024-09-19T14:10:11.711890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.838545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'82","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:08.528868+0000","last_change":"2024-09-19T13:36:17.361965+0000","last_active":"2024-09-19T14:12:08.528868+0000","last_peered":"2024-09-19T14:12:08.528868+0000","last_clean":"2024-09-19T14:12:08.528868+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:12:08.528868+0000","last_undegraded":"2024-09-19T14:12:08.528868+0000","last_fullsized":"2024-09-19T14:12:08.528868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:25.682631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'388","reported_seq":1821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859075+0000","last_change":"2024-09-19T13:36:09.341541+0000","last_active":"2024-09-19T14:13:45.859075+0000","last_peered":"2024-09-19T14:13:45.859075+0000","last_clean":"2024-09-19T14:13:45.859075+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:13:45.859075+0000","last_undegraded":"2024-09-19T14:13:45.859075+0000","last_fullsized":"2024-09-19T14:13:45.859075+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:38.682073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'199","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.164446+0000","last_change":"2024-09-19T13:36:44.400469+0000","last_active":"2024-09-19T14:12:13.164446+0000","last_peered":"2024-09-19T14:12:13.164446+0000","last_clean":"2024-09-19T14:12:13.164446+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:12:13.164446+0000","last_undegraded":"2024-09-19T14:12:13.164446+0000","last_fullsized":"2024-09-19T14:12:13.164446+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:06.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898702,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":9219,"num_write":928,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719839+0000","last_change":"2024-09-19T13:36:11.334533+0000","last_active":"2024-09-19T14:10:01.719839+0000","last_peered":"2024-09-19T14:10:01.719839+0000","last_clean":"2024-09-19T14:10:01.719839+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:10:01.719839+0000","last_undegraded":"2024-09-19T14:10:01.719839+0000","last_fullsized":"2024-09-19T14:10:01.719839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'111","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.627563+0000","last_change":"2024-09-19T13:36:13.346260+0000","last_active":"2024-09-19T14:13:46.627563+0000","last_peered":"2024-09-19T14:13:46.627563+0000","last_clean":"2024-09-19T14:13:46.627563+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:13:46.627563+0000","last_undegraded":"2024-09-19T14:13:46.627563+0000","last_fullsized":"2024-09-19T14:13:46.627563+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:37.266432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":195,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730630+0000","last_change":"2024-09-19T13:36:15.348740+0000","last_active":"2024-09-19T14:11:16.730630+0000","last_peered":"2024-09-19T14:11:16.730630+0000","last_clean":"2024-09-19T14:11:16.730630+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:11:16.730630+0000","last_undegraded":"2024-09-19T14:11:16.730630+0000","last_fullsized":"2024-09-19T14:11:16.730630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:00.693042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'161","reported_seq":1613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.352324+0000","last_change":"2024-09-19T13:36:17.359613+0000","last_active":"2024-09-19T14:12:27.352324+0000","last_peered":"2024-09-19T14:12:27.352324+0000","last_clean":"2024-09-19T14:12:27.352324+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:12:27.352324+0000","last_undegraded":"2024-09-19T14:12:27.352324+0000","last_fullsized":"2024-09-19T14:12:27.352324+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:03.545885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1270","reported_seq":2983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882294+0000","last_change":"2024-09-19T13:36:09.338262+0000","last_active":"2024-09-19T14:12:15.882294+0000","last_peered":"2024-09-19T14:12:15.882294+0000","last_clean":"2024-09-19T14:12:15.882294+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:12:15.882294+0000","last_undegraded":"2024-09-19T14:12:15.882294+0000","last_fullsized":"2024-09-19T14:12:15.882294+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:47.191145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'204","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727812+0000","last_change":"2024-09-19T13:36:07.813158+0000","last_active":"2024-09-19T14:12:25.727812+0000","last_peered":"2024-09-19T14:12:25.727812+0000","last_clean":"2024-09-19T14:12:25.727812+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:12:25.727812+0000","last_undegraded":"2024-09-19T14:12:25.727812+0000","last_fullsized":"2024-09-19T14:12:25.727812+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:46.920199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6558355,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":101743,"num_write":1007,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.636111+0000","last_change":"2024-09-19T13:36:11.338136+0000","last_active":"2024-09-19T14:10:06.636111+0000","last_peered":"2024-09-19T14:10:06.636111+0000","last_clean":"2024-09-19T14:10:06.636111+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:10:06.636111+0000","last_undegraded":"2024-09-19T14:10:06.636111+0000","last_fullsized":"2024-09-19T14:10:06.636111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:55.192579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'155","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.752326+0000","last_change":"2024-09-19T13:36:13.345467+0000","last_active":"2024-09-19T14:13:46.752326+0000","last_peered":"2024-09-19T14:13:46.752326+0000","last_clean":"2024-09-19T14:13:46.752326+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:13:46.752326+0000","last_undegraded":"2024-09-19T14:13:46.752326+0000","last_fullsized":"2024-09-19T14:13:46.752326+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":282,"num_write":118,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611550+0000","last_change":"2024-09-19T13:36:15.349620+0000","last_active":"2024-09-19T14:11:16.611550+0000","last_peered":"2024-09-19T14:11:16.611550+0000","last_clean":"2024-09-19T14:11:16.611550+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:11:16.611550+0000","last_undegraded":"2024-09-19T14:11:16.611550+0000","last_fullsized":"2024-09-19T14:11:16.611550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.666417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'158","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855539+0000","last_change":"2024-09-19T13:36:17.360385+0000","last_active":"2024-09-19T14:13:45.855539+0000","last_peered":"2024-09-19T14:13:45.855539+0000","last_clean":"2024-09-19T14:13:45.855539+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:13:45.855539+0000","last_undegraded":"2024-09-19T14:13:45.855539+0000","last_fullsized":"2024-09-19T14:13:45.855539+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:56.457101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'835","reported_seq":2511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354875+0000","last_change":"2024-09-19T13:36:09.340041+0000","last_active":"2024-09-19T14:12:27.354875+0000","last_peered":"2024-09-19T14:12:27.354875+0000","last_clean":"2024-09-19T14:12:27.354875+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:12:27.354875+0000","last_undegraded":"2024-09-19T14:12:27.354875+0000","last_fullsized":"2024-09-19T14:12:27.354875+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.813909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'243","reported_seq":934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.413480+0000","last_change":"2024-09-19T13:36:07.816141+0000","last_active":"2024-09-19T14:11:59.413480+0000","last_peered":"2024-09-19T14:11:59.413480+0000","last_clean":"2024-09-19T14:11:59.413480+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:11:59.413480+0000","last_undegraded":"2024-09-19T14:11:59.413480+0000","last_fullsized":"2024-09-19T14:11:59.413480+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:19.313544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6958799,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":884,"num_read_kb":7647,"num_write":1097,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759140+0000","last_change":"2024-09-19T13:36:09.327555+0000","last_active":"2024-09-19T14:12:27.759140+0000","last_peered":"2024-09-19T14:12:27.759140+0000","last_clean":"2024-09-19T14:12:27.759140+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:12:27.759140+0000","last_undegraded":"2024-09-19T14:12:27.759140+0000","last_fullsized":"2024-09-19T14:12:27.759140+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:05.495968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'214","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818398+0000","last_change":"2024-09-19T13:36:44.477056+0000","last_active":"2024-09-19T14:11:36.818398+0000","last_peered":"2024-09-19T14:11:36.818398+0000","last_clean":"2024-09-19T14:11:36.818398+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:11:36.818398+0000","last_undegraded":"2024-09-19T14:11:36.818398+0000","last_fullsized":"2024-09-19T14:11:36.818398+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:33.685772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":556,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":9780,"num_write":1044,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'454","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.864388+0000","last_change":"2024-09-19T13:36:09.336079+0000","last_active":"2024-09-19T14:13:45.864388+0000","last_peered":"2024-09-19T14:13:45.864388+0000","last_clean":"2024-09-19T14:13:45.864388+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:13:45.864388+0000","last_undegraded":"2024-09-19T14:13:45.864388+0000","last_fullsized":"2024-09-19T14:13:45.864388+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:37.224054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'206","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.496205+0000","last_change":"2024-09-19T13:36:07.813078+0000","last_active":"2024-09-19T14:12:11.496205+0000","last_peered":"2024-09-19T14:12:11.496205+0000","last_clean":"2024-09-19T14:12:11.496205+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:12:11.496205+0000","last_undegraded":"2024-09-19T14:12:11.496205+0000","last_fullsized":"2024-09-19T14:12:11.496205+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:50:05.153900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569610,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":41340,"num_write":994,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'834","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171315+0000","last_change":"2024-09-19T13:36:09.337109+0000","last_active":"2024-09-19T14:12:15.171315+0000","last_peered":"2024-09-19T14:12:15.171315+0000","last_clean":"2024-09-19T14:12:15.171315+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:12:15.171315+0000","last_undegraded":"2024-09-19T14:12:15.171315+0000","last_fullsized":"2024-09-19T14:12:15.171315+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:35.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'341","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.655125+0000","last_change":"2024-09-19T13:36:07.799742+0000","last_active":"2024-09-19T14:13:41.655125+0000","last_peered":"2024-09-19T14:13:41.655125+0000","last_clean":"2024-09-19T14:13:41.655125+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:13:41.655125+0000","last_undegraded":"2024-09-19T14:13:41.655125+0000","last_fullsized":"2024-09-19T14:13:41.655125+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:24.145889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031324,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":982,"num_read_kb":17821,"num_write":1246,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1313","reported_seq":2966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.881914+0000","last_change":"2024-09-19T13:36:09.337337+0000","last_active":"2024-09-19T14:12:15.881914+0000","last_peered":"2024-09-19T14:12:15.881914+0000","last_clean":"2024-09-19T14:12:15.881914+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:12:15.881914+0000","last_undegraded":"2024-09-19T14:12:15.881914+0000","last_fullsized":"2024-09-19T14:12:15.881914+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:42.621753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'181","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.215253+0000","last_change":"2024-09-19T13:36:07.799229+0000","last_active":"2024-09-19T14:12:06.215253+0000","last_peered":"2024-09-19T14:12:06.215253+0000","last_clean":"2024-09-19T14:12:06.215253+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:12:06.215253+0000","last_undegraded":"2024-09-19T14:12:06.215253+0000","last_fullsized":"2024-09-19T14:12:06.215253+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:58.585027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22190415,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":35047,"num_write":884,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'459","reported_seq":2150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.394101+0000","last_change":"2024-09-19T13:36:09.337422+0000","last_active":"2024-09-19T14:12:14.394101+0000","last_peered":"2024-09-19T14:12:14.394101+0000","last_clean":"2024-09-19T14:12:14.394101+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:12:14.394101+0000","last_undegraded":"2024-09-19T14:12:14.394101+0000","last_fullsized":"2024-09-19T14:12:14.394101+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:01.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'260","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.483590+0000","last_change":"2024-09-19T13:36:07.807531+0000","last_active":"2024-09-19T14:12:15.483590+0000","last_peered":"2024-09-19T14:12:15.483590+0000","last_clean":"2024-09-19T14:12:15.483590+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:12:15.483590+0000","last_undegraded":"2024-09-19T14:12:15.483590+0000","last_fullsized":"2024-09-19T14:12:15.483590+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:04.888500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'504","reported_seq":2120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176086+0000","last_change":"2024-09-19T13:36:09.345213+0000","last_active":"2024-09-19T14:12:26.176086+0000","last_peered":"2024-09-19T14:12:26.176086+0000","last_clean":"2024-09-19T14:12:26.176086+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:12:26.176086+0000","last_undegraded":"2024-09-19T14:12:26.176086+0000","last_fullsized":"2024-09-19T14:12:26.176086+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:29.948161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'206","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:37.059809+0000","last_change":"2024-09-19T13:36:07.807149+0000","last_active":"2024-09-19T14:13:37.059809+0000","last_peered":"2024-09-19T14:13:37.059809+0000","last_clean":"2024-09-19T14:13:37.059809+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:13:37.059809+0000","last_undegraded":"2024-09-19T14:13:37.059809+0000","last_fullsized":"2024-09-19T14:13:37.059809+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":13493,"num_write":1004,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'441","reported_seq":1912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857244+0000","last_change":"2024-09-19T13:36:09.339640+0000","last_active":"2024-09-19T14:13:45.857244+0000","last_peered":"2024-09-19T14:13:45.857244+0000","last_clean":"2024-09-19T14:13:45.857244+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:13:45.857244+0000","last_undegraded":"2024-09-19T14:13:45.857244+0000","last_fullsized":"2024-09-19T14:13:45.857244+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:04.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'235","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:38.916973+0000","last_change":"2024-09-19T13:36:07.799033+0000","last_active":"2024-09-19T14:13:38.916973+0000","last_peered":"2024-09-19T14:13:38.916973+0000","last_clean":"2024-09-19T14:13:38.916973+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:13:38.916973+0000","last_undegraded":"2024-09-19T14:13:38.916973+0000","last_fullsized":"2024-09-19T14:13:38.916973+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:19.554246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":654,"num_read_kb":12697,"num_write":1148,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'795","reported_seq":2305,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354863+0000","last_change":"2024-09-19T13:36:09.334668+0000","last_active":"2024-09-19T14:12:27.354863+0000","last_peered":"2024-09-19T14:12:27.354863+0000","last_clean":"2024-09-19T14:12:27.354863+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:12:27.354863+0000","last_undegraded":"2024-09-19T14:12:27.354863+0000","last_fullsized":"2024-09-19T14:12:27.354863+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:41.139613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'187","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:24.204718+0000","last_change":"2024-09-19T13:36:07.810286+0000","last_active":"2024-09-19T14:11:24.204718+0000","last_peered":"2024-09-19T14:11:24.204718+0000","last_clean":"2024-09-19T14:11:24.204718+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:11:24.204718+0000","last_undegraded":"2024-09-19T14:11:24.204718+0000","last_fullsized":"2024-09-19T14:11:24.204718+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.597999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10490759,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":31169,"num_write":925,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'408","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355318+0000","last_change":"2024-09-19T13:36:09.330316+0000","last_active":"2024-09-19T14:12:27.355318+0000","last_peered":"2024-09-19T14:12:27.355318+0000","last_clean":"2024-09-19T14:12:27.355318+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:12:27.355318+0000","last_undegraded":"2024-09-19T14:12:27.355318+0000","last_fullsized":"2024-09-19T14:12:27.355318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:07.464094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'215","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:25.727427+0000","last_change":"2024-09-19T13:36:07.798277+0000","last_active":"2024-09-19T14:12:25.727427+0000","last_peered":"2024-09-19T14:12:25.727427+0000","last_clean":"2024-09-19T14:12:25.727427+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:12:25.727427+0000","last_undegraded":"2024-09-19T14:12:25.727427+0000","last_fullsized":"2024-09-19T14:12:25.727427+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:15.349763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956151,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":31236,"num_write":1020,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'415","reported_seq":1917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.927264+0000","last_change":"2024-09-19T13:36:09.335622+0000","last_active":"2024-09-19T14:12:13.927264+0000","last_peered":"2024-09-19T14:12:13.927264+0000","last_clean":"2024-09-19T14:12:13.927264+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:12:13.927264+0000","last_undegraded":"2024-09-19T14:12:13.927264+0000","last_fullsized":"2024-09-19T14:12:13.927264+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:17:53.466085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'289","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:19.110439+0000","last_change":"2024-09-19T13:36:07.810715+0000","last_active":"2024-09-19T14:11:19.110439+0000","last_peered":"2024-09-19T14:11:19.110439+0000","last_clean":"2024-09-19T14:11:19.110439+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:11:19.110439+0000","last_undegraded":"2024-09-19T14:11:19.110439+0000","last_fullsized":"2024-09-19T14:11:19.110439+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:31.514058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27201,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":11922,"num_write":1197,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'363","reported_seq":1800,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.169773+0000","last_change":"2024-09-19T13:36:09.337015+0000","last_active":"2024-09-19T14:12:26.169773+0000","last_peered":"2024-09-19T14:12:26.169773+0000","last_clean":"2024-09-19T14:12:26.169773+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:12:26.169773+0000","last_undegraded":"2024-09-19T14:12:26.169773+0000","last_fullsized":"2024-09-19T14:12:26.169773+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:30.671479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'209","reported_seq":882,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:45.071355+0000","last_change":"2024-09-19T13:36:07.814269+0000","last_active":"2024-09-19T14:11:45.071355+0000","last_peered":"2024-09-19T14:11:45.071355+0000","last_clean":"2024-09-19T14:11:45.071355+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:11:45.071355+0000","last_undegraded":"2024-09-19T14:11:45.071355+0000","last_fullsized":"2024-09-19T14:11:45.071355+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:15.947998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5413251,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":98527,"num_write":1021,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'868","reported_seq":2495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819671+0000","last_change":"2024-09-19T13:36:09.338093+0000","last_active":"2024-09-19T14:12:14.819671+0000","last_peered":"2024-09-19T14:12:14.819671+0000","last_clean":"2024-09-19T14:12:14.819671+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:12:14.819671+0000","last_undegraded":"2024-09-19T14:12:14.819671+0000","last_fullsized":"2024-09-19T14:12:14.819671+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:05.996200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'239","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.238395+0000","last_change":"2024-09-19T13:36:07.814412+0000","last_active":"2024-09-19T14:11:59.238395+0000","last_peered":"2024-09-19T14:11:59.238395+0000","last_clean":"2024-09-19T14:11:59.238395+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:11:59.238395+0000","last_undegraded":"2024-09-19T14:11:59.238395+0000","last_fullsized":"2024-09-19T14:11:59.238395+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:00.783704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3437313,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":9315,"num_write":1045,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.874456+0000","last_change":"2024-09-19T13:36:09.341212+0000","last_active":"2024-09-19T14:12:15.874456+0000","last_peered":"2024-09-19T14:12:15.874456+0000","last_clean":"2024-09-19T14:12:15.874456+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:12:15.874456+0000","last_undegraded":"2024-09-19T14:12:15.874456+0000","last_fullsized":"2024-09-19T14:12:15.874456+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:57.018874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'247","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733913+0000","last_change":"2024-09-19T13:36:07.807328+0000","last_active":"2024-09-19T14:10:06.733913+0000","last_peered":"2024-09-19T14:10:06.733913+0000","last_clean":"2024-09-19T14:10:06.733913+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:10:06.733913+0000","last_undegraded":"2024-09-19T14:10:06.733913+0000","last_fullsized":"2024-09-19T14:10:06.733913+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:08.421022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9310237,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":634,"num_read_kb":13968,"num_write":1073,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'506","reported_seq":2122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.600040+0000","last_change":"2024-09-19T13:36:09.336661+0000","last_active":"2024-09-19T14:12:13.600040+0000","last_peered":"2024-09-19T14:12:13.600040+0000","last_clean":"2024-09-19T14:12:13.600040+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:12:13.600040+0000","last_undegraded":"2024-09-19T14:12:13.600040+0000","last_fullsized":"2024-09-19T14:12:13.600040+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:04.813825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'220","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.567382+0000","last_change":"2024-09-19T13:36:07.808201+0000","last_active":"2024-09-19T14:11:55.567382+0000","last_peered":"2024-09-19T14:11:55.567382+0000","last_clean":"2024-09-19T14:11:55.567382+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:11:55.567382+0000","last_undegraded":"2024-09-19T14:11:55.567382+0000","last_fullsized":"2024-09-19T14:11:55.567382+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:55.157068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534349,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":599,"num_read_kb":75622,"num_write":969,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'448","reported_seq":1944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758451+0000","last_change":"2024-09-19T13:36:09.337955+0000","last_active":"2024-09-19T14:12:27.758451+0000","last_peered":"2024-09-19T14:12:27.758451+0000","last_clean":"2024-09-19T14:12:27.758451+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:12:27.758451+0000","last_undegraded":"2024-09-19T14:12:27.758451+0000","last_fullsized":"2024-09-19T14:12:27.758451+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:36.790174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'197","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.547310+0000","last_change":"2024-09-19T13:36:07.810689+0000","last_active":"2024-09-19T14:12:13.547310+0000","last_peered":"2024-09-19T14:12:13.547310+0000","last_clean":"2024-09-19T14:12:13.547310+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:12:13.547310+0000","last_undegraded":"2024-09-19T14:12:13.547310+0000","last_fullsized":"2024-09-19T14:12:13.547310+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:59.845601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324671,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":543,"num_read_kb":10629,"num_write":1011,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'191","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:07.376741+0000","last_change":"2024-09-19T13:36:07.816743+0000","last_active":"2024-09-19T14:12:07.376741+0000","last_peered":"2024-09-19T14:12:07.376741+0000","last_clean":"2024-09-19T14:12:07.376741+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:12:07.376741+0000","last_undegraded":"2024-09-19T14:12:07.376741+0000","last_fullsized":"2024-09-19T14:12:07.376741+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.831713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4409468,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":459,"num_read_kb":6982,"num_write":946,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'984","reported_seq":2906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176238+0000","last_change":"2024-09-19T13:36:09.340334+0000","last_active":"2024-09-19T14:12:26.176238+0000","last_peered":"2024-09-19T14:12:26.176238+0000","last_clean":"2024-09-19T14:12:26.176238+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:12:26.176238+0000","last_undegraded":"2024-09-19T14:12:26.176238+0000","last_fullsized":"2024-09-19T14:12:26.176238+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:50.291927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'226","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:10.172942+0000","last_change":"2024-09-19T13:36:07.805884+0000","last_active":"2024-09-19T14:12:10.172942+0000","last_peered":"2024-09-19T14:12:10.172942+0000","last_clean":"2024-09-19T14:12:10.172942+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:12:10.172942+0000","last_undegraded":"2024-09-19T14:12:10.172942+0000","last_fullsized":"2024-09-19T14:12:10.172942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:43.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7246065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":719,"num_read_kb":54230,"num_write":1170,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'386","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.347586+0000","last_change":"2024-09-19T13:36:09.336829+0000","last_active":"2024-09-19T14:12:27.347586+0000","last_peered":"2024-09-19T14:12:27.347586+0000","last_clean":"2024-09-19T14:12:27.347586+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:12:27.347586+0000","last_undegraded":"2024-09-19T14:12:27.347586+0000","last_fullsized":"2024-09-19T14:12:27.347586+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:29.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1682,"ondisk_log_size":1682,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":614,"ondisk_log_size":614,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":405878,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7581,"num_read_kb":9313,"num_write":5135,"num_write_kb":2593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":189930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1879,"ondisk_log_size":1879,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2397,"num_read_kb":2862,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4236,"ondisk_log_size":4236,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":487465899,"num_objects":412,"num_object_clones":0,"num_object_copies":824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":0,"num_read":38487,"num_read_kb":2616691,"num_write":63619,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":976797696,"data_stored":974931798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4246,"ondisk_log_size":4246,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63610923,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":117,"num_read_kb":176453,"num_write":136,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127229952,"data_stored":127221846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63610923,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":115,"num_read_kb":179418,"num_write":136,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127229952,"data_stored":127221846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542608,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":359656,"kb_used_data":143832,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94012184,"statfs":{"total":96636764160,"available":96268476416,"internally_reserved":0,"allocated":147283968,"data_stored":145414466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220985802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542609,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364772,"kb_used_data":153108,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94007068,"statfs":{"total":96636764160,"available":96263237632,"internally_reserved":0,"allocated":156782592,"data_stored":155158296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216725958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229244,"kb_used_data":139820,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94142596,"statfs":{"total":96636764160,"available":96402018304,"internally_reserved":0,"allocated":143175680,"data_stored":141307822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542612,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255312,"kb_used_data":179712,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94116528,"statfs":{"total":96636764160,"available":96375324672,"internally_reserved":0,"allocated":184025088,"data_stored":182276595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542610,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405664,"kb_used_data":175952,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93966176,"statfs":{"total":96636764160,"available":96221364224,"internally_reserved":0,"allocated":180174848,"data_stored":178395336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542610,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161904,"kb_used_data":98784,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94209936,"statfs":{"total":96636764160,"available":96470974464,"internally_reserved":0,"allocated":101154816,"data_stored":99542049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542609,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262920,"kb_used_data":141560,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94108920,"statfs":{"total":96636764160,"available":96367534080,"internally_reserved":0,"allocated":144957440,"data_stored":143275793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542610,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429088,"kb_used_data":199376,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93942752,"statfs":{"total":96636764160,"available":96197378048,"internally_reserved":0,"allocated":204161024,"data_stored":202300137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155848704,"data_stored":155531495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":87781376,"data_stored":87605617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83361792,"data_stored":83206147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":139661312,"data_stored":139427172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":156217344,"data_stored":155923322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":120438784,"data_stored":120161976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":105390080,"data_stored":105253044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":128098304,"data_stored":127823025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":22615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":30215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":25850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":12834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":45848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":30308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23117097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5827243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8978432,"data_stored":8976178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13742080,"data_stored":13740281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9502720,"data_stored":9500759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27852800,"data_stored":27850546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15839232,"data_stored":15837433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23658496,"data_stored":23656242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5353472,"data_stored":5351673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:14:19.619 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T14:14:19.943 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:14:19.943 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":260,"fsid":"0f9e9aa8-63c5-4955-9c42-4c204ccced9a","created":"2024-09-19T13:35:38.533058+0000","modified":"2024-09-19T14:03:09.830832+0000","last_up_change":"2024-09-19T13:35:50.723767+0000","last_in_change":"2024-09-19T13:35:41.732911+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:35:50.893695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T13:35:57.588696+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-19T13:36:06.079937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-19T13:36:08.136207+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-19T13:36:09.503625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-19T13:36:11.388879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-19T13:36:13.353330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-19T13:36:15.406619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-19T13:51:14.114591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"249","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-19T13:52:46.893030+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-19T13:52:49.620046+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-19T14:03:07.494083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"13ac99f9-0395-45d8-af2d-85fb6a74fd4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6809","nonce":2947892333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6811","nonce":2947892333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6815","nonce":2947892333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":2947892333},{"type":"v1","addr":"172.21.15.94:6813","nonce":2947892333}]},"public_addr":"172.21.15.94:6809/2947892333","cluster_addr":"172.21.15.94:6811/2947892333","heartbeat_back_addr":"172.21.15.94:6815/2947892333","heartbeat_front_addr":"172.21.15.94:6813/2947892333","state":["exists","up"]},{"osd":1,"uuid":"7a56daa1-457d-4a7f-a6ef-496cee83a5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6823","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6825","nonce":4240401748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6827","nonce":4240401748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6831","nonce":4240401748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":4240401748},{"type":"v1","addr":"172.21.15.94:6829","nonce":4240401748}]},"public_addr":"172.21.15.94:6825/4240401748","cluster_addr":"172.21.15.94:6827/4240401748","heartbeat_back_addr":"172.21.15.94:6831/4240401748","heartbeat_front_addr":"172.21.15.94:6829/4240401748","state":["exists","up"]},{"osd":2,"uuid":"7db08beb-0782-4f83-bb02-70e08f6fdded","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6801","nonce":943812970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6803","nonce":943812970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6807","nonce":943812970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":943812970},{"type":"v1","addr":"172.21.15.94:6805","nonce":943812970}]},"public_addr":"172.21.15.94:6801/943812970","cluster_addr":"172.21.15.94:6803/943812970","heartbeat_back_addr":"172.21.15.94:6807/943812970","heartbeat_front_addr":"172.21.15.94:6805/943812970","state":["exists","up"]},{"osd":3,"uuid":"ae120132-ec0d-4aa5-b573-42456b82b018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6817","nonce":2406227919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6819","nonce":2406227919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6824","nonce":2406227919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2406227919},{"type":"v1","addr":"172.21.15.94:6821","nonce":2406227919}]},"public_addr":"172.21.15.94:6817/2406227919","cluster_addr":"172.21.15.94:6819/2406227919","heartbeat_back_addr":"172.21.15.94:6824/2406227919","heartbeat_front_addr":"172.21.15.94:6821/2406227919","state":["exists","up"]},{"osd":4,"uuid":"82c729c9-4fb8-4e58-90ad-615aca660f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6827","nonce":1468975705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6829","nonce":1468975705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6833","nonce":1468975705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1468975705},{"type":"v1","addr":"172.21.15.149:6831","nonce":1468975705}]},"public_addr":"172.21.15.149:6827/1468975705","cluster_addr":"172.21.15.149:6829/1468975705","heartbeat_back_addr":"172.21.15.149:6833/1468975705","heartbeat_front_addr":"172.21.15.149:6831/1468975705","state":["exists","up"]},{"osd":5,"uuid":"9fdf6ffe-df56-4eb8-a879-cbb73618f54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6811","nonce":155328186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6813","nonce":155328186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6817","nonce":155328186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":155328186},{"type":"v1","addr":"172.21.15.149:6815","nonce":155328186}]},"public_addr":"172.21.15.149:6811/155328186","cluster_addr":"172.21.15.149:6813/155328186","heartbeat_back_addr":"172.21.15.149:6817/155328186","heartbeat_front_addr":"172.21.15.149:6815/155328186","state":["exists","up"]},{"osd":6,"uuid":"450599d0-2e28-4886-8bdb-69dc45595893","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6803","nonce":2885675404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6805","nonce":2885675404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6809","nonce":2885675404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2885675404},{"type":"v1","addr":"172.21.15.149:6807","nonce":2885675404}]},"public_addr":"172.21.15.149:6803/2885675404","cluster_addr":"172.21.15.149:6805/2885675404","heartbeat_back_addr":"172.21.15.149:6809/2885675404","heartbeat_front_addr":"172.21.15.149:6807/2885675404","state":["exists","up"]},{"osd":7,"uuid":"8487aebb-0dd5-489b-a14e-913f44484a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6819","nonce":2247801421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6821","nonce":2247801421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6825","nonce":2247801421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2247801421},{"type":"v1","addr":"172.21.15.149:6823","nonce":2247801421}]},"public_addr":"172.21.15.149:6819/2247801421","cluster_addr":"172.21.15.149:6821/2247801421","heartbeat_back_addr":"172.21.15.149:6825/2247801421","heartbeat_front_addr":"172.21.15.149:6823/2247801421","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.202236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.608235+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.805303+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.059553+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.176912+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.527000+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:47.797236+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:35:48.734976+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"67.19","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T14:14:20.956 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T14:14:20.956 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:21.107 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:21.107 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:21.107 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:21.118 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T14:14:21.419 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T14:14:21.432 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T14:14:21.432 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:21.568 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:21.569 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:21.569 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:21.579 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T14:14:21.883 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T14:14:21.897 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T14:14:21.898 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:22.034 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:22.034 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:22.034 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:22.045 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T14:14:22.347 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T14:14:22.361 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T14:14:22.361 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:22.497 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:22.497 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:22.497 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:22.508 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T14:14:22.810 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T14:14:22.824 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T14:14:22.824 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:22.963 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:22.963 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:22.963 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:22.973 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T14:14:23.276 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T14:14:23.289 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T14:14:23.290 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:23.430 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:23.430 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:23.430 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:23.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T14:14:23.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-19T14:14:23.743 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T14:14:23.757 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T14:14:23.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:23.897 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:23.898 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:23.898 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:23.908 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T14:14:24.211 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T14:14:24.225 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T14:14:24.225 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T14:14:24.365 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2024-09-19T14:14:24.365 INFO:teuthology.orchestra.run.smithi094.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T14:14:24.365 INFO:teuthology.orchestra.run.smithi094.stdout:} 2024-09-19T14:14:24.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T14:14:24.680 INFO:teuthology.orchestra.run.smithi094.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T14:14:24.694 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:14:25.017 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:14:25.029 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:14:25.032 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1409,"stamp":"2024-09-19T14:14:23.710212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41806249,"num_objects":632,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":296329,"num_read_kb":3211329,"num_write":145619,"num_write_kb":2512533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13864,"ondisk_log_size":13864,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1359504,"kb_used_data":110208,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753615216,"statfs":{"total":773094113280,"available":771701981184,"internally_reserved":0,"allocated":112852992,"data_stored":99880336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-573895079,"num_objects":-280,"num_object_clones":0,"num_object_copies":-560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-280,"num_whiteouts":0,"num_read":608,"num_read_kb":667,"num_write":436,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005053"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.604790+0000","last_change":"2024-09-19T14:03:08.839286+0000","last_active":"2024-09-19T14:10:41.604790+0000","last_peered":"2024-09-19T14:10:41.604790+0000","last_clean":"2024-09-19T14:10:41.604790+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:10:41.604790+0000","last_undegraded":"2024-09-19T14:10:41.604790+0000","last_fullsized":"2024-09-19T14:10:41.604790+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:42.826327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.602224+0000","last_change":"2024-09-19T13:52:51.581992+0000","last_active":"2024-09-19T14:10:21.602224+0000","last_peered":"2024-09-19T14:10:21.602224+0000","last_clean":"2024-09-19T14:10:21.602224+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:10:21.602224+0000","last_undegraded":"2024-09-19T14:10:21.602224+0000","last_fullsized":"2024-09-19T14:10:21.602224+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:21.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722729+0000","last_change":"2024-09-19T13:52:48.556806+0000","last_active":"2024-09-19T14:10:21.722729+0000","last_peered":"2024-09-19T14:10:21.722729+0000","last_clean":"2024-09-19T14:10:21.722729+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:10:21.722729+0000","last_undegraded":"2024-09-19T14:10:21.722729+0000","last_fullsized":"2024-09-19T14:10:21.722729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:12.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.618002+0000","last_change":"2024-09-19T13:51:15.739764+0000","last_active":"2024-09-19T14:12:06.618002+0000","last_peered":"2024-09-19T14:12:06.618002+0000","last_clean":"2024-09-19T14:12:06.618002+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:12:06.618002+0000","last_undegraded":"2024-09-19T14:12:06.618002+0000","last_fullsized":"2024-09-19T14:12:06.618002+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:19.998068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.811878+0000","last_change":"2024-09-19T14:03:08.835558+0000","last_active":"2024-09-19T14:10:41.811878+0000","last_peered":"2024-09-19T14:10:41.811878+0000","last_clean":"2024-09-19T14:10:41.811878+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:10:41.811878+0000","last_undegraded":"2024-09-19T14:10:41.811878+0000","last_fullsized":"2024-09-19T14:10:41.811878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:48.618379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.743761+0000","last_change":"2024-09-19T13:52:51.587845+0000","last_active":"2024-09-19T14:12:51.743761+0000","last_peered":"2024-09-19T14:12:51.743761+0000","last_clean":"2024-09-19T14:12:51.743761+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:12:51.743761+0000","last_undegraded":"2024-09-19T14:12:51.743761+0000","last_fullsized":"2024-09-19T14:12:51.743761+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:46.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.657785+0000","last_change":"2024-09-19T13:52:48.554640+0000","last_active":"2024-09-19T14:12:51.657785+0000","last_peered":"2024-09-19T14:12:51.657785+0000","last_clean":"2024-09-19T14:12:51.657785+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:12:51.657785+0000","last_undegraded":"2024-09-19T14:12:51.657785+0000","last_fullsized":"2024-09-19T14:12:51.657785+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:35.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.816386+0000","last_change":"2024-09-19T13:51:15.745607+0000","last_active":"2024-09-19T14:11:16.816386+0000","last_peered":"2024-09-19T14:11:16.816386+0000","last_clean":"2024-09-19T14:11:16.816386+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:11:16.816386+0000","last_undegraded":"2024-09-19T14:11:16.816386+0000","last_fullsized":"2024-09-19T14:11:16.816386+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.713992+0000","last_change":"2024-09-19T14:03:08.837569+0000","last_active":"2024-09-19T14:10:26.713992+0000","last_peered":"2024-09-19T14:10:26.713992+0000","last_clean":"2024-09-19T14:10:26.713992+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:10:26.713992+0000","last_undegraded":"2024-09-19T14:10:26.713992+0000","last_fullsized":"2024-09-19T14:10:26.713992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:12.734099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.614000+0000","last_change":"2024-09-19T13:52:51.586976+0000","last_active":"2024-09-19T14:11:36.614000+0000","last_peered":"2024-09-19T14:11:36.614000+0000","last_clean":"2024-09-19T14:11:36.614000+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:11:36.614000+0000","last_undegraded":"2024-09-19T14:11:36.614000+0000","last_fullsized":"2024-09-19T14:11:36.614000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:28.946709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813410+0000","last_change":"2024-09-19T13:52:48.554485+0000","last_active":"2024-09-19T14:10:51.813410+0000","last_peered":"2024-09-19T14:10:51.813410+0000","last_clean":"2024-09-19T14:10:51.813410+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:10:51.813410+0000","last_undegraded":"2024-09-19T14:10:51.813410+0000","last_fullsized":"2024-09-19T14:10:51.813410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:12.978118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611594+0000","last_change":"2024-09-19T13:51:15.737359+0000","last_active":"2024-09-19T14:11:16.611594+0000","last_peered":"2024-09-19T14:11:16.611594+0000","last_clean":"2024-09-19T14:11:16.611594+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:11:16.611594+0000","last_undegraded":"2024-09-19T14:11:16.611594+0000","last_fullsized":"2024-09-19T14:11:16.611594+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:50.162815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723353+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:10:26.723353+0000","last_peered":"2024-09-19T14:10:26.723353+0000","last_clean":"2024-09-19T14:10:26.723353+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:10:26.723353+0000","last_undegraded":"2024-09-19T14:10:26.723353+0000","last_fullsized":"2024-09-19T14:10:26.723353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.363715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.727658+0000","last_change":"2024-09-19T13:52:51.581539+0000","last_active":"2024-09-19T14:10:56.727658+0000","last_peered":"2024-09-19T14:10:56.727658+0000","last_clean":"2024-09-19T14:10:56.727658+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:10:56.727658+0000","last_undegraded":"2024-09-19T14:10:56.727658+0000","last_fullsized":"2024-09-19T14:10:56.727658+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:52.537771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733334+0000","last_change":"2024-09-19T13:52:48.553843+0000","last_active":"2024-09-19T14:11:36.733334+0000","last_peered":"2024-09-19T14:11:36.733334+0000","last_clean":"2024-09-19T14:11:36.733334+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:11:36.733334+0000","last_undegraded":"2024-09-19T14:11:36.733334+0000","last_fullsized":"2024-09-19T14:11:36.733334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:42.945314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730599+0000","last_change":"2024-09-19T13:51:15.746581+0000","last_active":"2024-09-19T14:11:16.730599+0000","last_peered":"2024-09-19T14:11:16.730599+0000","last_clean":"2024-09-19T14:11:16.730599+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:11:16.730599+0000","last_undegraded":"2024-09-19T14:11:16.730599+0000","last_fullsized":"2024-09-19T14:11:16.730599+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:13.432237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730008+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:11:11.730008+0000","last_peered":"2024-09-19T14:11:11.730008+0000","last_clean":"2024-09-19T14:11:11.730008+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:11:11.730008+0000","last_undegraded":"2024-09-19T14:11:11.730008+0000","last_fullsized":"2024-09-19T14:11:11.730008+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:51.597736+0000","last_change":"2024-09-19T13:53:44.846213+0000","last_active":"2024-09-19T14:09:51.597736+0000","last_peered":"2024-09-19T14:09:51.597736+0000","last_clean":"2024-09-19T14:09:51.597736+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:09:51.597736+0000","last_undegraded":"2024-09-19T14:09:51.597736+0000","last_fullsized":"2024-09-19T14:09:51.597736+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:34.290843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'5","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.618567+0000","last_change":"2024-09-19T13:52:48.552836+0000","last_active":"2024-09-19T14:12:11.618567+0000","last_peered":"2024-09-19T14:12:11.618567+0000","last_clean":"2024-09-19T14:12:11.618567+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:12:11.618567+0000","last_undegraded":"2024-09-19T14:12:11.618567+0000","last_fullsized":"2024-09-19T14:12:11.618567+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:10.701239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":5,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730570+0000","last_change":"2024-09-19T13:51:15.743989+0000","last_active":"2024-09-19T14:11:16.730570+0000","last_peered":"2024-09-19T14:11:16.730570+0000","last_clean":"2024-09-19T14:11:16.730570+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:11:16.730570+0000","last_undegraded":"2024-09-19T14:11:16.730570+0000","last_fullsized":"2024-09-19T14:11:16.730570+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:33.192776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647908+0000","last_change":"2024-09-19T14:03:08.837855+0000","last_active":"2024-09-19T14:11:31.647908+0000","last_peered":"2024-09-19T14:11:31.647908+0000","last_clean":"2024-09-19T14:11:31.647908+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:11:31.647908+0000","last_undegraded":"2024-09-19T14:11:31.647908+0000","last_fullsized":"2024-09-19T14:11:31.647908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:17.620266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'6","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.455133+0000","last_change":"2024-09-19T13:52:51.576379+0000","last_active":"2024-09-19T14:14:18.455133+0000","last_peered":"2024-09-19T14:14:18.455133+0000","last_clean":"2024-09-19T14:14:18.455133+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:14:18.455133+0000","last_undegraded":"2024-09-19T14:14:18.455133+0000","last_fullsized":"2024-09-19T14:14:18.455133+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:14.311651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738379+0000","last_change":"2024-09-19T13:52:48.553148+0000","last_active":"2024-09-19T14:12:16.738379+0000","last_peered":"2024-09-19T14:12:16.738379+0000","last_clean":"2024-09-19T14:12:16.738379+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:12:16.738379+0000","last_undegraded":"2024-09-19T14:12:16.738379+0000","last_fullsized":"2024-09-19T14:12:16.738379+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:55.422175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720708+0000","last_change":"2024-09-19T13:51:15.746742+0000","last_active":"2024-09-19T14:11:16.720708+0000","last_peered":"2024-09-19T14:11:16.720708+0000","last_clean":"2024-09-19T14:11:16.720708+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:11:16.720708+0000","last_undegraded":"2024-09-19T14:11:16.720708+0000","last_fullsized":"2024-09-19T14:11:16.720708+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:30.998138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739569+0000","last_change":"2024-09-19T14:03:08.842863+0000","last_active":"2024-09-19T14:10:41.739569+0000","last_peered":"2024-09-19T14:10:41.739569+0000","last_clean":"2024-09-19T14:10:41.739569+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:10:41.739569+0000","last_undegraded":"2024-09-19T14:10:41.739569+0000","last_fullsized":"2024-09-19T14:10:41.739569+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:07.703304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.713321+0000","last_change":"2024-09-19T13:52:51.577966+0000","last_active":"2024-09-19T14:10:21.713321+0000","last_peered":"2024-09-19T14:10:21.713321+0000","last_clean":"2024-09-19T14:10:21.713321+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:10:21.713321+0000","last_undegraded":"2024-09-19T14:10:21.713321+0000","last_fullsized":"2024-09-19T14:10:21.713321+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:07.818951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723019+0000","last_change":"2024-09-19T13:52:48.556329+0000","last_active":"2024-09-19T14:10:21.723019+0000","last_peered":"2024-09-19T14:10:21.723019+0000","last_clean":"2024-09-19T14:10:21.723019+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:10:21.723019+0000","last_undegraded":"2024-09-19T14:10:21.723019+0000","last_fullsized":"2024-09-19T14:10:21.723019+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:39.632455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":103,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.222490+0000","last_change":"2024-09-19T13:51:15.738677+0000","last_active":"2024-09-19T14:11:23.222490+0000","last_peered":"2024-09-19T14:11:23.222490+0000","last_clean":"2024-09-19T14:11:23.222490+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:11:23.222490+0000","last_undegraded":"2024-09-19T14:11:23.222490+0000","last_fullsized":"2024-09-19T14:11:23.222490+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:11.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739606+0000","last_change":"2024-09-19T14:03:08.844476+0000","last_active":"2024-09-19T14:10:41.739606+0000","last_peered":"2024-09-19T14:10:41.739606+0000","last_clean":"2024-09-19T14:10:41.739606+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:10:41.739606+0000","last_undegraded":"2024-09-19T14:10:41.739606+0000","last_fullsized":"2024-09-19T14:10:41.739606+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:07.162545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'8","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.372877+0000","last_change":"2024-09-19T13:52:51.580942+0000","last_active":"2024-09-19T14:14:18.372877+0000","last_peered":"2024-09-19T14:14:18.372877+0000","last_clean":"2024-09-19T14:14:18.372877+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:14:18.372877+0000","last_undegraded":"2024-09-19T14:14:18.372877+0000","last_fullsized":"2024-09-19T14:14:18.372877+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:13.538115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.623655+0000","last_change":"2024-09-19T13:52:48.559959+0000","last_active":"2024-09-19T14:12:51.623655+0000","last_peered":"2024-09-19T14:12:51.623655+0000","last_clean":"2024-09-19T14:12:51.623655+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:12:51.623655+0000","last_undegraded":"2024-09-19T14:12:51.623655+0000","last_fullsized":"2024-09-19T14:12:51.623655+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:01.163462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.640638+0000","last_change":"2024-09-19T13:51:15.740479+0000","last_active":"2024-09-19T14:10:36.640638+0000","last_peered":"2024-09-19T14:10:36.640638+0000","last_clean":"2024-09-19T14:10:36.640638+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:10:36.640638+0000","last_undegraded":"2024-09-19T14:10:36.640638+0000","last_fullsized":"2024-09-19T14:10:36.640638+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:23.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636875+0000","last_change":"2024-09-19T14:03:08.839816+0000","last_active":"2024-09-19T14:10:11.636875+0000","last_peered":"2024-09-19T14:10:11.636875+0000","last_clean":"2024-09-19T14:10:11.636875+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:10:11.636875+0000","last_undegraded":"2024-09-19T14:10:11.636875+0000","last_fullsized":"2024-09-19T14:10:11.636875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:56.109994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'5","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737813+0000","last_change":"2024-09-19T13:52:51.579222+0000","last_active":"2024-09-19T14:12:11.737813+0000","last_peered":"2024-09-19T14:12:11.737813+0000","last_clean":"2024-09-19T14:12:11.737813+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:12:11.737813+0000","last_undegraded":"2024-09-19T14:12:11.737813+0000","last_fullsized":"2024-09-19T14:12:11.737813+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:47.019906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:56.630186+0000","last_change":"2024-09-19T13:52:48.554787+0000","last_active":"2024-09-19T14:13:56.630186+0000","last_peered":"2024-09-19T14:13:56.630186+0000","last_clean":"2024-09-19T14:13:56.630186+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:13:56.630186+0000","last_undegraded":"2024-09-19T14:13:56.630186+0000","last_fullsized":"2024-09-19T14:13:56.630186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:28.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.128068+0000","last_change":"2024-09-19T13:51:15.739410+0000","last_active":"2024-09-19T14:12:01.128068+0000","last_peered":"2024-09-19T14:12:01.128068+0000","last_clean":"2024-09-19T14:12:01.128068+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:12:01.128068+0000","last_undegraded":"2024-09-19T14:12:01.128068+0000","last_fullsized":"2024-09-19T14:12:01.128068+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:59.512917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.807924+0000","last_change":"2024-09-19T14:03:08.841302+0000","last_active":"2024-09-19T14:10:11.807924+0000","last_peered":"2024-09-19T14:10:11.807924+0000","last_clean":"2024-09-19T14:10:11.807924+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:10:11.807924+0000","last_undegraded":"2024-09-19T14:10:11.807924+0000","last_fullsized":"2024-09-19T14:10:11.807924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:41.250326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733241+0000","last_change":"2024-09-19T13:52:51.578766+0000","last_active":"2024-09-19T14:11:36.733241+0000","last_peered":"2024-09-19T14:11:36.733241+0000","last_clean":"2024-09-19T14:11:36.733241+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:11:36.733241+0000","last_undegraded":"2024-09-19T14:11:36.733241+0000","last_fullsized":"2024-09-19T14:11:36.733241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:06.602738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752669+0000","last_change":"2024-09-19T13:52:48.554709+0000","last_active":"2024-09-19T14:12:11.752669+0000","last_peered":"2024-09-19T14:12:11.752669+0000","last_clean":"2024-09-19T14:12:11.752669+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:12:11.752669+0000","last_undegraded":"2024-09-19T14:12:11.752669+0000","last_fullsized":"2024-09-19T14:12:11.752669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:18.382465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.724834+0000","last_change":"2024-09-19T13:51:15.744268+0000","last_active":"2024-09-19T14:10:36.724834+0000","last_peered":"2024-09-19T14:10:36.724834+0000","last_clean":"2024-09-19T14:10:36.724834+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:10:36.724834+0000","last_undegraded":"2024-09-19T14:10:36.724834+0000","last_fullsized":"2024-09-19T14:10:36.724834+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:44.697556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734779+0000","last_change":"2024-09-19T14:03:08.840741+0000","last_active":"2024-09-19T14:10:11.734779+0000","last_peered":"2024-09-19T14:10:11.734779+0000","last_clean":"2024-09-19T14:10:11.734779+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:10:11.734779+0000","last_undegraded":"2024-09-19T14:10:11.734779+0000","last_fullsized":"2024-09-19T14:10:11.734779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:28.511196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717148+0000","last_change":"2024-09-19T13:52:51.576629+0000","last_active":"2024-09-19T14:09:46.717148+0000","last_peered":"2024-09-19T14:09:46.717148+0000","last_clean":"2024-09-19T14:09:46.717148+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:09:46.717148+0000","last_undegraded":"2024-09-19T14:09:46.717148+0000","last_fullsized":"2024-09-19T14:09:46.717148+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:12.831765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.822571+0000","last_change":"2024-09-19T13:52:48.558114+0000","last_active":"2024-09-19T14:12:11.822571+0000","last_peered":"2024-09-19T14:12:11.822571+0000","last_clean":"2024-09-19T14:12:11.822571+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:12:11.822571+0000","last_undegraded":"2024-09-19T14:12:11.822571+0000","last_fullsized":"2024-09-19T14:12:11.822571+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:06.649539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.811335+0000","last_change":"2024-09-19T13:51:15.739232+0000","last_active":"2024-09-19T14:10:36.811335+0000","last_peered":"2024-09-19T14:10:36.811335+0000","last_clean":"2024-09-19T14:10:36.811335+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:10:36.811335+0000","last_undegraded":"2024-09-19T14:10:36.811335+0000","last_fullsized":"2024-09-19T14:10:36.811335+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:51.455590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600709+0000","last_change":"2024-09-19T14:03:08.838834+0000","last_active":"2024-09-19T14:10:11.600709+0000","last_peered":"2024-09-19T14:10:11.600709+0000","last_clean":"2024-09-19T14:10:11.600709+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:10:11.600709+0000","last_undegraded":"2024-09-19T14:10:11.600709+0000","last_fullsized":"2024-09-19T14:10:11.600709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:03.093578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:46.717534+0000","last_change":"2024-09-19T13:52:51.583920+0000","last_active":"2024-09-19T14:09:46.717534+0000","last_peered":"2024-09-19T14:09:46.717534+0000","last_clean":"2024-09-19T14:09:46.717534+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:09:46.717534+0000","last_undegraded":"2024-09-19T14:09:46.717534+0000","last_fullsized":"2024-09-19T14:09:46.717534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:36.896326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'8","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.618726+0000","last_change":"2024-09-19T13:52:48.555699+0000","last_active":"2024-09-19T14:12:11.618726+0000","last_peered":"2024-09-19T14:12:11.618726+0000","last_clean":"2024-09-19T14:12:11.618726+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:12:11.618726+0000","last_undegraded":"2024-09-19T14:12:11.618726+0000","last_fullsized":"2024-09-19T14:12:11.618726+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:08.653057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.732994+0000","last_change":"2024-09-19T13:51:15.743134+0000","last_active":"2024-09-19T14:10:01.732994+0000","last_peered":"2024-09-19T14:10:01.732994+0000","last_clean":"2024-09-19T14:10:01.732994+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:10:01.732994+0000","last_undegraded":"2024-09-19T14:10:01.732994+0000","last_fullsized":"2024-09-19T14:10:01.732994+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:20.033888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723447+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:10:26.723447+0000","last_peered":"2024-09-19T14:10:26.723447+0000","last_clean":"2024-09-19T14:10:26.723447+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:10:26.723447+0000","last_undegraded":"2024-09-19T14:10:26.723447+0000","last_fullsized":"2024-09-19T14:10:26.723447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:46.882911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'14","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:51.665691+0000","last_change":"2024-09-19T13:52:51.584825+0000","last_active":"2024-09-19T14:13:51.665691+0000","last_peered":"2024-09-19T14:13:51.665691+0000","last_clean":"2024-09-19T14:13:51.665691+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:13:51.665691+0000","last_undegraded":"2024-09-19T14:13:51.665691+0000","last_fullsized":"2024-09-19T14:13:51.665691+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:27.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11793,"num_write":34,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732335+0000","last_change":"2024-09-19T13:52:48.558319+0000","last_active":"2024-09-19T14:11:31.732335+0000","last_peered":"2024-09-19T14:11:31.732335+0000","last_clean":"2024-09-19T14:11:31.732335+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:11:31.732335+0000","last_undegraded":"2024-09-19T14:11:31.732335+0000","last_fullsized":"2024-09-19T14:11:31.732335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:02.238052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.235548+0000","last_change":"2024-09-19T13:51:15.743038+0000","last_active":"2024-09-19T14:11:22.235548+0000","last_peered":"2024-09-19T14:11:22.235548+0000","last_clean":"2024-09-19T14:11:22.235548+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:11:22.235548+0000","last_undegraded":"2024-09-19T14:11:22.235548+0000","last_fullsized":"2024-09-19T14:11:22.235548+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:09.961396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.604316+0000","last_change":"2024-09-19T14:03:08.842157+0000","last_active":"2024-09-19T14:10:26.604316+0000","last_peered":"2024-09-19T14:10:26.604316+0000","last_clean":"2024-09-19T14:10:26.604316+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:10:26.604316+0000","last_undegraded":"2024-09-19T14:10:26.604316+0000","last_fullsized":"2024-09-19T14:10:26.604316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:51.665657+0000","last_change":"2024-09-19T13:52:51.582431+0000","last_active":"2024-09-19T14:13:51.665657+0000","last_peered":"2024-09-19T14:13:51.665657+0000","last_clean":"2024-09-19T14:13:51.665657+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:13:51.665657+0000","last_undegraded":"2024-09-19T14:13:51.665657+0000","last_fullsized":"2024-09-19T14:13:51.665657+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:56.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732554+0000","last_change":"2024-09-19T13:52:48.558710+0000","last_active":"2024-09-19T14:11:31.732554+0000","last_peered":"2024-09-19T14:11:31.732554+0000","last_clean":"2024-09-19T14:11:31.732554+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:11:31.732554+0000","last_undegraded":"2024-09-19T14:11:31.732554+0000","last_fullsized":"2024-09-19T14:11:31.732554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:43.224289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599659+0000","last_change":"2024-09-19T13:51:15.739209+0000","last_active":"2024-09-19T14:09:56.599659+0000","last_peered":"2024-09-19T14:09:56.599659+0000","last_clean":"2024-09-19T14:09:56.599659+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:09:56.599659+0000","last_undegraded":"2024-09-19T14:09:56.599659+0000","last_fullsized":"2024-09-19T14:09:56.599659+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:48.014773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602888+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:10:16.602888+0000","last_peered":"2024-09-19T14:10:16.602888+0000","last_clean":"2024-09-19T14:10:16.602888+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:10:16.602888+0000","last_undegraded":"2024-09-19T14:10:16.602888+0000","last_fullsized":"2024-09-19T14:10:16.602888+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:48.528788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732599+0000","last_change":"2024-09-19T13:52:51.580249+0000","last_active":"2024-09-19T14:11:31.732599+0000","last_peered":"2024-09-19T14:11:31.732599+0000","last_clean":"2024-09-19T14:11:31.732599+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:11:31.732599+0000","last_undegraded":"2024-09-19T14:11:31.732599+0000","last_fullsized":"2024-09-19T14:11:31.732599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:23.302145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722601+0000","last_change":"2024-09-19T13:52:48.548153+0000","last_active":"2024-09-19T14:11:31.722601+0000","last_peered":"2024-09-19T14:11:31.722601+0000","last_clean":"2024-09-19T14:11:31.722601+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:11:31.722601+0000","last_undegraded":"2024-09-19T14:11:31.722601+0000","last_fullsized":"2024-09-19T14:11:31.722601+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:48.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":214,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718953+0000","last_change":"2024-09-19T13:51:15.736147+0000","last_active":"2024-09-19T14:09:56.718953+0000","last_peered":"2024-09-19T14:09:56.718953+0000","last_clean":"2024-09-19T14:09:56.718953+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:09:56.718953+0000","last_undegraded":"2024-09-19T14:09:56.718953+0000","last_fullsized":"2024-09-19T14:09:56.718953+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:46:19.842918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723422+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:10:26.723422+0000","last_peered":"2024-09-19T14:10:26.723422+0000","last_clean":"2024-09-19T14:10:26.723422+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:10:26.723422+0000","last_undegraded":"2024-09-19T14:10:26.723422+0000","last_fullsized":"2024-09-19T14:10:26.723422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:18.667527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.395874+0000","last_change":"2024-09-19T13:52:51.585924+0000","last_active":"2024-09-19T14:14:18.395874+0000","last_peered":"2024-09-19T14:14:18.395874+0000","last_clean":"2024-09-19T14:14:18.395874+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:14:18.395874+0000","last_undegraded":"2024-09-19T14:14:18.395874+0000","last_fullsized":"2024-09-19T14:14:18.395874+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:33.073773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'10","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.402353+0000","last_change":"2024-09-19T13:52:48.547186+0000","last_active":"2024-09-19T14:14:18.402353+0000","last_peered":"2024-09-19T14:14:18.402353+0000","last_clean":"2024-09-19T14:14:18.402353+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:14:18.402353+0000","last_undegraded":"2024-09-19T14:14:18.402353+0000","last_fullsized":"2024-09-19T14:14:18.402353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:31.825750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26674,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.377489+0000","last_change":"2024-09-19T13:51:15.745411+0000","last_active":"2024-09-19T14:12:01.377489+0000","last_peered":"2024-09-19T14:12:01.377489+0000","last_clean":"2024-09-19T14:12:01.377489+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:12:01.377489+0000","last_undegraded":"2024-09-19T14:12:01.377489+0000","last_fullsized":"2024-09-19T14:12:01.377489+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:56.436504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820573+0000","last_change":"2024-09-19T14:03:08.839556+0000","last_active":"2024-09-19T14:11:51.820573+0000","last_peered":"2024-09-19T14:11:51.820573+0000","last_clean":"2024-09-19T14:11:51.820573+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:11:51.820573+0000","last_undegraded":"2024-09-19T14:11:51.820573+0000","last_fullsized":"2024-09-19T14:11:51.820573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:45.080550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'7","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622402+0000","last_change":"2024-09-19T13:52:51.578477+0000","last_active":"2024-09-19T14:13:06.622402+0000","last_peered":"2024-09-19T14:13:06.622402+0000","last_clean":"2024-09-19T14:13:06.622402+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:13:06.622402+0000","last_undegraded":"2024-09-19T14:13:06.622402+0000","last_fullsized":"2024-09-19T14:13:06.622402+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:50.156854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.760360+0000","last_change":"2024-09-19T13:52:48.558154+0000","last_active":"2024-09-19T14:13:06.760360+0000","last_peered":"2024-09-19T14:13:06.760360+0000","last_clean":"2024-09-19T14:13:06.760360+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:13:06.760360+0000","last_undegraded":"2024-09-19T14:13:06.760360+0000","last_fullsized":"2024-09-19T14:13:06.760360+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:17.554459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733289+0000","last_change":"2024-09-19T13:51:15.743194+0000","last_active":"2024-09-19T14:11:36.733289+0000","last_peered":"2024-09-19T14:11:36.733289+0000","last_clean":"2024-09-19T14:11:36.733289+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:11:36.733289+0000","last_undegraded":"2024-09-19T14:11:36.733289+0000","last_fullsized":"2024-09-19T14:11:36.733289+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:50.338128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732215+0000","last_change":"2024-09-19T14:03:08.841430+0000","last_active":"2024-09-19T14:09:56.732215+0000","last_peered":"2024-09-19T14:09:56.732215+0000","last_clean":"2024-09-19T14:09:56.732215+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:09:56.732215+0000","last_undegraded":"2024-09-19T14:09:56.732215+0000","last_fullsized":"2024-09-19T14:09:56.732215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:02.341745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726947+0000","last_change":"2024-09-19T13:52:51.585844+0000","last_active":"2024-09-19T14:10:51.726947+0000","last_peered":"2024-09-19T14:10:51.726947+0000","last_clean":"2024-09-19T14:10:51.726947+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:10:51.726947+0000","last_undegraded":"2024-09-19T14:10:51.726947+0000","last_fullsized":"2024-09-19T14:10:51.726947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:51.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'6","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.828643+0000","last_change":"2024-09-19T13:52:48.558799+0000","last_active":"2024-09-19T14:13:06.828643+0000","last_peered":"2024-09-19T14:13:06.828643+0000","last_clean":"2024-09-19T14:13:06.828643+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:13:06.828643+0000","last_undegraded":"2024-09-19T14:13:06.828643+0000","last_fullsized":"2024-09-19T14:13:06.828643+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:02.090671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.123898+0000","last_change":"2024-09-19T13:51:15.747319+0000","last_active":"2024-09-19T14:12:01.123898+0000","last_peered":"2024-09-19T14:12:01.123898+0000","last_clean":"2024-09-19T14:12:01.123898+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:12:01.123898+0000","last_undegraded":"2024-09-19T14:12:01.123898+0000","last_fullsized":"2024-09-19T14:12:01.123898+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:36.553112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.725348+0000","last_change":"2024-09-19T14:03:08.837522+0000","last_active":"2024-09-19T14:11:51.725348+0000","last_peered":"2024-09-19T14:11:51.725348+0000","last_clean":"2024-09-19T14:11:51.725348+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:11:51.725348+0000","last_undegraded":"2024-09-19T14:11:51.725348+0000","last_fullsized":"2024-09-19T14:11:51.725348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:20.683332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643598+0000","last_change":"2024-09-19T13:52:51.586120+0000","last_active":"2024-09-19T14:10:56.643598+0000","last_peered":"2024-09-19T14:10:56.643598+0000","last_clean":"2024-09-19T14:10:56.643598+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:10:56.643598+0000","last_undegraded":"2024-09-19T14:10:56.643598+0000","last_fullsized":"2024-09-19T14:10:56.643598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:59.884434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.607991+0000","last_change":"2024-09-19T13:52:48.554380+0000","last_active":"2024-09-19T14:10:51.607991+0000","last_peered":"2024-09-19T14:10:51.607991+0000","last_clean":"2024-09-19T14:10:51.607991+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:10:51.607991+0000","last_undegraded":"2024-09-19T14:10:51.607991+0000","last_fullsized":"2024-09-19T14:10:51.607991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:07.309256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722642+0000","last_change":"2024-09-19T13:51:15.747867+0000","last_active":"2024-09-19T14:11:31.722642+0000","last_peered":"2024-09-19T14:11:31.722642+0000","last_clean":"2024-09-19T14:11:31.722642+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:11:31.722642+0000","last_undegraded":"2024-09-19T14:11:31.722642+0000","last_fullsized":"2024-09-19T14:11:31.722642+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749807+0000","last_change":"2024-09-19T14:03:08.841866+0000","last_active":"2024-09-19T14:11:51.749807+0000","last_peered":"2024-09-19T14:11:51.749807+0000","last_clean":"2024-09-19T14:11:51.749807+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:11:51.749807+0000","last_undegraded":"2024-09-19T14:11:51.749807+0000","last_fullsized":"2024-09-19T14:11:51.749807+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:36.658533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727005+0000","last_change":"2024-09-19T13:52:51.582164+0000","last_active":"2024-09-19T14:10:51.727005+0000","last_peered":"2024-09-19T14:10:51.727005+0000","last_clean":"2024-09-19T14:10:51.727005+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:10:51.727005+0000","last_undegraded":"2024-09-19T14:10:51.727005+0000","last_fullsized":"2024-09-19T14:10:51.727005+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:27.713291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'8","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:11.660376+0000","last_change":"2024-09-19T13:52:48.547009+0000","last_active":"2024-09-19T14:13:11.660376+0000","last_peered":"2024-09-19T14:13:11.660376+0000","last_clean":"2024-09-19T14:13:11.660376+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:13:11.660376+0000","last_undegraded":"2024-09-19T14:13:11.660376+0000","last_fullsized":"2024-09-19T14:13:11.660376+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:40.726822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.310015+0000","last_change":"2024-09-19T13:51:15.740368+0000","last_active":"2024-09-19T14:11:59.310015+0000","last_peered":"2024-09-19T14:11:59.310015+0000","last_clean":"2024-09-19T14:11:59.310015+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:11:59.310015+0000","last_undegraded":"2024-09-19T14:11:59.310015+0000","last_fullsized":"2024-09-19T14:11:59.310015+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.326002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.718769+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:09:56.718769+0000","last_peered":"2024-09-19T14:09:56.718769+0000","last_clean":"2024-09-19T14:09:56.718769+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:09:56.718769+0000","last_undegraded":"2024-09-19T14:09:56.718769+0000","last_fullsized":"2024-09-19T14:09:56.718769+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:23.564561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'5","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.372539+0000","last_change":"2024-09-19T13:52:51.584114+0000","last_active":"2024-09-19T14:14:18.372539+0000","last_peered":"2024-09-19T14:14:18.372539+0000","last_clean":"2024-09-19T14:14:18.372539+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:14:18.372539+0000","last_undegraded":"2024-09-19T14:14:18.372539+0000","last_fullsized":"2024-09-19T14:14:18.372539+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:15.511565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.601992+0000","last_change":"2024-09-19T13:52:48.555321+0000","last_active":"2024-09-19T14:10:11.601992+0000","last_peered":"2024-09-19T14:10:11.601992+0000","last_clean":"2024-09-19T14:10:11.601992+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:10:11.601992+0000","last_undegraded":"2024-09-19T14:10:11.601992+0000","last_fullsized":"2024-09-19T14:10:11.601992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:35.546166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613130+0000","last_change":"2024-09-19T13:51:15.743442+0000","last_active":"2024-09-19T14:11:31.613130+0000","last_peered":"2024-09-19T14:11:31.613130+0000","last_clean":"2024-09-19T14:11:31.613130+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:11:31.613130+0000","last_undegraded":"2024-09-19T14:11:31.613130+0000","last_fullsized":"2024-09-19T14:11:31.613130+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:06.945466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.733045+0000","last_change":"2024-09-19T14:03:08.843681+0000","last_active":"2024-09-19T14:10:01.733045+0000","last_peered":"2024-09-19T14:10:01.733045+0000","last_clean":"2024-09-19T14:10:01.733045+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:10:01.733045+0000","last_undegraded":"2024-09-19T14:10:01.733045+0000","last_fullsized":"2024-09-19T14:10:01.733045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:00.158335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734797+0000","last_change":"2024-09-19T13:52:51.586345+0000","last_active":"2024-09-19T14:10:11.734797+0000","last_peered":"2024-09-19T14:10:11.734797+0000","last_clean":"2024-09-19T14:10:11.734797+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:10:11.734797+0000","last_undegraded":"2024-09-19T14:10:11.734797+0000","last_fullsized":"2024-09-19T14:10:11.734797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.184586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.653935+0000","last_change":"2024-09-19T13:52:48.546287+0000","last_active":"2024-09-19T14:12:21.653935+0000","last_peered":"2024-09-19T14:12:21.653935+0000","last_clean":"2024-09-19T14:12:21.653935+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:12:21.653935+0000","last_undegraded":"2024-09-19T14:12:21.653935+0000","last_fullsized":"2024-09-19T14:12:21.653935+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:25.721235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:13.401604+0000","last_change":"2024-09-19T13:51:15.743432+0000","last_active":"2024-09-19T14:11:13.401604+0000","last_peered":"2024-09-19T14:11:13.401604+0000","last_clean":"2024-09-19T14:11:13.401604+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:11:13.401604+0000","last_undegraded":"2024-09-19T14:11:13.401604+0000","last_fullsized":"2024-09-19T14:11:13.401604+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:33.234941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.732266+0000","last_change":"2024-09-19T14:03:08.842574+0000","last_active":"2024-09-19T14:09:56.732266+0000","last_peered":"2024-09-19T14:09:56.732266+0000","last_clean":"2024-09-19T14:09:56.732266+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:09:56.732266+0000","last_undegraded":"2024-09-19T14:09:56.732266+0000","last_fullsized":"2024-09-19T14:09:56.732266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:57.148212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.642788+0000","last_change":"2024-09-19T13:52:51.583284+0000","last_active":"2024-09-19T14:10:51.642788+0000","last_peered":"2024-09-19T14:10:51.642788+0000","last_clean":"2024-09-19T14:10:51.642788+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:10:51.642788+0000","last_undegraded":"2024-09-19T14:10:51.642788+0000","last_fullsized":"2024-09-19T14:10:51.642788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:42.843357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'4","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.380467+0000","last_change":"2024-09-19T13:52:48.557637+0000","last_active":"2024-09-19T14:14:18.380467+0000","last_peered":"2024-09-19T14:14:18.380467+0000","last_clean":"2024-09-19T14:14:18.380467+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:14:18.380467+0000","last_undegraded":"2024-09-19T14:14:18.380467+0000","last_fullsized":"2024-09-19T14:14:18.380467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:06.589139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.726202+0000","last_change":"2024-09-19T13:51:15.742226+0000","last_active":"2024-09-19T14:10:46.726202+0000","last_peered":"2024-09-19T14:10:46.726202+0000","last_clean":"2024-09-19T14:10:46.726202+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:10:46.726202+0000","last_undegraded":"2024-09-19T14:10:46.726202+0000","last_fullsized":"2024-09-19T14:10:46.726202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:54.177354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.599771+0000","last_change":"2024-09-19T14:03:08.836511+0000","last_active":"2024-09-19T14:09:56.599771+0000","last_peered":"2024-09-19T14:09:56.599771+0000","last_clean":"2024-09-19T14:09:56.599771+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:09:56.599771+0000","last_undegraded":"2024-09-19T14:09:56.599771+0000","last_fullsized":"2024-09-19T14:09:56.599771+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:37.198257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.735788+0000","last_change":"2024-09-19T13:52:51.586838+0000","last_active":"2024-09-19T14:10:16.735788+0000","last_peered":"2024-09-19T14:10:16.735788+0000","last_clean":"2024-09-19T14:10:16.735788+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:10:16.735788+0000","last_undegraded":"2024-09-19T14:10:16.735788+0000","last_fullsized":"2024-09-19T14:10:16.735788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:15.962404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727446+0000","last_change":"2024-09-19T13:52:48.556403+0000","last_active":"2024-09-19T14:10:51.727446+0000","last_peered":"2024-09-19T14:10:51.727446+0000","last_clean":"2024-09-19T14:10:51.727446+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:10:51.727446+0000","last_undegraded":"2024-09-19T14:10:51.727446+0000","last_fullsized":"2024-09-19T14:10:51.727446+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:20.551373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.716860+0000","last_change":"2024-09-19T13:51:15.746021+0000","last_active":"2024-09-19T14:10:46.716860+0000","last_peered":"2024-09-19T14:10:46.716860+0000","last_clean":"2024-09-19T14:10:46.716860+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:10:46.716860+0000","last_undegraded":"2024-09-19T14:10:46.716860+0000","last_fullsized":"2024-09-19T14:10:46.716860+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:23.497158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.746520+0000","last_change":"2024-09-19T14:03:08.843561+0000","last_active":"2024-09-19T14:11:31.746520+0000","last_peered":"2024-09-19T14:11:31.746520+0000","last_clean":"2024-09-19T14:11:31.746520+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:11:31.746520+0000","last_undegraded":"2024-09-19T14:11:31.746520+0000","last_fullsized":"2024-09-19T14:11:31.746520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:24.992091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.630774+0000","last_change":"2024-09-19T13:52:51.586079+0000","last_active":"2024-09-19T14:13:46.630774+0000","last_peered":"2024-09-19T14:13:46.630774+0000","last_clean":"2024-09-19T14:13:46.630774+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:13:46.630774+0000","last_undegraded":"2024-09-19T14:13:46.630774+0000","last_fullsized":"2024-09-19T14:13:46.630774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:06.216009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.766339+0000","last_change":"2024-09-19T13:52:48.554440+0000","last_active":"2024-09-19T14:13:41.766339+0000","last_peered":"2024-09-19T14:13:41.766339+0000","last_clean":"2024-09-19T14:13:41.766339+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:13:41.766339+0000","last_undegraded":"2024-09-19T14:13:41.766339+0000","last_fullsized":"2024-09-19T14:13:41.766339+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:31.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.607300+0000","last_change":"2024-09-19T13:51:15.740499+0000","last_active":"2024-09-19T14:10:46.607300+0000","last_peered":"2024-09-19T14:10:46.607300+0000","last_clean":"2024-09-19T14:10:46.607300+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:10:46.607300+0000","last_undegraded":"2024-09-19T14:10:46.607300+0000","last_fullsized":"2024-09-19T14:10:46.607300+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:10.208746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611531+0000","last_change":"2024-09-19T14:03:08.840165+0000","last_active":"2024-09-19T14:11:31.611531+0000","last_peered":"2024-09-19T14:11:31.611531+0000","last_clean":"2024-09-19T14:11:31.611531+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:11:31.611531+0000","last_undegraded":"2024-09-19T14:11:31.611531+0000","last_fullsized":"2024-09-19T14:11:31.611531+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:26.897102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613946+0000","last_change":"2024-09-19T13:52:51.587531+0000","last_active":"2024-09-19T14:11:36.613946+0000","last_peered":"2024-09-19T14:11:36.613946+0000","last_clean":"2024-09-19T14:11:36.613946+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:11:36.613946+0000","last_undegraded":"2024-09-19T14:11:36.613946+0000","last_fullsized":"2024-09-19T14:11:36.613946+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:31.550230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818442+0000","last_change":"2024-09-19T13:52:48.558491+0000","last_active":"2024-09-19T14:11:36.818442+0000","last_peered":"2024-09-19T14:11:36.818442+0000","last_clean":"2024-09-19T14:11:36.818442+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:11:36.818442+0000","last_undegraded":"2024-09-19T14:11:36.818442+0000","last_fullsized":"2024-09-19T14:11:36.818442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:47.947923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.610873+0000","last_change":"2024-09-19T13:51:15.745899+0000","last_active":"2024-09-19T14:11:11.610873+0000","last_peered":"2024-09-19T14:11:11.610873+0000","last_clean":"2024-09-19T14:11:11.610873+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:11:11.610873+0000","last_undegraded":"2024-09-19T14:11:11.610873+0000","last_fullsized":"2024-09-19T14:11:11.610873+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:38.734235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645917+0000","last_change":"2024-09-19T14:03:08.834382+0000","last_active":"2024-09-19T14:11:16.645917+0000","last_peered":"2024-09-19T14:11:16.645917+0000","last_clean":"2024-09-19T14:11:16.645917+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:11:16.645917+0000","last_undegraded":"2024-09-19T14:11:16.645917+0000","last_fullsized":"2024-09-19T14:11:16.645917+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:23.550035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.753996+0000","last_change":"2024-09-19T13:52:51.587324+0000","last_active":"2024-09-19T14:12:21.753996+0000","last_peered":"2024-09-19T14:12:21.753996+0000","last_clean":"2024-09-19T14:12:21.753996+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:12:21.753996+0000","last_undegraded":"2024-09-19T14:12:21.753996+0000","last_fullsized":"2024-09-19T14:12:21.753996+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:31.730122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600809+0000","last_change":"2024-09-19T13:52:48.553095+0000","last_active":"2024-09-19T14:10:11.600809+0000","last_peered":"2024-09-19T14:10:11.600809+0000","last_clean":"2024-09-19T14:10:11.600809+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:10:11.600809+0000","last_undegraded":"2024-09-19T14:10:11.600809+0000","last_fullsized":"2024-09-19T14:10:11.600809+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:06.522712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752646+0000","last_change":"2024-09-19T13:51:15.745034+0000","last_active":"2024-09-19T14:12:11.752646+0000","last_peered":"2024-09-19T14:12:11.752646+0000","last_clean":"2024-09-19T14:12:11.752646+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:12:11.752646+0000","last_undegraded":"2024-09-19T14:12:11.752646+0000","last_fullsized":"2024-09-19T14:12:11.752646+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.684247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732364+0000","last_change":"2024-09-19T14:03:08.839316+0000","last_active":"2024-09-19T14:11:31.732364+0000","last_peered":"2024-09-19T14:11:31.732364+0000","last_clean":"2024-09-19T14:11:31.732364+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:11:31.732364+0000","last_undegraded":"2024-09-19T14:11:31.732364+0000","last_fullsized":"2024-09-19T14:11:31.732364+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:47.115178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.721502+0000","last_change":"2024-09-19T13:52:51.583041+0000","last_active":"2024-09-19T14:10:11.721502+0000","last_peered":"2024-09-19T14:10:11.721502+0000","last_clean":"2024-09-19T14:10:11.721502+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:10:11.721502+0000","last_undegraded":"2024-09-19T14:10:11.721502+0000","last_fullsized":"2024-09-19T14:10:11.721502+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:32.304868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.754007+0000","last_change":"2024-09-19T13:52:48.558143+0000","last_active":"2024-09-19T14:12:21.754007+0000","last_peered":"2024-09-19T14:12:21.754007+0000","last_clean":"2024-09-19T14:12:21.754007+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:12:21.754007+0000","last_undegraded":"2024-09-19T14:12:21.754007+0000","last_fullsized":"2024-09-19T14:12:21.754007+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:09.148223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.652462+0000","last_change":"2024-09-19T13:51:15.746992+0000","last_active":"2024-09-19T14:12:06.652462+0000","last_peered":"2024-09-19T14:12:06.652462+0000","last_clean":"2024-09-19T14:12:06.652462+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:12:06.652462+0000","last_undegraded":"2024-09-19T14:12:06.652462+0000","last_fullsized":"2024-09-19T14:12:06.652462+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:59.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820648+0000","last_change":"2024-09-19T14:03:08.835971+0000","last_active":"2024-09-19T14:11:51.820648+0000","last_peered":"2024-09-19T14:11:51.820648+0000","last_clean":"2024-09-19T14:11:51.820648+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:11:51.820648+0000","last_undegraded":"2024-09-19T14:11:51.820648+0000","last_fullsized":"2024-09-19T14:11:51.820648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:49.881174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648494+0000","last_change":"2024-09-19T13:52:51.582819+0000","last_active":"2024-09-19T14:11:36.648494+0000","last_peered":"2024-09-19T14:11:36.648494+0000","last_clean":"2024-09-19T14:11:36.648494+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:11:36.648494+0000","last_undegraded":"2024-09-19T14:11:36.648494+0000","last_fullsized":"2024-09-19T14:11:36.648494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:43.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.741650+0000","last_change":"2024-09-19T13:52:48.556826+0000","last_active":"2024-09-19T14:10:56.741650+0000","last_peered":"2024-09-19T14:10:56.741650+0000","last_clean":"2024-09-19T14:10:56.741650+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:10:56.741650+0000","last_undegraded":"2024-09-19T14:10:56.741650+0000","last_fullsized":"2024-09-19T14:10:56.741650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:39.933207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.616079+0000","last_change":"2024-09-19T13:51:15.742662+0000","last_active":"2024-09-19T14:12:06.616079+0000","last_peered":"2024-09-19T14:12:06.616079+0000","last_clean":"2024-09-19T14:12:06.616079+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:12:06.616079+0000","last_undegraded":"2024-09-19T14:12:06.616079+0000","last_fullsized":"2024-09-19T14:12:06.616079+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:47.205807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.616208+0000","last_change":"2024-09-19T14:03:08.837483+0000","last_active":"2024-09-19T14:11:51.616208+0000","last_peered":"2024-09-19T14:11:51.616208+0000","last_clean":"2024-09-19T14:11:51.616208+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:11:51.616208+0000","last_undegraded":"2024-09-19T14:11:51.616208+0000","last_fullsized":"2024-09-19T14:11:51.616208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:43.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.607103+0000","last_change":"2024-09-19T13:52:51.582481+0000","last_active":"2024-09-19T14:10:56.607103+0000","last_peered":"2024-09-19T14:10:56.607103+0000","last_clean":"2024-09-19T14:10:56.607103+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:10:56.607103+0000","last_undegraded":"2024-09-19T14:10:56.607103+0000","last_fullsized":"2024-09-19T14:10:56.607103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.118790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747273+0000","last_change":"2024-09-19T13:52:48.558237+0000","last_active":"2024-09-19T14:11:36.747273+0000","last_peered":"2024-09-19T14:11:36.747273+0000","last_clean":"2024-09-19T14:11:36.747273+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:11:36.747273+0000","last_undegraded":"2024-09-19T14:11:36.747273+0000","last_fullsized":"2024-09-19T14:11:36.747273+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:14.742516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.737132+0000","last_change":"2024-09-19T13:51:15.739439+0000","last_active":"2024-09-19T14:12:06.737132+0000","last_peered":"2024-09-19T14:12:06.737132+0000","last_clean":"2024-09-19T14:12:06.737132+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:12:06.737132+0000","last_undegraded":"2024-09-19T14:12:06.737132+0000","last_fullsized":"2024-09-19T14:12:06.737132+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:29.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613161+0000","last_change":"2024-09-19T14:03:08.843652+0000","last_active":"2024-09-19T14:11:31.613161+0000","last_peered":"2024-09-19T14:11:31.613161+0000","last_clean":"2024-09-19T14:11:31.613161+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:11:31.613161+0000","last_undegraded":"2024-09-19T14:11:31.613161+0000","last_fullsized":"2024-09-19T14:11:31.613161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:18.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'7","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.740798+0000","last_change":"2024-09-19T13:52:51.584999+0000","last_active":"2024-09-19T14:13:41.740798+0000","last_peered":"2024-09-19T14:13:41.740798+0000","last_clean":"2024-09-19T14:13:41.740798+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:13:41.740798+0000","last_undegraded":"2024-09-19T14:13:41.740798+0000","last_fullsized":"2024-09-19T14:13:41.740798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:06.878095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648525+0000","last_change":"2024-09-19T13:52:48.554967+0000","last_active":"2024-09-19T14:11:36.648525+0000","last_peered":"2024-09-19T14:11:36.648525+0000","last_clean":"2024-09-19T14:11:36.648525+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:11:36.648525+0000","last_undegraded":"2024-09-19T14:11:36.648525+0000","last_fullsized":"2024-09-19T14:11:36.648525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:11.689955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.726954+0000","last_change":"2024-09-19T13:51:15.746342+0000","last_active":"2024-09-19T14:12:06.726954+0000","last_peered":"2024-09-19T14:12:06.726954+0000","last_clean":"2024-09-19T14:12:06.726954+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:12:06.726954+0000","last_undegraded":"2024-09-19T14:12:06.726954+0000","last_fullsized":"2024-09-19T14:12:06.726954+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:44.550078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747359+0000","last_change":"2024-09-19T14:03:08.842987+0000","last_active":"2024-09-19T14:11:36.747359+0000","last_peered":"2024-09-19T14:11:36.747359+0000","last_clean":"2024-09-19T14:11:36.747359+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:11:36.747359+0000","last_undegraded":"2024-09-19T14:11:36.747359+0000","last_fullsized":"2024-09-19T14:11:36.747359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:51.898754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.282359+0000","last_change":"2024-09-19T13:52:51.581838+0000","last_active":"2024-09-19T14:14:18.282359+0000","last_peered":"2024-09-19T14:14:18.282359+0000","last_clean":"2024-09-19T14:14:18.282359+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:14:18.282359+0000","last_undegraded":"2024-09-19T14:14:18.282359+0000","last_fullsized":"2024-09-19T14:14:18.282359+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:20.245214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":214,"num_write":4,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723307+0000","last_change":"2024-09-19T13:52:48.546981+0000","last_active":"2024-09-19T14:11:36.723307+0000","last_peered":"2024-09-19T14:11:36.723307+0000","last_clean":"2024-09-19T14:11:36.723307+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:11:36.723307+0000","last_undegraded":"2024-09-19T14:11:36.723307+0000","last_fullsized":"2024-09-19T14:11:36.723307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:09.807617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.748475+0000","last_change":"2024-09-19T13:51:15.745532+0000","last_active":"2024-09-19T14:11:22.748475+0000","last_peered":"2024-09-19T14:11:22.748475+0000","last_clean":"2024-09-19T14:11:22.748475+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:11:22.748475+0000","last_undegraded":"2024-09-19T14:11:22.748475+0000","last_fullsized":"2024-09-19T14:11:22.748475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:14.528177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'195","reported_seq":820,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.472000+0000","last_change":"2024-09-19T13:36:07.808934+0000","last_active":"2024-09-19T14:14:18.472000+0000","last_peered":"2024-09-19T14:14:18.472000+0000","last_clean":"2024-09-19T14:14:18.472000+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:14:18.472000+0000","last_undegraded":"2024-09-19T14:14:18.472000+0000","last_fullsized":"2024-09-19T14:14:18.472000+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:00.228367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":14767,"num_write":959,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'808","reported_seq":2383,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544116+0000","last_change":"2024-09-19T13:36:09.334352+0000","last_active":"2024-09-19T14:12:15.544116+0000","last_peered":"2024-09-19T14:12:15.544116+0000","last_clean":"2024-09-19T14:12:15.544116+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:12:15.544116+0000","last_undegraded":"2024-09-19T14:12:15.544116+0000","last_fullsized":"2024-09-19T14:12:15.544116+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:03.775963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'191","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.484927+0000","last_change":"2024-09-19T13:36:07.810255+0000","last_active":"2024-09-19T14:14:18.484927+0000","last_peered":"2024-09-19T14:14:18.484927+0000","last_clean":"2024-09-19T14:14:18.484927+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:14:18.484927+0000","last_undegraded":"2024-09-19T14:14:18.484927+0000","last_fullsized":"2024-09-19T14:14:18.484927+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:57.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":5759,"num_write":878,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'700","reported_seq":2388,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607197+0000","last_change":"2024-09-19T13:36:09.341109+0000","last_active":"2024-09-19T14:12:13.607197+0000","last_peered":"2024-09-19T14:12:13.607197+0000","last_clean":"2024-09-19T14:12:13.607197+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:12:13.607197+0000","last_undegraded":"2024-09-19T14:12:13.607197+0000","last_fullsized":"2024-09-19T14:12:13.607197+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:22.137955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'223","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.447946+0000","last_change":"2024-09-19T13:36:07.802705+0000","last_active":"2024-09-19T14:14:18.447946+0000","last_peered":"2024-09-19T14:14:18.447946+0000","last_clean":"2024-09-19T14:14:18.447946+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:14:18.447946+0000","last_undegraded":"2024-09-19T14:14:18.447946+0000","last_fullsized":"2024-09-19T14:14:18.447946+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:57.788681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":12221,"num_write":1127,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'389","reported_seq":1859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260118+0000","last_change":"2024-09-19T13:36:09.331848+0000","last_active":"2024-09-19T14:12:20.260118+0000","last_peered":"2024-09-19T14:12:20.260118+0000","last_clean":"2024-09-19T14:12:20.260118+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:12:20.260118+0000","last_undegraded":"2024-09-19T14:12:20.260118+0000","last_fullsized":"2024-09-19T14:12:20.260118+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:25:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'221","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.469833+0000","last_change":"2024-09-19T13:36:07.812873+0000","last_active":"2024-09-19T14:14:18.469833+0000","last_peered":"2024-09-19T14:14:18.469833+0000","last_clean":"2024-09-19T14:14:18.469833+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:14:18.469833+0000","last_undegraded":"2024-09-19T14:14:18.469833+0000","last_fullsized":"2024-09-19T14:14:18.469833+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:44.575892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311660,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":9100,"num_write":1128,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'993","reported_seq":2638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.225812+0000","last_change":"2024-09-19T13:36:44.400454+0000","last_active":"2024-09-19T14:12:13.225812+0000","last_peered":"2024-09-19T14:12:13.225812+0000","last_clean":"2024-09-19T14:12:13.225812+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:12:13.225812+0000","last_undegraded":"2024-09-19T14:12:13.225812+0000","last_fullsized":"2024-09-19T14:12:13.225812+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":900,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.890102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'198","reported_seq":891,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.446898+0000","last_change":"2024-09-19T13:36:07.808137+0000","last_active":"2024-09-19T14:14:18.446898+0000","last_peered":"2024-09-19T14:14:18.446898+0000","last_clean":"2024-09-19T14:14:18.446898+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:14:18.446898+0000","last_undegraded":"2024-09-19T14:14:18.446898+0000","last_fullsized":"2024-09-19T14:14:18.446898+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:25.229167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":762,"num_read_kb":134002,"num_write":945,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'557","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176066+0000","last_change":"2024-09-19T13:36:09.334428+0000","last_active":"2024-09-19T14:12:26.176066+0000","last_peered":"2024-09-19T14:12:26.176066+0000","last_clean":"2024-09-19T14:12:26.176066+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:12:26.176066+0000","last_undegraded":"2024-09-19T14:12:26.176066+0000","last_fullsized":"2024-09-19T14:12:26.176066+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:02.385725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'190","reported_seq":763,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.628222+0000","last_change":"2024-09-19T13:36:07.816316+0000","last_active":"2024-09-19T14:13:41.628222+0000","last_peered":"2024-09-19T14:13:41.628222+0000","last_clean":"2024-09-19T14:13:41.628222+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:13:41.628222+0000","last_undegraded":"2024-09-19T14:13:41.628222+0000","last_fullsized":"2024-09-19T14:13:41.628222+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.797797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":377,"num_write":871,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'835","reported_seq":2442,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544277+0000","last_change":"2024-09-19T13:36:09.333458+0000","last_active":"2024-09-19T14:12:15.544277+0000","last_peered":"2024-09-19T14:12:15.544277+0000","last_clean":"2024-09-19T14:12:15.544277+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:12:15.544277+0000","last_undegraded":"2024-09-19T14:12:15.544277+0000","last_fullsized":"2024-09-19T14:12:15.544277+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.936303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'189","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.383128+0000","last_change":"2024-09-19T13:36:07.816581+0000","last_active":"2024-09-19T14:14:18.383128+0000","last_peered":"2024-09-19T14:14:18.383128+0000","last_clean":"2024-09-19T14:14:18.383128+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:14:18.383128+0000","last_undegraded":"2024-09-19T14:14:18.383128+0000","last_fullsized":"2024-09-19T14:14:18.383128+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:11.595208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":7782,"num_write":893,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'502","reported_seq":2283,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226009+0000","last_change":"2024-09-19T13:36:09.343477+0000","last_active":"2024-09-19T14:12:13.226009+0000","last_peered":"2024-09-19T14:12:13.226009+0000","last_clean":"2024-09-19T14:12:13.226009+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:12:13.226009+0000","last_undegraded":"2024-09-19T14:12:13.226009+0000","last_fullsized":"2024-09-19T14:12:13.226009+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'195","reported_seq":1005,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.447500+0000","last_change":"2024-09-19T13:36:07.807757+0000","last_active":"2024-09-19T14:14:18.447500+0000","last_peered":"2024-09-19T14:14:18.447500+0000","last_clean":"2024-09-19T14:14:18.447500+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:14:18.447500+0000","last_undegraded":"2024-09-19T14:14:18.447500+0000","last_fullsized":"2024-09-19T14:14:18.447500+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:20.739883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1090,"num_read_kb":38780,"num_write":956,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'842","reported_seq":2345,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819911+0000","last_change":"2024-09-19T13:36:09.343462+0000","last_active":"2024-09-19T14:12:14.819911+0000","last_peered":"2024-09-19T14:12:14.819911+0000","last_clean":"2024-09-19T14:12:14.819911+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:12:14.819911+0000","last_undegraded":"2024-09-19T14:12:14.819911+0000","last_fullsized":"2024-09-19T14:12:14.819911+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:58.095506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'549","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171201+0000","last_change":"2024-09-19T13:36:09.331543+0000","last_active":"2024-09-19T14:12:15.171201+0000","last_peered":"2024-09-19T14:12:15.171201+0000","last_clean":"2024-09-19T14:12:15.171201+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:12:15.171201+0000","last_undegraded":"2024-09-19T14:12:15.171201+0000","last_fullsized":"2024-09-19T14:12:15.171201+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.041550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'191","reported_seq":796,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.470167+0000","last_change":"2024-09-19T13:36:07.812427+0000","last_active":"2024-09-19T14:14:18.470167+0000","last_peered":"2024-09-19T14:14:18.470167+0000","last_clean":"2024-09-19T14:14:18.470167+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:14:18.470167+0000","last_undegraded":"2024-09-19T14:14:18.470167+0000","last_fullsized":"2024-09-19T14:14:18.470167+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:24.508499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":11511,"num_write":896,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'380","reported_seq":1872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355286+0000","last_change":"2024-09-19T13:36:09.341235+0000","last_active":"2024-09-19T14:12:27.355286+0000","last_peered":"2024-09-19T14:12:27.355286+0000","last_clean":"2024-09-19T14:12:27.355286+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:12:27.355286+0000","last_undegraded":"2024-09-19T14:12:27.355286+0000","last_fullsized":"2024-09-19T14:12:27.355286+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:22.590894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'193","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.470001+0000","last_change":"2024-09-19T13:36:07.811910+0000","last_active":"2024-09-19T14:14:18.470001+0000","last_peered":"2024-09-19T14:14:18.470001+0000","last_clean":"2024-09-19T14:14:18.470001+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:14:18.470001+0000","last_undegraded":"2024-09-19T14:14:18.470001+0000","last_fullsized":"2024-09-19T14:14:18.470001+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:59.243018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":26719,"num_write":915,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'556","reported_seq":2179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882271+0000","last_change":"2024-09-19T13:36:09.336283+0000","last_active":"2024-09-19T14:12:15.882271+0000","last_peered":"2024-09-19T14:12:15.882271+0000","last_clean":"2024-09-19T14:12:15.882271+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:12:15.882271+0000","last_undegraded":"2024-09-19T14:12:15.882271+0000","last_fullsized":"2024-09-19T14:12:15.882271+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:45.974339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'225","reported_seq":882,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.454049+0000","last_change":"2024-09-19T13:36:44.401303+0000","last_active":"2024-09-19T14:14:18.454049+0000","last_peered":"2024-09-19T14:14:18.454049+0000","last_clean":"2024-09-19T14:14:18.454049+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:14:18.454049+0000","last_undegraded":"2024-09-19T14:14:18.454049+0000","last_fullsized":"2024-09-19T14:14:18.454049+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:04.996764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":629,"num_read_kb":31855,"num_write":1145,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'377","reported_seq":1908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260138+0000","last_change":"2024-09-19T13:36:09.337079+0000","last_active":"2024-09-19T14:12:20.260138+0000","last_peered":"2024-09-19T14:12:20.260138+0000","last_clean":"2024-09-19T14:12:20.260138+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:12:20.260138+0000","last_undegraded":"2024-09-19T14:12:20.260138+0000","last_fullsized":"2024-09-19T14:12:20.260138+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:50.941135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'205","reported_seq":846,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.416363+0000","last_change":"2024-09-19T13:36:07.806856+0000","last_active":"2024-09-19T14:14:18.416363+0000","last_peered":"2024-09-19T14:14:18.416363+0000","last_clean":"2024-09-19T14:14:18.416363+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:14:18.416363+0000","last_undegraded":"2024-09-19T14:14:18.416363+0000","last_fullsized":"2024-09-19T14:14:18.416363+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:01.787704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":49502,"num_write":988,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'390","reported_seq":1995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176428+0000","last_change":"2024-09-19T13:36:09.324663+0000","last_active":"2024-09-19T14:12:26.176428+0000","last_peered":"2024-09-19T14:12:26.176428+0000","last_clean":"2024-09-19T14:12:26.176428+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:12:26.176428+0000","last_undegraded":"2024-09-19T14:12:26.176428+0000","last_fullsized":"2024-09-19T14:12:26.176428+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:16.398494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'193","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.296891+0000","last_change":"2024-09-19T13:36:07.807094+0000","last_active":"2024-09-19T14:14:18.296891+0000","last_peered":"2024-09-19T14:14:18.296891+0000","last_clean":"2024-09-19T14:14:18.296891+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:14:18.296891+0000","last_undegraded":"2024-09-19T14:14:18.296891+0000","last_fullsized":"2024-09-19T14:14:18.296891+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:17.714362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145924,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":176003,"num_write":888,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'907","reported_seq":2603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176234+0000","last_change":"2024-09-19T13:36:09.331135+0000","last_active":"2024-09-19T14:12:26.176234+0000","last_peered":"2024-09-19T14:12:26.176234+0000","last_clean":"2024-09-19T14:12:26.176234+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:12:26.176234+0000","last_undegraded":"2024-09-19T14:12:26.176234+0000","last_fullsized":"2024-09-19T14:12:26.176234+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:01.836377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'246","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.436965+0000","last_change":"2024-09-19T13:36:07.813101+0000","last_active":"2024-09-19T14:14:18.436965+0000","last_peered":"2024-09-19T14:14:18.436965+0000","last_clean":"2024-09-19T14:14:18.436965+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:14:18.436965+0000","last_undegraded":"2024-09-19T14:14:18.436965+0000","last_fullsized":"2024-09-19T14:14:18.436965+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:17.235229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":112164,"num_write":1137,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'136","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.817689+0000","last_change":"2024-09-19T13:36:17.363690+0000","last_active":"2024-09-19T14:12:27.817689+0000","last_peered":"2024-09-19T14:12:27.817689+0000","last_clean":"2024-09-19T14:12:27.817689+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:12:27.817689+0000","last_undegraded":"2024-09-19T14:12:27.817689+0000","last_fullsized":"2024-09-19T14:12:27.817689+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:29.851738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'815","reported_seq":2311,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260090+0000","last_change":"2024-09-19T13:36:09.344275+0000","last_active":"2024-09-19T14:12:20.260090+0000","last_peered":"2024-09-19T14:12:20.260090+0000","last_clean":"2024-09-19T14:12:20.260090+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:12:20.260090+0000","last_undegraded":"2024-09-19T14:12:20.260090+0000","last_fullsized":"2024-09-19T14:12:20.260090+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:38.192022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'174","reported_seq":846,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.298341+0000","last_change":"2024-09-19T13:36:07.808149+0000","last_active":"2024-09-19T14:14:18.298341+0000","last_peered":"2024-09-19T14:14:18.298341+0000","last_clean":"2024-09-19T14:14:18.298341+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:14:18.298341+0000","last_undegraded":"2024-09-19T14:14:18.298341+0000","last_fullsized":"2024-09-19T14:14:18.298341+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:33.668595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":47147,"num_write":844,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599370+0000","last_change":"2024-09-19T13:36:11.340404+0000","last_active":"2024-09-19T14:10:01.599370+0000","last_peered":"2024-09-19T14:10:01.599370+0000","last_clean":"2024-09-19T14:10:01.599370+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:10:01.599370+0000","last_undegraded":"2024-09-19T14:10:01.599370+0000","last_fullsized":"2024-09-19T14:10:01.599370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.755867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'194","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.405263+0000","last_change":"2024-09-19T13:36:13.346842+0000","last_active":"2024-09-19T14:14:18.405263+0000","last_peered":"2024-09-19T14:14:18.405263+0000","last_clean":"2024-09-19T14:14:18.405263+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:14:18.405263+0000","last_undegraded":"2024-09-19T14:14:18.405263+0000","last_fullsized":"2024-09-19T14:14:18.405263+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:09.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":375,"num_write":156,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733994+0000","last_change":"2024-09-19T13:36:15.353039+0000","last_active":"2024-09-19T14:10:06.733994+0000","last_peered":"2024-09-19T14:10:06.733994+0000","last_clean":"2024-09-19T14:10:06.733994+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:10:06.733994+0000","last_undegraded":"2024-09-19T14:10:06.733994+0000","last_fullsized":"2024-09-19T14:10:06.733994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:40.506433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2504","reported_seq":4316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.251946+0000","last_change":"2024-09-19T13:36:17.362187+0000","last_active":"2024-09-19T14:12:26.251946+0000","last_peered":"2024-09-19T14:12:26.251946+0000","last_clean":"2024-09-19T14:12:26.251946+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:12:26.251946+0000","last_undegraded":"2024-09-19T14:12:26.251946+0000","last_fullsized":"2024-09-19T14:12:26.251946+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:08.218008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'475","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819729+0000","last_change":"2024-09-19T13:36:09.335816+0000","last_active":"2024-09-19T14:12:14.819729+0000","last_peered":"2024-09-19T14:12:14.819729+0000","last_clean":"2024-09-19T14:12:14.819729+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:12:14.819729+0000","last_undegraded":"2024-09-19T14:12:14.819729+0000","last_fullsized":"2024-09-19T14:12:14.819729+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:08.833605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'170","reported_seq":747,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.373836+0000","last_change":"2024-09-19T13:36:07.812428+0000","last_active":"2024-09-19T14:14:18.373836+0000","last_peered":"2024-09-19T14:14:18.373836+0000","last_clean":"2024-09-19T14:14:18.373836+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:14:18.373836+0000","last_undegraded":"2024-09-19T14:14:18.373836+0000","last_fullsized":"2024-09-19T14:14:18.373836+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:55.799082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":371,"num_read_kb":36151,"num_write":775,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730615+0000","last_change":"2024-09-19T13:36:11.336313+0000","last_active":"2024-09-19T14:11:16.730615+0000","last_peered":"2024-09-19T14:11:16.730615+0000","last_clean":"2024-09-19T14:11:16.730615+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:11:16.730615+0000","last_undegraded":"2024-09-19T14:11:16.730615+0000","last_fullsized":"2024-09-19T14:11:16.730615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'78","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.395391+0000","last_change":"2024-09-19T13:36:13.337644+0000","last_active":"2024-09-19T14:12:14.395391+0000","last_peered":"2024-09-19T14:12:14.395391+0000","last_clean":"2024-09-19T14:12:14.395391+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:12:14.395391+0000","last_undegraded":"2024-09-19T14:12:14.395391+0000","last_fullsized":"2024-09-19T14:12:14.395391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.720756+0000","last_change":"2024-09-19T13:36:15.349335+0000","last_active":"2024-09-19T14:10:06.720756+0000","last_peered":"2024-09-19T14:10:06.720756+0000","last_clean":"2024-09-19T14:10:06.720756+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:10:06.720756+0000","last_undegraded":"2024-09-19T14:10:06.720756+0000","last_fullsized":"2024-09-19T14:10:06.720756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:03.785626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'134","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.878009+0000","last_change":"2024-09-19T13:36:17.360523+0000","last_active":"2024-09-19T14:12:15.878009+0000","last_peered":"2024-09-19T14:12:15.878009+0000","last_clean":"2024-09-19T14:12:15.878009+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:12:15.878009+0000","last_undegraded":"2024-09-19T14:12:15.878009+0000","last_fullsized":"2024-09-19T14:12:15.878009+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:18.406844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'833","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.865020+0000","last_change":"2024-09-19T13:36:09.338236+0000","last_active":"2024-09-19T14:13:45.865020+0000","last_peered":"2024-09-19T14:13:45.865020+0000","last_clean":"2024-09-19T14:13:45.865020+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:13:45.865020+0000","last_undegraded":"2024-09-19T14:13:45.865020+0000","last_fullsized":"2024-09-19T14:13:45.865020+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:40.242627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'168","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.466648+0000","last_change":"2024-09-19T13:36:07.806261+0000","last_active":"2024-09-19T14:14:18.466648+0000","last_peered":"2024-09-19T14:14:18.466648+0000","last_clean":"2024-09-19T14:14:18.466648+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:14:18.466648+0000","last_undegraded":"2024-09-19T14:14:18.466648+0000","last_fullsized":"2024-09-19T14:14:18.466648+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:30.372295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":63998,"num_write":820,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719618+0000","last_change":"2024-09-19T13:36:11.337174+0000","last_active":"2024-09-19T14:10:01.719618+0000","last_peered":"2024-09-19T14:10:01.719618+0000","last_clean":"2024-09-19T14:10:01.719618+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:10:01.719618+0000","last_undegraded":"2024-09-19T14:10:01.719618+0000","last_fullsized":"2024-09-19T14:10:01.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:56.806199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'103","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.682418+0000","last_change":"2024-09-19T13:36:13.342093+0000","last_active":"2024-09-19T14:12:06.682418+0000","last_peered":"2024-09-19T14:12:06.682418+0000","last_clean":"2024-09-19T14:12:06.682418+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:12:06.682418+0000","last_undegraded":"2024-09-19T14:12:06.682418+0000","last_fullsized":"2024-09-19T14:12:06.682418+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:01.319447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'763","reported_seq":2065,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.209679+0000","last_change":"2024-09-19T13:36:15.353722+0000","last_active":"2024-09-19T14:14:18.209679+0000","last_peered":"2024-09-19T14:14:18.209679+0000","last_clean":"2024-09-19T14:14:18.209679+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:14:18.209679+0000","last_undegraded":"2024-09-19T14:14:18.209679+0000","last_fullsized":"2024-09-19T14:14:18.209679+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:26.683896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'275","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.861063+0000","last_change":"2024-09-19T13:36:17.362162+0000","last_active":"2024-09-19T14:12:27.861063+0000","last_peered":"2024-09-19T14:12:27.861063+0000","last_clean":"2024-09-19T14:12:27.861063+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:12:27.861063+0000","last_undegraded":"2024-09-19T14:12:27.861063+0000","last_fullsized":"2024-09-19T14:12:27.861063+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:30.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'431","reported_seq":1979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607238+0000","last_change":"2024-09-19T13:36:09.336191+0000","last_active":"2024-09-19T14:12:13.607238+0000","last_peered":"2024-09-19T14:12:13.607238+0000","last_clean":"2024-09-19T14:12:13.607238+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:12:13.607238+0000","last_undegraded":"2024-09-19T14:12:13.607238+0000","last_fullsized":"2024-09-19T14:12:13.607238+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:03.461778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'182","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.402327+0000","last_change":"2024-09-19T13:36:07.816563+0000","last_active":"2024-09-19T14:14:18.402327+0000","last_peered":"2024-09-19T14:14:18.402327+0000","last_clean":"2024-09-19T14:14:18.402327+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:14:18.402327+0000","last_undegraded":"2024-09-19T14:14:18.402327+0000","last_fullsized":"2024-09-19T14:14:18.402327+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:45.659866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":22529,"num_write":874,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599419+0000","last_change":"2024-09-19T13:36:11.335988+0000","last_active":"2024-09-19T14:10:01.599419+0000","last_peered":"2024-09-19T14:10:01.599419+0000","last_clean":"2024-09-19T14:10:01.599419+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:10:01.599419+0000","last_undegraded":"2024-09-19T14:10:01.599419+0000","last_fullsized":"2024-09-19T14:10:01.599419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:16.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'115","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.366930+0000","last_change":"2024-09-19T13:36:13.678694+0000","last_active":"2024-09-19T14:14:18.366930+0000","last_peered":"2024-09-19T14:14:18.366930+0000","last_clean":"2024-09-19T14:14:18.366930+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:14:18.366930+0000","last_undegraded":"2024-09-19T14:14:18.366930+0000","last_fullsized":"2024-09-19T14:14:18.366930+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":261,"num_write":92,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'795","reported_seq":2166,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.448202+0000","last_change":"2024-09-19T13:36:15.347048+0000","last_active":"2024-09-19T14:14:18.448202+0000","last_peered":"2024-09-19T14:14:18.448202+0000","last_clean":"2024-09-19T14:14:18.448202+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:14:18.448202+0000","last_undegraded":"2024-09-19T14:14:18.448202+0000","last_fullsized":"2024-09-19T14:14:18.448202+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:55.442266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'450","reported_seq":2022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226765+0000","last_change":"2024-09-19T13:36:09.334631+0000","last_active":"2024-09-19T14:12:13.226765+0000","last_peered":"2024-09-19T14:12:13.226765+0000","last_clean":"2024-09-19T14:12:13.226765+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:12:13.226765+0000","last_undegraded":"2024-09-19T14:12:13.226765+0000","last_fullsized":"2024-09-19T14:12:13.226765+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:01.778994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'239","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.380040+0000","last_change":"2024-09-19T13:36:07.809526+0000","last_active":"2024-09-19T14:14:18.380040+0000","last_peered":"2024-09-19T14:14:18.380040+0000","last_clean":"2024-09-19T14:14:18.380040+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:14:18.380040+0000","last_undegraded":"2024-09-19T14:14:18.380040+0000","last_fullsized":"2024-09-19T14:14:18.380040+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:56.101821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":46832,"num_write":1033,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740936+0000","last_change":"2024-09-19T13:36:11.332976+0000","last_active":"2024-09-19T14:10:51.740936+0000","last_peered":"2024-09-19T14:10:51.740936+0000","last_clean":"2024-09-19T14:10:51.740936+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:10:51.740936+0000","last_undegraded":"2024-09-19T14:10:51.740936+0000","last_fullsized":"2024-09-19T14:10:51.740936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:44.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'189","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.431333+0000","last_change":"2024-09-19T13:36:13.679868+0000","last_active":"2024-09-19T14:14:18.431333+0000","last_peered":"2024-09-19T14:14:18.431333+0000","last_clean":"2024-09-19T14:14:18.431333+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:14:18.431333+0000","last_undegraded":"2024-09-19T14:14:18.431333+0000","last_fullsized":"2024-09-19T14:14:18.431333+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:05.662964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":253,"num_read_kb":317,"num_write":142,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.635466+0000","last_change":"2024-09-19T13:36:15.351051+0000","last_active":"2024-09-19T14:10:01.635466+0000","last_peered":"2024-09-19T14:10:01.635466+0000","last_clean":"2024-09-19T14:10:01.635466+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:10:01.635466+0000","last_undegraded":"2024-09-19T14:10:01.635466+0000","last_fullsized":"2024-09-19T14:10:01.635466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:18.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'538","reported_seq":1352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.036523+0000","last_change":"2024-09-19T13:36:17.360774+0000","last_active":"2024-09-19T14:13:47.036523+0000","last_peered":"2024-09-19T14:13:47.036523+0000","last_clean":"2024-09-19T14:13:47.036523+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:13:47.036523+0000","last_undegraded":"2024-09-19T14:13:47.036523+0000","last_fullsized":"2024-09-19T14:13:47.036523+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355481+0000","last_change":"2024-09-19T13:36:09.332369+0000","last_active":"2024-09-19T14:12:27.355481+0000","last_peered":"2024-09-19T14:12:27.355481+0000","last_clean":"2024-09-19T14:12:27.355481+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:12:27.355481+0000","last_undegraded":"2024-09-19T14:12:27.355481+0000","last_fullsized":"2024-09-19T14:12:27.355481+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:59.620240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'202","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.484173+0000","last_change":"2024-09-19T13:36:07.806031+0000","last_active":"2024-09-19T14:14:18.484173+0000","last_peered":"2024-09-19T14:14:18.484173+0000","last_clean":"2024-09-19T14:14:18.484173+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:14:18.484173+0000","last_undegraded":"2024-09-19T14:14:18.484173+0000","last_fullsized":"2024-09-19T14:14:18.484173+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:23.397652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":31454,"num_write":896,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"34'3","reported_seq":974,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:17.979131+0000","last_change":"2024-09-19T13:36:11.333511+0000","last_active":"2024-09-19T14:14:17.979131+0000","last_peered":"2024-09-19T14:14:17.979131+0000","last_clean":"2024-09-19T14:14:17.979131+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:14:17.979131+0000","last_undegraded":"2024-09-19T14:14:17.979131+0000","last_fullsized":"2024-09-19T14:14:17.979131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:38.186843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'126","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.283908+0000","last_change":"2024-09-19T13:36:13.346402+0000","last_active":"2024-09-19T14:14:18.283908+0000","last_peered":"2024-09-19T14:14:18.283908+0000","last_clean":"2024-09-19T14:14:18.283908+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:14:18.283908+0000","last_undegraded":"2024-09-19T14:14:18.283908+0000","last_fullsized":"2024-09-19T14:14:18.283908+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:23.310060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10667,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:01.728430+0000","last_change":"2024-09-19T13:36:15.346352+0000","last_active":"2024-09-19T14:11:01.728430+0000","last_peered":"2024-09-19T14:11:01.728430+0000","last_clean":"2024-09-19T14:11:01.728430+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:11:01.728430+0000","last_undegraded":"2024-09-19T14:11:01.728430+0000","last_fullsized":"2024-09-19T14:11:01.728430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:31.554437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'173","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.844081+0000","last_change":"2024-09-19T13:36:17.360996+0000","last_active":"2024-09-19T14:13:36.844081+0000","last_peered":"2024-09-19T14:13:36.844081+0000","last_clean":"2024-09-19T14:13:36.844081+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:13:36.844081+0000","last_undegraded":"2024-09-19T14:13:36.844081+0000","last_fullsized":"2024-09-19T14:13:36.844081+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:40.718784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'343","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.175897+0000","last_change":"2024-09-19T13:36:44.478051+0000","last_active":"2024-09-19T14:12:26.175897+0000","last_peered":"2024-09-19T14:12:26.175897+0000","last_clean":"2024-09-19T14:12:26.175897+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:12:26.175897+0000","last_undegraded":"2024-09-19T14:12:26.175897+0000","last_fullsized":"2024-09-19T14:12:26.175897+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:28:06.614029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'238","reported_seq":1061,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.380642+0000","last_change":"2024-09-19T13:36:07.812190+0000","last_active":"2024-09-19T14:14:18.380642+0000","last_peered":"2024-09-19T14:14:18.380642+0000","last_clean":"2024-09-19T14:14:18.380642+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:14:18.380642+0000","last_undegraded":"2024-09-19T14:14:18.380642+0000","last_fullsized":"2024-09-19T14:14:18.380642+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:32.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":168929,"num_write":1052,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805690+0000","last_change":"2024-09-19T13:36:11.333725+0000","last_active":"2024-09-19T14:09:56.805690+0000","last_peered":"2024-09-19T14:09:56.805690+0000","last_clean":"2024-09-19T14:09:56.805690+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:09:56.805690+0000","last_undegraded":"2024-09-19T14:09:56.805690+0000","last_fullsized":"2024-09-19T14:09:56.805690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:01.253625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'160","reported_seq":729,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.440727+0000","last_change":"2024-09-19T13:36:13.348257+0000","last_active":"2024-09-19T14:14:18.440727+0000","last_peered":"2024-09-19T14:14:18.440727+0000","last_clean":"2024-09-19T14:14:18.440727+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:14:18.440727+0000","last_undegraded":"2024-09-19T14:14:18.440727+0000","last_fullsized":"2024-09-19T14:14:18.440727+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:53.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":189,"num_read_kb":233,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'804","reported_seq":2358,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.214902+0000","last_change":"2024-09-19T13:36:15.347632+0000","last_active":"2024-09-19T14:14:18.214902+0000","last_peered":"2024-09-19T14:14:18.214902+0000","last_clean":"2024-09-19T14:14:18.214902+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:14:18.214902+0000","last_undegraded":"2024-09-19T14:14:18.214902+0000","last_fullsized":"2024-09-19T14:14:18.214902+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:07.500173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.860638+0000","last_change":"2024-09-19T13:36:17.360696+0000","last_active":"2024-09-19T14:13:45.860638+0000","last_peered":"2024-09-19T14:13:45.860638+0000","last_clean":"2024-09-19T14:13:45.860638+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:13:45.860638+0000","last_undegraded":"2024-09-19T14:13:45.860638+0000","last_fullsized":"2024-09-19T14:13:45.860638+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:33.562231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'423","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.167396+0000","last_change":"2024-09-19T13:36:09.341941+0000","last_active":"2024-09-19T14:12:26.167396+0000","last_peered":"2024-09-19T14:12:26.167396+0000","last_clean":"2024-09-19T14:12:26.167396+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:12:26.167396+0000","last_undegraded":"2024-09-19T14:12:26.167396+0000","last_fullsized":"2024-09-19T14:12:26.167396+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:51.059363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'205","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.469906+0000","last_change":"2024-09-19T13:36:07.809548+0000","last_active":"2024-09-19T14:14:18.469906+0000","last_peered":"2024-09-19T14:14:18.469906+0000","last_clean":"2024-09-19T14:14:18.469906+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:14:18.469906+0000","last_undegraded":"2024-09-19T14:14:18.469906+0000","last_fullsized":"2024-09-19T14:14:18.469906+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:50.752222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":543,"num_read_kb":50665,"num_write":1025,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813329+0000","last_change":"2024-09-19T13:36:11.328331+0000","last_active":"2024-09-19T14:10:51.813329+0000","last_peered":"2024-09-19T14:10:51.813329+0000","last_clean":"2024-09-19T14:10:51.813329+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:10:51.813329+0000","last_undegraded":"2024-09-19T14:10:51.813329+0000","last_fullsized":"2024-09-19T14:10:51.813329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:34.826493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'190","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.456925+0000","last_change":"2024-09-19T13:36:13.346349+0000","last_active":"2024-09-19T14:14:18.456925+0000","last_peered":"2024-09-19T14:14:18.456925+0000","last_clean":"2024-09-19T14:14:18.456925+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:14:18.456925+0000","last_undegraded":"2024-09-19T14:14:18.456925+0000","last_fullsized":"2024-09-19T14:14:18.456925+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:53.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20793,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":404,"num_write":130,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.814113+0000","last_change":"2024-09-19T13:36:15.353964+0000","last_active":"2024-09-19T14:10:56.814113+0000","last_peered":"2024-09-19T14:10:56.814113+0000","last_clean":"2024-09-19T14:10:56.814113+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:10:56.814113+0000","last_undegraded":"2024-09-19T14:10:56.814113+0000","last_fullsized":"2024-09-19T14:10:56.814113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:04.430132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'170","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.168956+0000","last_change":"2024-09-19T13:36:17.362550+0000","last_active":"2024-09-19T14:12:15.168956+0000","last_peered":"2024-09-19T14:12:15.168956+0000","last_clean":"2024-09-19T14:12:15.168956+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:12:15.168956+0000","last_undegraded":"2024-09-19T14:12:15.168956+0000","last_fullsized":"2024-09-19T14:12:15.168956+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:34.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1295","reported_seq":3068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.858675+0000","last_change":"2024-09-19T13:36:09.334870+0000","last_active":"2024-09-19T14:13:45.858675+0000","last_peered":"2024-09-19T14:13:45.858675+0000","last_clean":"2024-09-19T14:13:45.858675+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:13:45.858675+0000","last_undegraded":"2024-09-19T14:13:45.858675+0000","last_fullsized":"2024-09-19T14:13:45.858675+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:57.257237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'190","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.436915+0000","last_change":"2024-09-19T13:36:07.799829+0000","last_active":"2024-09-19T14:14:18.436915+0000","last_peered":"2024-09-19T14:14:18.436915+0000","last_clean":"2024-09-19T14:14:18.436915+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:14:18.436915+0000","last_undegraded":"2024-09-19T14:14:18.436915+0000","last_fullsized":"2024-09-19T14:14:18.436915+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":2025,"num_write":905,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.805745+0000","last_change":"2024-09-19T13:36:11.338782+0000","last_active":"2024-09-19T14:09:56.805745+0000","last_peered":"2024-09-19T14:09:56.805745+0000","last_clean":"2024-09-19T14:09:56.805745+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:09:56.805745+0000","last_undegraded":"2024-09-19T14:09:56.805745+0000","last_fullsized":"2024-09-19T14:09:56.805745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:16.443904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'146","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.315728+0000","last_change":"2024-09-19T13:36:13.344371+0000","last_active":"2024-09-19T14:14:18.315728+0000","last_peered":"2024-09-19T14:14:18.315728+0000","last_clean":"2024-09-19T14:14:18.315728+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:14:18.315728+0000","last_undegraded":"2024-09-19T14:14:18.315728+0000","last_fullsized":"2024-09-19T14:14:18.315728+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:58.796476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":203,"num_read_kb":278,"num_write":160,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601278+0000","last_change":"2024-09-19T13:36:15.348413+0000","last_active":"2024-09-19T14:10:06.601278+0000","last_peered":"2024-09-19T14:10:06.601278+0000","last_clean":"2024-09-19T14:10:06.601278+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:10:06.601278+0000","last_undegraded":"2024-09-19T14:10:06.601278+0000","last_fullsized":"2024-09-19T14:10:06.601278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:18.820957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'118","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.738924+0000","last_change":"2024-09-19T13:36:17.364393+0000","last_active":"2024-09-19T14:12:21.738924+0000","last_peered":"2024-09-19T14:12:21.738924+0000","last_clean":"2024-09-19T14:12:21.738924+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:12:21.738924+0000","last_undegraded":"2024-09-19T14:12:21.738924+0000","last_fullsized":"2024-09-19T14:12:21.738924+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:02.719840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'468","reported_seq":2089,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.926778+0000","last_change":"2024-09-19T13:36:09.329775+0000","last_active":"2024-09-19T14:12:13.926778+0000","last_peered":"2024-09-19T14:12:13.926778+0000","last_clean":"2024-09-19T14:12:13.926778+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:12:13.926778+0000","last_undegraded":"2024-09-19T14:12:13.926778+0000","last_fullsized":"2024-09-19T14:12:13.926778+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:15.175433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'216","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.410466+0000","last_change":"2024-09-19T13:36:07.814623+0000","last_active":"2024-09-19T14:14:18.410466+0000","last_peered":"2024-09-19T14:14:18.410466+0000","last_clean":"2024-09-19T14:14:18.410466+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:14:18.410466+0000","last_undegraded":"2024-09-19T14:14:18.410466+0000","last_fullsized":"2024-09-19T14:14:18.410466+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:56.724159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":62927,"num_write":1024,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.634762+0000","last_change":"2024-09-19T13:36:11.336246+0000","last_active":"2024-09-19T14:09:56.634762+0000","last_peered":"2024-09-19T14:09:56.634762+0000","last_clean":"2024-09-19T14:09:56.634762+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:09:56.634762+0000","last_undegraded":"2024-09-19T14:09:56.634762+0000","last_fullsized":"2024-09-19T14:09:56.634762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:18.982990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'146","reported_seq":717,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.260728+0000","last_change":"2024-09-19T13:36:13.343683+0000","last_active":"2024-09-19T14:14:18.260728+0000","last_peered":"2024-09-19T14:14:18.260728+0000","last_clean":"2024-09-19T14:14:18.260728+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:14:18.260728+0000","last_undegraded":"2024-09-19T14:14:18.260728+0000","last_fullsized":"2024-09-19T14:14:18.260728+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.516524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":180,"num_read_kb":188,"num_write":94,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'736","reported_seq":2200,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.210898+0000","last_change":"2024-09-19T13:36:15.350112+0000","last_active":"2024-09-19T14:14:18.210898+0000","last_peered":"2024-09-19T14:14:18.210898+0000","last_clean":"2024-09-19T14:14:18.210898+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:14:18.210898+0000","last_undegraded":"2024-09-19T14:14:18.210898+0000","last_fullsized":"2024-09-19T14:14:18.210898+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.284435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'119","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.540330+0000","last_change":"2024-09-19T13:36:17.355488+0000","last_active":"2024-09-19T14:12:15.540330+0000","last_peered":"2024-09-19T14:12:15.540330+0000","last_clean":"2024-09-19T14:12:15.540330+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:12:15.540330+0000","last_undegraded":"2024-09-19T14:12:15.540330+0000","last_fullsized":"2024-09-19T14:12:15.540330+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.296270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1573","reported_seq":3192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.346545+0000","last_change":"2024-09-19T13:36:09.332881+0000","last_active":"2024-09-19T14:12:27.346545+0000","last_peered":"2024-09-19T14:12:27.346545+0000","last_clean":"2024-09-19T14:12:27.346545+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:12:27.346545+0000","last_undegraded":"2024-09-19T14:12:27.346545+0000","last_fullsized":"2024-09-19T14:12:27.346545+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1500,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:05.228435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'200","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.471383+0000","last_change":"2024-09-19T13:36:07.800961+0000","last_active":"2024-09-19T14:14:18.471383+0000","last_peered":"2024-09-19T14:14:18.471383+0000","last_clean":"2024-09-19T14:14:18.471383+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:14:18.471383+0000","last_undegraded":"2024-09-19T14:14:18.471383+0000","last_fullsized":"2024-09-19T14:14:18.471383+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":26305,"num_write":903,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"34'6","reported_seq":1922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:17.989257+0000","last_change":"2024-09-19T13:36:11.338913+0000","last_active":"2024-09-19T14:14:17.989257+0000","last_peered":"2024-09-19T14:14:17.989257+0000","last_clean":"2024-09-19T14:14:17.989257+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:14:17.989257+0000","last_undegraded":"2024-09-19T14:14:17.989257+0000","last_fullsized":"2024-09-19T14:14:17.989257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:52:36.373641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1680,"num_read_kb":2149,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'75","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.605372+0000","last_change":"2024-09-19T13:36:13.678517+0000","last_active":"2024-09-19T14:11:59.605372+0000","last_peered":"2024-09-19T14:11:59.605372+0000","last_clean":"2024-09-19T14:11:59.605372+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:11:59.605372+0000","last_undegraded":"2024-09-19T14:11:59.605372+0000","last_fullsized":"2024-09-19T14:11:59.605372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:55.910454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'779","reported_seq":4737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.211882+0000","last_change":"2024-09-19T13:36:15.352291+0000","last_active":"2024-09-19T14:14:18.211882+0000","last_peered":"2024-09-19T14:14:18.211882+0000","last_clean":"2024-09-19T14:14:18.211882+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:14:18.211882+0000","last_undegraded":"2024-09-19T14:14:18.211882+0000","last_fullsized":"2024-09-19T14:14:18.211882+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:43.392004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'128","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.409862+0000","last_change":"2024-09-19T13:36:17.360266+0000","last_active":"2024-09-19T14:12:26.409862+0000","last_peered":"2024-09-19T14:12:26.409862+0000","last_clean":"2024-09-19T14:12:26.409862+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:12:26.409862+0000","last_undegraded":"2024-09-19T14:12:26.409862+0000","last_fullsized":"2024-09-19T14:12:26.409862+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:17.091973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'908","reported_seq":2529,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.393463+0000","last_change":"2024-09-19T13:36:09.345481+0000","last_active":"2024-09-19T14:12:14.393463+0000","last_peered":"2024-09-19T14:12:14.393463+0000","last_clean":"2024-09-19T14:12:14.393463+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:12:14.393463+0000","last_undegraded":"2024-09-19T14:12:14.393463+0000","last_fullsized":"2024-09-19T14:12:14.393463+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:16.331902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'179","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:32.410844+0000","last_change":"2024-09-19T13:36:07.803394+0000","last_active":"2024-09-19T14:11:32.410844+0000","last_peered":"2024-09-19T14:11:32.410844+0000","last_clean":"2024-09-19T14:11:32.410844+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:11:32.410844+0000","last_undegraded":"2024-09-19T14:11:32.410844+0000","last_fullsized":"2024-09-19T14:11:32.410844+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:45.538917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:09:56.719129+0000","last_change":"2024-09-19T13:36:11.334156+0000","last_active":"2024-09-19T14:09:56.719129+0000","last_peered":"2024-09-19T14:09:56.719129+0000","last_clean":"2024-09-19T14:09:56.719129+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:09:56.719129+0000","last_undegraded":"2024-09-19T14:09:56.719129+0000","last_fullsized":"2024-09-19T14:09:56.719129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:26.831809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'195","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.412199+0000","last_change":"2024-09-19T13:36:13.346678+0000","last_active":"2024-09-19T14:14:18.412199+0000","last_peered":"2024-09-19T14:14:18.412199+0000","last_clean":"2024-09-19T14:14:18.412199+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:14:18.412199+0000","last_undegraded":"2024-09-19T14:14:18.412199+0000","last_fullsized":"2024-09-19T14:14:18.412199+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:27.806745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":866,"num_read_kb":913,"num_write":1382,"num_write_kb":1260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.710550+0000","last_change":"2024-09-19T13:36:15.349430+0000","last_active":"2024-09-19T14:10:01.710550+0000","last_peered":"2024-09-19T14:10:01.710550+0000","last_clean":"2024-09-19T14:10:01.710550+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:10:01.710550+0000","last_undegraded":"2024-09-19T14:10:01.710550+0000","last_fullsized":"2024-09-19T14:10:01.710550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:55.349813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'116","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.223769+0000","last_change":"2024-09-19T13:36:17.354159+0000","last_active":"2024-09-19T14:12:13.223769+0000","last_peered":"2024-09-19T14:12:13.223769+0000","last_clean":"2024-09-19T14:12:13.223769+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:12:13.223769+0000","last_undegraded":"2024-09-19T14:12:13.223769+0000","last_fullsized":"2024-09-19T14:12:13.223769+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:21.937480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176339+0000","last_change":"2024-09-19T13:36:09.335373+0000","last_active":"2024-09-19T14:12:26.176339+0000","last_peered":"2024-09-19T14:12:26.176339+0000","last_clean":"2024-09-19T14:12:26.176339+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:12:26.176339+0000","last_undegraded":"2024-09-19T14:12:26.176339+0000","last_fullsized":"2024-09-19T14:12:26.176339+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:13.238868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.751980+0000","last_change":"2024-09-19T13:35:53.209257+0000","last_active":"2024-09-19T14:12:06.751980+0000","last_peered":"2024-09-19T14:12:06.751980+0000","last_clean":"2024-09-19T14:12:06.751980+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:12:06.751980+0000","last_undegraded":"2024-09-19T14:12:06.751980+0000","last_fullsized":"2024-09-19T14:12:06.751980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:51.725320+0000","last_clean_scrub_stamp":"2024-09-19T13:35:51.725320+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:26.239545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610925+0000","last_change":"2024-09-19T13:36:00.766592+0000","last_active":"2024-09-19T14:11:26.610925+0000","last_peered":"2024-09-19T14:11:26.610925+0000","last_clean":"2024-09-19T14:11:26.610925+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:11:26.610925+0000","last_undegraded":"2024-09-19T14:11:26.610925+0000","last_fullsized":"2024-09-19T14:11:26.610925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:27.934615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'229","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.466870+0000","last_change":"2024-09-19T13:36:07.812870+0000","last_active":"2024-09-19T14:14:18.466870+0000","last_peered":"2024-09-19T14:14:18.466870+0000","last_clean":"2024-09-19T14:14:18.466870+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:14:18.466870+0000","last_undegraded":"2024-09-19T14:14:18.466870+0000","last_fullsized":"2024-09-19T14:14:18.466870+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":4147,"num_write":1074,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747345+0000","last_change":"2024-09-19T13:36:11.335928+0000","last_active":"2024-09-19T14:11:36.747345+0000","last_peered":"2024-09-19T14:11:36.747345+0000","last_clean":"2024-09-19T14:11:36.747345+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:11:36.747345+0000","last_undegraded":"2024-09-19T14:11:36.747345+0000","last_fullsized":"2024-09-19T14:11:36.747345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:19.656066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'335","reported_seq":1021,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.487682+0000","last_change":"2024-09-19T13:36:13.348035+0000","last_active":"2024-09-19T14:14:18.487682+0000","last_peered":"2024-09-19T14:14:18.487682+0000","last_clean":"2024-09-19T14:14:18.487682+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:14:18.487682+0000","last_undegraded":"2024-09-19T14:14:18.487682+0000","last_fullsized":"2024-09-19T14:14:18.487682+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:31.984054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":939,"num_write":532,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.608712+0000","last_change":"2024-09-19T13:36:15.353267+0000","last_active":"2024-09-19T14:10:56.608712+0000","last_peered":"2024-09-19T14:10:56.608712+0000","last_clean":"2024-09-19T14:10:56.608712+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:10:56.608712+0000","last_undegraded":"2024-09-19T14:10:56.608712+0000","last_fullsized":"2024-09-19T14:10:56.608712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:16.239382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'189","reported_seq":879,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.764923+0000","last_change":"2024-09-19T13:36:17.356980+0000","last_active":"2024-09-19T14:12:27.764923+0000","last_peered":"2024-09-19T14:12:27.764923+0000","last_clean":"2024-09-19T14:12:27.764923+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:12:27.764923+0000","last_undegraded":"2024-09-19T14:12:27.764923+0000","last_fullsized":"2024-09-19T14:12:27.764923+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:00.567870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'974","reported_seq":2577,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855901+0000","last_change":"2024-09-19T13:36:09.343922+0000","last_active":"2024-09-19T14:13:45.855901+0000","last_peered":"2024-09-19T14:13:45.855901+0000","last_clean":"2024-09-19T14:13:45.855901+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:13:45.855901+0000","last_undegraded":"2024-09-19T14:13:45.855901+0000","last_fullsized":"2024-09-19T14:13:45.855901+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":900,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:14.020473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752563+0000","last_change":"2024-09-19T13:36:00.854468+0000","last_active":"2024-09-19T14:12:11.752563+0000","last_peered":"2024-09-19T14:12:11.752563+0000","last_clean":"2024-09-19T14:12:11.752563+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:12:11.752563+0000","last_undegraded":"2024-09-19T14:12:11.752563+0000","last_fullsized":"2024-09-19T14:12:11.752563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:35.110401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'211","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.486141+0000","last_change":"2024-09-19T13:36:07.802200+0000","last_active":"2024-09-19T14:14:18.486141+0000","last_peered":"2024-09-19T14:14:18.486141+0000","last_clean":"2024-09-19T14:14:18.486141+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:14:18.486141+0000","last_undegraded":"2024-09-19T14:14:18.486141+0000","last_fullsized":"2024-09-19T14:14:18.486141+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.035934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":42960,"num_write":983,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.606429+0000","last_change":"2024-09-19T13:36:11.337197+0000","last_active":"2024-09-19T14:10:51.606429+0000","last_peered":"2024-09-19T14:10:51.606429+0000","last_clean":"2024-09-19T14:10:51.606429+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:10:51.606429+0000","last_undegraded":"2024-09-19T14:10:51.606429+0000","last_fullsized":"2024-09-19T14:10:51.606429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:00.715855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'823","reported_seq":2203,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.419539+0000","last_change":"2024-09-19T13:36:13.344429+0000","last_active":"2024-09-19T14:14:18.419539+0000","last_peered":"2024-09-19T14:14:18.419539+0000","last_clean":"2024-09-19T14:14:18.419539+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:14:18.419539+0000","last_undegraded":"2024-09-19T14:14:18.419539+0000","last_fullsized":"2024-09-19T14:14:18.419539+0000","mapping_epoch":28,"log_start":"260'800","ondisk_log_start":"260'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:47.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1143,"num_read_kb":1321,"num_write":246,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749934+0000","last_change":"2024-09-19T13:36:15.355170+0000","last_active":"2024-09-19T14:11:51.749934+0000","last_peered":"2024-09-19T14:11:51.749934+0000","last_clean":"2024-09-19T14:11:51.749934+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:11:51.749934+0000","last_undegraded":"2024-09-19T14:11:51.749934+0000","last_fullsized":"2024-09-19T14:11:51.749934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:24.165465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'128","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.807878+0000","last_change":"2024-09-19T13:36:17.353025+0000","last_active":"2024-09-19T14:13:45.807878+0000","last_peered":"2024-09-19T14:13:45.807878+0000","last_clean":"2024-09-19T14:13:45.807878+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:13:45.807878+0000","last_undegraded":"2024-09-19T14:13:45.807878+0000","last_fullsized":"2024-09-19T14:13:45.807878+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:31.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'770","reported_seq":2365,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226542+0000","last_change":"2024-09-19T13:36:09.335144+0000","last_active":"2024-09-19T14:12:13.226542+0000","last_peered":"2024-09-19T14:12:13.226542+0000","last_clean":"2024-09-19T14:12:13.226542+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:12:13.226542+0000","last_undegraded":"2024-09-19T14:12:13.226542+0000","last_fullsized":"2024-09-19T14:12:13.226542+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:14.738804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.817492+0000","last_change":"2024-09-19T13:36:00.763165+0000","last_active":"2024-09-19T14:11:26.817492+0000","last_peered":"2024-09-19T14:11:26.817492+0000","last_clean":"2024-09-19T14:11:26.817492+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:11:26.817492+0000","last_undegraded":"2024-09-19T14:11:26.817492+0000","last_fullsized":"2024-09-19T14:11:26.817492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:42.369963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'179","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.410597+0000","last_change":"2024-09-19T13:36:07.803619+0000","last_active":"2024-09-19T14:14:18.410597+0000","last_peered":"2024-09-19T14:14:18.410597+0000","last_clean":"2024-09-19T14:14:18.410597+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:14:18.410597+0000","last_undegraded":"2024-09-19T14:14:18.410597+0000","last_fullsized":"2024-09-19T14:14:18.410597+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:55.600380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":6136,"num_write":878,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813393+0000","last_change":"2024-09-19T13:36:11.334995+0000","last_active":"2024-09-19T14:10:51.813393+0000","last_peered":"2024-09-19T14:10:51.813393+0000","last_clean":"2024-09-19T14:10:51.813393+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:10:51.813393+0000","last_undegraded":"2024-09-19T14:10:51.813393+0000","last_fullsized":"2024-09-19T14:10:51.813393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:49.486350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'201","reported_seq":1189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.151581+0000","last_change":"2024-09-19T13:36:13.678601+0000","last_active":"2024-09-19T14:13:47.151581+0000","last_peered":"2024-09-19T14:13:47.151581+0000","last_clean":"2024-09-19T14:13:47.151581+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:13:47.151581+0000","last_undegraded":"2024-09-19T14:13:47.151581+0000","last_fullsized":"2024-09-19T14:13:47.151581+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:44.121580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614634+0000","last_change":"2024-09-19T13:36:15.350412+0000","last_active":"2024-09-19T14:11:41.614634+0000","last_peered":"2024-09-19T14:11:41.614634+0000","last_clean":"2024-09-19T14:11:41.614634+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:11:41.614634+0000","last_undegraded":"2024-09-19T14:11:41.614634+0000","last_fullsized":"2024-09-19T14:11:41.614634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:44.795963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.456924+0000","last_change":"2024-09-19T13:36:17.363655+0000","last_active":"2024-09-19T14:12:27.456924+0000","last_peered":"2024-09-19T14:12:27.456924+0000","last_clean":"2024-09-19T14:12:27.456924+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:12:27.456924+0000","last_undegraded":"2024-09-19T14:12:27.456924+0000","last_fullsized":"2024-09-19T14:12:27.456924+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:54.511400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'351","reported_seq":1871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759134+0000","last_change":"2024-09-19T13:36:09.326835+0000","last_active":"2024-09-19T14:12:27.759134+0000","last_peered":"2024-09-19T14:12:27.759134+0000","last_clean":"2024-09-19T14:12:27.759134+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:12:27.759134+0000","last_undegraded":"2024-09-19T14:12:27.759134+0000","last_fullsized":"2024-09-19T14:12:27.759134+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:36.883583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.610896+0000","last_change":"2024-09-19T13:36:00.767107+0000","last_active":"2024-09-19T14:11:26.610896+0000","last_peered":"2024-09-19T14:11:26.610896+0000","last_clean":"2024-09-19T14:11:26.610896+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:11:26.610896+0000","last_undegraded":"2024-09-19T14:11:26.610896+0000","last_fullsized":"2024-09-19T14:11:26.610896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:58.438229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'223","reported_seq":846,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.454844+0000","last_change":"2024-09-19T13:36:07.801289+0000","last_active":"2024-09-19T14:14:18.454844+0000","last_peered":"2024-09-19T14:14:18.454844+0000","last_clean":"2024-09-19T14:14:18.454844+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:14:18.454844+0000","last_undegraded":"2024-09-19T14:14:18.454844+0000","last_fullsized":"2024-09-19T14:14:18.454844+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:37.845838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":5696,"num_write":1072,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614656+0000","last_change":"2024-09-19T13:36:11.337905+0000","last_active":"2024-09-19T14:11:41.614656+0000","last_peered":"2024-09-19T14:11:41.614656+0000","last_clean":"2024-09-19T14:11:41.614656+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:11:41.614656+0000","last_undegraded":"2024-09-19T14:11:41.614656+0000","last_fullsized":"2024-09-19T14:11:41.614656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:00.320875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'106","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622447+0000","last_change":"2024-09-19T13:36:13.341625+0000","last_active":"2024-09-19T14:13:06.622447+0000","last_peered":"2024-09-19T14:13:06.622447+0000","last_clean":"2024-09-19T14:13:06.622447+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:13:06.622447+0000","last_undegraded":"2024-09-19T14:13:06.622447+0000","last_fullsized":"2024-09-19T14:13:06.622447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:24.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.718378+0000","last_change":"2024-09-19T13:36:15.348466+0000","last_active":"2024-09-19T14:10:56.718378+0000","last_peered":"2024-09-19T14:10:56.718378+0000","last_clean":"2024-09-19T14:10:56.718378+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:10:56.718378+0000","last_undegraded":"2024-09-19T14:10:56.718378+0000","last_fullsized":"2024-09-19T14:10:56.718378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:23:41.097287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'106","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.019026+0000","last_change":"2024-09-19T13:36:17.362663+0000","last_active":"2024-09-19T14:12:27.019026+0000","last_peered":"2024-09-19T14:12:27.019026+0000","last_clean":"2024-09-19T14:12:27.019026+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:12:27.019026+0000","last_undegraded":"2024-09-19T14:12:27.019026+0000","last_fullsized":"2024-09-19T14:12:27.019026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:27.259346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'599","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260112+0000","last_change":"2024-09-19T13:36:09.342497+0000","last_active":"2024-09-19T14:12:20.260112+0000","last_peered":"2024-09-19T14:12:20.260112+0000","last_clean":"2024-09-19T14:12:20.260112+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:12:20.260112+0000","last_undegraded":"2024-09-19T14:12:20.260112+0000","last_fullsized":"2024-09-19T14:12:20.260112+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:24.198820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'204","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.471996+0000","last_change":"2024-09-19T13:36:07.809389+0000","last_active":"2024-09-19T14:14:18.471996+0000","last_peered":"2024-09-19T14:14:18.471996+0000","last_clean":"2024-09-19T14:14:18.471996+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:14:18.471996+0000","last_undegraded":"2024-09-19T14:14:18.471996+0000","last_fullsized":"2024-09-19T14:14:18.471996+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:41.507863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":24801,"num_write":998,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:26.647184+0000","last_change":"2024-09-19T13:36:00.763237+0000","last_active":"2024-09-19T14:11:26.647184+0000","last_peered":"2024-09-19T14:11:26.647184+0000","last_clean":"2024-09-19T14:11:26.647184+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:11:26.647184+0000","last_undegraded":"2024-09-19T14:11:26.647184+0000","last_fullsized":"2024-09-19T14:11:26.647184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:36.142012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613912+0000","last_change":"2024-09-19T13:36:11.333288+0000","last_active":"2024-09-19T14:11:36.613912+0000","last_peered":"2024-09-19T14:11:36.613912+0000","last_clean":"2024-09-19T14:11:36.613912+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:11:36.613912+0000","last_undegraded":"2024-09-19T14:11:36.613912+0000","last_fullsized":"2024-09-19T14:11:36.613912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:43.796231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'264","reported_seq":910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.498277+0000","last_change":"2024-09-19T13:36:13.344037+0000","last_active":"2024-09-19T14:14:18.498277+0000","last_peered":"2024-09-19T14:14:18.498277+0000","last_clean":"2024-09-19T14:14:18.498277+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:14:18.498277+0000","last_undegraded":"2024-09-19T14:14:18.498277+0000","last_fullsized":"2024-09-19T14:14:18.498277+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12301,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":381,"num_read_kb":528,"num_write":240,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.734022+0000","last_change":"2024-09-19T13:36:15.347284+0000","last_active":"2024-09-19T14:11:41.734022+0000","last_peered":"2024-09-19T14:11:41.734022+0000","last_clean":"2024-09-19T14:11:41.734022+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:11:41.734022+0000","last_undegraded":"2024-09-19T14:11:41.734022+0000","last_fullsized":"2024-09-19T14:11:41.734022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:45.336194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'126","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.815901+0000","last_change":"2024-09-19T13:36:17.358825+0000","last_active":"2024-09-19T14:12:14.815901+0000","last_peered":"2024-09-19T14:12:14.815901+0000","last_clean":"2024-09-19T14:12:14.815901+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:12:14.815901+0000","last_undegraded":"2024-09-19T14:12:14.815901+0000","last_fullsized":"2024-09-19T14:12:14.815901+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:26.627242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1168","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.469596+0000","last_change":"2024-09-19T13:36:09.338739+0000","last_active":"2024-09-19T14:12:12.469596+0000","last_peered":"2024-09-19T14:12:12.469596+0000","last_clean":"2024-09-19T14:12:12.469596+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:12:12.469596+0000","last_undegraded":"2024-09-19T14:12:12.469596+0000","last_fullsized":"2024-09-19T14:12:12.469596+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:57.267957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'238","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.365840+0000","last_change":"2024-09-19T13:36:07.804201+0000","last_active":"2024-09-19T14:14:18.365840+0000","last_peered":"2024-09-19T14:14:18.365840+0000","last_clean":"2024-09-19T14:14:18.365840+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:14:18.365840+0000","last_undegraded":"2024-09-19T14:14:18.365840+0000","last_fullsized":"2024-09-19T14:14:18.365840+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:17.647156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":611,"num_read_kb":113129,"num_write":1047,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747369+0000","last_change":"2024-09-19T13:36:00.854514+0000","last_active":"2024-09-19T14:11:36.747369+0000","last_peered":"2024-09-19T14:11:36.747369+0000","last_clean":"2024-09-19T14:11:36.747369+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:11:36.747369+0000","last_undegraded":"2024-09-19T14:11:36.747369+0000","last_fullsized":"2024-09-19T14:11:36.747369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:14.132561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723266+0000","last_change":"2024-09-19T13:36:11.336803+0000","last_active":"2024-09-19T14:11:36.723266+0000","last_peered":"2024-09-19T14:11:36.723266+0000","last_clean":"2024-09-19T14:11:36.723266+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:11:36.723266+0000","last_undegraded":"2024-09-19T14:11:36.723266+0000","last_fullsized":"2024-09-19T14:11:36.723266+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:07.018411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'145","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.356860+0000","last_change":"2024-09-19T13:36:13.678497+0000","last_active":"2024-09-19T14:12:27.356860+0000","last_peered":"2024-09-19T14:12:27.356860+0000","last_clean":"2024-09-19T14:12:27.356860+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:12:27.356860+0000","last_undegraded":"2024-09-19T14:12:27.356860+0000","last_fullsized":"2024-09-19T14:12:27.356860+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.504350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'788","reported_seq":2498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.501998+0000","last_change":"2024-09-19T13:36:15.349702+0000","last_active":"2024-09-19T14:14:18.501998+0000","last_peered":"2024-09-19T14:14:18.501998+0000","last_clean":"2024-09-19T14:14:18.501998+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:14:18.501998+0000","last_undegraded":"2024-09-19T14:14:18.501998+0000","last_fullsized":"2024-09-19T14:14:18.501998+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.512113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'139","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.173795+0000","last_change":"2024-09-19T13:36:17.364028+0000","last_active":"2024-09-19T14:12:26.173795+0000","last_peered":"2024-09-19T14:12:26.173795+0000","last_clean":"2024-09-19T14:12:26.173795+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:12:26.173795+0000","last_undegraded":"2024-09-19T14:12:26.173795+0000","last_fullsized":"2024-09-19T14:12:26.173795+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:00.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738323+0000","last_change":"2024-09-19T13:36:09.334788+0000","last_active":"2024-09-19T14:12:16.738323+0000","last_peered":"2024-09-19T14:12:16.738323+0000","last_clean":"2024-09-19T14:12:16.738323+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:12:16.738323+0000","last_undegraded":"2024-09-19T14:12:16.738323+0000","last_fullsized":"2024-09-19T14:12:16.738323+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'210","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.389862+0000","last_change":"2024-09-19T13:36:07.809079+0000","last_active":"2024-09-19T14:14:18.389862+0000","last_peered":"2024-09-19T14:14:18.389862+0000","last_clean":"2024-09-19T14:14:18.389862+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:14:18.389862+0000","last_undegraded":"2024-09-19T14:14:18.389862+0000","last_fullsized":"2024-09-19T14:14:18.389862+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:54.831177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":8334,"num_write":1024,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.641430+0000","last_change":"2024-09-19T13:36:00.763660+0000","last_active":"2024-09-19T14:10:41.641430+0000","last_peered":"2024-09-19T14:10:41.641430+0000","last_clean":"2024-09-19T14:10:41.641430+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:10:41.641430+0000","last_undegraded":"2024-09-19T14:10:41.641430+0000","last_fullsized":"2024-09-19T14:10:41.641430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:18.186285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733201+0000","last_change":"2024-09-19T13:36:11.329844+0000","last_active":"2024-09-19T14:11:36.733201+0000","last_peered":"2024-09-19T14:11:36.733201+0000","last_clean":"2024-09-19T14:11:36.733201+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:11:36.733201+0000","last_undegraded":"2024-09-19T14:11:36.733201+0000","last_fullsized":"2024-09-19T14:11:36.733201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:37.515612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'87","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.941455+0000","last_change":"2024-09-19T13:36:13.343716+0000","last_active":"2024-09-19T14:11:55.941455+0000","last_peered":"2024-09-19T14:11:55.941455+0000","last_clean":"2024-09-19T14:11:55.941455+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:11:55.941455+0000","last_undegraded":"2024-09-19T14:11:55.941455+0000","last_fullsized":"2024-09-19T14:11:55.941455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'797","reported_seq":2378,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.448027+0000","last_change":"2024-09-19T13:36:15.350187+0000","last_active":"2024-09-19T14:14:18.448027+0000","last_peered":"2024-09-19T14:14:18.448027+0000","last_clean":"2024-09-19T14:14:18.448027+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:14:18.448027+0000","last_undegraded":"2024-09-19T14:14:18.448027+0000","last_fullsized":"2024-09-19T14:14:18.448027+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.788209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'291","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:04.821247+0000","last_change":"2024-09-19T13:36:17.362227+0000","last_active":"2024-09-19T14:12:04.821247+0000","last_peered":"2024-09-19T14:12:04.821247+0000","last_clean":"2024-09-19T14:12:04.821247+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:12:04.821247+0000","last_undegraded":"2024-09-19T14:12:04.821247+0000","last_fullsized":"2024-09-19T14:12:04.821247+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:31.124289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'722","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758644+0000","last_change":"2024-09-19T13:36:09.334632+0000","last_active":"2024-09-19T14:12:27.758644+0000","last_peered":"2024-09-19T14:12:27.758644+0000","last_clean":"2024-09-19T14:12:27.758644+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:12:27.758644+0000","last_undegraded":"2024-09-19T14:12:27.758644+0000","last_fullsized":"2024-09-19T14:12:27.758644+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:08.592744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'224","reported_seq":860,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.494773+0000","last_change":"2024-09-19T13:36:07.811604+0000","last_active":"2024-09-19T14:14:18.494773+0000","last_peered":"2024-09-19T14:14:18.494773+0000","last_clean":"2024-09-19T14:14:18.494773+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:14:18.494773+0000","last_undegraded":"2024-09-19T14:14:18.494773+0000","last_fullsized":"2024-09-19T14:14:18.494773+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:27.180358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":41557,"num_write":1060,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.716308+0000","last_change":"2024-09-19T13:36:00.816633+0000","last_active":"2024-09-19T14:10:41.716308+0000","last_peered":"2024-09-19T14:10:41.716308+0000","last_clean":"2024-09-19T14:10:41.716308+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:10:41.716308+0000","last_undegraded":"2024-09-19T14:10:41.716308+0000","last_fullsized":"2024-09-19T14:10:41.716308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:35:57.745052+0000","last_clean_scrub_stamp":"2024-09-19T13:35:57.745052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:57.733243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738348+0000","last_change":"2024-09-19T13:36:11.334617+0000","last_active":"2024-09-19T14:12:16.738348+0000","last_peered":"2024-09-19T14:12:16.738348+0000","last_clean":"2024-09-19T14:12:16.738348+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:12:16.738348+0000","last_undegraded":"2024-09-19T14:12:16.738348+0000","last_fullsized":"2024-09-19T14:12:16.738348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:31.167102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'304","reported_seq":1007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.396941+0000","last_change":"2024-09-19T13:36:13.678434+0000","last_active":"2024-09-19T14:14:18.396941+0000","last_peered":"2024-09-19T14:14:18.396941+0000","last_clean":"2024-09-19T14:14:18.396941+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:14:18.396941+0000","last_undegraded":"2024-09-19T14:14:18.396941+0000","last_fullsized":"2024-09-19T14:14:18.396941+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:14.308303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16920,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":432,"num_read_kb":558,"num_write":210,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.733909+0000","last_change":"2024-09-19T13:36:15.348438+0000","last_active":"2024-09-19T14:11:41.733909+0000","last_peered":"2024-09-19T14:11:41.733909+0000","last_clean":"2024-09-19T14:11:41.733909+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:11:41.733909+0000","last_undegraded":"2024-09-19T14:11:41.733909+0000","last_fullsized":"2024-09-19T14:11:41.733909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:32.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'160","reported_seq":653,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.232087+0000","last_change":"2024-09-19T13:36:17.358950+0000","last_active":"2024-09-19T14:12:27.232087+0000","last_peered":"2024-09-19T14:12:27.232087+0000","last_clean":"2024-09-19T14:12:27.232087+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:12:27.232087+0000","last_undegraded":"2024-09-19T14:12:27.232087+0000","last_fullsized":"2024-09-19T14:12:27.232087+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:09.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'143","reported_seq":706,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.863516+0000","last_change":"2024-09-19T13:36:17.361305+0000","last_active":"2024-09-19T14:12:27.863516+0000","last_peered":"2024-09-19T14:12:27.863516+0000","last_clean":"2024-09-19T14:12:27.863516+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:12:27.863516+0000","last_undegraded":"2024-09-19T14:12:27.863516+0000","last_fullsized":"2024-09-19T14:12:27.863516+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:26.500978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'776","reported_seq":2472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819999+0000","last_change":"2024-09-19T13:36:09.330532+0000","last_active":"2024-09-19T14:12:14.819999+0000","last_peered":"2024-09-19T14:12:14.819999+0000","last_clean":"2024-09-19T14:12:14.819999+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:12:14.819999+0000","last_undegraded":"2024-09-19T14:12:14.819999+0000","last_fullsized":"2024-09-19T14:12:14.819999+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:28.861247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'197","reported_seq":940,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.357991+0000","last_change":"2024-09-19T13:36:07.807459+0000","last_active":"2024-09-19T14:14:18.357991+0000","last_peered":"2024-09-19T14:14:18.357991+0000","last_clean":"2024-09-19T14:14:18.357991+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:14:18.357991+0000","last_undegraded":"2024-09-19T14:14:18.357991+0000","last_fullsized":"2024-09-19T14:14:18.357991+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:55.208501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":235834,"num_write":982,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645462+0000","last_change":"2024-09-19T13:36:11.335979+0000","last_active":"2024-09-19T14:11:11.645462+0000","last_peered":"2024-09-19T14:11:11.645462+0000","last_clean":"2024-09-19T14:11:11.645462+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:11:11.645462+0000","last_undegraded":"2024-09-19T14:11:11.645462+0000","last_fullsized":"2024-09-19T14:11:11.645462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:55.864456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'139","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.438003+0000","last_change":"2024-09-19T13:36:13.342360+0000","last_active":"2024-09-19T14:14:18.438003+0000","last_peered":"2024-09-19T14:14:18.438003+0000","last_clean":"2024-09-19T14:14:18.438003+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:14:18.438003+0000","last_undegraded":"2024-09-19T14:14:18.438003+0000","last_fullsized":"2024-09-19T14:14:18.438003+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:00.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":264,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730499+0000","last_change":"2024-09-19T13:36:15.347213+0000","last_active":"2024-09-19T14:11:16.730499+0000","last_peered":"2024-09-19T14:11:16.730499+0000","last_clean":"2024-09-19T14:11:16.730499+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:11:16.730499+0000","last_undegraded":"2024-09-19T14:11:16.730499+0000","last_fullsized":"2024-09-19T14:11:16.730499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:56.274514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'125","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.583991+0000","last_change":"2024-09-19T13:36:17.361898+0000","last_active":"2024-09-19T14:12:27.583991+0000","last_peered":"2024-09-19T14:12:27.583991+0000","last_clean":"2024-09-19T14:12:27.583991+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:12:27.583991+0000","last_undegraded":"2024-09-19T14:12:27.583991+0000","last_fullsized":"2024-09-19T14:12:27.583991+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:32.112739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'450","reported_seq":2133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.856226+0000","last_change":"2024-09-19T13:36:09.341398+0000","last_active":"2024-09-19T14:13:45.856226+0000","last_peered":"2024-09-19T14:13:45.856226+0000","last_clean":"2024-09-19T14:13:45.856226+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:13:45.856226+0000","last_undegraded":"2024-09-19T14:13:45.856226+0000","last_fullsized":"2024-09-19T14:13:45.856226+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:27.435893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'204","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.324702+0000","last_change":"2024-09-19T13:36:44.400759+0000","last_active":"2024-09-19T14:14:18.324702+0000","last_peered":"2024-09-19T14:14:18.324702+0000","last_clean":"2024-09-19T14:14:18.324702+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:14:18.324702+0000","last_undegraded":"2024-09-19T14:14:18.324702+0000","last_fullsized":"2024-09-19T14:14:18.324702+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:53.572285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":26124,"num_write":1061,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.729952+0000","last_change":"2024-09-19T13:36:11.337455+0000","last_active":"2024-09-19T14:11:11.729952+0000","last_peered":"2024-09-19T14:11:11.729952+0000","last_clean":"2024-09-19T14:11:11.729952+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:11:11.729952+0000","last_undegraded":"2024-09-19T14:11:11.729952+0000","last_fullsized":"2024-09-19T14:11:11.729952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:12.668776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":538,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.243489+0000","last_change":"2024-09-19T13:36:13.343393+0000","last_active":"2024-09-19T14:11:58.243489+0000","last_peered":"2024-09-19T14:11:58.243489+0000","last_clean":"2024-09-19T14:11:58.243489+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:11:58.243489+0000","last_undegraded":"2024-09-19T14:11:58.243489+0000","last_fullsized":"2024-09-19T14:11:58.243489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:39.552041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.744597+0000","last_change":"2024-09-19T13:36:15.353524+0000","last_active":"2024-09-19T14:11:16.744597+0000","last_peered":"2024-09-19T14:11:16.744597+0000","last_clean":"2024-09-19T14:11:16.744597+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:11:16.744597+0000","last_undegraded":"2024-09-19T14:11:16.744597+0000","last_fullsized":"2024-09-19T14:11:16.744597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:39.216630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'216","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.357835+0000","last_change":"2024-09-19T13:36:17.356683+0000","last_active":"2024-09-19T14:12:27.357835+0000","last_peered":"2024-09-19T14:12:27.357835+0000","last_clean":"2024-09-19T14:12:27.357835+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:12:27.357835+0000","last_undegraded":"2024-09-19T14:12:27.357835+0000","last_fullsized":"2024-09-19T14:12:27.357835+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:18.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'397","reported_seq":1840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171074+0000","last_change":"2024-09-19T13:36:09.334800+0000","last_active":"2024-09-19T14:12:15.171074+0000","last_peered":"2024-09-19T14:12:15.171074+0000","last_clean":"2024-09-19T14:12:15.171074+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:12:15.171074+0000","last_undegraded":"2024-09-19T14:12:15.171074+0000","last_fullsized":"2024-09-19T14:12:15.171074+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:14.288345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'213","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.288959+0000","last_change":"2024-09-19T13:36:07.810838+0000","last_active":"2024-09-19T14:14:18.288959+0000","last_peered":"2024-09-19T14:14:18.288959+0000","last_clean":"2024-09-19T14:14:18.288959+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:14:18.288959+0000","last_undegraded":"2024-09-19T14:14:18.288959+0000","last_fullsized":"2024-09-19T14:14:18.288959+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:49.405832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":16519,"num_write":1037,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743810+0000","last_change":"2024-09-19T13:36:11.336061+0000","last_active":"2024-09-19T14:11:11.743810+0000","last_peered":"2024-09-19T14:11:11.743810+0000","last_clean":"2024-09-19T14:11:11.743810+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:11:11.743810+0000","last_undegraded":"2024-09-19T14:11:11.743810+0000","last_fullsized":"2024-09-19T14:11:11.743810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:12.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'144","reported_seq":721,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.359138+0000","last_change":"2024-09-19T13:36:13.342506+0000","last_active":"2024-09-19T14:14:18.359138+0000","last_peered":"2024-09-19T14:14:18.359138+0000","last_clean":"2024-09-19T14:14:18.359138+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:14:18.359138+0000","last_undegraded":"2024-09-19T14:14:18.359138+0000","last_fullsized":"2024-09-19T14:14:18.359138+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":198,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720728+0000","last_change":"2024-09-19T13:36:15.349264+0000","last_active":"2024-09-19T14:11:16.720728+0000","last_peered":"2024-09-19T14:11:16.720728+0000","last_clean":"2024-09-19T14:11:16.720728+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:11:16.720728+0000","last_undegraded":"2024-09-19T14:11:16.720728+0000","last_fullsized":"2024-09-19T14:11:16.720728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.086503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'180","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.817537+0000","last_change":"2024-09-19T13:36:17.359223+0000","last_active":"2024-09-19T14:12:14.817537+0000","last_peered":"2024-09-19T14:12:14.817537+0000","last_clean":"2024-09-19T14:12:14.817537+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:12:14.817537+0000","last_undegraded":"2024-09-19T14:12:14.817537+0000","last_fullsized":"2024-09-19T14:12:14.817537+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:10.712355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'407","reported_seq":1890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857973+0000","last_change":"2024-09-19T13:36:09.347751+0000","last_active":"2024-09-19T14:13:45.857973+0000","last_peered":"2024-09-19T14:13:45.857973+0000","last_clean":"2024-09-19T14:13:45.857973+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:13:45.857973+0000","last_undegraded":"2024-09-19T14:13:45.857973+0000","last_fullsized":"2024-09-19T14:13:45.857973+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:52.995531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'224","reported_seq":909,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.469996+0000","last_change":"2024-09-19T13:36:07.810378+0000","last_active":"2024-09-19T14:14:18.469996+0000","last_peered":"2024-09-19T14:14:18.469996+0000","last_clean":"2024-09-19T14:14:18.469996+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:14:18.469996+0000","last_undegraded":"2024-09-19T14:14:18.469996+0000","last_fullsized":"2024-09-19T14:14:18.469996+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:11.342159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":697,"num_read_kb":42518,"num_write":1086,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.720199+0000","last_change":"2024-09-19T13:36:11.338516+0000","last_active":"2024-09-19T14:11:11.720199+0000","last_peered":"2024-09-19T14:11:11.720199+0000","last_clean":"2024-09-19T14:11:11.720199+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:11:11.720199+0000","last_undegraded":"2024-09-19T14:11:11.720199+0000","last_fullsized":"2024-09-19T14:11:11.720199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:01:07.656648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'129","reported_seq":685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.336765+0000","last_change":"2024-09-19T13:36:13.348210+0000","last_active":"2024-09-19T14:14:18.336765+0000","last_peered":"2024-09-19T14:14:18.336765+0000","last_clean":"2024-09-19T14:14:18.336765+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:14:18.336765+0000","last_undegraded":"2024-09-19T14:14:18.336765+0000","last_fullsized":"2024-09-19T14:14:18.336765+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:04.880223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611560+0000","last_change":"2024-09-19T13:36:15.353429+0000","last_active":"2024-09-19T14:11:16.611560+0000","last_peered":"2024-09-19T14:11:16.611560+0000","last_clean":"2024-09-19T14:11:16.611560+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:11:16.611560+0000","last_undegraded":"2024-09-19T14:11:16.611560+0000","last_fullsized":"2024-09-19T14:11:16.611560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'841","reported_seq":2324,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859435+0000","last_change":"2024-09-19T13:36:09.338894+0000","last_active":"2024-09-19T14:13:45.859435+0000","last_peered":"2024-09-19T14:13:45.859435+0000","last_clean":"2024-09-19T14:13:45.859435+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:13:45.859435+0000","last_undegraded":"2024-09-19T14:13:45.859435+0000","last_fullsized":"2024-09-19T14:13:45.859435+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:00.425682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'212","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.478716+0000","last_change":"2024-09-19T13:36:07.802099+0000","last_active":"2024-09-19T14:14:18.478716+0000","last_peered":"2024-09-19T14:14:18.478716+0000","last_clean":"2024-09-19T14:14:18.478716+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:14:18.478716+0000","last_undegraded":"2024-09-19T14:14:18.478716+0000","last_fullsized":"2024-09-19T14:14:18.478716+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:50.286421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":34256,"num_write":1036,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619281+0000","last_change":"2024-09-19T13:36:11.339451+0000","last_active":"2024-09-19T14:12:16.619281+0000","last_peered":"2024-09-19T14:12:16.619281+0000","last_clean":"2024-09-19T14:12:16.619281+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:12:16.619281+0000","last_undegraded":"2024-09-19T14:12:16.619281+0000","last_fullsized":"2024-09-19T14:12:16.619281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:18.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'186","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.479778+0000","last_change":"2024-09-19T13:36:13.344513+0000","last_active":"2024-09-19T14:14:18.479778+0000","last_peered":"2024-09-19T14:14:18.479778+0000","last_clean":"2024-09-19T14:14:18.479778+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:14:18.479778+0000","last_undegraded":"2024-09-19T14:14:18.479778+0000","last_fullsized":"2024-09-19T14:14:18.479778+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:22.941079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":293,"num_read_kb":440,"num_write":180,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.609853+0000","last_change":"2024-09-19T13:36:15.354407+0000","last_active":"2024-09-19T14:11:16.609853+0000","last_peered":"2024-09-19T14:11:16.609853+0000","last_clean":"2024-09-19T14:11:16.609853+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:11:16.609853+0000","last_undegraded":"2024-09-19T14:11:16.609853+0000","last_fullsized":"2024-09-19T14:11:16.609853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'194","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.814286+0000","last_change":"2024-09-19T13:36:17.363573+0000","last_active":"2024-09-19T14:12:27.814286+0000","last_peered":"2024-09-19T14:12:27.814286+0000","last_clean":"2024-09-19T14:12:27.814286+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:12:27.814286+0000","last_undegraded":"2024-09-19T14:12:27.814286+0000","last_fullsized":"2024-09-19T14:12:27.814286+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:53.961300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619272+0000","last_change":"2024-09-19T13:36:09.334303+0000","last_active":"2024-09-19T14:12:16.619272+0000","last_peered":"2024-09-19T14:12:16.619272+0000","last_clean":"2024-09-19T14:12:16.619272+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:12:16.619272+0000","last_undegraded":"2024-09-19T14:12:16.619272+0000","last_fullsized":"2024-09-19T14:12:16.619272+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:28.147108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'190","reported_seq":926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.410652+0000","last_change":"2024-09-19T13:36:07.808757+0000","last_active":"2024-09-19T14:14:18.410652+0000","last_peered":"2024-09-19T14:14:18.410652+0000","last_clean":"2024-09-19T14:14:18.410652+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:14:18.410652+0000","last_undegraded":"2024-09-19T14:14:18.410652+0000","last_fullsized":"2024-09-19T14:14:18.410652+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:21.182962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":906,"num_read_kb":49787,"num_write":936,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723358+0000","last_change":"2024-09-19T13:36:11.339099+0000","last_active":"2024-09-19T14:11:36.723358+0000","last_peered":"2024-09-19T14:11:36.723358+0000","last_clean":"2024-09-19T14:11:36.723358+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:11:36.723358+0000","last_undegraded":"2024-09-19T14:11:36.723358+0000","last_fullsized":"2024-09-19T14:11:36.723358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:44.638696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'131","reported_seq":698,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.342908+0000","last_change":"2024-09-19T13:36:13.351689+0000","last_active":"2024-09-19T14:14:18.342908+0000","last_peered":"2024-09-19T14:14:18.342908+0000","last_clean":"2024-09-19T14:14:18.342908+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:14:18.342908+0000","last_undegraded":"2024-09-19T14:14:18.342908+0000","last_fullsized":"2024-09-19T14:14:18.342908+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:59.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645982+0000","last_change":"2024-09-19T13:36:15.352438+0000","last_active":"2024-09-19T14:11:16.645982+0000","last_peered":"2024-09-19T14:11:16.645982+0000","last_clean":"2024-09-19T14:11:16.645982+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:11:16.645982+0000","last_undegraded":"2024-09-19T14:11:16.645982+0000","last_fullsized":"2024-09-19T14:11:16.645982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:36.174138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'153","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:05.915979+0000","last_change":"2024-09-19T13:36:17.361800+0000","last_active":"2024-09-19T14:12:05.915979+0000","last_peered":"2024-09-19T14:12:05.915979+0000","last_clean":"2024-09-19T14:12:05.915979+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:12:05.915979+0000","last_undegraded":"2024-09-19T14:12:05.915979+0000","last_fullsized":"2024-09-19T14:12:05.915979+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:05.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'363","reported_seq":1760,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758484+0000","last_change":"2024-09-19T13:36:09.347725+0000","last_active":"2024-09-19T14:12:27.758484+0000","last_peered":"2024-09-19T14:12:27.758484+0000","last_clean":"2024-09-19T14:12:27.758484+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:12:27.758484+0000","last_undegraded":"2024-09-19T14:12:27.758484+0000","last_fullsized":"2024-09-19T14:12:27.758484+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:58.075633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'203","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.356816+0000","last_change":"2024-09-19T13:36:07.804673+0000","last_active":"2024-09-19T14:14:18.356816+0000","last_peered":"2024-09-19T14:14:18.356816+0000","last_clean":"2024-09-19T14:14:18.356816+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:14:18.356816+0000","last_undegraded":"2024-09-19T14:14:18.356816+0000","last_fullsized":"2024-09-19T14:14:18.356816+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:43.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":98647,"num_write":933,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730104+0000","last_change":"2024-09-19T13:36:11.336450+0000","last_active":"2024-09-19T14:11:11.730104+0000","last_peered":"2024-09-19T14:11:11.730104+0000","last_clean":"2024-09-19T14:11:11.730104+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:11:11.730104+0000","last_undegraded":"2024-09-19T14:11:11.730104+0000","last_fullsized":"2024-09-19T14:11:11.730104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:28.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'123","reported_seq":686,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.461935+0000","last_change":"2024-09-19T13:36:13.679719+0000","last_active":"2024-09-19T14:14:18.461935+0000","last_peered":"2024-09-19T14:14:18.461935+0000","last_clean":"2024-09-19T14:14:18.461935+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:14:18.461935+0000","last_undegraded":"2024-09-19T14:14:18.461935+0000","last_fullsized":"2024-09-19T14:14:18.461935+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7162,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":222,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.653996+0000","last_change":"2024-09-19T13:36:15.346362+0000","last_active":"2024-09-19T14:12:21.653996+0000","last_peered":"2024-09-19T14:12:21.653996+0000","last_clean":"2024-09-19T14:12:21.653996+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:12:21.653996+0000","last_undegraded":"2024-09-19T14:12:21.653996+0000","last_fullsized":"2024-09-19T14:12:21.653996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:04.233453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'110","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.035975+0000","last_change":"2024-09-19T13:36:17.358911+0000","last_active":"2024-09-19T14:13:47.035975+0000","last_peered":"2024-09-19T14:13:47.035975+0000","last_clean":"2024-09-19T14:13:47.035975+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:13:47.035975+0000","last_undegraded":"2024-09-19T14:13:47.035975+0000","last_fullsized":"2024-09-19T14:13:47.035975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:09.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'864","reported_seq":2572,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759017+0000","last_change":"2024-09-19T13:36:09.328018+0000","last_active":"2024-09-19T14:12:27.759017+0000","last_peered":"2024-09-19T14:12:27.759017+0000","last_clean":"2024-09-19T14:12:27.759017+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:12:27.759017+0000","last_undegraded":"2024-09-19T14:12:27.759017+0000","last_fullsized":"2024-09-19T14:12:27.759017+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:01.380904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'238","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.416666+0000","last_change":"2024-09-19T13:36:07.810852+0000","last_active":"2024-09-19T14:14:18.416666+0000","last_peered":"2024-09-19T14:14:18.416666+0000","last_clean":"2024-09-19T14:14:18.416666+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:14:18.416666+0000","last_undegraded":"2024-09-19T14:14:18.416666+0000","last_fullsized":"2024-09-19T14:14:18.416666+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:23.670171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":17644,"num_write":972,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.645501+0000","last_change":"2024-09-19T13:36:11.341498+0000","last_active":"2024-09-19T14:11:11.645501+0000","last_peered":"2024-09-19T14:11:11.645501+0000","last_clean":"2024-09-19T14:11:11.645501+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:11:11.645501+0000","last_undegraded":"2024-09-19T14:11:11.645501+0000","last_fullsized":"2024-09-19T14:11:11.645501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:07.914209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'73","reported_seq":582,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.739219+0000","last_change":"2024-09-19T13:36:13.678466+0000","last_active":"2024-09-19T14:12:21.739219+0000","last_peered":"2024-09-19T14:12:21.739219+0000","last_clean":"2024-09-19T14:12:21.739219+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:12:21.739219+0000","last_undegraded":"2024-09-19T14:12:21.739219+0000","last_fullsized":"2024-09-19T14:12:21.739219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.085161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'779","reported_seq":4109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.207156+0000","last_change":"2024-09-19T13:36:15.350958+0000","last_active":"2024-09-19T14:14:18.207156+0000","last_peered":"2024-09-19T14:14:18.207156+0000","last_clean":"2024-09-19T14:14:18.207156+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:14:18.207156+0000","last_undegraded":"2024-09-19T14:14:18.207156+0000","last_fullsized":"2024-09-19T14:14:18.207156+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.003728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'116","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.815973+0000","last_change":"2024-09-19T13:36:17.363671+0000","last_active":"2024-09-19T14:12:27.815973+0000","last_peered":"2024-09-19T14:12:27.815973+0000","last_clean":"2024-09-19T14:12:27.815973+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:12:27.815973+0000","last_undegraded":"2024-09-19T14:12:27.815973+0000","last_fullsized":"2024-09-19T14:12:27.815973+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'835","reported_seq":2302,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:03.844154+0000","last_change":"2024-09-19T13:36:09.338783+0000","last_active":"2024-09-19T14:12:03.844154+0000","last_peered":"2024-09-19T14:12:03.844154+0000","last_clean":"2024-09-19T14:12:03.844154+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:12:03.844154+0000","last_undegraded":"2024-09-19T14:12:03.844154+0000","last_fullsized":"2024-09-19T14:12:03.844154+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:11.912759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'178","reported_seq":755,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.446043+0000","last_change":"2024-09-19T13:36:07.814956+0000","last_active":"2024-09-19T14:14:18.446043+0000","last_peered":"2024-09-19T14:14:18.446043+0000","last_clean":"2024-09-19T14:14:18.446043+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:14:18.446043+0000","last_undegraded":"2024-09-19T14:14:18.446043+0000","last_fullsized":"2024-09-19T14:14:18.446043+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:59.519413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":5488,"num_write":868,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743900+0000","last_change":"2024-09-19T13:36:11.339110+0000","last_active":"2024-09-19T14:11:11.743900+0000","last_peered":"2024-09-19T14:11:11.743900+0000","last_clean":"2024-09-19T14:11:11.743900+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:11:11.743900+0000","last_undegraded":"2024-09-19T14:11:11.743900+0000","last_fullsized":"2024-09-19T14:11:11.743900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:19.072017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'147","reported_seq":711,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.271827+0000","last_change":"2024-09-19T13:36:13.345724+0000","last_active":"2024-09-19T14:14:18.271827+0000","last_peered":"2024-09-19T14:14:18.271827+0000","last_clean":"2024-09-19T14:14:18.271827+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:14:18.271827+0000","last_undegraded":"2024-09-19T14:14:18.271827+0000","last_fullsized":"2024-09-19T14:14:18.271827+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:09.615248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7396,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":254,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601159+0000","last_change":"2024-09-19T13:36:15.348860+0000","last_active":"2024-09-19T14:10:06.601159+0000","last_peered":"2024-09-19T14:10:06.601159+0000","last_clean":"2024-09-19T14:10:06.601159+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:10:06.601159+0000","last_undegraded":"2024-09-19T14:10:06.601159+0000","last_fullsized":"2024-09-19T14:10:06.601159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:42.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'111","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.467492+0000","last_change":"2024-09-19T13:36:17.357887+0000","last_active":"2024-09-19T14:12:12.467492+0000","last_peered":"2024-09-19T14:12:12.467492+0000","last_clean":"2024-09-19T14:12:12.467492+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:12:12.467492+0000","last_undegraded":"2024-09-19T14:12:12.467492+0000","last_fullsized":"2024-09-19T14:12:12.467492+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:57.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2548,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758795+0000","last_change":"2024-09-19T13:36:09.339435+0000","last_active":"2024-09-19T14:12:27.758795+0000","last_peered":"2024-09-19T14:12:27.758795+0000","last_clean":"2024-09-19T14:12:27.758795+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:12:27.758795+0000","last_undegraded":"2024-09-19T14:12:27.758795+0000","last_fullsized":"2024-09-19T14:12:27.758795+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:54.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'241","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.493638+0000","last_change":"2024-09-19T13:36:07.814402+0000","last_active":"2024-09-19T14:14:18.493638+0000","last_peered":"2024-09-19T14:14:18.493638+0000","last_clean":"2024-09-19T14:14:18.493638+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:14:18.493638+0000","last_undegraded":"2024-09-19T14:14:18.493638+0000","last_fullsized":"2024-09-19T14:14:18.493638+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:05.518831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":59575,"num_write":1084,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.609332+0000","last_change":"2024-09-19T13:36:11.336616+0000","last_active":"2024-09-19T14:11:11.609332+0000","last_peered":"2024-09-19T14:11:11.609332+0000","last_clean":"2024-09-19T14:11:11.609332+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:11:11.609332+0000","last_undegraded":"2024-09-19T14:11:11.609332+0000","last_fullsized":"2024-09-19T14:11:11.609332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:30.775102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'132","reported_seq":685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.278251+0000","last_change":"2024-09-19T13:36:13.344971+0000","last_active":"2024-09-19T14:14:18.278251+0000","last_peered":"2024-09-19T14:14:18.278251+0000","last_clean":"2024-09-19T14:14:18.278251+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:14:18.278251+0000","last_undegraded":"2024-09-19T14:14:18.278251+0000","last_fullsized":"2024-09-19T14:14:18.278251+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:03.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.711890+0000","last_change":"2024-09-19T13:36:15.353381+0000","last_active":"2024-09-19T14:10:11.711890+0000","last_peered":"2024-09-19T14:10:11.711890+0000","last_clean":"2024-09-19T14:10:11.711890+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:10:11.711890+0000","last_undegraded":"2024-09-19T14:10:11.711890+0000","last_fullsized":"2024-09-19T14:10:11.711890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.838545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'82","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:08.528868+0000","last_change":"2024-09-19T13:36:17.361965+0000","last_active":"2024-09-19T14:12:08.528868+0000","last_peered":"2024-09-19T14:12:08.528868+0000","last_clean":"2024-09-19T14:12:08.528868+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:12:08.528868+0000","last_undegraded":"2024-09-19T14:12:08.528868+0000","last_fullsized":"2024-09-19T14:12:08.528868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:25.682631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'388","reported_seq":1821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.859075+0000","last_change":"2024-09-19T13:36:09.341541+0000","last_active":"2024-09-19T14:13:45.859075+0000","last_peered":"2024-09-19T14:13:45.859075+0000","last_clean":"2024-09-19T14:13:45.859075+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:13:45.859075+0000","last_undegraded":"2024-09-19T14:13:45.859075+0000","last_fullsized":"2024-09-19T14:13:45.859075+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:38.682073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'200","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:46.826609+0000","last_change":"2024-09-19T13:36:44.400469+0000","last_active":"2024-09-19T14:12:46.826609+0000","last_peered":"2024-09-19T14:12:46.826609+0000","last_clean":"2024-09-19T14:12:46.826609+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:12:46.826609+0000","last_undegraded":"2024-09-19T14:12:46.826609+0000","last_fullsized":"2024-09-19T14:12:46.826609+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:06.811166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":516,"num_read_kb":9219,"num_write":929,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719839+0000","last_change":"2024-09-19T13:36:11.334533+0000","last_active":"2024-09-19T14:10:01.719839+0000","last_peered":"2024-09-19T14:10:01.719839+0000","last_clean":"2024-09-19T14:10:01.719839+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:10:01.719839+0000","last_undegraded":"2024-09-19T14:10:01.719839+0000","last_fullsized":"2024-09-19T14:10:01.719839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'115","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.449942+0000","last_change":"2024-09-19T13:36:13.346260+0000","last_active":"2024-09-19T14:14:18.449942+0000","last_peered":"2024-09-19T14:14:18.449942+0000","last_clean":"2024-09-19T14:14:18.449942+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:14:18.449942+0000","last_undegraded":"2024-09-19T14:14:18.449942+0000","last_fullsized":"2024-09-19T14:14:18.449942+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:37.266432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7954,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":214,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730630+0000","last_change":"2024-09-19T13:36:15.348740+0000","last_active":"2024-09-19T14:11:16.730630+0000","last_peered":"2024-09-19T14:11:16.730630+0000","last_clean":"2024-09-19T14:11:16.730630+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:11:16.730630+0000","last_undegraded":"2024-09-19T14:11:16.730630+0000","last_fullsized":"2024-09-19T14:11:16.730630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:00.693042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'161","reported_seq":1613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.352324+0000","last_change":"2024-09-19T13:36:17.359613+0000","last_active":"2024-09-19T14:12:27.352324+0000","last_peered":"2024-09-19T14:12:27.352324+0000","last_clean":"2024-09-19T14:12:27.352324+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:12:27.352324+0000","last_undegraded":"2024-09-19T14:12:27.352324+0000","last_fullsized":"2024-09-19T14:12:27.352324+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:03.545885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1270","reported_seq":2983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.882294+0000","last_change":"2024-09-19T13:36:09.338262+0000","last_active":"2024-09-19T14:12:15.882294+0000","last_peered":"2024-09-19T14:12:15.882294+0000","last_clean":"2024-09-19T14:12:15.882294+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:12:15.882294+0000","last_undegraded":"2024-09-19T14:12:15.882294+0000","last_fullsized":"2024-09-19T14:12:15.882294+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:47.191145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'207","reported_seq":884,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.416859+0000","last_change":"2024-09-19T13:36:07.813158+0000","last_active":"2024-09-19T14:14:18.416859+0000","last_peered":"2024-09-19T14:14:18.416859+0000","last_clean":"2024-09-19T14:14:18.416859+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:14:18.416859+0000","last_undegraded":"2024-09-19T14:14:18.416859+0000","last_fullsized":"2024-09-19T14:14:18.416859+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:46.920199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":101743,"num_write":1010,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.636111+0000","last_change":"2024-09-19T13:36:11.338136+0000","last_active":"2024-09-19T14:10:06.636111+0000","last_peered":"2024-09-19T14:10:06.636111+0000","last_clean":"2024-09-19T14:10:06.636111+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:10:06.636111+0000","last_undegraded":"2024-09-19T14:10:06.636111+0000","last_fullsized":"2024-09-19T14:10:06.636111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:55.192579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'159","reported_seq":732,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.473577+0000","last_change":"2024-09-19T13:36:13.345467+0000","last_active":"2024-09-19T14:14:18.473577+0000","last_peered":"2024-09-19T14:14:18.473577+0000","last_clean":"2024-09-19T14:14:18.473577+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:14:18.473577+0000","last_undegraded":"2024-09-19T14:14:18.473577+0000","last_fullsized":"2024-09-19T14:14:18.473577+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9862,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":313,"num_write":122,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611550+0000","last_change":"2024-09-19T13:36:15.349620+0000","last_active":"2024-09-19T14:11:16.611550+0000","last_peered":"2024-09-19T14:11:16.611550+0000","last_clean":"2024-09-19T14:11:16.611550+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:11:16.611550+0000","last_undegraded":"2024-09-19T14:11:16.611550+0000","last_fullsized":"2024-09-19T14:11:16.611550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.666417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'158","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855539+0000","last_change":"2024-09-19T13:36:17.360385+0000","last_active":"2024-09-19T14:13:45.855539+0000","last_peered":"2024-09-19T14:13:45.855539+0000","last_clean":"2024-09-19T14:13:45.855539+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:13:45.855539+0000","last_undegraded":"2024-09-19T14:13:45.855539+0000","last_fullsized":"2024-09-19T14:13:45.855539+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:56.457101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'835","reported_seq":2511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354875+0000","last_change":"2024-09-19T13:36:09.340041+0000","last_active":"2024-09-19T14:12:27.354875+0000","last_peered":"2024-09-19T14:12:27.354875+0000","last_clean":"2024-09-19T14:12:27.354875+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:12:27.354875+0000","last_undegraded":"2024-09-19T14:12:27.354875+0000","last_fullsized":"2024-09-19T14:12:27.354875+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:44.813909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'247","reported_seq":938,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.448739+0000","last_change":"2024-09-19T13:36:07.816141+0000","last_active":"2024-09-19T14:14:18.448739+0000","last_peered":"2024-09-19T14:14:18.448739+0000","last_clean":"2024-09-19T14:14:18.448739+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:14:18.448739+0000","last_undegraded":"2024-09-19T14:14:18.448739+0000","last_fullsized":"2024-09-19T14:14:18.448739+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:19.313544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":888,"num_read_kb":7647,"num_write":1101,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.759140+0000","last_change":"2024-09-19T13:36:09.327555+0000","last_active":"2024-09-19T14:12:27.759140+0000","last_peered":"2024-09-19T14:12:27.759140+0000","last_clean":"2024-09-19T14:12:27.759140+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:12:27.759140+0000","last_undegraded":"2024-09-19T14:12:27.759140+0000","last_fullsized":"2024-09-19T14:12:27.759140+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:05.495968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'216","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.304233+0000","last_change":"2024-09-19T13:36:44.477056+0000","last_active":"2024-09-19T14:14:18.304233+0000","last_peered":"2024-09-19T14:14:18.304233+0000","last_clean":"2024-09-19T14:14:18.304233+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:14:18.304233+0000","last_undegraded":"2024-09-19T14:14:18.304233+0000","last_fullsized":"2024-09-19T14:14:18.304233+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:33.685772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":577,"num_read_kb":9780,"num_write":1046,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'454","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.864388+0000","last_change":"2024-09-19T13:36:09.336079+0000","last_active":"2024-09-19T14:13:45.864388+0000","last_peered":"2024-09-19T14:13:45.864388+0000","last_clean":"2024-09-19T14:13:45.864388+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:13:45.864388+0000","last_undegraded":"2024-09-19T14:13:45.864388+0000","last_fullsized":"2024-09-19T14:13:45.864388+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:37.224054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'209","reported_seq":878,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.357355+0000","last_change":"2024-09-19T13:36:07.813078+0000","last_active":"2024-09-19T14:14:18.357355+0000","last_peered":"2024-09-19T14:14:18.357355+0000","last_clean":"2024-09-19T14:14:18.357355+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:14:18.357355+0000","last_undegraded":"2024-09-19T14:14:18.357355+0000","last_fullsized":"2024-09-19T14:14:18.357355+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:50:05.153900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":691,"num_read_kb":41340,"num_write":997,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'834","reported_seq":2594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.171315+0000","last_change":"2024-09-19T13:36:09.337109+0000","last_active":"2024-09-19T14:12:15.171315+0000","last_peered":"2024-09-19T14:12:15.171315+0000","last_clean":"2024-09-19T14:12:15.171315+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:12:15.171315+0000","last_undegraded":"2024-09-19T14:12:15.171315+0000","last_fullsized":"2024-09-19T14:12:15.171315+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:35.605562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'347","reported_seq":1028,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.472181+0000","last_change":"2024-09-19T13:36:07.799742+0000","last_active":"2024-09-19T14:14:18.472181+0000","last_peered":"2024-09-19T14:14:18.472181+0000","last_clean":"2024-09-19T14:14:18.472181+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:14:18.472181+0000","last_undegraded":"2024-09-19T14:14:18.472181+0000","last_fullsized":"2024-09-19T14:14:18.472181+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:24.145889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":988,"num_read_kb":17821,"num_write":1252,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1313","reported_seq":2966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.881914+0000","last_change":"2024-09-19T13:36:09.337337+0000","last_active":"2024-09-19T14:12:15.881914+0000","last_peered":"2024-09-19T14:12:15.881914+0000","last_clean":"2024-09-19T14:12:15.881914+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:12:15.881914+0000","last_undegraded":"2024-09-19T14:12:15.881914+0000","last_fullsized":"2024-09-19T14:12:15.881914+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:42.621753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'186","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.454966+0000","last_change":"2024-09-19T13:36:07.799229+0000","last_active":"2024-09-19T14:14:18.454966+0000","last_peered":"2024-09-19T14:14:18.454966+0000","last_clean":"2024-09-19T14:14:18.454966+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:14:18.454966+0000","last_undegraded":"2024-09-19T14:14:18.454966+0000","last_fullsized":"2024-09-19T14:14:18.454966+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:58.585027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170303,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":35047,"num_write":889,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'459","reported_seq":2150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.394101+0000","last_change":"2024-09-19T13:36:09.337422+0000","last_active":"2024-09-19T14:12:14.394101+0000","last_peered":"2024-09-19T14:12:14.394101+0000","last_clean":"2024-09-19T14:12:14.394101+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:12:14.394101+0000","last_undegraded":"2024-09-19T14:12:14.394101+0000","last_fullsized":"2024-09-19T14:12:14.394101+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:01.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'260","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.483590+0000","last_change":"2024-09-19T13:36:07.807531+0000","last_active":"2024-09-19T14:12:15.483590+0000","last_peered":"2024-09-19T14:12:15.483590+0000","last_clean":"2024-09-19T14:12:15.483590+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:12:15.483590+0000","last_undegraded":"2024-09-19T14:12:15.483590+0000","last_fullsized":"2024-09-19T14:12:15.483590+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:04.888500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'504","reported_seq":2120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176086+0000","last_change":"2024-09-19T13:36:09.345213+0000","last_active":"2024-09-19T14:12:26.176086+0000","last_peered":"2024-09-19T14:12:26.176086+0000","last_clean":"2024-09-19T14:12:26.176086+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:12:26.176086+0000","last_undegraded":"2024-09-19T14:12:26.176086+0000","last_fullsized":"2024-09-19T14:12:26.176086+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:29.948161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'213","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.467487+0000","last_change":"2024-09-19T13:36:07.807149+0000","last_active":"2024-09-19T14:14:18.467487+0000","last_peered":"2024-09-19T14:14:18.467487+0000","last_clean":"2024-09-19T14:14:18.467487+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:14:18.467487+0000","last_undegraded":"2024-09-19T14:14:18.467487+0000","last_fullsized":"2024-09-19T14:14:18.467487+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:34:20.698696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":13499,"num_write":1011,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'441","reported_seq":1912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.857244+0000","last_change":"2024-09-19T13:36:09.339640+0000","last_active":"2024-09-19T14:13:45.857244+0000","last_peered":"2024-09-19T14:13:45.857244+0000","last_clean":"2024-09-19T14:13:45.857244+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:13:45.857244+0000","last_undegraded":"2024-09-19T14:13:45.857244+0000","last_fullsized":"2024-09-19T14:13:45.857244+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:04.637249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'243","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.454973+0000","last_change":"2024-09-19T13:36:07.799033+0000","last_active":"2024-09-19T14:14:18.454973+0000","last_peered":"2024-09-19T14:14:18.454973+0000","last_clean":"2024-09-19T14:14:18.454973+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:14:18.454973+0000","last_undegraded":"2024-09-19T14:14:18.454973+0000","last_fullsized":"2024-09-19T14:14:18.454973+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:19.554246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":662,"num_read_kb":12703,"num_write":1156,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'795","reported_seq":2305,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.354863+0000","last_change":"2024-09-19T13:36:09.334668+0000","last_active":"2024-09-19T14:12:27.354863+0000","last_peered":"2024-09-19T14:12:27.354863+0000","last_clean":"2024-09-19T14:12:27.354863+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:12:27.354863+0000","last_undegraded":"2024-09-19T14:12:27.354863+0000","last_fullsized":"2024-09-19T14:12:27.354863+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:41.139613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'198","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.454616+0000","last_change":"2024-09-19T13:36:07.810286+0000","last_active":"2024-09-19T14:14:18.454616+0000","last_peered":"2024-09-19T14:14:18.454616+0000","last_clean":"2024-09-19T14:14:18.454616+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:14:18.454616+0000","last_undegraded":"2024-09-19T14:14:18.454616+0000","last_fullsized":"2024-09-19T14:14:18.454616+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.597999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":31175,"num_write":936,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'408","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.355318+0000","last_change":"2024-09-19T13:36:09.330316+0000","last_active":"2024-09-19T14:12:27.355318+0000","last_peered":"2024-09-19T14:12:27.355318+0000","last_clean":"2024-09-19T14:12:27.355318+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:12:27.355318+0000","last_undegraded":"2024-09-19T14:12:27.355318+0000","last_fullsized":"2024-09-19T14:12:27.355318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:07.464094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'218","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.372567+0000","last_change":"2024-09-19T13:36:07.798277+0000","last_active":"2024-09-19T14:14:18.372567+0000","last_peered":"2024-09-19T14:14:18.372567+0000","last_clean":"2024-09-19T14:14:18.372567+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:14:18.372567+0000","last_undegraded":"2024-09-19T14:14:18.372567+0000","last_fullsized":"2024-09-19T14:14:18.372567+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:15.349763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":31236,"num_write":1023,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'415","reported_seq":1917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.927264+0000","last_change":"2024-09-19T13:36:09.335622+0000","last_active":"2024-09-19T14:12:13.927264+0000","last_peered":"2024-09-19T14:12:13.927264+0000","last_clean":"2024-09-19T14:12:13.927264+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:12:13.927264+0000","last_undegraded":"2024-09-19T14:12:13.927264+0000","last_fullsized":"2024-09-19T14:12:13.927264+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:17:53.466085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'290","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.616538+0000","last_change":"2024-09-19T13:36:07.810715+0000","last_active":"2024-09-19T14:12:11.616538+0000","last_peered":"2024-09-19T14:12:11.616538+0000","last_clean":"2024-09-19T14:12:11.616538+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:12:11.616538+0000","last_undegraded":"2024-09-19T14:12:11.616538+0000","last_fullsized":"2024-09-19T14:12:11.616538+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:31.514058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":11922,"num_write":1198,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'363","reported_seq":1800,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.169773+0000","last_change":"2024-09-19T13:36:09.337015+0000","last_active":"2024-09-19T14:12:26.169773+0000","last_peered":"2024-09-19T14:12:26.169773+0000","last_clean":"2024-09-19T14:12:26.169773+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:12:26.169773+0000","last_undegraded":"2024-09-19T14:12:26.169773+0000","last_fullsized":"2024-09-19T14:12:26.169773+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:30.671479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'212","reported_seq":885,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.417377+0000","last_change":"2024-09-19T13:36:07.814269+0000","last_active":"2024-09-19T14:14:18.417377+0000","last_peered":"2024-09-19T14:14:18.417377+0000","last_clean":"2024-09-19T14:14:18.417377+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:14:18.417377+0000","last_undegraded":"2024-09-19T14:14:18.417377+0000","last_fullsized":"2024-09-19T14:14:18.417377+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:15.947998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":593,"num_read_kb":98527,"num_write":1024,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'868","reported_seq":2495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.819671+0000","last_change":"2024-09-19T13:36:09.338093+0000","last_active":"2024-09-19T14:12:14.819671+0000","last_peered":"2024-09-19T14:12:14.819671+0000","last_clean":"2024-09-19T14:12:14.819671+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:12:14.819671+0000","last_undegraded":"2024-09-19T14:12:14.819671+0000","last_fullsized":"2024-09-19T14:12:14.819671+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:05.996200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'243","reported_seq":924,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.383138+0000","last_change":"2024-09-19T13:36:07.814412+0000","last_active":"2024-09-19T14:14:18.383138+0000","last_peered":"2024-09-19T14:14:18.383138+0000","last_clean":"2024-09-19T14:14:18.383138+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:14:18.383138+0000","last_undegraded":"2024-09-19T14:14:18.383138+0000","last_fullsized":"2024-09-19T14:14:18.383138+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:00.783704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":868,"num_read_kb":9315,"num_write":1049,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.874456+0000","last_change":"2024-09-19T13:36:09.341212+0000","last_active":"2024-09-19T14:12:15.874456+0000","last_peered":"2024-09-19T14:12:15.874456+0000","last_clean":"2024-09-19T14:12:15.874456+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:12:15.874456+0000","last_undegraded":"2024-09-19T14:12:15.874456+0000","last_fullsized":"2024-09-19T14:12:15.874456+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:57.018874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'251","reported_seq":876,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.321801+0000","last_change":"2024-09-19T13:36:07.807328+0000","last_active":"2024-09-19T14:14:18.321801+0000","last_peered":"2024-09-19T14:14:18.321801+0000","last_clean":"2024-09-19T14:14:18.321801+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:14:18.321801+0000","last_undegraded":"2024-09-19T14:14:18.321801+0000","last_fullsized":"2024-09-19T14:14:18.321801+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:08.421022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":13968,"num_write":1077,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'506","reported_seq":2122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.600040+0000","last_change":"2024-09-19T13:36:09.336661+0000","last_active":"2024-09-19T14:12:13.600040+0000","last_peered":"2024-09-19T14:12:13.600040+0000","last_clean":"2024-09-19T14:12:13.600040+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:12:13.600040+0000","last_undegraded":"2024-09-19T14:12:13.600040+0000","last_fullsized":"2024-09-19T14:12:13.600040+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:04.813825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'222","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.325155+0000","last_change":"2024-09-19T13:36:07.808201+0000","last_active":"2024-09-19T14:14:18.325155+0000","last_peered":"2024-09-19T14:14:18.325155+0000","last_clean":"2024-09-19T14:14:18.325155+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:14:18.325155+0000","last_undegraded":"2024-09-19T14:14:18.325155+0000","last_fullsized":"2024-09-19T14:14:18.325155+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:55.157068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":601,"num_read_kb":75622,"num_write":971,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'448","reported_seq":1944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.758451+0000","last_change":"2024-09-19T13:36:09.337955+0000","last_active":"2024-09-19T14:12:27.758451+0000","last_peered":"2024-09-19T14:12:27.758451+0000","last_clean":"2024-09-19T14:12:27.758451+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:12:27.758451+0000","last_undegraded":"2024-09-19T14:12:27.758451+0000","last_fullsized":"2024-09-19T14:12:27.758451+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:36.790174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'198","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:31.627116+0000","last_change":"2024-09-19T13:36:07.810689+0000","last_active":"2024-09-19T14:13:31.627116+0000","last_peered":"2024-09-19T14:13:31.627116+0000","last_clean":"2024-09-19T14:13:31.627116+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:13:31.627116+0000","last_undegraded":"2024-09-19T14:13:31.627116+0000","last_fullsized":"2024-09-19T14:13:31.627116+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:59.845601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":10629,"num_write":1012,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'195","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.349086+0000","last_change":"2024-09-19T13:36:07.816743+0000","last_active":"2024-09-19T14:14:18.349086+0000","last_peered":"2024-09-19T14:14:18.349086+0000","last_clean":"2024-09-19T14:14:18.349086+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:14:18.349086+0000","last_undegraded":"2024-09-19T14:14:18.349086+0000","last_fullsized":"2024-09-19T14:14:18.349086+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.831713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":6982,"num_write":950,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'984","reported_seq":2906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.176238+0000","last_change":"2024-09-19T13:36:09.340334+0000","last_active":"2024-09-19T14:12:26.176238+0000","last_peered":"2024-09-19T14:12:26.176238+0000","last_clean":"2024-09-19T14:12:26.176238+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:12:26.176238+0000","last_undegraded":"2024-09-19T14:12:26.176238+0000","last_fullsized":"2024-09-19T14:12:26.176238+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:50.291927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'229","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.267153+0000","last_change":"2024-09-19T13:36:07.805884+0000","last_active":"2024-09-19T14:14:18.267153+0000","last_peered":"2024-09-19T14:14:18.267153+0000","last_clean":"2024-09-19T14:14:18.267153+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:14:18.267153+0000","last_undegraded":"2024-09-19T14:14:18.267153+0000","last_fullsized":"2024-09-19T14:14:18.267153+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:06.779719+0000","last_clean_scrub_stamp":"2024-09-19T13:36:06.779719+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:43.155393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":54230,"num_write":1173,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'386","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.347586+0000","last_change":"2024-09-19T13:36:09.336829+0000","last_active":"2024-09-19T14:12:27.347586+0000","last_peered":"2024-09-19T14:12:27.347586+0000","last_clean":"2024-09-19T14:12:27.347586+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:12:27.347586+0000","last_undegraded":"2024-09-19T14:12:27.347586+0000","last_fullsized":"2024-09-19T14:12:27.347586+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:29.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1682,"ondisk_log_size":1682,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":641,"ondisk_log_size":641,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314615,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7869,"num_read_kb":9932,"num_write":5261,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1908,"ondisk_log_size":1908,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2874,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4236,"ondisk_log_size":4236,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40883929,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38761,"num_read_kb":2616727,"num_write":63893,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":81767858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4120,"ondisk_log_size":4120,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":176453,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":179418,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542609,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235932,"kb_used_data":15876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94135908,"statfs":{"total":96636764160,"available":96395169792,"internally_reserved":0,"allocated":16257024,"data_stored":14556338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542610,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230832,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94141008,"statfs":{"total":96636764160,"available":96400392192,"internally_reserved":0,"allocated":15327232,"data_stored":13795194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542610,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102936,"kb_used_data":13428,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94268904,"statfs":{"total":96636764160,"available":96531357696,"internally_reserved":0,"allocated":13750272,"data_stored":12053849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542613,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94824,"kb_used_data":19204,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94277016,"statfs":{"total":96636764160,"available":96539664384,"internally_reserved":0,"allocated":19664896,"data_stored":18070568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542611,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248848,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122992,"statfs":{"total":96636764160,"available":96381943808,"internally_reserved":0,"allocated":19529728,"data_stored":17906941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542611,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75712,"kb_used_data":8420,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296128,"statfs":{"total":96636764160,"available":96559235072,"internally_reserved":0,"allocated":8622080,"data_stored":7083388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542610,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128276,"kb_used_data":6860,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94243564,"statfs":{"total":96636764160,"available":96505409536,"internally_reserved":0,"allocated":7024640,"data_stored":5427412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542611,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242144,"kb_used_data":12380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94129696,"statfs":{"total":96636764160,"available":96388808704,"internally_reserved":0,"allocated":12677120,"data_stored":10986646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8458240,"data_stored":8279931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3432448,"data_stored":3312234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5058560,"data_stored":4967857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":15790141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":15955950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10084352,"data_stored":9935554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11751424,"data_stored":11680028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":11846163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:14:25.107 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.107 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.107 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.107 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.107 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.107 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.108 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.109 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.110 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.111 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.112 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.113 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.114 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.115 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.116 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.117 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.118 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.119 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.120 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.121 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.122 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.123 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.124 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.125 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.126 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.127 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.128 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.129 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.130 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.131 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.132 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T13:35:51.725320+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.133 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.134 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.135 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.136 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.137 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.138 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T13:35:57.745052+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=35, tm_sec=57, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.139 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.140 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.141 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.142 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.143 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.144 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.145 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.146 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.147 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.148 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.149 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.150 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.151 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.152 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-19T13:36:06.779719+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=6, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.152 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:25.152 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T14:14:45.153 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:14:45.492 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:14:45.503 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:14:45.505 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1419,"stamp":"2024-09-19T14:14:43.718889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41806249,"num_objects":632,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":296329,"num_read_kb":3211329,"num_write":145619,"num_write_kb":2512533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33718,"num_omap_keys":136,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13890,"ondisk_log_size":13890,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1359104,"kb_used_data":110208,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753615616,"statfs":{"total":773094113280,"available":771702390784,"internally_reserved":0,"allocated":112852992,"data_stored":99880336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30482,"num_omap_keys":123,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005163"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.604790+0000","last_change":"2024-09-19T14:03:08.839286+0000","last_active":"2024-09-19T14:10:41.604790+0000","last_peered":"2024-09-19T14:10:41.604790+0000","last_clean":"2024-09-19T14:10:41.604790+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:10:41.604790+0000","last_undegraded":"2024-09-19T14:10:41.604790+0000","last_fullsized":"2024-09-19T14:10:41.604790+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:42.826327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.602224+0000","last_change":"2024-09-19T13:52:51.581992+0000","last_active":"2024-09-19T14:10:21.602224+0000","last_peered":"2024-09-19T14:10:21.602224+0000","last_clean":"2024-09-19T14:10:21.602224+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:10:21.602224+0000","last_undegraded":"2024-09-19T14:10:21.602224+0000","last_fullsized":"2024-09-19T14:10:21.602224+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:21.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722729+0000","last_change":"2024-09-19T13:52:48.556806+0000","last_active":"2024-09-19T14:10:21.722729+0000","last_peered":"2024-09-19T14:10:21.722729+0000","last_clean":"2024-09-19T14:10:21.722729+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:10:21.722729+0000","last_undegraded":"2024-09-19T14:10:21.722729+0000","last_fullsized":"2024-09-19T14:10:21.722729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:12.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.618002+0000","last_change":"2024-09-19T13:51:15.739764+0000","last_active":"2024-09-19T14:12:06.618002+0000","last_peered":"2024-09-19T14:12:06.618002+0000","last_clean":"2024-09-19T14:12:06.618002+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:12:06.618002+0000","last_undegraded":"2024-09-19T14:12:06.618002+0000","last_fullsized":"2024-09-19T14:12:06.618002+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:19.998068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.811878+0000","last_change":"2024-09-19T14:03:08.835558+0000","last_active":"2024-09-19T14:10:41.811878+0000","last_peered":"2024-09-19T14:10:41.811878+0000","last_clean":"2024-09-19T14:10:41.811878+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:10:41.811878+0000","last_undegraded":"2024-09-19T14:10:41.811878+0000","last_fullsized":"2024-09-19T14:10:41.811878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:48.618379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.743761+0000","last_change":"2024-09-19T13:52:51.587845+0000","last_active":"2024-09-19T14:12:51.743761+0000","last_peered":"2024-09-19T14:12:51.743761+0000","last_clean":"2024-09-19T14:12:51.743761+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:12:51.743761+0000","last_undegraded":"2024-09-19T14:12:51.743761+0000","last_fullsized":"2024-09-19T14:12:51.743761+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:46.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.657785+0000","last_change":"2024-09-19T13:52:48.554640+0000","last_active":"2024-09-19T14:12:51.657785+0000","last_peered":"2024-09-19T14:12:51.657785+0000","last_clean":"2024-09-19T14:12:51.657785+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:12:51.657785+0000","last_undegraded":"2024-09-19T14:12:51.657785+0000","last_fullsized":"2024-09-19T14:12:51.657785+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:35.344207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.816386+0000","last_change":"2024-09-19T13:51:15.745607+0000","last_active":"2024-09-19T14:11:16.816386+0000","last_peered":"2024-09-19T14:11:16.816386+0000","last_clean":"2024-09-19T14:11:16.816386+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:11:16.816386+0000","last_undegraded":"2024-09-19T14:11:16.816386+0000","last_fullsized":"2024-09-19T14:11:16.816386+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.713992+0000","last_change":"2024-09-19T14:03:08.837569+0000","last_active":"2024-09-19T14:10:26.713992+0000","last_peered":"2024-09-19T14:10:26.713992+0000","last_clean":"2024-09-19T14:10:26.713992+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:10:26.713992+0000","last_undegraded":"2024-09-19T14:10:26.713992+0000","last_fullsized":"2024-09-19T14:10:26.713992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:12.734099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.614000+0000","last_change":"2024-09-19T13:52:51.586976+0000","last_active":"2024-09-19T14:11:36.614000+0000","last_peered":"2024-09-19T14:11:36.614000+0000","last_clean":"2024-09-19T14:11:36.614000+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:11:36.614000+0000","last_undegraded":"2024-09-19T14:11:36.614000+0000","last_fullsized":"2024-09-19T14:11:36.614000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:28.946709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.813410+0000","last_change":"2024-09-19T13:52:48.554485+0000","last_active":"2024-09-19T14:10:51.813410+0000","last_peered":"2024-09-19T14:10:51.813410+0000","last_clean":"2024-09-19T14:10:51.813410+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:10:51.813410+0000","last_undegraded":"2024-09-19T14:10:51.813410+0000","last_fullsized":"2024-09-19T14:10:51.813410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:12.978118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611594+0000","last_change":"2024-09-19T13:51:15.737359+0000","last_active":"2024-09-19T14:11:16.611594+0000","last_peered":"2024-09-19T14:11:16.611594+0000","last_clean":"2024-09-19T14:11:16.611594+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:11:16.611594+0000","last_undegraded":"2024-09-19T14:11:16.611594+0000","last_fullsized":"2024-09-19T14:11:16.611594+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:50.162815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723353+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:10:26.723353+0000","last_peered":"2024-09-19T14:10:26.723353+0000","last_clean":"2024-09-19T14:10:26.723353+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:10:26.723353+0000","last_undegraded":"2024-09-19T14:10:26.723353+0000","last_fullsized":"2024-09-19T14:10:26.723353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.363715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.727658+0000","last_change":"2024-09-19T13:52:51.581539+0000","last_active":"2024-09-19T14:10:56.727658+0000","last_peered":"2024-09-19T14:10:56.727658+0000","last_clean":"2024-09-19T14:10:56.727658+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:10:56.727658+0000","last_undegraded":"2024-09-19T14:10:56.727658+0000","last_fullsized":"2024-09-19T14:10:56.727658+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:52.537771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733334+0000","last_change":"2024-09-19T13:52:48.553843+0000","last_active":"2024-09-19T14:11:36.733334+0000","last_peered":"2024-09-19T14:11:36.733334+0000","last_clean":"2024-09-19T14:11:36.733334+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:11:36.733334+0000","last_undegraded":"2024-09-19T14:11:36.733334+0000","last_fullsized":"2024-09-19T14:11:36.733334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:42.945314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730599+0000","last_change":"2024-09-19T13:51:15.746581+0000","last_active":"2024-09-19T14:11:16.730599+0000","last_peered":"2024-09-19T14:11:16.730599+0000","last_clean":"2024-09-19T14:11:16.730599+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:11:16.730599+0000","last_undegraded":"2024-09-19T14:11:16.730599+0000","last_fullsized":"2024-09-19T14:11:16.730599+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:13.432237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730008+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:11:11.730008+0000","last_peered":"2024-09-19T14:11:11.730008+0000","last_clean":"2024-09-19T14:11:11.730008+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:11:11.730008+0000","last_undegraded":"2024-09-19T14:11:11.730008+0000","last_fullsized":"2024-09-19T14:11:11.730008+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.617196+0000","last_change":"2024-09-19T13:53:44.846213+0000","last_active":"2024-09-19T14:12:16.617196+0000","last_peered":"2024-09-19T14:12:16.617196+0000","last_clean":"2024-09-19T14:12:16.617196+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:12:16.617196+0000","last_undegraded":"2024-09-19T14:12:16.617196+0000","last_fullsized":"2024-09-19T14:12:16.617196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'5","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.334223+0000","last_change":"2024-09-19T13:52:48.552836+0000","last_active":"2024-09-19T14:14:18.334223+0000","last_peered":"2024-09-19T14:14:18.334223+0000","last_clean":"2024-09-19T14:14:18.334223+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:14:18.334223+0000","last_undegraded":"2024-09-19T14:14:18.334223+0000","last_fullsized":"2024-09-19T14:14:18.334223+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":5,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730570+0000","last_change":"2024-09-19T13:51:15.743989+0000","last_active":"2024-09-19T14:11:16.730570+0000","last_peered":"2024-09-19T14:11:16.730570+0000","last_clean":"2024-09-19T14:11:16.730570+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:11:16.730570+0000","last_undegraded":"2024-09-19T14:11:16.730570+0000","last_fullsized":"2024-09-19T14:11:16.730570+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:33.192776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647908+0000","last_change":"2024-09-19T14:03:08.837855+0000","last_active":"2024-09-19T14:11:31.647908+0000","last_peered":"2024-09-19T14:11:31.647908+0000","last_clean":"2024-09-19T14:11:31.647908+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:11:31.647908+0000","last_undegraded":"2024-09-19T14:11:31.647908+0000","last_fullsized":"2024-09-19T14:11:31.647908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:17.620266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.467991+0000","last_change":"2024-09-19T13:52:51.576379+0000","last_active":"2024-09-19T14:14:18.467991+0000","last_peered":"2024-09-19T14:14:18.467991+0000","last_clean":"2024-09-19T14:14:18.467991+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:14:18.467991+0000","last_undegraded":"2024-09-19T14:14:18.467991+0000","last_fullsized":"2024-09-19T14:14:18.467991+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.333404+0000","last_change":"2024-09-19T13:52:48.553148+0000","last_active":"2024-09-19T14:14:18.333404+0000","last_peered":"2024-09-19T14:14:18.333404+0000","last_clean":"2024-09-19T14:14:18.333404+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:14:18.333404+0000","last_undegraded":"2024-09-19T14:14:18.333404+0000","last_fullsized":"2024-09-19T14:14:18.333404+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720708+0000","last_change":"2024-09-19T13:51:15.746742+0000","last_active":"2024-09-19T14:11:16.720708+0000","last_peered":"2024-09-19T14:11:16.720708+0000","last_clean":"2024-09-19T14:11:16.720708+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:11:16.720708+0000","last_undegraded":"2024-09-19T14:11:16.720708+0000","last_fullsized":"2024-09-19T14:11:16.720708+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:30.998138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739569+0000","last_change":"2024-09-19T14:03:08.842863+0000","last_active":"2024-09-19T14:10:41.739569+0000","last_peered":"2024-09-19T14:10:41.739569+0000","last_clean":"2024-09-19T14:10:41.739569+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:10:41.739569+0000","last_undegraded":"2024-09-19T14:10:41.739569+0000","last_fullsized":"2024-09-19T14:10:41.739569+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:07.703304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.713321+0000","last_change":"2024-09-19T13:52:51.577966+0000","last_active":"2024-09-19T14:10:21.713321+0000","last_peered":"2024-09-19T14:10:21.713321+0000","last_clean":"2024-09-19T14:10:21.713321+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:10:21.713321+0000","last_undegraded":"2024-09-19T14:10:21.713321+0000","last_fullsized":"2024-09-19T14:10:21.713321+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:07.818951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723019+0000","last_change":"2024-09-19T13:52:48.556329+0000","last_active":"2024-09-19T14:10:21.723019+0000","last_peered":"2024-09-19T14:10:21.723019+0000","last_clean":"2024-09-19T14:10:21.723019+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:10:21.723019+0000","last_undegraded":"2024-09-19T14:10:21.723019+0000","last_fullsized":"2024-09-19T14:10:21.723019+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:39.632455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":103,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.222490+0000","last_change":"2024-09-19T13:51:15.738677+0000","last_active":"2024-09-19T14:11:23.222490+0000","last_peered":"2024-09-19T14:11:23.222490+0000","last_clean":"2024-09-19T14:11:23.222490+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:11:23.222490+0000","last_undegraded":"2024-09-19T14:11:23.222490+0000","last_fullsized":"2024-09-19T14:11:23.222490+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:11.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739606+0000","last_change":"2024-09-19T14:03:08.844476+0000","last_active":"2024-09-19T14:10:41.739606+0000","last_peered":"2024-09-19T14:10:41.739606+0000","last_clean":"2024-09-19T14:10:41.739606+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:10:41.739606+0000","last_undegraded":"2024-09-19T14:10:41.739606+0000","last_fullsized":"2024-09-19T14:10:41.739606+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:07.162545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'8","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.372877+0000","last_change":"2024-09-19T13:52:51.580942+0000","last_active":"2024-09-19T14:14:18.372877+0000","last_peered":"2024-09-19T14:14:18.372877+0000","last_clean":"2024-09-19T14:14:18.372877+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:14:18.372877+0000","last_undegraded":"2024-09-19T14:14:18.372877+0000","last_fullsized":"2024-09-19T14:14:18.372877+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:13.538115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.623655+0000","last_change":"2024-09-19T13:52:48.559959+0000","last_active":"2024-09-19T14:12:51.623655+0000","last_peered":"2024-09-19T14:12:51.623655+0000","last_clean":"2024-09-19T14:12:51.623655+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:12:51.623655+0000","last_undegraded":"2024-09-19T14:12:51.623655+0000","last_fullsized":"2024-09-19T14:12:51.623655+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:01.163462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.640638+0000","last_change":"2024-09-19T13:51:15.740479+0000","last_active":"2024-09-19T14:10:36.640638+0000","last_peered":"2024-09-19T14:10:36.640638+0000","last_clean":"2024-09-19T14:10:36.640638+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:10:36.640638+0000","last_undegraded":"2024-09-19T14:10:36.640638+0000","last_fullsized":"2024-09-19T14:10:36.640638+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:23.474644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.636875+0000","last_change":"2024-09-19T14:03:08.839816+0000","last_active":"2024-09-19T14:10:11.636875+0000","last_peered":"2024-09-19T14:10:11.636875+0000","last_clean":"2024-09-19T14:10:11.636875+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:10:11.636875+0000","last_undegraded":"2024-09-19T14:10:11.636875+0000","last_fullsized":"2024-09-19T14:10:11.636875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:56.109994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'5","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.259053+0000","last_change":"2024-09-19T13:52:51.579222+0000","last_active":"2024-09-19T14:14:18.259053+0000","last_peered":"2024-09-19T14:14:18.259053+0000","last_clean":"2024-09-19T14:14:18.259053+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:14:18.259053+0000","last_undegraded":"2024-09-19T14:14:18.259053+0000","last_fullsized":"2024-09-19T14:14:18.259053+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:56.630186+0000","last_change":"2024-09-19T13:52:48.554787+0000","last_active":"2024-09-19T14:13:56.630186+0000","last_peered":"2024-09-19T14:13:56.630186+0000","last_clean":"2024-09-19T14:13:56.630186+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:13:56.630186+0000","last_undegraded":"2024-09-19T14:13:56.630186+0000","last_fullsized":"2024-09-19T14:13:56.630186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:28.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.128068+0000","last_change":"2024-09-19T13:51:15.739410+0000","last_active":"2024-09-19T14:12:01.128068+0000","last_peered":"2024-09-19T14:12:01.128068+0000","last_clean":"2024-09-19T14:12:01.128068+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:12:01.128068+0000","last_undegraded":"2024-09-19T14:12:01.128068+0000","last_fullsized":"2024-09-19T14:12:01.128068+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:59.512917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.807924+0000","last_change":"2024-09-19T14:03:08.841302+0000","last_active":"2024-09-19T14:10:11.807924+0000","last_peered":"2024-09-19T14:10:11.807924+0000","last_clean":"2024-09-19T14:10:11.807924+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:10:11.807924+0000","last_undegraded":"2024-09-19T14:10:11.807924+0000","last_fullsized":"2024-09-19T14:10:11.807924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:41.250326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733241+0000","last_change":"2024-09-19T13:52:51.578766+0000","last_active":"2024-09-19T14:11:36.733241+0000","last_peered":"2024-09-19T14:11:36.733241+0000","last_clean":"2024-09-19T14:11:36.733241+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:11:36.733241+0000","last_undegraded":"2024-09-19T14:11:36.733241+0000","last_fullsized":"2024-09-19T14:11:36.733241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:06.602738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.460809+0000","last_change":"2024-09-19T13:52:48.554709+0000","last_active":"2024-09-19T14:14:18.460809+0000","last_peered":"2024-09-19T14:14:18.460809+0000","last_clean":"2024-09-19T14:14:18.460809+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:14:18.460809+0000","last_undegraded":"2024-09-19T14:14:18.460809+0000","last_fullsized":"2024-09-19T14:14:18.460809+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.724834+0000","last_change":"2024-09-19T13:51:15.744268+0000","last_active":"2024-09-19T14:10:36.724834+0000","last_peered":"2024-09-19T14:10:36.724834+0000","last_clean":"2024-09-19T14:10:36.724834+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:10:36.724834+0000","last_undegraded":"2024-09-19T14:10:36.724834+0000","last_fullsized":"2024-09-19T14:10:36.724834+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:44.697556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.734779+0000","last_change":"2024-09-19T14:03:08.840741+0000","last_active":"2024-09-19T14:10:11.734779+0000","last_peered":"2024-09-19T14:10:11.734779+0000","last_clean":"2024-09-19T14:10:11.734779+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:10:11.734779+0000","last_undegraded":"2024-09-19T14:10:11.734779+0000","last_fullsized":"2024-09-19T14:10:11.734779+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:28.511196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737854+0000","last_change":"2024-09-19T13:52:51.576629+0000","last_active":"2024-09-19T14:12:11.737854+0000","last_peered":"2024-09-19T14:12:11.737854+0000","last_clean":"2024-09-19T14:12:11.737854+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:12:11.737854+0000","last_undegraded":"2024-09-19T14:12:11.737854+0000","last_fullsized":"2024-09-19T14:12:11.737854+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.363588+0000","last_change":"2024-09-19T13:52:48.558114+0000","last_active":"2024-09-19T14:14:18.363588+0000","last_peered":"2024-09-19T14:14:18.363588+0000","last_clean":"2024-09-19T14:14:18.363588+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:14:18.363588+0000","last_undegraded":"2024-09-19T14:14:18.363588+0000","last_fullsized":"2024-09-19T14:14:18.363588+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.811335+0000","last_change":"2024-09-19T13:51:15.739232+0000","last_active":"2024-09-19T14:10:36.811335+0000","last_peered":"2024-09-19T14:10:36.811335+0000","last_clean":"2024-09-19T14:10:36.811335+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:10:36.811335+0000","last_undegraded":"2024-09-19T14:10:36.811335+0000","last_fullsized":"2024-09-19T14:10:36.811335+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:51.455590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.600709+0000","last_change":"2024-09-19T14:03:08.838834+0000","last_active":"2024-09-19T14:10:11.600709+0000","last_peered":"2024-09-19T14:10:11.600709+0000","last_clean":"2024-09-19T14:10:11.600709+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:10:11.600709+0000","last_undegraded":"2024-09-19T14:10:11.600709+0000","last_fullsized":"2024-09-19T14:10:11.600709+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:03.093578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737705+0000","last_change":"2024-09-19T13:52:51.583920+0000","last_active":"2024-09-19T14:12:11.737705+0000","last_peered":"2024-09-19T14:12:11.737705+0000","last_clean":"2024-09-19T14:12:11.737705+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:12:11.737705+0000","last_undegraded":"2024-09-19T14:12:11.737705+0000","last_fullsized":"2024-09-19T14:12:11.737705+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'8","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.322159+0000","last_change":"2024-09-19T13:52:48.555699+0000","last_active":"2024-09-19T14:14:18.322159+0000","last_peered":"2024-09-19T14:14:18.322159+0000","last_clean":"2024-09-19T14:14:18.322159+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:14:18.322159+0000","last_undegraded":"2024-09-19T14:14:18.322159+0000","last_fullsized":"2024-09-19T14:14:18.322159+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.753938+0000","last_change":"2024-09-19T13:51:15.743134+0000","last_active":"2024-09-19T14:12:21.753938+0000","last_peered":"2024-09-19T14:12:21.753938+0000","last_clean":"2024-09-19T14:12:21.753938+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:12:21.753938+0000","last_undegraded":"2024-09-19T14:12:21.753938+0000","last_fullsized":"2024-09-19T14:12:21.753938+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723447+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:10:26.723447+0000","last_peered":"2024-09-19T14:10:26.723447+0000","last_clean":"2024-09-19T14:10:26.723447+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:10:26.723447+0000","last_undegraded":"2024-09-19T14:10:26.723447+0000","last_fullsized":"2024-09-19T14:10:26.723447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:46.882911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'14","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:51.665691+0000","last_change":"2024-09-19T13:52:51.584825+0000","last_active":"2024-09-19T14:13:51.665691+0000","last_peered":"2024-09-19T14:13:51.665691+0000","last_clean":"2024-09-19T14:13:51.665691+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:13:51.665691+0000","last_undegraded":"2024-09-19T14:13:51.665691+0000","last_fullsized":"2024-09-19T14:13:51.665691+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:27.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11793,"num_write":34,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732335+0000","last_change":"2024-09-19T13:52:48.558319+0000","last_active":"2024-09-19T14:11:31.732335+0000","last_peered":"2024-09-19T14:11:31.732335+0000","last_clean":"2024-09-19T14:11:31.732335+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:11:31.732335+0000","last_undegraded":"2024-09-19T14:11:31.732335+0000","last_fullsized":"2024-09-19T14:11:31.732335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:02.238052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":99,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.753264+0000","last_change":"2024-09-19T13:51:15.743038+0000","last_active":"2024-09-19T14:12:16.753264+0000","last_peered":"2024-09-19T14:12:16.753264+0000","last_clean":"2024-09-19T14:12:16.753264+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:12:16.753264+0000","last_undegraded":"2024-09-19T14:12:16.753264+0000","last_fullsized":"2024-09-19T14:12:16.753264+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.604316+0000","last_change":"2024-09-19T14:03:08.842157+0000","last_active":"2024-09-19T14:10:26.604316+0000","last_peered":"2024-09-19T14:10:26.604316+0000","last_clean":"2024-09-19T14:10:26.604316+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:10:26.604316+0000","last_undegraded":"2024-09-19T14:10:26.604316+0000","last_fullsized":"2024-09-19T14:10:26.604316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:51.665657+0000","last_change":"2024-09-19T13:52:51.582431+0000","last_active":"2024-09-19T14:13:51.665657+0000","last_peered":"2024-09-19T14:13:51.665657+0000","last_clean":"2024-09-19T14:13:51.665657+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:13:51.665657+0000","last_undegraded":"2024-09-19T14:13:51.665657+0000","last_fullsized":"2024-09-19T14:13:51.665657+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:56.110232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732554+0000","last_change":"2024-09-19T13:52:48.558710+0000","last_active":"2024-09-19T14:11:31.732554+0000","last_peered":"2024-09-19T14:11:31.732554+0000","last_clean":"2024-09-19T14:11:31.732554+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:11:31.732554+0000","last_undegraded":"2024-09-19T14:11:31.732554+0000","last_fullsized":"2024-09-19T14:11:31.732554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:43.224289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":70,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619200+0000","last_change":"2024-09-19T13:51:15.739209+0000","last_active":"2024-09-19T14:12:16.619200+0000","last_peered":"2024-09-19T14:12:16.619200+0000","last_clean":"2024-09-19T14:12:16.619200+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:12:16.619200+0000","last_undegraded":"2024-09-19T14:12:16.619200+0000","last_fullsized":"2024-09-19T14:12:16.619200+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:16.602888+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:10:16.602888+0000","last_peered":"2024-09-19T14:10:16.602888+0000","last_clean":"2024-09-19T14:10:16.602888+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:10:16.602888+0000","last_undegraded":"2024-09-19T14:10:16.602888+0000","last_fullsized":"2024-09-19T14:10:16.602888+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:48.528788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732599+0000","last_change":"2024-09-19T13:52:51.580249+0000","last_active":"2024-09-19T14:11:31.732599+0000","last_peered":"2024-09-19T14:11:31.732599+0000","last_clean":"2024-09-19T14:11:31.732599+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:11:31.732599+0000","last_undegraded":"2024-09-19T14:11:31.732599+0000","last_fullsized":"2024-09-19T14:11:31.732599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:23.302145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722601+0000","last_change":"2024-09-19T13:52:48.548153+0000","last_active":"2024-09-19T14:11:31.722601+0000","last_peered":"2024-09-19T14:11:31.722601+0000","last_clean":"2024-09-19T14:11:31.722601+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:11:31.722601+0000","last_undegraded":"2024-09-19T14:11:31.722601+0000","last_fullsized":"2024-09-19T14:11:31.722601+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:48.036020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738310+0000","last_change":"2024-09-19T13:51:15.736147+0000","last_active":"2024-09-19T14:12:16.738310+0000","last_peered":"2024-09-19T14:12:16.738310+0000","last_clean":"2024-09-19T14:12:16.738310+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:12:16.738310+0000","last_undegraded":"2024-09-19T14:12:16.738310+0000","last_fullsized":"2024-09-19T14:12:16.738310+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723422+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:10:26.723422+0000","last_peered":"2024-09-19T14:10:26.723422+0000","last_clean":"2024-09-19T14:10:26.723422+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:10:26.723422+0000","last_undegraded":"2024-09-19T14:10:26.723422+0000","last_fullsized":"2024-09-19T14:10:26.723422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:18.667527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.395874+0000","last_change":"2024-09-19T13:52:51.585924+0000","last_active":"2024-09-19T14:14:18.395874+0000","last_peered":"2024-09-19T14:14:18.395874+0000","last_clean":"2024-09-19T14:14:18.395874+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:14:18.395874+0000","last_undegraded":"2024-09-19T14:14:18.395874+0000","last_fullsized":"2024-09-19T14:14:18.395874+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:33.073773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'10","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.402353+0000","last_change":"2024-09-19T13:52:48.547186+0000","last_active":"2024-09-19T14:14:18.402353+0000","last_peered":"2024-09-19T14:14:18.402353+0000","last_clean":"2024-09-19T14:14:18.402353+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:14:18.402353+0000","last_undegraded":"2024-09-19T14:14:18.402353+0000","last_fullsized":"2024-09-19T14:14:18.402353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:31.825750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26674,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":151,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738361+0000","last_change":"2024-09-19T13:51:15.745411+0000","last_active":"2024-09-19T14:12:16.738361+0000","last_peered":"2024-09-19T14:12:16.738361+0000","last_clean":"2024-09-19T14:12:16.738361+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:12:16.738361+0000","last_undegraded":"2024-09-19T14:12:16.738361+0000","last_fullsized":"2024-09-19T14:12:16.738361+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820573+0000","last_change":"2024-09-19T14:03:08.839556+0000","last_active":"2024-09-19T14:11:51.820573+0000","last_peered":"2024-09-19T14:11:51.820573+0000","last_clean":"2024-09-19T14:11:51.820573+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:11:51.820573+0000","last_undegraded":"2024-09-19T14:11:51.820573+0000","last_fullsized":"2024-09-19T14:11:51.820573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:45.080550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'7","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622402+0000","last_change":"2024-09-19T13:52:51.578477+0000","last_active":"2024-09-19T14:13:06.622402+0000","last_peered":"2024-09-19T14:13:06.622402+0000","last_clean":"2024-09-19T14:13:06.622402+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:13:06.622402+0000","last_undegraded":"2024-09-19T14:13:06.622402+0000","last_fullsized":"2024-09-19T14:13:06.622402+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:50.156854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.760360+0000","last_change":"2024-09-19T13:52:48.558154+0000","last_active":"2024-09-19T14:13:06.760360+0000","last_peered":"2024-09-19T14:13:06.760360+0000","last_clean":"2024-09-19T14:13:06.760360+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:13:06.760360+0000","last_undegraded":"2024-09-19T14:13:06.760360+0000","last_fullsized":"2024-09-19T14:13:06.760360+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:17.554459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733289+0000","last_change":"2024-09-19T13:51:15.743194+0000","last_active":"2024-09-19T14:11:36.733289+0000","last_peered":"2024-09-19T14:11:36.733289+0000","last_clean":"2024-09-19T14:11:36.733289+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:11:36.733289+0000","last_undegraded":"2024-09-19T14:11:36.733289+0000","last_fullsized":"2024-09-19T14:11:36.733289+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:50.338128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752603+0000","last_change":"2024-09-19T14:03:08.841430+0000","last_active":"2024-09-19T14:12:11.752603+0000","last_peered":"2024-09-19T14:12:11.752603+0000","last_clean":"2024-09-19T14:12:11.752603+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:12:11.752603+0000","last_undegraded":"2024-09-19T14:12:11.752603+0000","last_fullsized":"2024-09-19T14:12:11.752603+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726947+0000","last_change":"2024-09-19T13:52:51.585844+0000","last_active":"2024-09-19T14:10:51.726947+0000","last_peered":"2024-09-19T14:10:51.726947+0000","last_clean":"2024-09-19T14:10:51.726947+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:10:51.726947+0000","last_undegraded":"2024-09-19T14:10:51.726947+0000","last_fullsized":"2024-09-19T14:10:51.726947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:51.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'6","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.828643+0000","last_change":"2024-09-19T13:52:48.558799+0000","last_active":"2024-09-19T14:13:06.828643+0000","last_peered":"2024-09-19T14:13:06.828643+0000","last_clean":"2024-09-19T14:13:06.828643+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:13:06.828643+0000","last_undegraded":"2024-09-19T14:13:06.828643+0000","last_fullsized":"2024-09-19T14:13:06.828643+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:02.090671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.123898+0000","last_change":"2024-09-19T13:51:15.747319+0000","last_active":"2024-09-19T14:12:01.123898+0000","last_peered":"2024-09-19T14:12:01.123898+0000","last_clean":"2024-09-19T14:12:01.123898+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:12:01.123898+0000","last_undegraded":"2024-09-19T14:12:01.123898+0000","last_fullsized":"2024-09-19T14:12:01.123898+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:36.553112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.725348+0000","last_change":"2024-09-19T14:03:08.837522+0000","last_active":"2024-09-19T14:11:51.725348+0000","last_peered":"2024-09-19T14:11:51.725348+0000","last_clean":"2024-09-19T14:11:51.725348+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:11:51.725348+0000","last_undegraded":"2024-09-19T14:11:51.725348+0000","last_fullsized":"2024-09-19T14:11:51.725348+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:20.683332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.643598+0000","last_change":"2024-09-19T13:52:51.586120+0000","last_active":"2024-09-19T14:10:56.643598+0000","last_peered":"2024-09-19T14:10:56.643598+0000","last_clean":"2024-09-19T14:10:56.643598+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:10:56.643598+0000","last_undegraded":"2024-09-19T14:10:56.643598+0000","last_fullsized":"2024-09-19T14:10:56.643598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:59.884434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.607991+0000","last_change":"2024-09-19T13:52:48.554380+0000","last_active":"2024-09-19T14:10:51.607991+0000","last_peered":"2024-09-19T14:10:51.607991+0000","last_clean":"2024-09-19T14:10:51.607991+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:10:51.607991+0000","last_undegraded":"2024-09-19T14:10:51.607991+0000","last_fullsized":"2024-09-19T14:10:51.607991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:07.309256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.722642+0000","last_change":"2024-09-19T13:51:15.747867+0000","last_active":"2024-09-19T14:11:31.722642+0000","last_peered":"2024-09-19T14:11:31.722642+0000","last_clean":"2024-09-19T14:11:31.722642+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:11:31.722642+0000","last_undegraded":"2024-09-19T14:11:31.722642+0000","last_fullsized":"2024-09-19T14:11:31.722642+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.458809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749807+0000","last_change":"2024-09-19T14:03:08.841866+0000","last_active":"2024-09-19T14:11:51.749807+0000","last_peered":"2024-09-19T14:11:51.749807+0000","last_clean":"2024-09-19T14:11:51.749807+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:11:51.749807+0000","last_undegraded":"2024-09-19T14:11:51.749807+0000","last_fullsized":"2024-09-19T14:11:51.749807+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:36.658533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727005+0000","last_change":"2024-09-19T13:52:51.582164+0000","last_active":"2024-09-19T14:10:51.727005+0000","last_peered":"2024-09-19T14:10:51.727005+0000","last_clean":"2024-09-19T14:10:51.727005+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:10:51.727005+0000","last_undegraded":"2024-09-19T14:10:51.727005+0000","last_fullsized":"2024-09-19T14:10:51.727005+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:27.713291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'8","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:11.660376+0000","last_change":"2024-09-19T13:52:48.547009+0000","last_active":"2024-09-19T14:13:11.660376+0000","last_peered":"2024-09-19T14:13:11.660376+0000","last_clean":"2024-09-19T14:13:11.660376+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:13:11.660376+0000","last_undegraded":"2024-09-19T14:13:11.660376+0000","last_fullsized":"2024-09-19T14:13:11.660376+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:40.726822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:59.310015+0000","last_change":"2024-09-19T13:51:15.740368+0000","last_active":"2024-09-19T14:11:59.310015+0000","last_peered":"2024-09-19T14:11:59.310015+0000","last_clean":"2024-09-19T14:11:59.310015+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:11:59.310015+0000","last_undegraded":"2024-09-19T14:11:59.310015+0000","last_fullsized":"2024-09-19T14:11:59.310015+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.326002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737832+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:12:11.737832+0000","last_peered":"2024-09-19T14:12:11.737832+0000","last_clean":"2024-09-19T14:12:11.737832+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:12:11.737832+0000","last_undegraded":"2024-09-19T14:12:11.737832+0000","last_fullsized":"2024-09-19T14:12:11.737832+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'5","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.422698+0000","last_change":"2024-09-19T13:52:51.584114+0000","last_active":"2024-09-19T14:14:18.422698+0000","last_peered":"2024-09-19T14:14:18.422698+0000","last_clean":"2024-09-19T14:14:18.422698+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:14:18.422698+0000","last_undegraded":"2024-09-19T14:14:18.422698+0000","last_fullsized":"2024-09-19T14:14:18.422698+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.619712+0000","last_change":"2024-09-19T13:52:48.555321+0000","last_active":"2024-09-19T14:12:21.619712+0000","last_peered":"2024-09-19T14:12:21.619712+0000","last_clean":"2024-09-19T14:12:21.619712+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:12:21.619712+0000","last_undegraded":"2024-09-19T14:12:21.619712+0000","last_fullsized":"2024-09-19T14:12:21.619712+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613130+0000","last_change":"2024-09-19T13:51:15.743442+0000","last_active":"2024-09-19T14:11:31.613130+0000","last_peered":"2024-09-19T14:11:31.613130+0000","last_clean":"2024-09-19T14:11:31.613130+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:11:31.613130+0000","last_undegraded":"2024-09-19T14:11:31.613130+0000","last_fullsized":"2024-09-19T14:11:31.613130+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:06.945466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.753347+0000","last_change":"2024-09-19T14:03:08.843681+0000","last_active":"2024-09-19T14:12:16.753347+0000","last_peered":"2024-09-19T14:12:16.753347+0000","last_clean":"2024-09-19T14:12:16.753347+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:12:16.753347+0000","last_undegraded":"2024-09-19T14:12:16.753347+0000","last_fullsized":"2024-09-19T14:12:16.753347+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.753845+0000","last_change":"2024-09-19T13:52:51.586345+0000","last_active":"2024-09-19T14:12:21.753845+0000","last_peered":"2024-09-19T14:12:21.753845+0000","last_clean":"2024-09-19T14:12:21.753845+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:12:21.753845+0000","last_undegraded":"2024-09-19T14:12:21.753845+0000","last_fullsized":"2024-09-19T14:12:21.753845+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.380573+0000","last_change":"2024-09-19T13:52:48.546287+0000","last_active":"2024-09-19T14:14:18.380573+0000","last_peered":"2024-09-19T14:14:18.380573+0000","last_clean":"2024-09-19T14:14:18.380573+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:14:18.380573+0000","last_undegraded":"2024-09-19T14:14:18.380573+0000","last_fullsized":"2024-09-19T14:14:18.380573+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:13.401604+0000","last_change":"2024-09-19T13:51:15.743432+0000","last_active":"2024-09-19T14:11:13.401604+0000","last_peered":"2024-09-19T14:11:13.401604+0000","last_clean":"2024-09-19T14:11:13.401604+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:11:13.401604+0000","last_undegraded":"2024-09-19T14:11:13.401604+0000","last_fullsized":"2024-09-19T14:11:13.401604+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:33.234941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752629+0000","last_change":"2024-09-19T14:03:08.842574+0000","last_active":"2024-09-19T14:12:11.752629+0000","last_peered":"2024-09-19T14:12:11.752629+0000","last_clean":"2024-09-19T14:12:11.752629+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:12:11.752629+0000","last_undegraded":"2024-09-19T14:12:11.752629+0000","last_fullsized":"2024-09-19T14:12:11.752629+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.642788+0000","last_change":"2024-09-19T13:52:51.583284+0000","last_active":"2024-09-19T14:10:51.642788+0000","last_peered":"2024-09-19T14:10:51.642788+0000","last_clean":"2024-09-19T14:10:51.642788+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:10:51.642788+0000","last_undegraded":"2024-09-19T14:10:51.642788+0000","last_fullsized":"2024-09-19T14:10:51.642788+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:42.843357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'4","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.416786+0000","last_change":"2024-09-19T13:52:48.557637+0000","last_active":"2024-09-19T14:14:18.416786+0000","last_peered":"2024-09-19T14:14:18.416786+0000","last_clean":"2024-09-19T14:14:18.416786+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:14:18.416786+0000","last_undegraded":"2024-09-19T14:14:18.416786+0000","last_fullsized":"2024-09-19T14:14:18.416786+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.726202+0000","last_change":"2024-09-19T13:51:15.742226+0000","last_active":"2024-09-19T14:10:46.726202+0000","last_peered":"2024-09-19T14:10:46.726202+0000","last_clean":"2024-09-19T14:10:46.726202+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:10:46.726202+0000","last_undegraded":"2024-09-19T14:10:46.726202+0000","last_fullsized":"2024-09-19T14:10:46.726202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:54.177354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.618684+0000","last_change":"2024-09-19T14:03:08.836511+0000","last_active":"2024-09-19T14:12:11.618684+0000","last_peered":"2024-09-19T14:12:11.618684+0000","last_clean":"2024-09-19T14:12:11.618684+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:12:11.618684+0000","last_undegraded":"2024-09-19T14:12:11.618684+0000","last_fullsized":"2024-09-19T14:12:11.618684+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.754582+0000","last_change":"2024-09-19T13:52:51.586838+0000","last_active":"2024-09-19T14:12:26.754582+0000","last_peered":"2024-09-19T14:12:26.754582+0000","last_clean":"2024-09-19T14:12:26.754582+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:12:26.754582+0000","last_undegraded":"2024-09-19T14:12:26.754582+0000","last_fullsized":"2024-09-19T14:12:26.754582+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727446+0000","last_change":"2024-09-19T13:52:48.556403+0000","last_active":"2024-09-19T14:10:51.727446+0000","last_peered":"2024-09-19T14:10:51.727446+0000","last_clean":"2024-09-19T14:10:51.727446+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:10:51.727446+0000","last_undegraded":"2024-09-19T14:10:51.727446+0000","last_fullsized":"2024-09-19T14:10:51.727446+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:20.551373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":133,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.716860+0000","last_change":"2024-09-19T13:51:15.746021+0000","last_active":"2024-09-19T14:10:46.716860+0000","last_peered":"2024-09-19T14:10:46.716860+0000","last_clean":"2024-09-19T14:10:46.716860+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:10:46.716860+0000","last_undegraded":"2024-09-19T14:10:46.716860+0000","last_fullsized":"2024-09-19T14:10:46.716860+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:23.497158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.746520+0000","last_change":"2024-09-19T14:03:08.843561+0000","last_active":"2024-09-19T14:11:31.746520+0000","last_peered":"2024-09-19T14:11:31.746520+0000","last_clean":"2024-09-19T14:11:31.746520+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:11:31.746520+0000","last_undegraded":"2024-09-19T14:11:31.746520+0000","last_fullsized":"2024-09-19T14:11:31.746520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:24.992091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.630774+0000","last_change":"2024-09-19T13:52:51.586079+0000","last_active":"2024-09-19T14:13:46.630774+0000","last_peered":"2024-09-19T14:13:46.630774+0000","last_clean":"2024-09-19T14:13:46.630774+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:13:46.630774+0000","last_undegraded":"2024-09-19T14:13:46.630774+0000","last_fullsized":"2024-09-19T14:13:46.630774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:06.216009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.766339+0000","last_change":"2024-09-19T13:52:48.554440+0000","last_active":"2024-09-19T14:13:41.766339+0000","last_peered":"2024-09-19T14:13:41.766339+0000","last_clean":"2024-09-19T14:13:41.766339+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:13:41.766339+0000","last_undegraded":"2024-09-19T14:13:41.766339+0000","last_fullsized":"2024-09-19T14:13:41.766339+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:31.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.607300+0000","last_change":"2024-09-19T13:51:15.740499+0000","last_active":"2024-09-19T14:10:46.607300+0000","last_peered":"2024-09-19T14:10:46.607300+0000","last_clean":"2024-09-19T14:10:46.607300+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:10:46.607300+0000","last_undegraded":"2024-09-19T14:10:46.607300+0000","last_fullsized":"2024-09-19T14:10:46.607300+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:10.208746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611531+0000","last_change":"2024-09-19T14:03:08.840165+0000","last_active":"2024-09-19T14:11:31.611531+0000","last_peered":"2024-09-19T14:11:31.611531+0000","last_clean":"2024-09-19T14:11:31.611531+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:11:31.611531+0000","last_undegraded":"2024-09-19T14:11:31.611531+0000","last_fullsized":"2024-09-19T14:11:31.611531+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:26.897102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613946+0000","last_change":"2024-09-19T13:52:51.587531+0000","last_active":"2024-09-19T14:11:36.613946+0000","last_peered":"2024-09-19T14:11:36.613946+0000","last_clean":"2024-09-19T14:11:36.613946+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:11:36.613946+0000","last_undegraded":"2024-09-19T14:11:36.613946+0000","last_fullsized":"2024-09-19T14:11:36.613946+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:31.550230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.818442+0000","last_change":"2024-09-19T13:52:48.558491+0000","last_active":"2024-09-19T14:11:36.818442+0000","last_peered":"2024-09-19T14:11:36.818442+0000","last_clean":"2024-09-19T14:11:36.818442+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:11:36.818442+0000","last_undegraded":"2024-09-19T14:11:36.818442+0000","last_fullsized":"2024-09-19T14:11:36.818442+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:47.947923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.610873+0000","last_change":"2024-09-19T13:51:15.745899+0000","last_active":"2024-09-19T14:11:11.610873+0000","last_peered":"2024-09-19T14:11:11.610873+0000","last_clean":"2024-09-19T14:11:11.610873+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:11:11.610873+0000","last_undegraded":"2024-09-19T14:11:11.610873+0000","last_fullsized":"2024-09-19T14:11:11.610873+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:38.734235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645917+0000","last_change":"2024-09-19T14:03:08.834382+0000","last_active":"2024-09-19T14:11:16.645917+0000","last_peered":"2024-09-19T14:11:16.645917+0000","last_clean":"2024-09-19T14:11:16.645917+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:11:16.645917+0000","last_undegraded":"2024-09-19T14:11:16.645917+0000","last_fullsized":"2024-09-19T14:11:16.645917+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:23.550035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.423362+0000","last_change":"2024-09-19T13:52:51.587324+0000","last_active":"2024-09-19T14:14:18.423362+0000","last_peered":"2024-09-19T14:14:18.423362+0000","last_clean":"2024-09-19T14:14:18.423362+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:14:18.423362+0000","last_undegraded":"2024-09-19T14:14:18.423362+0000","last_fullsized":"2024-09-19T14:14:18.423362+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.617999+0000","last_change":"2024-09-19T13:52:48.553095+0000","last_active":"2024-09-19T14:12:21.617999+0000","last_peered":"2024-09-19T14:12:21.617999+0000","last_clean":"2024-09-19T14:12:21.617999+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:12:21.617999+0000","last_undegraded":"2024-09-19T14:12:21.617999+0000","last_fullsized":"2024-09-19T14:12:21.617999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752646+0000","last_change":"2024-09-19T13:51:15.745034+0000","last_active":"2024-09-19T14:12:11.752646+0000","last_peered":"2024-09-19T14:12:11.752646+0000","last_clean":"2024-09-19T14:12:11.752646+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:12:11.752646+0000","last_undegraded":"2024-09-19T14:12:11.752646+0000","last_fullsized":"2024-09-19T14:12:11.752646+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:23.684247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732364+0000","last_change":"2024-09-19T14:03:08.839316+0000","last_active":"2024-09-19T14:11:31.732364+0000","last_peered":"2024-09-19T14:11:31.732364+0000","last_clean":"2024-09-19T14:11:31.732364+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:11:31.732364+0000","last_undegraded":"2024-09-19T14:11:31.732364+0000","last_fullsized":"2024-09-19T14:11:31.732364+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:47.115178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.739244+0000","last_change":"2024-09-19T13:52:51.583041+0000","last_active":"2024-09-19T14:12:21.739244+0000","last_peered":"2024-09-19T14:12:21.739244+0000","last_clean":"2024-09-19T14:12:21.739244+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:12:21.739244+0000","last_undegraded":"2024-09-19T14:12:21.739244+0000","last_fullsized":"2024-09-19T14:12:21.739244+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.304410+0000","last_change":"2024-09-19T13:52:48.558143+0000","last_active":"2024-09-19T14:14:18.304410+0000","last_peered":"2024-09-19T14:14:18.304410+0000","last_clean":"2024-09-19T14:14:18.304410+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:14:18.304410+0000","last_undegraded":"2024-09-19T14:14:18.304410+0000","last_fullsized":"2024-09-19T14:14:18.304410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.652462+0000","last_change":"2024-09-19T13:51:15.746992+0000","last_active":"2024-09-19T14:12:06.652462+0000","last_peered":"2024-09-19T14:12:06.652462+0000","last_clean":"2024-09-19T14:12:06.652462+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:12:06.652462+0000","last_undegraded":"2024-09-19T14:12:06.652462+0000","last_fullsized":"2024-09-19T14:12:06.652462+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:59.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.820648+0000","last_change":"2024-09-19T14:03:08.835971+0000","last_active":"2024-09-19T14:11:51.820648+0000","last_peered":"2024-09-19T14:11:51.820648+0000","last_clean":"2024-09-19T14:11:51.820648+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:11:51.820648+0000","last_undegraded":"2024-09-19T14:11:51.820648+0000","last_fullsized":"2024-09-19T14:11:51.820648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:49.881174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648494+0000","last_change":"2024-09-19T13:52:51.582819+0000","last_active":"2024-09-19T14:11:36.648494+0000","last_peered":"2024-09-19T14:11:36.648494+0000","last_clean":"2024-09-19T14:11:36.648494+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:11:36.648494+0000","last_undegraded":"2024-09-19T14:11:36.648494+0000","last_fullsized":"2024-09-19T14:11:36.648494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:43.290667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.741650+0000","last_change":"2024-09-19T13:52:48.556826+0000","last_active":"2024-09-19T14:10:56.741650+0000","last_peered":"2024-09-19T14:10:56.741650+0000","last_clean":"2024-09-19T14:10:56.741650+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:10:56.741650+0000","last_undegraded":"2024-09-19T14:10:56.741650+0000","last_fullsized":"2024-09-19T14:10:56.741650+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:39.933207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.616079+0000","last_change":"2024-09-19T13:51:15.742662+0000","last_active":"2024-09-19T14:12:06.616079+0000","last_peered":"2024-09-19T14:12:06.616079+0000","last_clean":"2024-09-19T14:12:06.616079+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:12:06.616079+0000","last_undegraded":"2024-09-19T14:12:06.616079+0000","last_fullsized":"2024-09-19T14:12:06.616079+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:47.205807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.616208+0000","last_change":"2024-09-19T14:03:08.837483+0000","last_active":"2024-09-19T14:11:51.616208+0000","last_peered":"2024-09-19T14:11:51.616208+0000","last_clean":"2024-09-19T14:11:51.616208+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:11:51.616208+0000","last_undegraded":"2024-09-19T14:11:51.616208+0000","last_fullsized":"2024-09-19T14:11:51.616208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:43.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.607103+0000","last_change":"2024-09-19T13:52:51.582481+0000","last_active":"2024-09-19T14:10:56.607103+0000","last_peered":"2024-09-19T14:10:56.607103+0000","last_clean":"2024-09-19T14:10:56.607103+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:10:56.607103+0000","last_undegraded":"2024-09-19T14:10:56.607103+0000","last_fullsized":"2024-09-19T14:10:56.607103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.118790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747273+0000","last_change":"2024-09-19T13:52:48.558237+0000","last_active":"2024-09-19T14:11:36.747273+0000","last_peered":"2024-09-19T14:11:36.747273+0000","last_clean":"2024-09-19T14:11:36.747273+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:11:36.747273+0000","last_undegraded":"2024-09-19T14:11:36.747273+0000","last_fullsized":"2024-09-19T14:11:36.747273+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:14.742516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.737132+0000","last_change":"2024-09-19T13:51:15.739439+0000","last_active":"2024-09-19T14:12:06.737132+0000","last_peered":"2024-09-19T14:12:06.737132+0000","last_clean":"2024-09-19T14:12:06.737132+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:12:06.737132+0000","last_undegraded":"2024-09-19T14:12:06.737132+0000","last_fullsized":"2024-09-19T14:12:06.737132+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:29.476267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613161+0000","last_change":"2024-09-19T14:03:08.843652+0000","last_active":"2024-09-19T14:11:31.613161+0000","last_peered":"2024-09-19T14:11:31.613161+0000","last_clean":"2024-09-19T14:11:31.613161+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:11:31.613161+0000","last_undegraded":"2024-09-19T14:11:31.613161+0000","last_fullsized":"2024-09-19T14:11:31.613161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:18.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'7","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.740798+0000","last_change":"2024-09-19T13:52:51.584999+0000","last_active":"2024-09-19T14:13:41.740798+0000","last_peered":"2024-09-19T14:13:41.740798+0000","last_clean":"2024-09-19T14:13:41.740798+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:13:41.740798+0000","last_undegraded":"2024-09-19T14:13:41.740798+0000","last_fullsized":"2024-09-19T14:13:41.740798+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:06.878095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.648525+0000","last_change":"2024-09-19T13:52:48.554967+0000","last_active":"2024-09-19T14:11:36.648525+0000","last_peered":"2024-09-19T14:11:36.648525+0000","last_clean":"2024-09-19T14:11:36.648525+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:11:36.648525+0000","last_undegraded":"2024-09-19T14:11:36.648525+0000","last_fullsized":"2024-09-19T14:11:36.648525+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:11.689955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.726954+0000","last_change":"2024-09-19T13:51:15.746342+0000","last_active":"2024-09-19T14:12:06.726954+0000","last_peered":"2024-09-19T14:12:06.726954+0000","last_clean":"2024-09-19T14:12:06.726954+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:12:06.726954+0000","last_undegraded":"2024-09-19T14:12:06.726954+0000","last_fullsized":"2024-09-19T14:12:06.726954+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:44.550078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747359+0000","last_change":"2024-09-19T14:03:08.842987+0000","last_active":"2024-09-19T14:11:36.747359+0000","last_peered":"2024-09-19T14:11:36.747359+0000","last_clean":"2024-09-19T14:11:36.747359+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:11:36.747359+0000","last_undegraded":"2024-09-19T14:11:36.747359+0000","last_fullsized":"2024-09-19T14:11:36.747359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:51.898754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.282359+0000","last_change":"2024-09-19T13:52:51.581838+0000","last_active":"2024-09-19T14:14:18.282359+0000","last_peered":"2024-09-19T14:14:18.282359+0000","last_clean":"2024-09-19T14:14:18.282359+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:14:18.282359+0000","last_undegraded":"2024-09-19T14:14:18.282359+0000","last_fullsized":"2024-09-19T14:14:18.282359+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:20.245214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":214,"num_write":4,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723307+0000","last_change":"2024-09-19T13:52:48.546981+0000","last_active":"2024-09-19T14:11:36.723307+0000","last_peered":"2024-09-19T14:11:36.723307+0000","last_clean":"2024-09-19T14:11:36.723307+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:11:36.723307+0000","last_undegraded":"2024-09-19T14:11:36.723307+0000","last_fullsized":"2024-09-19T14:11:36.723307+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:09.807617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:22.748475+0000","last_change":"2024-09-19T13:51:15.745532+0000","last_active":"2024-09-19T14:11:22.748475+0000","last_peered":"2024-09-19T14:11:22.748475+0000","last_clean":"2024-09-19T14:11:22.748475+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:11:22.748475+0000","last_undegraded":"2024-09-19T14:11:22.748475+0000","last_fullsized":"2024-09-19T14:11:22.748475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:14.528177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'198","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.123580+0000","last_change":"2024-09-19T14:14:37.123580+0000","last_active":"2024-09-19T14:14:37.123580+0000","last_peered":"2024-09-19T14:14:37.123580+0000","last_clean":"2024-09-19T14:14:37.123580+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:14:37.123580+0000","last_undegraded":"2024-09-19T14:14:37.123580+0000","last_fullsized":"2024-09-19T14:14:37.123580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.123480+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:59.204973+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":14767,"num_write":959,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'808","reported_seq":2383,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544116+0000","last_change":"2024-09-19T13:36:09.334352+0000","last_active":"2024-09-19T14:12:15.544116+0000","last_peered":"2024-09-19T14:12:15.544116+0000","last_clean":"2024-09-19T14:12:15.544116+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:12:15.544116+0000","last_undegraded":"2024-09-19T14:12:15.544116+0000","last_fullsized":"2024-09-19T14:12:15.544116+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:03.775963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'195","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.326367+0000","last_change":"2024-09-19T14:14:29.326367+0000","last_active":"2024-09-19T14:14:29.326367+0000","last_peered":"2024-09-19T14:14:29.326367+0000","last_clean":"2024-09-19T14:14:29.326367+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:14:29.326367+0000","last_undegraded":"2024-09-19T14:14:29.326367+0000","last_fullsized":"2024-09-19T14:14:29.326367+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.326239+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:00.504896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":5759,"num_write":878,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'702","reported_seq":2398,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.246546+0000","last_change":"2024-09-19T14:14:41.246546+0000","last_active":"2024-09-19T14:14:41.246546+0000","last_peered":"2024-09-19T14:14:41.246546+0000","last_clean":"2024-09-19T14:14:41.246546+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:14:41.246546+0000","last_undegraded":"2024-09-19T14:14:41.246546+0000","last_fullsized":"2024-09-19T14:14:41.246546+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'702","last_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_deep_scrub":"260'702","last_deep_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.246453+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:35.785088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'225","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.292915+0000","last_change":"2024-09-19T14:14:32.292915+0000","last_active":"2024-09-19T14:14:32.292915+0000","last_peered":"2024-09-19T14:14:32.292915+0000","last_clean":"2024-09-19T14:14:32.292915+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:14:32.292915+0000","last_undegraded":"2024-09-19T14:14:32.292915+0000","last_fullsized":"2024-09-19T14:14:32.292915+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.292807+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:56.116597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":12221,"num_write":1127,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'389","reported_seq":1859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:20.260118+0000","last_change":"2024-09-19T13:36:09.331848+0000","last_active":"2024-09-19T14:12:20.260118+0000","last_peered":"2024-09-19T14:12:20.260118+0000","last_clean":"2024-09-19T14:12:20.260118+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:12:20.260118+0000","last_undegraded":"2024-09-19T14:12:20.260118+0000","last_fullsized":"2024-09-19T14:12:20.260118+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:25:24.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'225","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.804464+0000","last_change":"2024-09-19T14:14:36.804464+0000","last_active":"2024-09-19T14:14:36.804464+0000","last_peered":"2024-09-19T14:14:36.804464+0000","last_clean":"2024-09-19T14:14:36.804464+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:14:36.804464+0000","last_undegraded":"2024-09-19T14:14:36.804464+0000","last_fullsized":"2024-09-19T14:14:36.804464+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.804346+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:50.761130+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311660,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":9100,"num_write":1128,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'994","reported_seq":2647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.190516+0000","last_change":"2024-09-19T14:14:40.190516+0000","last_active":"2024-09-19T14:14:40.190516+0000","last_peered":"2024-09-19T14:14:40.190516+0000","last_clean":"2024-09-19T14:14:40.190516+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:14:40.190516+0000","last_undegraded":"2024-09-19T14:14:40.190516+0000","last_fullsized":"2024-09-19T14:14:40.190516+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'994","last_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_deep_scrub":"260'994","last_deep_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.190428+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:54.056506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'203","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.089410+0000","last_change":"2024-09-19T14:14:36.089410+0000","last_active":"2024-09-19T14:14:36.089410+0000","last_peered":"2024-09-19T14:14:36.089410+0000","last_clean":"2024-09-19T14:14:36.089410+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:14:36.089410+0000","last_undegraded":"2024-09-19T14:14:36.089410+0000","last_fullsized":"2024-09-19T14:14:36.089410+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.089313+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:07.911503+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":762,"num_read_kb":134002,"num_write":945,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'559","reported_seq":2312,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.131013+0000","last_change":"2024-09-19T14:14:36.131013+0000","last_active":"2024-09-19T14:14:36.131013+0000","last_peered":"2024-09-19T14:14:36.131013+0000","last_clean":"2024-09-19T14:14:36.131013+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:14:36.131013+0000","last_undegraded":"2024-09-19T14:14:36.131013+0000","last_fullsized":"2024-09-19T14:14:36.131013+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.130918+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.095702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'193","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.782781+0000","last_change":"2024-09-19T14:14:35.782781+0000","last_active":"2024-09-19T14:14:35.782781+0000","last_peered":"2024-09-19T14:14:35.782781+0000","last_clean":"2024-09-19T14:14:35.782781+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:14:35.782781+0000","last_undegraded":"2024-09-19T14:14:35.782781+0000","last_fullsized":"2024-09-19T14:14:35.782781+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.782688+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.990734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":377,"num_write":871,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'835","reported_seq":2442,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.544277+0000","last_change":"2024-09-19T13:36:09.333458+0000","last_active":"2024-09-19T14:12:15.544277+0000","last_peered":"2024-09-19T14:12:15.544277+0000","last_clean":"2024-09-19T14:12:15.544277+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:12:15.544277+0000","last_undegraded":"2024-09-19T14:12:15.544277+0000","last_fullsized":"2024-09-19T14:12:15.544277+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:16.936303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'192","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.091489+0000","last_change":"2024-09-19T14:14:35.091489+0000","last_active":"2024-09-19T14:14:35.091489+0000","last_peered":"2024-09-19T14:14:35.091489+0000","last_clean":"2024-09-19T14:14:35.091489+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:14:35.091489+0000","last_undegraded":"2024-09-19T14:14:35.091489+0000","last_fullsized":"2024-09-19T14:14:35.091489+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'192","last_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_deep_scrub":"260'192","last_deep_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.091359+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:04.394433+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":7782,"num_write":893,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'502","reported_seq":2283,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.226009+0000","last_change":"2024-09-19T13:36:09.343477+0000","last_active":"2024-09-19T14:12:13.226009+0000","last_peered":"2024-09-19T14:12:13.226009+0000","last_clean":"2024-09-19T14:12:13.226009+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:12:13.226009+0000","last_undegraded":"2024-09-19T14:12:13.226009+0000","last_fullsized":"2024-09-19T14:12:13.226009+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:46.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'196","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.298383+0000","last_change":"2024-09-19T14:14:32.298383+0000","last_active":"2024-09-19T14:14:32.298383+0000","last_peered":"2024-09-19T14:14:32.298383+0000","last_clean":"2024-09-19T14:14:32.298383+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:14:32.298383+0000","last_undegraded":"2024-09-19T14:14:32.298383+0000","last_fullsized":"2024-09-19T14:14:32.298383+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.298282+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:47.257623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1090,"num_read_kb":38780,"num_write":956,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'844","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.151176+0000","last_change":"2024-09-19T14:14:32.151176+0000","last_active":"2024-09-19T14:14:32.151176+0000","last_peered":"2024-09-19T14:14:32.151176+0000","last_clean":"2024-09-19T14:14:32.151176+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:14:32.151176+0000","last_undegraded":"2024-09-19T14:14:32.151176+0000","last_fullsized":"2024-09-19T14:14:32.151176+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.151071+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:53:10.742546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'554","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.736290+0000","last_change":"2024-09-19T14:14:41.736290+0000","last_active":"2024-09-19T14:14:41.736290+0000","last_peered":"2024-09-19T14:14:41.736290+0000","last_clean":"2024-09-19T14:14:41.736290+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:14:41.736290+0000","last_undegraded":"2024-09-19T14:14:41.736290+0000","last_fullsized":"2024-09-19T14:14:41.736290+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'554","last_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_deep_scrub":"260'554","last_deep_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.736205+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:58.060707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'193","reported_seq":806,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.105113+0000","last_change":"2024-09-19T14:14:34.105113+0000","last_active":"2024-09-19T14:14:34.105113+0000","last_peered":"2024-09-19T14:14:34.105113+0000","last_clean":"2024-09-19T14:14:34.105113+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:14:34.105113+0000","last_undegraded":"2024-09-19T14:14:34.105113+0000","last_fullsized":"2024-09-19T14:14:34.105113+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.105025+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:38.487293+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":11511,"num_write":896,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'383","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.214409+0000","last_change":"2024-09-19T14:14:40.214409+0000","last_active":"2024-09-19T14:14:40.214409+0000","last_peered":"2024-09-19T14:14:40.214409+0000","last_clean":"2024-09-19T14:14:40.214409+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:14:40.214409+0000","last_undegraded":"2024-09-19T14:14:40.214409+0000","last_fullsized":"2024-09-19T14:14:40.214409+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.214311+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:37:14.302323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'197","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.132624+0000","last_change":"2024-09-19T14:14:32.132624+0000","last_active":"2024-09-19T14:14:32.132624+0000","last_peered":"2024-09-19T14:14:32.132624+0000","last_clean":"2024-09-19T14:14:32.132624+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:14:32.132624+0000","last_undegraded":"2024-09-19T14:14:32.132624+0000","last_fullsized":"2024-09-19T14:14:32.132624+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.132498+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:29.891589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":26719,"num_write":915,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'559","reported_seq":2190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.704483+0000","last_change":"2024-09-19T14:14:40.704483+0000","last_active":"2024-09-19T14:14:40.704483+0000","last_peered":"2024-09-19T14:14:40.704483+0000","last_clean":"2024-09-19T14:14:40.704483+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:14:40.704483+0000","last_undegraded":"2024-09-19T14:14:40.704483+0000","last_fullsized":"2024-09-19T14:14:40.704483+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.704381+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:12.312285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'227","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.161690+0000","last_change":"2024-09-19T14:14:30.161690+0000","last_active":"2024-09-19T14:14:30.161690+0000","last_peered":"2024-09-19T14:14:30.161690+0000","last_clean":"2024-09-19T14:14:30.161690+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:14:30.161690+0000","last_undegraded":"2024-09-19T14:14:30.161690+0000","last_fullsized":"2024-09-19T14:14:30.161690+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'227","last_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_deep_scrub":"260'227","last_deep_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.161577+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:19.848076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":629,"num_read_kb":31855,"num_write":1145,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'379","reported_seq":1918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.163058+0000","last_change":"2024-09-19T14:14:30.163058+0000","last_active":"2024-09-19T14:14:30.163058+0000","last_peered":"2024-09-19T14:14:30.163058+0000","last_clean":"2024-09-19T14:14:30.163058+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:14:30.163058+0000","last_undegraded":"2024-09-19T14:14:30.163058+0000","last_fullsized":"2024-09-19T14:14:30.163058+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.162974+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:37.556799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'206","reported_seq":855,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.663692+0000","last_change":"2024-09-19T14:14:27.663692+0000","last_active":"2024-09-19T14:14:27.663692+0000","last_peered":"2024-09-19T14:14:27.663692+0000","last_clean":"2024-09-19T14:14:27.663692+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:14:27.663692+0000","last_undegraded":"2024-09-19T14:14:27.663692+0000","last_fullsized":"2024-09-19T14:14:27.663692+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.663598+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:54:59.757452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":49502,"num_write":988,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'394","reported_seq":2007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.172225+0000","last_change":"2024-09-19T14:14:31.172225+0000","last_active":"2024-09-19T14:14:31.172225+0000","last_peered":"2024-09-19T14:14:31.172225+0000","last_clean":"2024-09-19T14:14:31.172225+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:14:31.172225+0000","last_undegraded":"2024-09-19T14:14:31.172225+0000","last_fullsized":"2024-09-19T14:14:31.172225+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'394","last_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_deep_scrub":"260'394","last_deep_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.172124+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:59.034171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'195","reported_seq":882,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.310078+0000","last_change":"2024-09-19T14:14:31.310078+0000","last_active":"2024-09-19T14:14:31.310078+0000","last_peered":"2024-09-19T14:14:31.310078+0000","last_clean":"2024-09-19T14:14:31.310078+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:14:31.310078+0000","last_undegraded":"2024-09-19T14:14:31.310078+0000","last_fullsized":"2024-09-19T14:14:31.310078+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.309994+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:02.549578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145924,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":176003,"num_write":888,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'910","reported_seq":2614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.755059+0000","last_change":"2024-09-19T14:14:40.755059+0000","last_active":"2024-09-19T14:14:40.755059+0000","last_peered":"2024-09-19T14:14:40.755059+0000","last_clean":"2024-09-19T14:14:40.755059+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:14:40.755059+0000","last_undegraded":"2024-09-19T14:14:40.755059+0000","last_fullsized":"2024-09-19T14:14:40.755059+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'910","last_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_deep_scrub":"260'910","last_deep_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.754973+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:03.252154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.263121+0000","last_change":"2024-09-19T14:14:30.263121+0000","last_active":"2024-09-19T14:14:30.263121+0000","last_peered":"2024-09-19T14:14:30.263121+0000","last_clean":"2024-09-19T14:14:30.263121+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:14:30.263121+0000","last_undegraded":"2024-09-19T14:14:30.263121+0000","last_fullsized":"2024-09-19T14:14:30.263121+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.263019+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:26.635817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":112164,"num_write":1137,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'136","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.817689+0000","last_change":"2024-09-19T13:36:17.363690+0000","last_active":"2024-09-19T14:12:27.817689+0000","last_peered":"2024-09-19T14:12:27.817689+0000","last_clean":"2024-09-19T14:12:27.817689+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:12:27.817689+0000","last_undegraded":"2024-09-19T14:12:27.817689+0000","last_fullsized":"2024-09-19T14:12:27.817689+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:29.851738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'819","reported_seq":2323,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.328941+0000","last_change":"2024-09-19T14:14:36.328941+0000","last_active":"2024-09-19T14:14:36.328941+0000","last_peered":"2024-09-19T14:14:36.328941+0000","last_clean":"2024-09-19T14:14:36.328941+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:14:36.328941+0000","last_undegraded":"2024-09-19T14:14:36.328941+0000","last_fullsized":"2024-09-19T14:14:36.328941+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'819","last_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_deep_scrub":"260'819","last_deep_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.328841+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:46.293758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'177","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.117409+0000","last_change":"2024-09-19T14:14:31.117409+0000","last_active":"2024-09-19T14:14:31.117409+0000","last_peered":"2024-09-19T14:14:31.117409+0000","last_clean":"2024-09-19T14:14:31.117409+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:14:31.117409+0000","last_undegraded":"2024-09-19T14:14:31.117409+0000","last_fullsized":"2024-09-19T14:14:31.117409+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.117313+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:40.698859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":47147,"num_write":844,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599370+0000","last_change":"2024-09-19T13:36:11.340404+0000","last_active":"2024-09-19T14:10:01.599370+0000","last_peered":"2024-09-19T14:10:01.599370+0000","last_clean":"2024-09-19T14:10:01.599370+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:10:01.599370+0000","last_undegraded":"2024-09-19T14:10:01.599370+0000","last_fullsized":"2024-09-19T14:10:01.599370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:03.755867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'194","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.405263+0000","last_change":"2024-09-19T13:36:13.346842+0000","last_active":"2024-09-19T14:14:18.405263+0000","last_peered":"2024-09-19T14:14:18.405263+0000","last_clean":"2024-09-19T14:14:18.405263+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:14:18.405263+0000","last_undegraded":"2024-09-19T14:14:18.405263+0000","last_fullsized":"2024-09-19T14:14:18.405263+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:09.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":375,"num_write":156,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.733994+0000","last_change":"2024-09-19T13:36:15.353039+0000","last_active":"2024-09-19T14:10:06.733994+0000","last_peered":"2024-09-19T14:10:06.733994+0000","last_clean":"2024-09-19T14:10:06.733994+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:10:06.733994+0000","last_undegraded":"2024-09-19T14:10:06.733994+0000","last_fullsized":"2024-09-19T14:10:06.733994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:40.506433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2504","reported_seq":4316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.251946+0000","last_change":"2024-09-19T13:36:17.362187+0000","last_active":"2024-09-19T14:12:26.251946+0000","last_peered":"2024-09-19T14:12:26.251946+0000","last_clean":"2024-09-19T14:12:26.251946+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:12:26.251946+0000","last_undegraded":"2024-09-19T14:12:26.251946+0000","last_fullsized":"2024-09-19T14:12:26.251946+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:08.218008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'479","reported_seq":2128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.773810+0000","last_change":"2024-09-19T14:14:37.773810+0000","last_active":"2024-09-19T14:14:37.773810+0000","last_peered":"2024-09-19T14:14:37.773810+0000","last_clean":"2024-09-19T14:14:37.773810+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:14:37.773810+0000","last_undegraded":"2024-09-19T14:14:37.773810+0000","last_fullsized":"2024-09-19T14:14:37.773810+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'479","last_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_deep_scrub":"260'479","last_deep_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.773706+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:04.083276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'172","reported_seq":757,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.319675+0000","last_change":"2024-09-19T14:14:24.319675+0000","last_active":"2024-09-19T14:14:24.319675+0000","last_peered":"2024-09-19T14:14:24.319675+0000","last_clean":"2024-09-19T14:14:24.319675+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:14:24.319675+0000","last_undegraded":"2024-09-19T14:14:24.319675+0000","last_fullsized":"2024-09-19T14:14:24.319675+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'172","last_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_deep_scrub":"260'172","last_deep_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.319605+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:56.937149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":371,"num_read_kb":36151,"num_write":775,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730615+0000","last_change":"2024-09-19T13:36:11.336313+0000","last_active":"2024-09-19T14:11:16.730615+0000","last_peered":"2024-09-19T14:11:16.730615+0000","last_clean":"2024-09-19T14:11:16.730615+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:11:16.730615+0000","last_undegraded":"2024-09-19T14:11:16.730615+0000","last_fullsized":"2024-09-19T14:11:16.730615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:33.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'78","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.395391+0000","last_change":"2024-09-19T13:36:13.337644+0000","last_active":"2024-09-19T14:12:14.395391+0000","last_peered":"2024-09-19T14:12:14.395391+0000","last_clean":"2024-09-19T14:12:14.395391+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:12:14.395391+0000","last_undegraded":"2024-09-19T14:12:14.395391+0000","last_fullsized":"2024-09-19T14:12:14.395391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.720756+0000","last_change":"2024-09-19T13:36:15.349335+0000","last_active":"2024-09-19T14:10:06.720756+0000","last_peered":"2024-09-19T14:10:06.720756+0000","last_clean":"2024-09-19T14:10:06.720756+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:10:06.720756+0000","last_undegraded":"2024-09-19T14:10:06.720756+0000","last_fullsized":"2024-09-19T14:10:06.720756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:03.785626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'134","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.878009+0000","last_change":"2024-09-19T13:36:17.360523+0000","last_active":"2024-09-19T14:12:15.878009+0000","last_peered":"2024-09-19T14:12:15.878009+0000","last_clean":"2024-09-19T14:12:15.878009+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:12:15.878009+0000","last_undegraded":"2024-09-19T14:12:15.878009+0000","last_fullsized":"2024-09-19T14:12:15.878009+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:18.406844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'837","reported_seq":2519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.219848+0000","last_change":"2024-09-19T14:14:35.219848+0000","last_active":"2024-09-19T14:14:35.219848+0000","last_peered":"2024-09-19T14:14:35.219848+0000","last_clean":"2024-09-19T14:14:35.219848+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:14:35.219848+0000","last_undegraded":"2024-09-19T14:14:35.219848+0000","last_fullsized":"2024-09-19T14:14:35.219848+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'837","last_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_deep_scrub":"260'837","last_deep_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.219760+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:28.048778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'169","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.152624+0000","last_change":"2024-09-19T14:14:29.152624+0000","last_active":"2024-09-19T14:14:29.152624+0000","last_peered":"2024-09-19T14:14:29.152624+0000","last_clean":"2024-09-19T14:14:29.152624+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:14:29.152624+0000","last_undegraded":"2024-09-19T14:14:29.152624+0000","last_fullsized":"2024-09-19T14:14:29.152624+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'169","last_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_deep_scrub":"260'169","last_deep_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.152542+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:24.812263+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":63998,"num_write":820,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719618+0000","last_change":"2024-09-19T13:36:11.337174+0000","last_active":"2024-09-19T14:10:01.719618+0000","last_peered":"2024-09-19T14:10:01.719618+0000","last_clean":"2024-09-19T14:10:01.719618+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:10:01.719618+0000","last_undegraded":"2024-09-19T14:10:01.719618+0000","last_fullsized":"2024-09-19T14:10:01.719618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:56.806199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'109","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.063068+0000","last_change":"2024-09-19T14:14:38.063068+0000","last_active":"2024-09-19T14:14:38.063068+0000","last_peered":"2024-09-19T14:14:38.063068+0000","last_clean":"2024-09-19T14:14:38.063068+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:14:38.063068+0000","last_undegraded":"2024-09-19T14:14:38.063068+0000","last_fullsized":"2024-09-19T14:14:38.063068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.062968+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:05.291095+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'763","reported_seq":2065,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.209679+0000","last_change":"2024-09-19T13:36:15.353722+0000","last_active":"2024-09-19T14:14:18.209679+0000","last_peered":"2024-09-19T14:14:18.209679+0000","last_clean":"2024-09-19T14:14:18.209679+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:14:18.209679+0000","last_undegraded":"2024-09-19T14:14:18.209679+0000","last_fullsized":"2024-09-19T14:14:18.209679+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:26.683896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'275","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.861063+0000","last_change":"2024-09-19T13:36:17.362162+0000","last_active":"2024-09-19T14:12:27.861063+0000","last_peered":"2024-09-19T14:12:27.861063+0000","last_clean":"2024-09-19T14:12:27.861063+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:12:27.861063+0000","last_undegraded":"2024-09-19T14:12:27.861063+0000","last_fullsized":"2024-09-19T14:12:27.861063+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:30.698621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'432","reported_seq":1988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.369783+0000","last_change":"2024-09-19T14:14:37.369783+0000","last_active":"2024-09-19T14:14:37.369783+0000","last_peered":"2024-09-19T14:14:37.369783+0000","last_clean":"2024-09-19T14:14:37.369783+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:14:37.369783+0000","last_undegraded":"2024-09-19T14:14:37.369783+0000","last_fullsized":"2024-09-19T14:14:37.369783+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.369664+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:53.882937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.095470+0000","last_change":"2024-09-19T14:14:26.095470+0000","last_active":"2024-09-19T14:14:26.095470+0000","last_peered":"2024-09-19T14:14:26.095470+0000","last_clean":"2024-09-19T14:14:26.095470+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:14:26.095470+0000","last_undegraded":"2024-09-19T14:14:26.095470+0000","last_fullsized":"2024-09-19T14:14:26.095470+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'185","last_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_deep_scrub":"260'185","last_deep_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.095355+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:16.399362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":22529,"num_write":874,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.599419+0000","last_change":"2024-09-19T13:36:11.335988+0000","last_active":"2024-09-19T14:10:01.599419+0000","last_peered":"2024-09-19T14:10:01.599419+0000","last_clean":"2024-09-19T14:10:01.599419+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:10:01.599419+0000","last_undegraded":"2024-09-19T14:10:01.599419+0000","last_fullsized":"2024-09-19T14:10:01.599419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:16.563649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'115","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.366930+0000","last_change":"2024-09-19T13:36:13.678694+0000","last_active":"2024-09-19T14:14:18.366930+0000","last_peered":"2024-09-19T14:14:18.366930+0000","last_clean":"2024-09-19T14:14:18.366930+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:14:18.366930+0000","last_undegraded":"2024-09-19T14:14:18.366930+0000","last_fullsized":"2024-09-19T14:14:18.366930+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:47.972067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":261,"num_write":92,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'795","reported_seq":2166,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.448202+0000","last_change":"2024-09-19T13:36:15.347048+0000","last_active":"2024-09-19T14:14:18.448202+0000","last_peered":"2024-09-19T14:14:18.448202+0000","last_clean":"2024-09-19T14:14:18.448202+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:14:18.448202+0000","last_undegraded":"2024-09-19T14:14:18.448202+0000","last_fullsized":"2024-09-19T14:14:18.448202+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:55.442266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'452","reported_seq":2032,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.750189+0000","last_change":"2024-09-19T14:14:38.750189+0000","last_active":"2024-09-19T14:14:38.750189+0000","last_peered":"2024-09-19T14:14:38.750189+0000","last_clean":"2024-09-19T14:14:38.750189+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:14:38.750189+0000","last_undegraded":"2024-09-19T14:14:38.750189+0000","last_fullsized":"2024-09-19T14:14:38.750189+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'452","last_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_deep_scrub":"260'452","last_deep_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.750102+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:49.925244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'243","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.150348+0000","last_change":"2024-09-19T14:14:28.150279+0000","last_active":"2024-09-19T14:14:28.150348+0000","last_peered":"2024-09-19T14:14:28.150348+0000","last_clean":"2024-09-19T14:14:28.150348+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:14:28.150348+0000","last_undegraded":"2024-09-19T14:14:28.150348+0000","last_fullsized":"2024-09-19T14:14:28.150348+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'243","last_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_deep_scrub":"260'243","last_deep_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.150184+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:23.391140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":46832,"num_write":1033,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.740936+0000","last_change":"2024-09-19T13:36:11.332976+0000","last_active":"2024-09-19T14:10:51.740936+0000","last_peered":"2024-09-19T14:10:51.740936+0000","last_clean":"2024-09-19T14:10:51.740936+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:10:51.740936+0000","last_undegraded":"2024-09-19T14:10:51.740936+0000","last_fullsized":"2024-09-19T14:10:51.740936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:44.306927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'189","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.431333+0000","last_change":"2024-09-19T13:36:13.679868+0000","last_active":"2024-09-19T14:14:18.431333+0000","last_peered":"2024-09-19T14:14:18.431333+0000","last_clean":"2024-09-19T14:14:18.431333+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:14:18.431333+0000","last_undegraded":"2024-09-19T14:14:18.431333+0000","last_fullsized":"2024-09-19T14:14:18.431333+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:05.662964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":253,"num_read_kb":317,"num_write":142,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.653450+0000","last_change":"2024-09-19T13:36:15.351051+0000","last_active":"2024-09-19T14:12:16.653450+0000","last_peered":"2024-09-19T14:12:16.653450+0000","last_clean":"2024-09-19T14:12:16.653450+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:12:16.653450+0000","last_undegraded":"2024-09-19T14:12:16.653450+0000","last_fullsized":"2024-09-19T14:12:16.653450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'538","reported_seq":1352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.036523+0000","last_change":"2024-09-19T13:36:17.360774+0000","last_active":"2024-09-19T14:13:47.036523+0000","last_peered":"2024-09-19T14:13:47.036523+0000","last_clean":"2024-09-19T14:13:47.036523+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:13:47.036523+0000","last_undegraded":"2024-09-19T14:13:47.036523+0000","last_fullsized":"2024-09-19T14:13:47.036523+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:16.458211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2066,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.703272+0000","last_change":"2024-09-19T14:14:29.703272+0000","last_active":"2024-09-19T14:14:29.703272+0000","last_peered":"2024-09-19T14:14:29.703272+0000","last_clean":"2024-09-19T14:14:29.703272+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:14:29.703272+0000","last_undegraded":"2024-09-19T14:14:29.703272+0000","last_fullsized":"2024-09-19T14:14:29.703272+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'477","last_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_deep_scrub":"260'477","last_deep_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.703144+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:43.741727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'207","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.084574+0000","last_change":"2024-09-19T14:14:26.084488+0000","last_active":"2024-09-19T14:14:26.084574+0000","last_peered":"2024-09-19T14:14:26.084574+0000","last_clean":"2024-09-19T14:14:26.084574+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:14:26.084574+0000","last_undegraded":"2024-09-19T14:14:26.084574+0000","last_fullsized":"2024-09-19T14:14:26.084574+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'207","last_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_deep_scrub":"260'207","last_deep_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.084345+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:14.683841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":31454,"num_write":896,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"260'4","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.082578+0000","last_change":"2024-09-19T14:14:34.082578+0000","last_active":"2024-09-19T14:14:34.082578+0000","last_peered":"2024-09-19T14:14:34.082578+0000","last_clean":"2024-09-19T14:14:34.082578+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:14:34.082578+0000","last_undegraded":"2024-09-19T14:14:34.082578+0000","last_fullsized":"2024-09-19T14:14:34.082578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.082477+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:29.861443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'126","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.284916+0000","last_change":"2024-09-19T13:36:13.346402+0000","last_active":"2024-09-19T14:14:18.284916+0000","last_peered":"2024-09-19T14:14:18.284916+0000","last_clean":"2024-09-19T14:14:18.284916+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:14:18.284916+0000","last_undegraded":"2024-09-19T14:14:18.284916+0000","last_fullsized":"2024-09-19T14:14:18.284916+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10667,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:01.728430+0000","last_change":"2024-09-19T13:36:15.346352+0000","last_active":"2024-09-19T14:11:01.728430+0000","last_peered":"2024-09-19T14:11:01.728430+0000","last_clean":"2024-09-19T14:11:01.728430+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:11:01.728430+0000","last_undegraded":"2024-09-19T14:11:01.728430+0000","last_fullsized":"2024-09-19T14:11:01.728430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:31.554437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'173","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.844081+0000","last_change":"2024-09-19T13:36:17.360996+0000","last_active":"2024-09-19T14:13:36.844081+0000","last_peered":"2024-09-19T14:13:36.844081+0000","last_clean":"2024-09-19T14:13:36.844081+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:13:36.844081+0000","last_undegraded":"2024-09-19T14:13:36.844081+0000","last_fullsized":"2024-09-19T14:13:36.844081+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:40.718784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'344","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.128335+0000","last_change":"2024-09-19T14:14:34.128335+0000","last_active":"2024-09-19T14:14:34.128335+0000","last_peered":"2024-09-19T14:14:34.128335+0000","last_clean":"2024-09-19T14:14:34.128335+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:14:34.128335+0000","last_undegraded":"2024-09-19T14:14:34.128335+0000","last_fullsized":"2024-09-19T14:14:34.128335+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'344","last_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_deep_scrub":"260'344","last_deep_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.128247+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:06.144660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'241","reported_seq":1073,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.069250+0000","last_change":"2024-09-19T14:14:32.069250+0000","last_active":"2024-09-19T14:14:32.069250+0000","last_peered":"2024-09-19T14:14:32.069250+0000","last_clean":"2024-09-19T14:14:32.069250+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:14:32.069250+0000","last_undegraded":"2024-09-19T14:14:32.069250+0000","last_fullsized":"2024-09-19T14:14:32.069250+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.069155+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:39.354526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":168929,"num_write":1052,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.087218+0000","last_change":"2024-09-19T14:14:36.087218+0000","last_active":"2024-09-19T14:14:36.087218+0000","last_peered":"2024-09-19T14:14:36.087218+0000","last_clean":"2024-09-19T14:14:36.087218+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:14:36.087218+0000","last_undegraded":"2024-09-19T14:14:36.087218+0000","last_fullsized":"2024-09-19T14:14:36.087218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.087119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:15.398847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'160","reported_seq":729,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.440727+0000","last_change":"2024-09-19T13:36:13.348257+0000","last_active":"2024-09-19T14:14:18.440727+0000","last_peered":"2024-09-19T14:14:18.440727+0000","last_clean":"2024-09-19T14:14:18.440727+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:14:18.440727+0000","last_undegraded":"2024-09-19T14:14:18.440727+0000","last_fullsized":"2024-09-19T14:14:18.440727+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:53.776403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":189,"num_read_kb":233,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'804","reported_seq":2358,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.214902+0000","last_change":"2024-09-19T13:36:15.347632+0000","last_active":"2024-09-19T14:14:18.214902+0000","last_peered":"2024-09-19T14:14:18.214902+0000","last_clean":"2024-09-19T14:14:18.214902+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:14:18.214902+0000","last_undegraded":"2024-09-19T14:14:18.214902+0000","last_fullsized":"2024-09-19T14:14:18.214902+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:07.500173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.860638+0000","last_change":"2024-09-19T13:36:17.360696+0000","last_active":"2024-09-19T14:13:45.860638+0000","last_peered":"2024-09-19T14:13:45.860638+0000","last_clean":"2024-09-19T14:13:45.860638+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:13:45.860638+0000","last_undegraded":"2024-09-19T14:13:45.860638+0000","last_fullsized":"2024-09-19T14:13:45.860638+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:33.562231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'429","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.275001+0000","last_change":"2024-09-19T14:14:33.275001+0000","last_active":"2024-09-19T14:14:33.275001+0000","last_peered":"2024-09-19T14:14:33.275001+0000","last_clean":"2024-09-19T14:14:33.275001+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:14:33.275001+0000","last_undegraded":"2024-09-19T14:14:33.275001+0000","last_fullsized":"2024-09-19T14:14:33.275001+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'429","last_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_deep_scrub":"260'429","last_deep_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.274911+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:04.889403+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'206","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.809045+0000","last_change":"2024-09-19T14:14:26.809045+0000","last_active":"2024-09-19T14:14:26.809045+0000","last_peered":"2024-09-19T14:14:26.809045+0000","last_clean":"2024-09-19T14:14:26.809045+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:14:26.809045+0000","last_undegraded":"2024-09-19T14:14:26.809045+0000","last_fullsized":"2024-09-19T14:14:26.809045+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.808956+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:42.176771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":543,"num_read_kb":50665,"num_write":1025,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.119264+0000","last_change":"2024-09-19T14:14:35.119264+0000","last_active":"2024-09-19T14:14:35.119264+0000","last_peered":"2024-09-19T14:14:35.119264+0000","last_clean":"2024-09-19T14:14:35.119264+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:14:35.119264+0000","last_undegraded":"2024-09-19T14:14:35.119264+0000","last_fullsized":"2024-09-19T14:14:35.119264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.119157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:35:11.867701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'190","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.456925+0000","last_change":"2024-09-19T13:36:13.346349+0000","last_active":"2024-09-19T14:14:18.456925+0000","last_peered":"2024-09-19T14:14:18.456925+0000","last_clean":"2024-09-19T14:14:18.456925+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:14:18.456925+0000","last_undegraded":"2024-09-19T14:14:18.456925+0000","last_fullsized":"2024-09-19T14:14:18.456925+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:53.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20793,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":404,"num_write":130,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.985385+0000","last_change":"2024-09-19T14:14:39.985385+0000","last_active":"2024-09-19T14:14:39.985385+0000","last_peered":"2024-09-19T14:14:39.985385+0000","last_clean":"2024-09-19T14:14:39.985385+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:14:39.985385+0000","last_undegraded":"2024-09-19T14:14:39.985385+0000","last_fullsized":"2024-09-19T14:14:39.985385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:14.242432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'170","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.168956+0000","last_change":"2024-09-19T13:36:17.362550+0000","last_active":"2024-09-19T14:12:15.168956+0000","last_peered":"2024-09-19T14:12:15.168956+0000","last_clean":"2024-09-19T14:12:15.168956+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:12:15.168956+0000","last_undegraded":"2024-09-19T14:12:15.168956+0000","last_fullsized":"2024-09-19T14:12:15.168956+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:34.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1299","reported_seq":3081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.665018+0000","last_change":"2024-09-19T14:14:30.665018+0000","last_active":"2024-09-19T14:14:30.665018+0000","last_peered":"2024-09-19T14:14:30.665018+0000","last_clean":"2024-09-19T14:14:30.665018+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:14:30.665018+0000","last_undegraded":"2024-09-19T14:14:30.665018+0000","last_fullsized":"2024-09-19T14:14:30.665018+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1299","last_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_deep_scrub":"260'1299","last_deep_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.664940+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":1200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:04.360372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'194","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.386580+0000","last_change":"2024-09-19T14:14:27.386580+0000","last_active":"2024-09-19T14:14:27.386580+0000","last_peered":"2024-09-19T14:14:27.386580+0000","last_clean":"2024-09-19T14:14:27.386580+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:14:27.386580+0000","last_undegraded":"2024-09-19T14:14:27.386580+0000","last_fullsized":"2024-09-19T14:14:27.386580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.386475+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:11.179031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":2025,"num_write":905,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.084095+0000","last_change":"2024-09-19T14:14:37.084095+0000","last_active":"2024-09-19T14:14:37.084095+0000","last_peered":"2024-09-19T14:14:37.084095+0000","last_clean":"2024-09-19T14:14:37.084095+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:14:37.084095+0000","last_undegraded":"2024-09-19T14:14:37.084095+0000","last_fullsized":"2024-09-19T14:14:37.084095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.084002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:24.084032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'146","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.316974+0000","last_change":"2024-09-19T13:36:13.344371+0000","last_active":"2024-09-19T14:14:18.316974+0000","last_peered":"2024-09-19T14:14:18.316974+0000","last_clean":"2024-09-19T14:14:18.316974+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:14:18.316974+0000","last_undegraded":"2024-09-19T14:14:18.316974+0000","last_fullsized":"2024-09-19T14:14:18.316974+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":203,"num_read_kb":278,"num_write":160,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.619819+0000","last_change":"2024-09-19T13:36:15.348413+0000","last_active":"2024-09-19T14:12:21.619819+0000","last_peered":"2024-09-19T14:12:21.619819+0000","last_clean":"2024-09-19T14:12:21.619819+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:12:21.619819+0000","last_undegraded":"2024-09-19T14:12:21.619819+0000","last_fullsized":"2024-09-19T14:12:21.619819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'118","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:36.846067+0000","last_change":"2024-09-19T13:36:17.364393+0000","last_active":"2024-09-19T14:13:36.846067+0000","last_peered":"2024-09-19T14:13:36.846067+0000","last_clean":"2024-09-19T14:13:36.846067+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:13:36.846067+0000","last_undegraded":"2024-09-19T14:13:36.846067+0000","last_fullsized":"2024-09-19T14:13:36.846067+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'471","reported_seq":2101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.635975+0000","last_change":"2024-09-19T14:14:31.635975+0000","last_active":"2024-09-19T14:14:31.635975+0000","last_peered":"2024-09-19T14:14:31.635975+0000","last_clean":"2024-09-19T14:14:31.635975+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:14:31.635975+0000","last_undegraded":"2024-09-19T14:14:31.635975+0000","last_fullsized":"2024-09-19T14:14:31.635975+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'471","last_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_deep_scrub":"260'471","last_deep_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.635871+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:59.000822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'218","reported_seq":858,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.107934+0000","last_change":"2024-09-19T14:14:28.107934+0000","last_active":"2024-09-19T14:14:28.107934+0000","last_peered":"2024-09-19T14:14:28.107934+0000","last_clean":"2024-09-19T14:14:28.107934+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:14:28.107934+0000","last_undegraded":"2024-09-19T14:14:28.107934+0000","last_fullsized":"2024-09-19T14:14:28.107934+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.107813+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:25.599144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":62927,"num_write":1024,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.387905+0000","last_change":"2024-09-19T14:14:38.387905+0000","last_active":"2024-09-19T14:14:38.387905+0000","last_peered":"2024-09-19T14:14:38.387905+0000","last_clean":"2024-09-19T14:14:38.387905+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:14:38.387905+0000","last_undegraded":"2024-09-19T14:14:38.387905+0000","last_fullsized":"2024-09-19T14:14:38.387905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.387808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:10.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'152","reported_seq":732,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.019987+0000","last_change":"2024-09-19T14:14:39.019987+0000","last_active":"2024-09-19T14:14:39.019987+0000","last_peered":"2024-09-19T14:14:39.019987+0000","last_clean":"2024-09-19T14:14:39.019987+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:14:39.019987+0000","last_undegraded":"2024-09-19T14:14:39.019987+0000","last_fullsized":"2024-09-19T14:14:39.019987+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.019863+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:04.873037+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":180,"num_read_kb":188,"num_write":94,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'736","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.008665+0000","last_change":"2024-09-19T14:14:41.008665+0000","last_active":"2024-09-19T14:14:41.008665+0000","last_peered":"2024-09-19T14:14:41.008665+0000","last_clean":"2024-09-19T14:14:41.008665+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:14:41.008665+0000","last_undegraded":"2024-09-19T14:14:41.008665+0000","last_fullsized":"2024-09-19T14:14:41.008665+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'736","last_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_deep_scrub":"260'736","last_deep_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.008532+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:52.770410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'119","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:15.540330+0000","last_change":"2024-09-19T13:36:17.355488+0000","last_active":"2024-09-19T14:12:15.540330+0000","last_peered":"2024-09-19T14:12:15.540330+0000","last_clean":"2024-09-19T14:12:15.540330+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:12:15.540330+0000","last_undegraded":"2024-09-19T14:12:15.540330+0000","last_fullsized":"2024-09-19T14:12:15.540330+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:38.296270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1577","reported_seq":3205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.622853+0000","last_change":"2024-09-19T14:14:32.622853+0000","last_active":"2024-09-19T14:14:32.622853+0000","last_peered":"2024-09-19T14:14:32.622853+0000","last_clean":"2024-09-19T14:14:32.622853+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:14:32.622853+0000","last_undegraded":"2024-09-19T14:14:32.622853+0000","last_fullsized":"2024-09-19T14:14:32.622853+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1577","last_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_deep_scrub":"260'1577","last_deep_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.622730+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":1500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:37.492268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'202","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.599775+0000","last_change":"2024-09-19T14:14:24.599775+0000","last_active":"2024-09-19T14:14:24.599775+0000","last_peered":"2024-09-19T14:14:24.599775+0000","last_clean":"2024-09-19T14:14:24.599775+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:14:24.599775+0000","last_undegraded":"2024-09-19T14:14:24.599775+0000","last_fullsized":"2024-09-19T14:14:24.599775+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.599680+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.795340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":26305,"num_write":903,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"34'6","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.202815+0000","last_change":"2024-09-19T13:36:11.338913+0000","last_active":"2024-09-19T14:14:18.202815+0000","last_peered":"2024-09-19T14:14:18.202815+0000","last_clean":"2024-09-19T14:14:18.202815+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:14:18.202815+0000","last_undegraded":"2024-09-19T14:14:18.202815+0000","last_fullsized":"2024-09-19T14:14:18.202815+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1680,"num_read_kb":2149,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'75","reported_seq":581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738440+0000","last_change":"2024-09-19T13:36:13.678517+0000","last_active":"2024-09-19T14:12:16.738440+0000","last_peered":"2024-09-19T14:12:16.738440+0000","last_clean":"2024-09-19T14:12:16.738440+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:12:16.738440+0000","last_undegraded":"2024-09-19T14:12:16.738440+0000","last_fullsized":"2024-09-19T14:12:16.738440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'779","reported_seq":4738,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.504729+0000","last_change":"2024-09-19T13:36:15.352291+0000","last_active":"2024-09-19T14:14:18.504729+0000","last_peered":"2024-09-19T14:14:18.504729+0000","last_clean":"2024-09-19T14:14:18.504729+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:14:18.504729+0000","last_undegraded":"2024-09-19T14:14:18.504729+0000","last_fullsized":"2024-09-19T14:14:18.504729+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'128","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.409862+0000","last_change":"2024-09-19T13:36:17.360266+0000","last_active":"2024-09-19T14:12:26.409862+0000","last_peered":"2024-09-19T14:12:26.409862+0000","last_clean":"2024-09-19T14:12:26.409862+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:12:26.409862+0000","last_undegraded":"2024-09-19T14:12:26.409862+0000","last_fullsized":"2024-09-19T14:12:26.409862+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:17.091973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'913","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.399491+0000","last_change":"2024-09-19T14:14:34.399491+0000","last_active":"2024-09-19T14:14:34.399491+0000","last_peered":"2024-09-19T14:14:34.399491+0000","last_clean":"2024-09-19T14:14:34.399491+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:14:34.399491+0000","last_undegraded":"2024-09-19T14:14:34.399491+0000","last_fullsized":"2024-09-19T14:14:34.399491+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.399381+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:04.254432+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'181","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.387106+0000","last_change":"2024-09-19T14:14:24.387106+0000","last_active":"2024-09-19T14:14:24.387106+0000","last_peered":"2024-09-19T14:14:24.387106+0000","last_clean":"2024-09-19T14:14:24.387106+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:14:24.387106+0000","last_undegraded":"2024-09-19T14:14:24.387106+0000","last_fullsized":"2024-09-19T14:14:24.387106+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'181","last_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_deep_scrub":"260'181","last_deep_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.387035+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:58.069276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737742+0000","last_change":"2024-09-19T13:36:11.334156+0000","last_active":"2024-09-19T14:12:11.737742+0000","last_peered":"2024-09-19T14:12:11.737742+0000","last_clean":"2024-09-19T14:12:11.737742+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:12:11.737742+0000","last_undegraded":"2024-09-19T14:12:11.737742+0000","last_fullsized":"2024-09-19T14:12:11.737742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'195","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.413055+0000","last_change":"2024-09-19T13:36:13.346678+0000","last_active":"2024-09-19T14:14:18.413055+0000","last_peered":"2024-09-19T14:14:18.413055+0000","last_clean":"2024-09-19T14:14:18.413055+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:14:18.413055+0000","last_undegraded":"2024-09-19T14:14:18.413055+0000","last_fullsized":"2024-09-19T14:14:18.413055+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":866,"num_read_kb":913,"num_write":1382,"num_write_kb":1260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.214279+0000","last_change":"2024-09-19T14:14:39.214279+0000","last_active":"2024-09-19T14:14:39.214279+0000","last_peered":"2024-09-19T14:14:39.214279+0000","last_clean":"2024-09-19T14:14:39.214279+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:14:39.214279+0000","last_undegraded":"2024-09-19T14:14:39.214279+0000","last_fullsized":"2024-09-19T14:14:39.214279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.214191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:32.459392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'116","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.223769+0000","last_change":"2024-09-19T13:36:17.354159+0000","last_active":"2024-09-19T14:12:13.223769+0000","last_peered":"2024-09-19T14:12:13.223769+0000","last_clean":"2024-09-19T14:12:13.223769+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:12:13.223769+0000","last_undegraded":"2024-09-19T14:12:13.223769+0000","last_fullsized":"2024-09-19T14:12:13.223769+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:21.937480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.142395+0000","last_change":"2024-09-19T14:14:33.142395+0000","last_active":"2024-09-19T14:14:33.142395+0000","last_peered":"2024-09-19T14:14:33.142395+0000","last_clean":"2024-09-19T14:14:33.142395+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:14:33.142395+0000","last_undegraded":"2024-09-19T14:14:33.142395+0000","last_fullsized":"2024-09-19T14:14:33.142395+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.142301+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:53:23.111973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.090762+0000","last_change":"2024-09-19T14:14:25.090762+0000","last_active":"2024-09-19T14:14:25.090762+0000","last_peered":"2024-09-19T14:14:25.090762+0000","last_clean":"2024-09-19T14:14:25.090762+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:14:25.090762+0000","last_undegraded":"2024-09-19T14:14:25.090762+0000","last_fullsized":"2024-09-19T14:14:25.090762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.090660+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:42.554407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":518,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.846077+0000","last_change":"2024-09-19T14:14:24.846077+0000","last_active":"2024-09-19T14:14:24.846077+0000","last_peered":"2024-09-19T14:14:24.846077+0000","last_clean":"2024-09-19T14:14:24.846077+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:14:24.846077+0000","last_undegraded":"2024-09-19T14:14:24.846077+0000","last_fullsized":"2024-09-19T14:14:24.846077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.845991+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:12.158112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'234","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.365639+0000","last_change":"2024-09-19T14:14:23.365639+0000","last_active":"2024-09-19T14:14:23.365639+0000","last_peered":"2024-09-19T14:14:23.365639+0000","last_clean":"2024-09-19T14:14:23.365639+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:14:23.365639+0000","last_undegraded":"2024-09-19T14:14:23.365639+0000","last_fullsized":"2024-09-19T14:14:23.365639+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'234","last_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_deep_scrub":"260'234","last_deep_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.365567+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:40:16.918810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":4147,"num_write":1074,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747345+0000","last_change":"2024-09-19T13:36:11.335928+0000","last_active":"2024-09-19T14:11:36.747345+0000","last_peered":"2024-09-19T14:11:36.747345+0000","last_clean":"2024-09-19T14:11:36.747345+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:11:36.747345+0000","last_undegraded":"2024-09-19T14:11:36.747345+0000","last_fullsized":"2024-09-19T14:11:36.747345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:19.656066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'335","reported_seq":1021,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.487682+0000","last_change":"2024-09-19T13:36:13.348035+0000","last_active":"2024-09-19T14:14:18.487682+0000","last_peered":"2024-09-19T14:14:18.487682+0000","last_clean":"2024-09-19T14:14:18.487682+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:14:18.487682+0000","last_undegraded":"2024-09-19T14:14:18.487682+0000","last_fullsized":"2024-09-19T14:14:18.487682+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:31.984054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":939,"num_write":532,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:56.608712+0000","last_change":"2024-09-19T13:36:15.353267+0000","last_active":"2024-09-19T14:10:56.608712+0000","last_peered":"2024-09-19T14:10:56.608712+0000","last_clean":"2024-09-19T14:10:56.608712+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:10:56.608712+0000","last_undegraded":"2024-09-19T14:10:56.608712+0000","last_fullsized":"2024-09-19T14:10:56.608712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:16.239382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'189","reported_seq":879,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.764923+0000","last_change":"2024-09-19T13:36:17.356980+0000","last_active":"2024-09-19T14:12:27.764923+0000","last_peered":"2024-09-19T14:12:27.764923+0000","last_clean":"2024-09-19T14:12:27.764923+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:12:27.764923+0000","last_undegraded":"2024-09-19T14:12:27.764923+0000","last_fullsized":"2024-09-19T14:12:27.764923+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:00.567870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'976","reported_seq":2587,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.255104+0000","last_change":"2024-09-19T14:14:34.255104+0000","last_active":"2024-09-19T14:14:34.255104+0000","last_peered":"2024-09-19T14:14:34.255104+0000","last_clean":"2024-09-19T14:14:34.255104+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:14:34.255104+0000","last_undegraded":"2024-09-19T14:14:34.255104+0000","last_fullsized":"2024-09-19T14:14:34.255104+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'976","last_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_deep_scrub":"260'976","last_deep_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.255007+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:17.054045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.122612+0000","last_change":"2024-09-19T14:14:27.122612+0000","last_active":"2024-09-19T14:14:27.122612+0000","last_peered":"2024-09-19T14:14:27.122612+0000","last_clean":"2024-09-19T14:14:27.122612+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:14:27.122612+0000","last_undegraded":"2024-09-19T14:14:27.122612+0000","last_fullsized":"2024-09-19T14:14:27.122612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.122523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:34.702946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'215","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.355899+0000","last_change":"2024-09-19T14:14:23.355899+0000","last_active":"2024-09-19T14:14:23.355899+0000","last_peered":"2024-09-19T14:14:23.355899+0000","last_clean":"2024-09-19T14:14:23.355899+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:14:23.355899+0000","last_undegraded":"2024-09-19T14:14:23.355899+0000","last_fullsized":"2024-09-19T14:14:23.355899+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.355816+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:31.085121+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":42960,"num_write":983,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.606429+0000","last_change":"2024-09-19T13:36:11.337197+0000","last_active":"2024-09-19T14:10:51.606429+0000","last_peered":"2024-09-19T14:10:51.606429+0000","last_clean":"2024-09-19T14:10:51.606429+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:10:51.606429+0000","last_undegraded":"2024-09-19T14:10:51.606429+0000","last_fullsized":"2024-09-19T14:10:51.606429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:00.715855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'823","reported_seq":2203,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.419539+0000","last_change":"2024-09-19T13:36:13.344429+0000","last_active":"2024-09-19T14:14:18.419539+0000","last_peered":"2024-09-19T14:14:18.419539+0000","last_clean":"2024-09-19T14:14:18.419539+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:14:18.419539+0000","last_undegraded":"2024-09-19T14:14:18.419539+0000","last_fullsized":"2024-09-19T14:14:18.419539+0000","mapping_epoch":28,"log_start":"260'800","ondisk_log_start":"260'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:47.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1143,"num_read_kb":1321,"num_write":246,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749934+0000","last_change":"2024-09-19T13:36:15.355170+0000","last_active":"2024-09-19T14:11:51.749934+0000","last_peered":"2024-09-19T14:11:51.749934+0000","last_clean":"2024-09-19T14:11:51.749934+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:11:51.749934+0000","last_undegraded":"2024-09-19T14:11:51.749934+0000","last_fullsized":"2024-09-19T14:11:51.749934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:24.165465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'128","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.807878+0000","last_change":"2024-09-19T13:36:17.353025+0000","last_active":"2024-09-19T14:13:45.807878+0000","last_peered":"2024-09-19T14:13:45.807878+0000","last_clean":"2024-09-19T14:13:45.807878+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:13:45.807878+0000","last_undegraded":"2024-09-19T14:13:45.807878+0000","last_fullsized":"2024-09-19T14:13:45.807878+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:31.622680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'772","reported_seq":2375,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.370868+0000","last_change":"2024-09-19T14:14:32.370868+0000","last_active":"2024-09-19T14:14:32.370868+0000","last_peered":"2024-09-19T14:14:32.370868+0000","last_clean":"2024-09-19T14:14:32.370868+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:14:32.370868+0000","last_undegraded":"2024-09-19T14:14:32.370868+0000","last_fullsized":"2024-09-19T14:14:32.370868+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'772","last_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_deep_scrub":"260'772","last_deep_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.370749+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.543791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.186455+0000","last_change":"2024-09-19T14:14:24.186455+0000","last_active":"2024-09-19T14:14:24.186455+0000","last_peered":"2024-09-19T14:14:24.186455+0000","last_clean":"2024-09-19T14:14:24.186455+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:14:24.186455+0000","last_undegraded":"2024-09-19T14:14:24.186455+0000","last_fullsized":"2024-09-19T14:14:24.186455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.186357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:33.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'184","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.246955+0000","last_change":"2024-09-19T14:14:24.246955+0000","last_active":"2024-09-19T14:14:24.246955+0000","last_peered":"2024-09-19T14:14:24.246955+0000","last_clean":"2024-09-19T14:14:24.246955+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:14:24.246955+0000","last_undegraded":"2024-09-19T14:14:24.246955+0000","last_fullsized":"2024-09-19T14:14:24.246955+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.246846+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:34.062372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":6136,"num_write":878,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.120713+0000","last_change":"2024-09-19T14:14:33.120713+0000","last_active":"2024-09-19T14:14:33.120713+0000","last_peered":"2024-09-19T14:14:33.120713+0000","last_clean":"2024-09-19T14:14:33.120713+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:14:33.120713+0000","last_undegraded":"2024-09-19T14:14:33.120713+0000","last_fullsized":"2024-09-19T14:14:33.120713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.120629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.158421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'201","reported_seq":1189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.151581+0000","last_change":"2024-09-19T13:36:13.678601+0000","last_active":"2024-09-19T14:13:47.151581+0000","last_peered":"2024-09-19T14:13:47.151581+0000","last_clean":"2024-09-19T14:13:47.151581+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:13:47.151581+0000","last_undegraded":"2024-09-19T14:13:47.151581+0000","last_fullsized":"2024-09-19T14:13:47.151581+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:44.121580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614634+0000","last_change":"2024-09-19T13:36:15.350412+0000","last_active":"2024-09-19T14:11:41.614634+0000","last_peered":"2024-09-19T14:11:41.614634+0000","last_clean":"2024-09-19T14:11:41.614634+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:11:41.614634+0000","last_undegraded":"2024-09-19T14:11:41.614634+0000","last_fullsized":"2024-09-19T14:11:41.614634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:44.795963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.906554+0000","last_change":"2024-09-19T13:36:17.363655+0000","last_active":"2024-09-19T14:12:27.906554+0000","last_peered":"2024-09-19T14:12:27.906554+0000","last_clean":"2024-09-19T14:12:27.906554+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:12:27.906554+0000","last_undegraded":"2024-09-19T14:12:27.906554+0000","last_fullsized":"2024-09-19T14:12:27.906554+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'352","reported_seq":1880,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.371001+0000","last_change":"2024-09-19T14:14:30.371001+0000","last_active":"2024-09-19T14:14:30.371001+0000","last_peered":"2024-09-19T14:14:30.371001+0000","last_clean":"2024-09-19T14:14:30.371001+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:14:30.371001+0000","last_undegraded":"2024-09-19T14:14:30.371001+0000","last_fullsized":"2024-09-19T14:14:30.371001+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.370905+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:22.516405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.799062+0000","last_change":"2024-09-19T14:14:23.799062+0000","last_active":"2024-09-19T14:14:23.799062+0000","last_peered":"2024-09-19T14:14:23.799062+0000","last_clean":"2024-09-19T14:14:23.799062+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:14:23.799062+0000","last_undegraded":"2024-09-19T14:14:23.799062+0000","last_fullsized":"2024-09-19T14:14:23.799062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.798956+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:54.613030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'228","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.574659+0000","last_change":"2024-09-19T14:14:23.574659+0000","last_active":"2024-09-19T14:14:23.574659+0000","last_peered":"2024-09-19T14:14:23.574659+0000","last_clean":"2024-09-19T14:14:23.574659+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:14:23.574659+0000","last_undegraded":"2024-09-19T14:14:23.574659+0000","last_fullsized":"2024-09-19T14:14:23.574659+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'228","last_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_deep_scrub":"260'228","last_deep_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.574564+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:46.444524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":5696,"num_write":1072,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.614656+0000","last_change":"2024-09-19T13:36:11.337905+0000","last_active":"2024-09-19T14:11:41.614656+0000","last_peered":"2024-09-19T14:11:41.614656+0000","last_clean":"2024-09-19T14:11:41.614656+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:11:41.614656+0000","last_undegraded":"2024-09-19T14:11:41.614656+0000","last_fullsized":"2024-09-19T14:11:41.614656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:00.320875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'106","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622447+0000","last_change":"2024-09-19T13:36:13.341625+0000","last_active":"2024-09-19T14:13:06.622447+0000","last_peered":"2024-09-19T14:13:06.622447+0000","last_clean":"2024-09-19T14:13:06.622447+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:13:06.622447+0000","last_undegraded":"2024-09-19T14:13:06.622447+0000","last_fullsized":"2024-09-19T14:13:06.622447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:24.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.224975+0000","last_change":"2024-09-19T14:14:41.224975+0000","last_active":"2024-09-19T14:14:41.224975+0000","last_peered":"2024-09-19T14:14:41.224975+0000","last_clean":"2024-09-19T14:14:41.224975+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:14:41.224975+0000","last_undegraded":"2024-09-19T14:14:41.224975+0000","last_fullsized":"2024-09-19T14:14:41.224975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.224899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:53.063511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'106","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.019026+0000","last_change":"2024-09-19T13:36:17.362663+0000","last_active":"2024-09-19T14:12:27.019026+0000","last_peered":"2024-09-19T14:12:27.019026+0000","last_clean":"2024-09-19T14:12:27.019026+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:12:27.019026+0000","last_undegraded":"2024-09-19T14:12:27.019026+0000","last_fullsized":"2024-09-19T14:12:27.019026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:27.259346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'601","reported_seq":2326,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.333499+0000","last_change":"2024-09-19T14:14:31.333499+0000","last_active":"2024-09-19T14:14:31.333499+0000","last_peered":"2024-09-19T14:14:31.333499+0000","last_clean":"2024-09-19T14:14:31.333499+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:14:31.333499+0000","last_undegraded":"2024-09-19T14:14:31.333499+0000","last_fullsized":"2024-09-19T14:14:31.333499+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'601","last_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_deep_scrub":"260'601","last_deep_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.333408+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:33.805427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'206","reported_seq":853,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.807429+0000","last_change":"2024-09-19T14:14:25.807429+0000","last_active":"2024-09-19T14:14:25.807429+0000","last_peered":"2024-09-19T14:14:25.807429+0000","last_clean":"2024-09-19T14:14:25.807429+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:14:25.807429+0000","last_undegraded":"2024-09-19T14:14:25.807429+0000","last_fullsized":"2024-09-19T14:14:25.807429+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.807326+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:54.324076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":24801,"num_write":998,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.271878+0000","last_change":"2024-09-19T14:14:22.271878+0000","last_active":"2024-09-19T14:14:22.271878+0000","last_peered":"2024-09-19T14:14:22.271878+0000","last_clean":"2024-09-19T14:14:22.271878+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:14:22.271878+0000","last_undegraded":"2024-09-19T14:14:22.271878+0000","last_fullsized":"2024-09-19T14:14:22.271878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.271798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:15.460044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.211839+0000","last_change":"2024-09-19T14:14:41.211839+0000","last_active":"2024-09-19T14:14:41.211839+0000","last_peered":"2024-09-19T14:14:41.211839+0000","last_clean":"2024-09-19T14:14:41.211839+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:14:41.211839+0000","last_undegraded":"2024-09-19T14:14:41.211839+0000","last_fullsized":"2024-09-19T14:14:41.211839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.211717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:50.720540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'264","reported_seq":910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.498277+0000","last_change":"2024-09-19T13:36:13.344037+0000","last_active":"2024-09-19T14:14:18.498277+0000","last_peered":"2024-09-19T14:14:18.498277+0000","last_clean":"2024-09-19T14:14:18.498277+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:14:18.498277+0000","last_undegraded":"2024-09-19T14:14:18.498277+0000","last_fullsized":"2024-09-19T14:14:18.498277+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12301,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":381,"num_read_kb":528,"num_write":240,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.734022+0000","last_change":"2024-09-19T13:36:15.347284+0000","last_active":"2024-09-19T14:11:41.734022+0000","last_peered":"2024-09-19T14:11:41.734022+0000","last_clean":"2024-09-19T14:11:41.734022+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:11:41.734022+0000","last_undegraded":"2024-09-19T14:11:41.734022+0000","last_fullsized":"2024-09-19T14:11:41.734022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:45.336194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'126","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619293+0000","last_change":"2024-09-19T13:36:17.358825+0000","last_active":"2024-09-19T14:12:16.619293+0000","last_peered":"2024-09-19T14:12:16.619293+0000","last_clean":"2024-09-19T14:12:16.619293+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:12:16.619293+0000","last_undegraded":"2024-09-19T14:12:16.619293+0000","last_fullsized":"2024-09-19T14:12:16.619293+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1173","reported_seq":2702,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.253870+0000","last_change":"2024-09-19T14:14:31.253870+0000","last_active":"2024-09-19T14:14:31.253870+0000","last_peered":"2024-09-19T14:14:31.253870+0000","last_clean":"2024-09-19T14:14:31.253870+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:14:31.253870+0000","last_undegraded":"2024-09-19T14:14:31.253870+0000","last_fullsized":"2024-09-19T14:14:31.253870+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1173","last_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_deep_scrub":"260'1173","last_deep_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.253789+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":1100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:19.605470+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'241","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.269778+0000","last_change":"2024-09-19T14:14:25.269778+0000","last_active":"2024-09-19T14:14:25.269778+0000","last_peered":"2024-09-19T14:14:25.269778+0000","last_clean":"2024-09-19T14:14:25.269778+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:14:25.269778+0000","last_undegraded":"2024-09-19T14:14:25.269778+0000","last_fullsized":"2024-09-19T14:14:25.269778+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.269708+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:59.804876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":611,"num_read_kb":113129,"num_write":1047,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.132997+0000","last_change":"2024-09-19T14:14:30.132997+0000","last_active":"2024-09-19T14:14:30.132997+0000","last_peered":"2024-09-19T14:14:30.132997+0000","last_clean":"2024-09-19T14:14:30.132997+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:14:30.132997+0000","last_undegraded":"2024-09-19T14:14:30.132997+0000","last_fullsized":"2024-09-19T14:14:30.132997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.132909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:09:35.776106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.210314+0000","last_change":"2024-09-19T14:14:38.210314+0000","last_active":"2024-09-19T14:14:38.210314+0000","last_peered":"2024-09-19T14:14:38.210314+0000","last_clean":"2024-09-19T14:14:38.210314+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:14:38.210314+0000","last_undegraded":"2024-09-19T14:14:38.210314+0000","last_fullsized":"2024-09-19T14:14:38.210314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.210233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:40.582675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'145","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.356860+0000","last_change":"2024-09-19T13:36:13.678497+0000","last_active":"2024-09-19T14:12:27.356860+0000","last_peered":"2024-09-19T14:12:27.356860+0000","last_clean":"2024-09-19T14:12:27.356860+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:12:27.356860+0000","last_undegraded":"2024-09-19T14:12:27.356860+0000","last_fullsized":"2024-09-19T14:12:27.356860+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:46.504350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'788","reported_seq":2498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.501998+0000","last_change":"2024-09-19T13:36:15.349702+0000","last_active":"2024-09-19T14:14:18.501998+0000","last_peered":"2024-09-19T14:14:18.501998+0000","last_clean":"2024-09-19T14:14:18.501998+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:14:18.501998+0000","last_undegraded":"2024-09-19T14:14:18.501998+0000","last_fullsized":"2024-09-19T14:14:18.501998+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.512113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'139","reported_seq":652,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.039505+0000","last_change":"2024-09-19T13:36:17.364028+0000","last_active":"2024-09-19T14:13:47.039505+0000","last_peered":"2024-09-19T14:13:47.039505+0000","last_clean":"2024-09-19T14:13:47.039505+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:13:47.039505+0000","last_undegraded":"2024-09-19T14:13:47.039505+0000","last_fullsized":"2024-09-19T14:13:47.039505+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.313938+0000","last_change":"2024-09-19T14:14:34.313938+0000","last_active":"2024-09-19T14:14:34.313938+0000","last_peered":"2024-09-19T14:14:34.313938+0000","last_clean":"2024-09-19T14:14:34.313938+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:14:34.313938+0000","last_undegraded":"2024-09-19T14:14:34.313938+0000","last_fullsized":"2024-09-19T14:14:34.313938+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'349","last_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_deep_scrub":"260'349","last_deep_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.313853+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:03.281146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'210","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.389550+0000","last_change":"2024-09-19T14:14:25.389550+0000","last_active":"2024-09-19T14:14:25.389550+0000","last_peered":"2024-09-19T14:14:25.389550+0000","last_clean":"2024-09-19T14:14:25.389550+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:14:25.389550+0000","last_undegraded":"2024-09-19T14:14:25.389550+0000","last_fullsized":"2024-09-19T14:14:25.389550+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.389494+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:57.196831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":8334,"num_write":1024,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.254724+0000","last_change":"2024-09-19T14:14:23.254724+0000","last_active":"2024-09-19T14:14:23.254724+0000","last_peered":"2024-09-19T14:14:23.254724+0000","last_clean":"2024-09-19T14:14:23.254724+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:14:23.254724+0000","last_undegraded":"2024-09-19T14:14:23.254724+0000","last_fullsized":"2024-09-19T14:14:23.254724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.254647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:57.792058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733201+0000","last_change":"2024-09-19T13:36:11.329844+0000","last_active":"2024-09-19T14:11:36.733201+0000","last_peered":"2024-09-19T14:11:36.733201+0000","last_clean":"2024-09-19T14:11:36.733201+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:11:36.733201+0000","last_undegraded":"2024-09-19T14:11:36.733201+0000","last_fullsized":"2024-09-19T14:11:36.733201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:37.515612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'87","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:55.941455+0000","last_change":"2024-09-19T13:36:13.343716+0000","last_active":"2024-09-19T14:11:55.941455+0000","last_peered":"2024-09-19T14:11:55.941455+0000","last_clean":"2024-09-19T14:11:55.941455+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:11:55.941455+0000","last_undegraded":"2024-09-19T14:11:55.941455+0000","last_fullsized":"2024-09-19T14:11:55.941455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'797","reported_seq":2378,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.448027+0000","last_change":"2024-09-19T13:36:15.350187+0000","last_active":"2024-09-19T14:14:18.448027+0000","last_peered":"2024-09-19T14:14:18.448027+0000","last_clean":"2024-09-19T14:14:18.448027+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:14:18.448027+0000","last_undegraded":"2024-09-19T14:14:18.448027+0000","last_fullsized":"2024-09-19T14:14:18.448027+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:22.788209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'291","reported_seq":806,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619244+0000","last_change":"2024-09-19T13:36:17.362227+0000","last_active":"2024-09-19T14:12:16.619244+0000","last_peered":"2024-09-19T14:12:16.619244+0000","last_clean":"2024-09-19T14:12:16.619244+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:12:16.619244+0000","last_undegraded":"2024-09-19T14:12:16.619244+0000","last_fullsized":"2024-09-19T14:12:16.619244+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'725","reported_seq":2605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.675073+0000","last_change":"2024-09-19T14:14:28.675073+0000","last_active":"2024-09-19T14:14:28.675073+0000","last_peered":"2024-09-19T14:14:28.675073+0000","last_clean":"2024-09-19T14:14:28.675073+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:14:28.675073+0000","last_undegraded":"2024-09-19T14:14:28.675073+0000","last_fullsized":"2024-09-19T14:14:28.675073+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'725","last_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_deep_scrub":"260'725","last_deep_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.674989+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.706637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3080,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'226","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.314956+0000","last_change":"2024-09-19T14:14:22.314956+0000","last_active":"2024-09-19T14:14:22.314956+0000","last_peered":"2024-09-19T14:14:22.314956+0000","last_clean":"2024-09-19T14:14:22.314956+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:14:22.314956+0000","last_undegraded":"2024-09-19T14:14:22.314956+0000","last_fullsized":"2024-09-19T14:14:22.314956+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.314854+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:16.077018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":41557,"num_write":1060,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.131186+0000","last_change":"2024-09-19T14:14:25.131186+0000","last_active":"2024-09-19T14:14:25.131186+0000","last_peered":"2024-09-19T14:14:25.131186+0000","last_clean":"2024-09-19T14:14:25.131186+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:14:25.131186+0000","last_undegraded":"2024-09-19T14:14:25.131186+0000","last_fullsized":"2024-09-19T14:14:25.131186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.131106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:59.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738348+0000","last_change":"2024-09-19T13:36:11.334617+0000","last_active":"2024-09-19T14:12:16.738348+0000","last_peered":"2024-09-19T14:12:16.738348+0000","last_clean":"2024-09-19T14:12:16.738348+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:12:16.738348+0000","last_undegraded":"2024-09-19T14:12:16.738348+0000","last_fullsized":"2024-09-19T14:12:16.738348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:31.167102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'304","reported_seq":1007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.396941+0000","last_change":"2024-09-19T13:36:13.678434+0000","last_active":"2024-09-19T14:14:18.396941+0000","last_peered":"2024-09-19T14:14:18.396941+0000","last_clean":"2024-09-19T14:14:18.396941+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:14:18.396941+0000","last_undegraded":"2024-09-19T14:14:18.396941+0000","last_fullsized":"2024-09-19T14:14:18.396941+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:14.308303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16920,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":432,"num_read_kb":558,"num_write":210,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:41.733909+0000","last_change":"2024-09-19T13:36:15.348438+0000","last_active":"2024-09-19T14:11:41.733909+0000","last_peered":"2024-09-19T14:11:41.733909+0000","last_clean":"2024-09-19T14:11:41.733909+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:11:41.733909+0000","last_undegraded":"2024-09-19T14:11:41.733909+0000","last_fullsized":"2024-09-19T14:11:41.733909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:32.956172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'160","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.349752+0000","last_change":"2024-09-19T13:36:17.358950+0000","last_active":"2024-09-19T14:12:27.349752+0000","last_peered":"2024-09-19T14:12:27.349752+0000","last_clean":"2024-09-19T14:12:27.349752+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:12:27.349752+0000","last_undegraded":"2024-09-19T14:12:27.349752+0000","last_fullsized":"2024-09-19T14:12:27.349752+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'143","reported_seq":706,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.863516+0000","last_change":"2024-09-19T13:36:17.361305+0000","last_active":"2024-09-19T14:12:27.863516+0000","last_peered":"2024-09-19T14:12:27.863516+0000","last_clean":"2024-09-19T14:12:27.863516+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:12:27.863516+0000","last_undegraded":"2024-09-19T14:12:27.863516+0000","last_fullsized":"2024-09-19T14:12:27.863516+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:26.500978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'780","reported_seq":2484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.645115+0000","last_change":"2024-09-19T14:14:33.645115+0000","last_active":"2024-09-19T14:14:33.645115+0000","last_peered":"2024-09-19T14:14:33.645115+0000","last_clean":"2024-09-19T14:14:33.645115+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:14:33.645115+0000","last_undegraded":"2024-09-19T14:14:33.645115+0000","last_fullsized":"2024-09-19T14:14:33.645115+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'780","last_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_deep_scrub":"260'780","last_deep_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.645030+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:38.455079+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'201","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.669948+0000","last_change":"2024-09-19T14:14:26.669948+0000","last_active":"2024-09-19T14:14:26.669948+0000","last_peered":"2024-09-19T14:14:26.669948+0000","last_clean":"2024-09-19T14:14:26.669948+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:14:26.669948+0000","last_undegraded":"2024-09-19T14:14:26.669948+0000","last_fullsized":"2024-09-19T14:14:26.669948+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.669848+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.636524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":235834,"num_write":982,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.369204+0000","last_change":"2024-09-19T14:14:39.369204+0000","last_active":"2024-09-19T14:14:39.369204+0000","last_peered":"2024-09-19T14:14:39.369204+0000","last_clean":"2024-09-19T14:14:39.369204+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:14:39.369204+0000","last_undegraded":"2024-09-19T14:14:39.369204+0000","last_fullsized":"2024-09-19T14:14:39.369204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.369113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:47.710446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'139","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.438003+0000","last_change":"2024-09-19T13:36:13.342360+0000","last_active":"2024-09-19T14:14:18.438003+0000","last_peered":"2024-09-19T14:14:18.438003+0000","last_clean":"2024-09-19T14:14:18.438003+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:14:18.438003+0000","last_undegraded":"2024-09-19T14:14:18.438003+0000","last_fullsized":"2024-09-19T14:14:18.438003+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:00.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":264,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730499+0000","last_change":"2024-09-19T13:36:15.347213+0000","last_active":"2024-09-19T14:11:16.730499+0000","last_peered":"2024-09-19T14:11:16.730499+0000","last_clean":"2024-09-19T14:11:16.730499+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:11:16.730499+0000","last_undegraded":"2024-09-19T14:11:16.730499+0000","last_fullsized":"2024-09-19T14:11:16.730499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:56.274514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'125","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.754232+0000","last_change":"2024-09-19T13:36:17.361898+0000","last_active":"2024-09-19T14:12:27.754232+0000","last_peered":"2024-09-19T14:12:27.754232+0000","last_clean":"2024-09-19T14:12:27.754232+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:12:27.754232+0000","last_undegraded":"2024-09-19T14:12:27.754232+0000","last_fullsized":"2024-09-19T14:12:27.754232+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'451","reported_seq":2142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.385125+0000","last_change":"2024-09-19T14:14:33.385125+0000","last_active":"2024-09-19T14:14:33.385125+0000","last_peered":"2024-09-19T14:14:33.385125+0000","last_clean":"2024-09-19T14:14:33.385125+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:14:33.385125+0000","last_undegraded":"2024-09-19T14:14:33.385125+0000","last_fullsized":"2024-09-19T14:14:33.385125+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.385044+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:40.641199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'206","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.184238+0000","last_change":"2024-09-19T14:14:29.184238+0000","last_active":"2024-09-19T14:14:29.184238+0000","last_peered":"2024-09-19T14:14:29.184238+0000","last_clean":"2024-09-19T14:14:29.184238+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:14:29.184238+0000","last_undegraded":"2024-09-19T14:14:29.184238+0000","last_fullsized":"2024-09-19T14:14:29.184238+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.184140+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:52.173970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":26124,"num_write":1061,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.729952+0000","last_change":"2024-09-19T13:36:11.337455+0000","last_active":"2024-09-19T14:11:11.729952+0000","last_peered":"2024-09-19T14:11:11.729952+0000","last_clean":"2024-09-19T14:11:11.729952+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:11:11.729952+0000","last_undegraded":"2024-09-19T14:11:11.729952+0000","last_fullsized":"2024-09-19T14:11:11.729952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:12.668776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":538,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:58.243489+0000","last_change":"2024-09-19T13:36:13.343393+0000","last_active":"2024-09-19T14:11:58.243489+0000","last_peered":"2024-09-19T14:11:58.243489+0000","last_clean":"2024-09-19T14:11:58.243489+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:11:58.243489+0000","last_undegraded":"2024-09-19T14:11:58.243489+0000","last_fullsized":"2024-09-19T14:11:58.243489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:39.552041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.744597+0000","last_change":"2024-09-19T13:36:15.353524+0000","last_active":"2024-09-19T14:11:16.744597+0000","last_peered":"2024-09-19T14:11:16.744597+0000","last_clean":"2024-09-19T14:11:16.744597+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:11:16.744597+0000","last_undegraded":"2024-09-19T14:11:16.744597+0000","last_fullsized":"2024-09-19T14:11:16.744597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:39.216630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'216","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.357835+0000","last_change":"2024-09-19T13:36:17.356683+0000","last_active":"2024-09-19T14:12:27.357835+0000","last_peered":"2024-09-19T14:12:27.357835+0000","last_clean":"2024-09-19T14:12:27.357835+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:12:27.357835+0000","last_undegraded":"2024-09-19T14:12:27.357835+0000","last_fullsized":"2024-09-19T14:12:27.357835+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:18.744990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'398","reported_seq":1849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.336463+0000","last_change":"2024-09-19T14:14:35.336463+0000","last_active":"2024-09-19T14:14:35.336463+0000","last_peered":"2024-09-19T14:14:35.336463+0000","last_clean":"2024-09-19T14:14:35.336463+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:14:35.336463+0000","last_undegraded":"2024-09-19T14:14:35.336463+0000","last_fullsized":"2024-09-19T14:14:35.336463+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'398","last_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_deep_scrub":"260'398","last_deep_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.336359+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:33.204997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'215","reported_seq":847,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.823104+0000","last_change":"2024-09-19T14:14:27.823104+0000","last_active":"2024-09-19T14:14:27.823104+0000","last_peered":"2024-09-19T14:14:27.823104+0000","last_clean":"2024-09-19T14:14:27.823104+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:14:27.823104+0000","last_undegraded":"2024-09-19T14:14:27.823104+0000","last_fullsized":"2024-09-19T14:14:27.823104+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.822984+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:08.778750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":16519,"num_write":1037,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743810+0000","last_change":"2024-09-19T13:36:11.336061+0000","last_active":"2024-09-19T14:11:11.743810+0000","last_peered":"2024-09-19T14:11:11.743810+0000","last_clean":"2024-09-19T14:11:11.743810+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:11:11.743810+0000","last_undegraded":"2024-09-19T14:11:11.743810+0000","last_fullsized":"2024-09-19T14:11:11.743810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:12.530149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'144","reported_seq":721,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.359138+0000","last_change":"2024-09-19T13:36:13.342506+0000","last_active":"2024-09-19T14:14:18.359138+0000","last_peered":"2024-09-19T14:14:18.359138+0000","last_clean":"2024-09-19T14:14:18.359138+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:14:18.359138+0000","last_undegraded":"2024-09-19T14:14:18.359138+0000","last_fullsized":"2024-09-19T14:14:18.359138+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:39.717793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":198,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.720728+0000","last_change":"2024-09-19T13:36:15.349264+0000","last_active":"2024-09-19T14:11:16.720728+0000","last_peered":"2024-09-19T14:11:16.720728+0000","last_clean":"2024-09-19T14:11:16.720728+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:11:16.720728+0000","last_undegraded":"2024-09-19T14:11:16.720728+0000","last_fullsized":"2024-09-19T14:11:16.720728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:23.086503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'180","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:14.817537+0000","last_change":"2024-09-19T13:36:17.359223+0000","last_active":"2024-09-19T14:12:14.817537+0000","last_peered":"2024-09-19T14:12:14.817537+0000","last_clean":"2024-09-19T14:12:14.817537+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:12:14.817537+0000","last_undegraded":"2024-09-19T14:12:14.817537+0000","last_fullsized":"2024-09-19T14:12:14.817537+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:10.712355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'410","reported_seq":1901,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.343318+0000","last_change":"2024-09-19T14:14:33.343318+0000","last_active":"2024-09-19T14:14:33.343318+0000","last_peered":"2024-09-19T14:14:33.343318+0000","last_clean":"2024-09-19T14:14:33.343318+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:14:33.343318+0000","last_undegraded":"2024-09-19T14:14:33.343318+0000","last_fullsized":"2024-09-19T14:14:33.343318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'410","last_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_deep_scrub":"260'410","last_deep_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.343234+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:26.919333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3249,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'225","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.302102+0000","last_change":"2024-09-19T14:14:25.302102+0000","last_active":"2024-09-19T14:14:25.302102+0000","last_peered":"2024-09-19T14:14:25.302102+0000","last_clean":"2024-09-19T14:14:25.302102+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:14:25.302102+0000","last_undegraded":"2024-09-19T14:14:25.302102+0000","last_fullsized":"2024-09-19T14:14:25.302102+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.302035+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:39.521325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":697,"num_read_kb":42518,"num_write":1086,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.200192+0000","last_change":"2024-09-19T14:14:40.200192+0000","last_active":"2024-09-19T14:14:40.200192+0000","last_peered":"2024-09-19T14:14:40.200192+0000","last_clean":"2024-09-19T14:14:40.200192+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:14:40.200192+0000","last_undegraded":"2024-09-19T14:14:40.200192+0000","last_fullsized":"2024-09-19T14:14:40.200192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.200107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:09.154313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'129","reported_seq":685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.336765+0000","last_change":"2024-09-19T13:36:13.348210+0000","last_active":"2024-09-19T14:14:18.336765+0000","last_peered":"2024-09-19T14:14:18.336765+0000","last_clean":"2024-09-19T14:14:18.336765+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:14:18.336765+0000","last_undegraded":"2024-09-19T14:14:18.336765+0000","last_fullsized":"2024-09-19T14:14:18.336765+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:04.880223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611560+0000","last_change":"2024-09-19T13:36:15.353429+0000","last_active":"2024-09-19T14:11:16.611560+0000","last_peered":"2024-09-19T14:11:16.611560+0000","last_clean":"2024-09-19T14:11:16.611560+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:11:16.611560+0000","last_undegraded":"2024-09-19T14:11:16.611560+0000","last_fullsized":"2024-09-19T14:11:16.611560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.961183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'843","reported_seq":2334,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.153572+0000","last_change":"2024-09-19T14:14:35.153572+0000","last_active":"2024-09-19T14:14:35.153572+0000","last_peered":"2024-09-19T14:14:35.153572+0000","last_clean":"2024-09-19T14:14:35.153572+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:14:35.153572+0000","last_undegraded":"2024-09-19T14:14:35.153572+0000","last_fullsized":"2024-09-19T14:14:35.153572+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'843","last_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_deep_scrub":"260'843","last_deep_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.153464+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:33.436497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'213","reported_seq":834,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.383816+0000","last_change":"2024-09-19T14:14:26.383816+0000","last_active":"2024-09-19T14:14:26.383816+0000","last_peered":"2024-09-19T14:14:26.383816+0000","last_clean":"2024-09-19T14:14:26.383816+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:14:26.383816+0000","last_undegraded":"2024-09-19T14:14:26.383816+0000","last_fullsized":"2024-09-19T14:14:26.383816+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.383747+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:29.585612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":34256,"num_write":1036,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619281+0000","last_change":"2024-09-19T13:36:11.339451+0000","last_active":"2024-09-19T14:12:16.619281+0000","last_peered":"2024-09-19T14:12:16.619281+0000","last_clean":"2024-09-19T14:12:16.619281+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:12:16.619281+0000","last_undegraded":"2024-09-19T14:12:16.619281+0000","last_fullsized":"2024-09-19T14:12:16.619281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:18.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'186","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.479778+0000","last_change":"2024-09-19T13:36:13.344513+0000","last_active":"2024-09-19T14:14:18.479778+0000","last_peered":"2024-09-19T14:14:18.479778+0000","last_clean":"2024-09-19T14:14:18.479778+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:14:18.479778+0000","last_undegraded":"2024-09-19T14:14:18.479778+0000","last_fullsized":"2024-09-19T14:14:18.479778+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:22.941079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":293,"num_read_kb":440,"num_write":180,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.609853+0000","last_change":"2024-09-19T13:36:15.354407+0000","last_active":"2024-09-19T14:11:16.609853+0000","last_peered":"2024-09-19T14:11:16.609853+0000","last_clean":"2024-09-19T14:11:16.609853+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:11:16.609853+0000","last_undegraded":"2024-09-19T14:11:16.609853+0000","last_fullsized":"2024-09-19T14:11:16.609853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.667446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'194","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.814286+0000","last_change":"2024-09-19T13:36:17.363573+0000","last_active":"2024-09-19T14:12:27.814286+0000","last_peered":"2024-09-19T14:12:27.814286+0000","last_clean":"2024-09-19T14:12:27.814286+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:12:27.814286+0000","last_undegraded":"2024-09-19T14:12:27.814286+0000","last_fullsized":"2024-09-19T14:12:27.814286+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:53.961300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.197145+0000","last_change":"2024-09-19T14:14:37.197145+0000","last_active":"2024-09-19T14:14:37.197145+0000","last_peered":"2024-09-19T14:14:37.197145+0000","last_clean":"2024-09-19T14:14:37.197145+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:14:37.197145+0000","last_undegraded":"2024-09-19T14:14:37.197145+0000","last_fullsized":"2024-09-19T14:14:37.197145+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.197060+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:42.296752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'195","reported_seq":939,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.278507+0000","last_change":"2024-09-19T14:14:26.278507+0000","last_active":"2024-09-19T14:14:26.278507+0000","last_peered":"2024-09-19T14:14:26.278507+0000","last_clean":"2024-09-19T14:14:26.278507+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:14:26.278507+0000","last_undegraded":"2024-09-19T14:14:26.278507+0000","last_fullsized":"2024-09-19T14:14:26.278507+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.278417+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:45.039194+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":906,"num_read_kb":49787,"num_write":936,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.723358+0000","last_change":"2024-09-19T13:36:11.339099+0000","last_active":"2024-09-19T14:11:36.723358+0000","last_peered":"2024-09-19T14:11:36.723358+0000","last_clean":"2024-09-19T14:11:36.723358+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:11:36.723358+0000","last_undegraded":"2024-09-19T14:11:36.723358+0000","last_fullsized":"2024-09-19T14:11:36.723358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:44.638696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'131","reported_seq":698,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.342908+0000","last_change":"2024-09-19T13:36:13.351689+0000","last_active":"2024-09-19T14:14:18.342908+0000","last_peered":"2024-09-19T14:14:18.342908+0000","last_clean":"2024-09-19T14:14:18.342908+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:14:18.342908+0000","last_undegraded":"2024-09-19T14:14:18.342908+0000","last_fullsized":"2024-09-19T14:14:18.342908+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:59.476614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645982+0000","last_change":"2024-09-19T13:36:15.352438+0000","last_active":"2024-09-19T14:11:16.645982+0000","last_peered":"2024-09-19T14:11:16.645982+0000","last_clean":"2024-09-19T14:11:16.645982+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:11:16.645982+0000","last_undegraded":"2024-09-19T14:11:16.645982+0000","last_fullsized":"2024-09-19T14:11:16.645982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:36.174138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'153","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:05.915979+0000","last_change":"2024-09-19T13:36:17.361800+0000","last_active":"2024-09-19T14:12:05.915979+0000","last_peered":"2024-09-19T14:12:05.915979+0000","last_clean":"2024-09-19T14:12:05.915979+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:12:05.915979+0000","last_undegraded":"2024-09-19T14:12:05.915979+0000","last_fullsized":"2024-09-19T14:12:05.915979+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:05.195856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'365","reported_seq":1770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.344661+0000","last_change":"2024-09-19T14:14:38.344661+0000","last_active":"2024-09-19T14:14:38.344661+0000","last_peered":"2024-09-19T14:14:38.344661+0000","last_clean":"2024-09-19T14:14:38.344661+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:14:38.344661+0000","last_undegraded":"2024-09-19T14:14:38.344661+0000","last_fullsized":"2024-09-19T14:14:38.344661+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'365","last_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_deep_scrub":"260'365","last_deep_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.344573+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:24.841460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'205","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.620062+0000","last_change":"2024-09-19T14:14:25.620062+0000","last_active":"2024-09-19T14:14:25.620062+0000","last_peered":"2024-09-19T14:14:25.620062+0000","last_clean":"2024-09-19T14:14:25.620062+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:14:25.620062+0000","last_undegraded":"2024-09-19T14:14:25.620062+0000","last_fullsized":"2024-09-19T14:14:25.620062+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.619965+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:40.388409+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":98647,"num_write":933,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730104+0000","last_change":"2024-09-19T13:36:11.336450+0000","last_active":"2024-09-19T14:11:11.730104+0000","last_peered":"2024-09-19T14:11:11.730104+0000","last_clean":"2024-09-19T14:11:11.730104+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:11:11.730104+0000","last_undegraded":"2024-09-19T14:11:11.730104+0000","last_fullsized":"2024-09-19T14:11:11.730104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:28.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'123","reported_seq":686,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.461935+0000","last_change":"2024-09-19T13:36:13.679719+0000","last_active":"2024-09-19T14:14:18.461935+0000","last_peered":"2024-09-19T14:14:18.461935+0000","last_clean":"2024-09-19T14:14:18.461935+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:14:18.461935+0000","last_undegraded":"2024-09-19T14:14:18.461935+0000","last_fullsized":"2024-09-19T14:14:18.461935+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7162,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":222,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.653996+0000","last_change":"2024-09-19T13:36:15.346362+0000","last_active":"2024-09-19T14:12:21.653996+0000","last_peered":"2024-09-19T14:12:21.653996+0000","last_clean":"2024-09-19T14:12:21.653996+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:12:21.653996+0000","last_undegraded":"2024-09-19T14:12:21.653996+0000","last_fullsized":"2024-09-19T14:12:21.653996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:04.233453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'110","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:47.035975+0000","last_change":"2024-09-19T13:36:17.358911+0000","last_active":"2024-09-19T14:13:47.035975+0000","last_peered":"2024-09-19T14:13:47.035975+0000","last_clean":"2024-09-19T14:13:47.035975+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:13:47.035975+0000","last_undegraded":"2024-09-19T14:13:47.035975+0000","last_fullsized":"2024-09-19T14:13:47.035975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:09.127296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'868","reported_seq":2584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.153740+0000","last_change":"2024-09-19T14:14:26.153740+0000","last_active":"2024-09-19T14:14:26.153740+0000","last_peered":"2024-09-19T14:14:26.153740+0000","last_clean":"2024-09-19T14:14:26.153740+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:14:26.153740+0000","last_undegraded":"2024-09-19T14:14:26.153740+0000","last_fullsized":"2024-09-19T14:14:26.153740+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'868","last_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_deep_scrub":"260'868","last_deep_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.153669+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:07.343986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2999,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'241","reported_seq":860,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.275883+0000","last_change":"2024-09-19T14:14:26.275883+0000","last_active":"2024-09-19T14:14:26.275883+0000","last_peered":"2024-09-19T14:14:26.275883+0000","last_clean":"2024-09-19T14:14:26.275883+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:14:26.275883+0000","last_undegraded":"2024-09-19T14:14:26.275883+0000","last_fullsized":"2024-09-19T14:14:26.275883+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.275769+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:42.512214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":17644,"num_write":972,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.450775+0000","last_change":"2024-09-19T14:14:41.450775+0000","last_active":"2024-09-19T14:14:41.450775+0000","last_peered":"2024-09-19T14:14:41.450775+0000","last_clean":"2024-09-19T14:14:41.450775+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:14:41.450775+0000","last_undegraded":"2024-09-19T14:14:41.450775+0000","last_fullsized":"2024-09-19T14:14:41.450775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.450684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:36.944231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'73","reported_seq":582,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.739219+0000","last_change":"2024-09-19T13:36:13.678466+0000","last_active":"2024-09-19T14:12:21.739219+0000","last_peered":"2024-09-19T14:12:21.739219+0000","last_clean":"2024-09-19T14:12:21.739219+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:12:21.739219+0000","last_undegraded":"2024-09-19T14:12:21.739219+0000","last_fullsized":"2024-09-19T14:12:21.739219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.085161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'779","reported_seq":4109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.207156+0000","last_change":"2024-09-19T13:36:15.350958+0000","last_active":"2024-09-19T14:14:18.207156+0000","last_peered":"2024-09-19T14:14:18.207156+0000","last_clean":"2024-09-19T14:14:18.207156+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:14:18.207156+0000","last_undegraded":"2024-09-19T14:14:18.207156+0000","last_fullsized":"2024-09-19T14:14:18.207156+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.003728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'116","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.815973+0000","last_change":"2024-09-19T13:36:17.363671+0000","last_active":"2024-09-19T14:12:27.815973+0000","last_peered":"2024-09-19T14:12:27.815973+0000","last_clean":"2024-09-19T14:12:27.815973+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:12:27.815973+0000","last_undegraded":"2024-09-19T14:12:27.815973+0000","last_fullsized":"2024-09-19T14:12:27.815973+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'838","reported_seq":2313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.704717+0000","last_change":"2024-09-19T14:14:36.704717+0000","last_active":"2024-09-19T14:14:36.704717+0000","last_peered":"2024-09-19T14:14:36.704717+0000","last_clean":"2024-09-19T14:14:36.704717+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:14:36.704717+0000","last_undegraded":"2024-09-19T14:14:36.704717+0000","last_fullsized":"2024-09-19T14:14:36.704717+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.704635+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:10.522393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'179","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.802969+0000","last_change":"2024-09-19T14:14:28.802969+0000","last_active":"2024-09-19T14:14:28.802969+0000","last_peered":"2024-09-19T14:14:28.802969+0000","last_clean":"2024-09-19T14:14:28.802969+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:14:28.802969+0000","last_undegraded":"2024-09-19T14:14:28.802969+0000","last_fullsized":"2024-09-19T14:14:28.802969+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'179","last_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_deep_scrub":"260'179","last_deep_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.802887+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:55.372480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":5488,"num_write":868,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.743900+0000","last_change":"2024-09-19T13:36:11.339110+0000","last_active":"2024-09-19T14:11:11.743900+0000","last_peered":"2024-09-19T14:11:11.743900+0000","last_clean":"2024-09-19T14:11:11.743900+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:11:11.743900+0000","last_undegraded":"2024-09-19T14:11:11.743900+0000","last_fullsized":"2024-09-19T14:11:11.743900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:19.072017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'147","reported_seq":711,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.271827+0000","last_change":"2024-09-19T13:36:13.345724+0000","last_active":"2024-09-19T14:14:18.271827+0000","last_peered":"2024-09-19T14:14:18.271827+0000","last_clean":"2024-09-19T14:14:18.271827+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:14:18.271827+0000","last_undegraded":"2024-09-19T14:14:18.271827+0000","last_fullsized":"2024-09-19T14:14:18.271827+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:09.615248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7396,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":254,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:06.601159+0000","last_change":"2024-09-19T13:36:15.348860+0000","last_active":"2024-09-19T14:10:06.601159+0000","last_peered":"2024-09-19T14:10:06.601159+0000","last_clean":"2024-09-19T14:10:06.601159+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:10:06.601159+0000","last_undegraded":"2024-09-19T14:10:06.601159+0000","last_fullsized":"2024-09-19T14:10:06.601159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:42.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'111","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:12.467492+0000","last_change":"2024-09-19T13:36:17.357887+0000","last_active":"2024-09-19T14:12:12.467492+0000","last_peered":"2024-09-19T14:12:12.467492+0000","last_clean":"2024-09-19T14:12:12.467492+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:12:12.467492+0000","last_undegraded":"2024-09-19T14:12:12.467492+0000","last_fullsized":"2024-09-19T14:12:12.467492+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:57.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.694724+0000","last_change":"2024-09-19T14:14:35.694724+0000","last_active":"2024-09-19T14:14:35.694724+0000","last_peered":"2024-09-19T14:14:35.694724+0000","last_clean":"2024-09-19T14:14:35.694724+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:14:35.694724+0000","last_undegraded":"2024-09-19T14:14:35.694724+0000","last_fullsized":"2024-09-19T14:14:35.694724+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'888","last_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_deep_scrub":"260'888","last_deep_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.694623+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:14.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'245","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.794846+0000","last_change":"2024-09-19T14:14:30.794846+0000","last_active":"2024-09-19T14:14:30.794846+0000","last_peered":"2024-09-19T14:14:30.794846+0000","last_clean":"2024-09-19T14:14:30.794846+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:14:30.794846+0000","last_undegraded":"2024-09-19T14:14:30.794846+0000","last_fullsized":"2024-09-19T14:14:30.794846+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'245","last_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_deep_scrub":"260'245","last_deep_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.794729+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:31.629348+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":59575,"num_write":1084,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.609332+0000","last_change":"2024-09-19T13:36:11.336616+0000","last_active":"2024-09-19T14:11:11.609332+0000","last_peered":"2024-09-19T14:11:11.609332+0000","last_clean":"2024-09-19T14:11:11.609332+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:11:11.609332+0000","last_undegraded":"2024-09-19T14:11:11.609332+0000","last_fullsized":"2024-09-19T14:11:11.609332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:30.775102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'132","reported_seq":685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.278251+0000","last_change":"2024-09-19T13:36:13.344971+0000","last_active":"2024-09-19T14:14:18.278251+0000","last_peered":"2024-09-19T14:14:18.278251+0000","last_clean":"2024-09-19T14:14:18.278251+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:14:18.278251+0000","last_undegraded":"2024-09-19T14:14:18.278251+0000","last_fullsized":"2024-09-19T14:14:18.278251+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:03.245114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:11.711890+0000","last_change":"2024-09-19T13:36:15.353381+0000","last_active":"2024-09-19T14:10:11.711890+0000","last_peered":"2024-09-19T14:10:11.711890+0000","last_clean":"2024-09-19T14:10:11.711890+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:10:11.711890+0000","last_undegraded":"2024-09-19T14:10:11.711890+0000","last_fullsized":"2024-09-19T14:10:11.711890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.838545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'82","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:08.528868+0000","last_change":"2024-09-19T13:36:17.361965+0000","last_active":"2024-09-19T14:12:08.528868+0000","last_peered":"2024-09-19T14:12:08.528868+0000","last_clean":"2024-09-19T14:12:08.528868+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:12:08.528868+0000","last_undegraded":"2024-09-19T14:12:08.528868+0000","last_fullsized":"2024-09-19T14:12:08.528868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:25.682631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'389","reported_seq":1830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.339428+0000","last_change":"2024-09-19T14:14:39.339428+0000","last_active":"2024-09-19T14:14:39.339428+0000","last_peered":"2024-09-19T14:14:39.339428+0000","last_clean":"2024-09-19T14:14:39.339428+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:14:39.339428+0000","last_undegraded":"2024-09-19T14:14:39.339428+0000","last_fullsized":"2024-09-19T14:14:39.339428+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.339324+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:46.745230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'201","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.141243+0000","last_change":"2024-09-19T14:14:23.141243+0000","last_active":"2024-09-19T14:14:23.141243+0000","last_peered":"2024-09-19T14:14:23.141243+0000","last_clean":"2024-09-19T14:14:23.141243+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:14:23.141243+0000","last_undegraded":"2024-09-19T14:14:23.141243+0000","last_fullsized":"2024-09-19T14:14:23.141243+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.141172+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:48:13.237318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":516,"num_read_kb":9219,"num_write":929,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:01.719839+0000","last_change":"2024-09-19T13:36:11.334533+0000","last_active":"2024-09-19T14:10:01.719839+0000","last_peered":"2024-09-19T14:10:01.719839+0000","last_clean":"2024-09-19T14:10:01.719839+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:10:01.719839+0000","last_undegraded":"2024-09-19T14:10:01.719839+0000","last_fullsized":"2024-09-19T14:10:01.719839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:10.318546+0000","last_clean_scrub_stamp":"2024-09-19T13:36:10.318546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:55.200899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'115","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.449942+0000","last_change":"2024-09-19T13:36:13.346260+0000","last_active":"2024-09-19T14:14:18.449942+0000","last_peered":"2024-09-19T14:14:18.449942+0000","last_clean":"2024-09-19T14:14:18.449942+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:14:18.449942+0000","last_undegraded":"2024-09-19T14:14:18.449942+0000","last_fullsized":"2024-09-19T14:14:18.449942+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:37.266432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7954,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":214,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730630+0000","last_change":"2024-09-19T13:36:15.348740+0000","last_active":"2024-09-19T14:11:16.730630+0000","last_peered":"2024-09-19T14:11:16.730630+0000","last_clean":"2024-09-19T14:11:16.730630+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:11:16.730630+0000","last_undegraded":"2024-09-19T14:11:16.730630+0000","last_fullsized":"2024-09-19T14:11:16.730630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:00.693042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'161","reported_seq":1613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.352324+0000","last_change":"2024-09-19T13:36:17.359613+0000","last_active":"2024-09-19T14:12:27.352324+0000","last_peered":"2024-09-19T14:12:27.352324+0000","last_clean":"2024-09-19T14:12:27.352324+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:12:27.352324+0000","last_undegraded":"2024-09-19T14:12:27.352324+0000","last_fullsized":"2024-09-19T14:12:27.352324+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:03.545885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1273","reported_seq":2994,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.694601+0000","last_change":"2024-09-19T14:14:34.694601+0000","last_active":"2024-09-19T14:14:34.694601+0000","last_peered":"2024-09-19T14:14:34.694601+0000","last_clean":"2024-09-19T14:14:34.694601+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:14:34.694601+0000","last_undegraded":"2024-09-19T14:14:34.694601+0000","last_fullsized":"2024-09-19T14:14:34.694601+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1273","last_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_deep_scrub":"260'1273","last_deep_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.694504+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:28.668229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'210","reported_seq":895,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.226451+0000","last_change":"2024-09-19T14:14:27.226451+0000","last_active":"2024-09-19T14:14:27.226451+0000","last_peered":"2024-09-19T14:14:27.226451+0000","last_clean":"2024-09-19T14:14:27.226451+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:14:27.226451+0000","last_undegraded":"2024-09-19T14:14:27.226451+0000","last_fullsized":"2024-09-19T14:14:27.226451+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.226323+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:19.006735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":101743,"num_write":1010,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.411618+0000","last_change":"2024-09-19T14:14:40.411618+0000","last_active":"2024-09-19T14:14:40.411618+0000","last_peered":"2024-09-19T14:14:40.411618+0000","last_clean":"2024-09-19T14:14:40.411618+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:14:40.411618+0000","last_undegraded":"2024-09-19T14:14:40.411618+0000","last_fullsized":"2024-09-19T14:14:40.411618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.411523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:59.159110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'159","reported_seq":732,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.473577+0000","last_change":"2024-09-19T13:36:13.345467+0000","last_active":"2024-09-19T14:14:18.473577+0000","last_peered":"2024-09-19T14:14:18.473577+0000","last_clean":"2024-09-19T14:14:18.473577+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:14:18.473577+0000","last_undegraded":"2024-09-19T14:14:18.473577+0000","last_fullsized":"2024-09-19T14:14:18.473577+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:12.328269+0000","last_clean_scrub_stamp":"2024-09-19T13:36:12.328269+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:15.423692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9862,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":313,"num_write":122,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611550+0000","last_change":"2024-09-19T13:36:15.349620+0000","last_active":"2024-09-19T14:11:16.611550+0000","last_peered":"2024-09-19T14:11:16.611550+0000","last_clean":"2024-09-19T14:11:16.611550+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:11:16.611550+0000","last_undegraded":"2024-09-19T14:11:16.611550+0000","last_fullsized":"2024-09-19T14:11:16.611550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:14.331500+0000","last_clean_scrub_stamp":"2024-09-19T13:36:14.331500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:30.666417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'158","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:45.855539+0000","last_change":"2024-09-19T13:36:17.360385+0000","last_active":"2024-09-19T14:13:45.855539+0000","last_peered":"2024-09-19T14:13:45.855539+0000","last_clean":"2024-09-19T14:13:45.855539+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:13:45.855539+0000","last_undegraded":"2024-09-19T14:13:45.855539+0000","last_fullsized":"2024-09-19T14:13:45.855539+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:56.457101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'836","reported_seq":2520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.397395+0000","last_change":"2024-09-19T14:14:37.397395+0000","last_active":"2024-09-19T14:14:37.397395+0000","last_peered":"2024-09-19T14:14:37.397395+0000","last_clean":"2024-09-19T14:14:37.397395+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:14:37.397395+0000","last_undegraded":"2024-09-19T14:14:37.397395+0000","last_fullsized":"2024-09-19T14:14:37.397395+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'836","last_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_deep_scrub":"260'836","last_deep_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.397294+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:44.618601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'249","reported_seq":948,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.176212+0000","last_change":"2024-09-19T14:14:31.176212+0000","last_active":"2024-09-19T14:14:31.176212+0000","last_peered":"2024-09-19T14:14:31.176212+0000","last_clean":"2024-09-19T14:14:31.176212+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:14:31.176212+0000","last_undegraded":"2024-09-19T14:14:31.176212+0000","last_fullsized":"2024-09-19T14:14:31.176212+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'249","last_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_deep_scrub":"260'249","last_deep_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.176114+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:57.461970+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":888,"num_read_kb":7647,"num_write":1101,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.436486+0000","last_change":"2024-09-19T14:14:36.436486+0000","last_active":"2024-09-19T14:14:36.436486+0000","last_peered":"2024-09-19T14:14:36.436486+0000","last_clean":"2024-09-19T14:14:36.436486+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:14:36.436486+0000","last_undegraded":"2024-09-19T14:14:36.436486+0000","last_fullsized":"2024-09-19T14:14:36.436486+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'447","last_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_deep_scrub":"260'447","last_deep_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.436372+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:10.165233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'218","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.173076+0000","last_change":"2024-09-19T14:14:27.173076+0000","last_active":"2024-09-19T14:14:27.173076+0000","last_peered":"2024-09-19T14:14:27.173076+0000","last_clean":"2024-09-19T14:14:27.173076+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:14:27.173076+0000","last_undegraded":"2024-09-19T14:14:27.173076+0000","last_fullsized":"2024-09-19T14:14:27.173076+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.172984+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:42.410826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":577,"num_read_kb":9780,"num_write":1046,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'455","reported_seq":2088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.752784+0000","last_change":"2024-09-19T14:14:39.752784+0000","last_active":"2024-09-19T14:14:39.752784+0000","last_peered":"2024-09-19T14:14:39.752784+0000","last_clean":"2024-09-19T14:14:39.752784+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:14:39.752784+0000","last_undegraded":"2024-09-19T14:14:39.752784+0000","last_fullsized":"2024-09-19T14:14:39.752784+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'455","last_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_deep_scrub":"260'455","last_deep_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.752704+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:34.065704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'211","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.759444+0000","last_change":"2024-09-19T14:14:29.759444+0000","last_active":"2024-09-19T14:14:29.759444+0000","last_peered":"2024-09-19T14:14:29.759444+0000","last_clean":"2024-09-19T14:14:29.759444+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:14:29.759444+0000","last_undegraded":"2024-09-19T14:14:29.759444+0000","last_fullsized":"2024-09-19T14:14:29.759444+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'211","last_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_deep_scrub":"260'211","last_deep_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.759339+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.186994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":691,"num_read_kb":41340,"num_write":997,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'838","reported_seq":2606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.446544+0000","last_change":"2024-09-19T14:14:35.446544+0000","last_active":"2024-09-19T14:14:35.446544+0000","last_peered":"2024-09-19T14:14:35.446544+0000","last_clean":"2024-09-19T14:14:35.446544+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:14:35.446544+0000","last_undegraded":"2024-09-19T14:14:35.446544+0000","last_fullsized":"2024-09-19T14:14:35.446544+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.446452+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:35.254669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'348","reported_seq":1037,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.265255+0000","last_change":"2024-09-19T14:14:28.265255+0000","last_active":"2024-09-19T14:14:28.265255+0000","last_peered":"2024-09-19T14:14:28.265255+0000","last_clean":"2024-09-19T14:14:28.265255+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:14:28.265255+0000","last_undegraded":"2024-09-19T14:14:28.265255+0000","last_fullsized":"2024-09-19T14:14:28.265255+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.265167+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:06.385286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":988,"num_read_kb":17821,"num_write":1252,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1315","reported_seq":2976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.329566+0000","last_change":"2024-09-19T14:14:41.329566+0000","last_active":"2024-09-19T14:14:41.329566+0000","last_peered":"2024-09-19T14:14:41.329566+0000","last_clean":"2024-09-19T14:14:41.329566+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:14:41.329566+0000","last_undegraded":"2024-09-19T14:14:41.329566+0000","last_fullsized":"2024-09-19T14:14:41.329566+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1315","last_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_deep_scrub":"260'1315","last_deep_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.329479+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:37.922023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'188","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.334879+0000","last_change":"2024-09-19T14:14:28.334879+0000","last_active":"2024-09-19T14:14:28.334879+0000","last_peered":"2024-09-19T14:14:28.334879+0000","last_clean":"2024-09-19T14:14:28.334879+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:14:28.334879+0000","last_undegraded":"2024-09-19T14:14:28.334879+0000","last_fullsized":"2024-09-19T14:14:28.334879+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.334791+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:30.887824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170303,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":35047,"num_write":889,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'461","reported_seq":2160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.731079+0000","last_change":"2024-09-19T14:14:37.731079+0000","last_active":"2024-09-19T14:14:37.731079+0000","last_peered":"2024-09-19T14:14:37.731079+0000","last_clean":"2024-09-19T14:14:37.731079+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:14:37.731079+0000","last_undegraded":"2024-09-19T14:14:37.731079+0000","last_fullsized":"2024-09-19T14:14:37.731079+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'461","last_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_deep_scrub":"260'461","last_deep_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.730982+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:25.634386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'263","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.272920+0000","last_change":"2024-09-19T14:14:27.272920+0000","last_active":"2024-09-19T14:14:27.272920+0000","last_peered":"2024-09-19T14:14:27.272920+0000","last_clean":"2024-09-19T14:14:27.272920+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:14:27.272920+0000","last_undegraded":"2024-09-19T14:14:27.272920+0000","last_fullsized":"2024-09-19T14:14:27.272920+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'263","last_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_deep_scrub":"260'263","last_deep_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.272800+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:17.008251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'506","reported_seq":2130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.307274+0000","last_change":"2024-09-19T14:14:40.307274+0000","last_active":"2024-09-19T14:14:40.307274+0000","last_peered":"2024-09-19T14:14:40.307274+0000","last_clean":"2024-09-19T14:14:40.307274+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:14:40.307274+0000","last_undegraded":"2024-09-19T14:14:40.307274+0000","last_fullsized":"2024-09-19T14:14:40.307274+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.307175+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:34.215410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'215","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.144807+0000","last_change":"2024-09-19T14:14:27.144807+0000","last_active":"2024-09-19T14:14:27.144807+0000","last_peered":"2024-09-19T14:14:27.144807+0000","last_clean":"2024-09-19T14:14:27.144807+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:14:27.144807+0000","last_undegraded":"2024-09-19T14:14:27.144807+0000","last_fullsized":"2024-09-19T14:14:27.144807+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.144709+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:35.772460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":13499,"num_write":1011,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'444","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.179317+0000","last_change":"2024-09-19T14:14:37.179317+0000","last_active":"2024-09-19T14:14:37.179317+0000","last_peered":"2024-09-19T14:14:37.179317+0000","last_clean":"2024-09-19T14:14:37.179317+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:14:37.179317+0000","last_undegraded":"2024-09-19T14:14:37.179317+0000","last_fullsized":"2024-09-19T14:14:37.179317+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'444","last_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_deep_scrub":"260'444","last_deep_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.179230+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:09.695208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'244","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.284232+0000","last_change":"2024-09-19T14:14:29.284232+0000","last_active":"2024-09-19T14:14:29.284232+0000","last_peered":"2024-09-19T14:14:29.284232+0000","last_clean":"2024-09-19T14:14:29.284232+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:14:29.284232+0000","last_undegraded":"2024-09-19T14:14:29.284232+0000","last_fullsized":"2024-09-19T14:14:29.284232+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.284150+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:03.574863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":662,"num_read_kb":12703,"num_write":1156,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'798","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.184755+0000","last_change":"2024-09-19T14:14:38.184755+0000","last_active":"2024-09-19T14:14:38.184755+0000","last_peered":"2024-09-19T14:14:38.184755+0000","last_clean":"2024-09-19T14:14:38.184755+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:14:38.184755+0000","last_undegraded":"2024-09-19T14:14:38.184755+0000","last_fullsized":"2024-09-19T14:14:38.184755+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.184639+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:45.021809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'200","reported_seq":820,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.783242+0000","last_change":"2024-09-19T14:14:32.783242+0000","last_active":"2024-09-19T14:14:32.783242+0000","last_peered":"2024-09-19T14:14:32.783242+0000","last_clean":"2024-09-19T14:14:32.783242+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:14:32.783242+0000","last_undegraded":"2024-09-19T14:14:32.783242+0000","last_fullsized":"2024-09-19T14:14:32.783242+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.783156+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.959321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":31175,"num_write":936,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'412","reported_seq":1863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.794667+0000","last_change":"2024-09-19T14:14:39.794667+0000","last_active":"2024-09-19T14:14:39.794667+0000","last_peered":"2024-09-19T14:14:39.794667+0000","last_clean":"2024-09-19T14:14:39.794667+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:14:39.794667+0000","last_undegraded":"2024-09-19T14:14:39.794667+0000","last_fullsized":"2024-09-19T14:14:39.794667+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'412","last_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_deep_scrub":"260'412","last_deep_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.794561+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:17.283150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'220","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.300531+0000","last_change":"2024-09-19T14:14:30.300531+0000","last_active":"2024-09-19T14:14:30.300531+0000","last_peered":"2024-09-19T14:14:30.300531+0000","last_clean":"2024-09-19T14:14:30.300531+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:14:30.300531+0000","last_undegraded":"2024-09-19T14:14:30.300531+0000","last_fullsized":"2024-09-19T14:14:30.300531+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.300443+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:44.686591+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":31236,"num_write":1023,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'417","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.201597+0000","last_change":"2024-09-19T14:14:28.201597+0000","last_active":"2024-09-19T14:14:28.201597+0000","last_peered":"2024-09-19T14:14:28.201597+0000","last_clean":"2024-09-19T14:14:28.201597+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:14:28.201597+0000","last_undegraded":"2024-09-19T14:14:28.201597+0000","last_fullsized":"2024-09-19T14:14:28.201597+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.201511+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:48.368700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'290","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.793178+0000","last_change":"2024-09-19T14:14:31.793178+0000","last_active":"2024-09-19T14:14:31.793178+0000","last_peered":"2024-09-19T14:14:31.793178+0000","last_clean":"2024-09-19T14:14:31.793178+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:14:31.793178+0000","last_undegraded":"2024-09-19T14:14:31.793178+0000","last_fullsized":"2024-09-19T14:14:31.793178+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.793101+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:55.675665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":11922,"num_write":1198,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'364","reported_seq":1810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.759457+0000","last_change":"2024-09-19T14:14:38.759457+0000","last_active":"2024-09-19T14:14:38.759457+0000","last_peered":"2024-09-19T14:14:38.759457+0000","last_clean":"2024-09-19T14:14:38.759457+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:14:38.759457+0000","last_undegraded":"2024-09-19T14:14:38.759457+0000","last_fullsized":"2024-09-19T14:14:38.759457+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.759372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:34.123627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'216","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.274839+0000","last_change":"2024-09-19T14:14:29.274839+0000","last_active":"2024-09-19T14:14:29.274839+0000","last_peered":"2024-09-19T14:14:29.274839+0000","last_clean":"2024-09-19T14:14:29.274839+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:14:29.274839+0000","last_undegraded":"2024-09-19T14:14:29.274839+0000","last_fullsized":"2024-09-19T14:14:29.274839+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.274732+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:54.840076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":593,"num_read_kb":98527,"num_write":1024,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'870","reported_seq":2506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.147163+0000","last_change":"2024-09-19T14:14:38.147163+0000","last_active":"2024-09-19T14:14:38.147163+0000","last_peered":"2024-09-19T14:14:38.147163+0000","last_clean":"2024-09-19T14:14:38.147163+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:14:38.147163+0000","last_undegraded":"2024-09-19T14:14:38.147163+0000","last_fullsized":"2024-09-19T14:14:38.147163+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'870","last_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_deep_scrub":"260'870","last_deep_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.147083+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:06:43.098776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'246","reported_seq":936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.136442+0000","last_change":"2024-09-19T14:14:29.136442+0000","last_active":"2024-09-19T14:14:29.136442+0000","last_peered":"2024-09-19T14:14:29.136442+0000","last_clean":"2024-09-19T14:14:29.136442+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:14:29.136442+0000","last_undegraded":"2024-09-19T14:14:29.136442+0000","last_fullsized":"2024-09-19T14:14:29.136442+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'246","last_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_deep_scrub":"260'246","last_deep_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.136336+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:58.288005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":868,"num_read_kb":9315,"num_write":1049,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3085,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.236512+0000","last_change":"2024-09-19T14:14:36.236512+0000","last_active":"2024-09-19T14:14:36.236512+0000","last_peered":"2024-09-19T14:14:36.236512+0000","last_clean":"2024-09-19T14:14:36.236512+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:14:36.236512+0000","last_undegraded":"2024-09-19T14:14:36.236512+0000","last_fullsized":"2024-09-19T14:14:36.236512+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1368","last_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_deep_scrub":"260'1368","last_deep_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.236418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:57.105756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'257","reported_seq":891,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.074777+0000","last_change":"2024-09-19T14:14:33.074714+0000","last_active":"2024-09-19T14:14:33.074777+0000","last_peered":"2024-09-19T14:14:33.074777+0000","last_clean":"2024-09-19T14:14:33.074777+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:14:33.074777+0000","last_undegraded":"2024-09-19T14:14:33.074777+0000","last_fullsized":"2024-09-19T14:14:33.074777+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'257","last_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_deep_scrub":"260'257","last_deep_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.074609+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:15.486564+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":13968,"num_write":1077,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'506","reported_seq":2123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:13.607663+0000","last_change":"2024-09-19T13:36:09.336661+0000","last_active":"2024-09-19T14:12:13.607663+0000","last_peered":"2024-09-19T14:12:13.607663+0000","last_clean":"2024-09-19T14:12:13.607663+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:12:13.607663+0000","last_undegraded":"2024-09-19T14:12:13.607663+0000","last_fullsized":"2024-09-19T14:12:13.607663+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'223","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.140942+0000","last_change":"2024-09-19T14:14:25.140942+0000","last_active":"2024-09-19T14:14:25.140942+0000","last_peered":"2024-09-19T14:14:25.140942+0000","last_clean":"2024-09-19T14:14:25.140942+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:14:25.140942+0000","last_undegraded":"2024-09-19T14:14:25.140942+0000","last_fullsized":"2024-09-19T14:14:25.140942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'223","last_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_deep_scrub":"260'223","last_deep_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.140874+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:35.398581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":601,"num_read_kb":75622,"num_write":971,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'451","reported_seq":1955,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.168465+0000","last_change":"2024-09-19T14:14:39.168465+0000","last_active":"2024-09-19T14:14:39.168465+0000","last_peered":"2024-09-19T14:14:39.168465+0000","last_clean":"2024-09-19T14:14:39.168465+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:14:39.168465+0000","last_undegraded":"2024-09-19T14:14:39.168465+0000","last_fullsized":"2024-09-19T14:14:39.168465+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.168391+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:37.445191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'200","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.769229+0000","last_change":"2024-09-19T14:14:33.769229+0000","last_active":"2024-09-19T14:14:33.769229+0000","last_peered":"2024-09-19T14:14:33.769229+0000","last_clean":"2024-09-19T14:14:33.769229+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:14:33.769229+0000","last_undegraded":"2024-09-19T14:14:33.769229+0000","last_fullsized":"2024-09-19T14:14:33.769229+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.769142+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:16.153085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":10629,"num_write":1012,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'199","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.744446+0000","last_change":"2024-09-19T14:14:34.744446+0000","last_active":"2024-09-19T14:14:34.744446+0000","last_peered":"2024-09-19T14:14:34.744446+0000","last_clean":"2024-09-19T14:14:34.744446+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:14:34.744446+0000","last_undegraded":"2024-09-19T14:14:34.744446+0000","last_fullsized":"2024-09-19T14:14:34.744446+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'199","last_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_deep_scrub":"260'199","last_deep_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.744323+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:13.419758+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":6982,"num_write":950,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'989","reported_seq":2919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.211498+0000","last_change":"2024-09-19T14:14:39.211498+0000","last_active":"2024-09-19T14:14:39.211498+0000","last_peered":"2024-09-19T14:14:39.211498+0000","last_clean":"2024-09-19T14:14:39.211498+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:14:39.211498+0000","last_undegraded":"2024-09-19T14:14:39.211498+0000","last_fullsized":"2024-09-19T14:14:39.211498+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'989","last_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_deep_scrub":"260'989","last_deep_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.211398+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:47.763679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4337,"num_omap_keys":17,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'233","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.306234+0000","last_change":"2024-09-19T14:14:28.306234+0000","last_active":"2024-09-19T14:14:28.306234+0000","last_peered":"2024-09-19T14:14:28.306234+0000","last_clean":"2024-09-19T14:14:28.306234+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:14:28.306234+0000","last_undegraded":"2024-09-19T14:14:28.306234+0000","last_fullsized":"2024-09-19T14:14:28.306234+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'233","last_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_deep_scrub":"260'233","last_deep_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.306126+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.168938+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":54230,"num_write":1173,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'386","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.347586+0000","last_change":"2024-09-19T13:36:09.336829+0000","last_active":"2024-09-19T14:12:27.347586+0000","last_peered":"2024-09-19T14:12:27.347586+0000","last_clean":"2024-09-19T14:12:27.347586+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:12:27.347586+0000","last_undegraded":"2024-09-19T14:12:27.347586+0000","last_fullsized":"2024-09-19T14:12:27.347586+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:08.315022+0000","last_clean_scrub_stamp":"2024-09-19T13:36:08.315022+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:29.837597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1682,"ondisk_log_size":1682,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":641,"ondisk_log_size":641,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314615,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7869,"num_read_kb":9932,"num_write":5261,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2874,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33718,"num_omap_keys":136,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4175,"ondisk_log_size":4175,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40883929,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38761,"num_read_kb":2616727,"num_write":63893,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":81767858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4188,"ondisk_log_size":4188,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":176453,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":179418,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542613,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235860,"kb_used_data":15876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94135980,"statfs":{"total":96636764160,"available":96395243520,"internally_reserved":0,"allocated":16257024,"data_stored":14556338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542614,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230792,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94141048,"statfs":{"total":96636764160,"available":96400433152,"internally_reserved":0,"allocated":15327232,"data_stored":13795194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542614,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102852,"kb_used_data":13428,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94268988,"statfs":{"total":96636764160,"available":96531443712,"internally_reserved":0,"allocated":13750272,"data_stored":12053849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542617,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94804,"kb_used_data":19204,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94277036,"statfs":{"total":96636764160,"available":96539684864,"internally_reserved":0,"allocated":19664896,"data_stored":18070568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542615,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248784,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123056,"statfs":{"total":96636764160,"available":96382009344,"internally_reserved":0,"allocated":19529728,"data_stored":17906941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542615,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75700,"kb_used_data":8420,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296140,"statfs":{"total":96636764160,"available":96559247360,"internally_reserved":0,"allocated":8622080,"data_stored":7083388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542614,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128220,"kb_used_data":6860,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94243620,"statfs":{"total":96636764160,"available":96505466880,"internally_reserved":0,"allocated":7024640,"data_stored":5427412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542615,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242092,"kb_used_data":12380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94129748,"statfs":{"total":96636764160,"available":96388861952,"internally_reserved":0,"allocated":12677120,"data_stored":10986646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8458240,"data_stored":8279931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3432448,"data_stored":3312234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5058560,"data_stored":4967857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":15790141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":15955950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10084352,"data_stored":9935554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11751424,"data_stored":11680028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":11846163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:14:45.520 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.521 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.522 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.523 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.524 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.525 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.526 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.527 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.528 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.529 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.530 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.531 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.532 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.533 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.534 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.535 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.536 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.537 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.538 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.539 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.540 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.541 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.542 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.543 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.544 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.545 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.546 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.547 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T13:36:10.318546+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=10, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.548 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.549 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.549 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T13:36:12.328269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.549 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T13:36:14.331500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.549 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.549 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.550 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T13:36:08.315022+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:14:45.550 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T14:15:05.551 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:15:05.890 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:15:05.901 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:15:05.904 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1430,"stamp":"2024-09-19T14:15:05.728419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41806249,"num_objects":632,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":296329,"num_read_kb":3211329,"num_write":145619,"num_write_kb":2512533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741328,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13963,"ondisk_log_size":13963,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1359104,"kb_used_data":110208,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753615616,"statfs":{"total":773094113280,"available":771702390784,"internally_reserved":0,"allocated":112852992,"data_stored":99880336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":520761,"num_omap_keys":1208,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005334"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.604790+0000","last_change":"2024-09-19T14:03:08.839286+0000","last_active":"2024-09-19T14:10:41.604790+0000","last_peered":"2024-09-19T14:10:41.604790+0000","last_clean":"2024-09-19T14:10:41.604790+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:10:41.604790+0000","last_undegraded":"2024-09-19T14:10:41.604790+0000","last_fullsized":"2024-09-19T14:10:41.604790+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:42.826327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.602224+0000","last_change":"2024-09-19T13:52:51.581992+0000","last_active":"2024-09-19T14:10:21.602224+0000","last_peered":"2024-09-19T14:10:21.602224+0000","last_clean":"2024-09-19T14:10:21.602224+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:10:21.602224+0000","last_undegraded":"2024-09-19T14:10:21.602224+0000","last_fullsized":"2024-09-19T14:10:21.602224+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:21.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.722729+0000","last_change":"2024-09-19T13:52:48.556806+0000","last_active":"2024-09-19T14:10:21.722729+0000","last_peered":"2024-09-19T14:10:21.722729+0000","last_clean":"2024-09-19T14:10:21.722729+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:10:21.722729+0000","last_undegraded":"2024-09-19T14:10:21.722729+0000","last_fullsized":"2024-09-19T14:10:21.722729+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:12.304171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.618002+0000","last_change":"2024-09-19T13:51:15.739764+0000","last_active":"2024-09-19T14:12:06.618002+0000","last_peered":"2024-09-19T14:12:06.618002+0000","last_clean":"2024-09-19T14:12:06.618002+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:12:06.618002+0000","last_undegraded":"2024-09-19T14:12:06.618002+0000","last_fullsized":"2024-09-19T14:12:06.618002+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:19.998068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.846653+0000","last_change":"2024-09-19T14:14:51.846653+0000","last_active":"2024-09-19T14:14:51.846653+0000","last_peered":"2024-09-19T14:14:51.846653+0000","last_clean":"2024-09-19T14:14:51.846653+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:14:51.846653+0000","last_undegraded":"2024-09-19T14:14:51.846653+0000","last_fullsized":"2024-09-19T14:14:51.846653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:51.846559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:51.846559+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.846559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:04.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.743761+0000","last_change":"2024-09-19T13:52:51.587845+0000","last_active":"2024-09-19T14:12:51.743761+0000","last_peered":"2024-09-19T14:12:51.743761+0000","last_clean":"2024-09-19T14:12:51.743761+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:12:51.743761+0000","last_undegraded":"2024-09-19T14:12:51.743761+0000","last_fullsized":"2024-09-19T14:12:51.743761+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:46.261905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.392837+0000","last_change":"2024-09-19T14:14:56.392837+0000","last_active":"2024-09-19T14:14:56.392837+0000","last_peered":"2024-09-19T14:14:56.392837+0000","last_clean":"2024-09-19T14:14:56.392837+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:14:56.392837+0000","last_undegraded":"2024-09-19T14:14:56.392837+0000","last_fullsized":"2024-09-19T14:14:56.392837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:56.392758+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:56.392758+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.392758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:53.408517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.009429+0000","last_change":"2024-09-19T14:14:44.009429+0000","last_active":"2024-09-19T14:14:44.009429+0000","last_peered":"2024-09-19T14:14:44.009429+0000","last_clean":"2024-09-19T14:14:44.009429+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:14:44.009429+0000","last_undegraded":"2024-09-19T14:14:44.009429+0000","last_fullsized":"2024-09-19T14:14:44.009429+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'21","last_scrub_stamp":"2024-09-19T14:14:44.009304+0000","last_deep_scrub":"260'21","last_deep_scrub_stamp":"2024-09-19T14:14:44.009304+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.009304+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.713992+0000","last_change":"2024-09-19T14:03:08.837569+0000","last_active":"2024-09-19T14:10:26.713992+0000","last_peered":"2024-09-19T14:10:26.713992+0000","last_clean":"2024-09-19T14:10:26.713992+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:10:26.713992+0000","last_undegraded":"2024-09-19T14:10:26.713992+0000","last_fullsized":"2024-09-19T14:10:26.713992+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:12.734099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.614000+0000","last_change":"2024-09-19T13:52:51.586976+0000","last_active":"2024-09-19T14:11:36.614000+0000","last_peered":"2024-09-19T14:11:36.614000+0000","last_clean":"2024-09-19T14:11:36.614000+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:11:36.614000+0000","last_undegraded":"2024-09-19T14:11:36.614000+0000","last_fullsized":"2024-09-19T14:11:36.614000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:28.946709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.953618+0000","last_change":"2024-09-19T14:14:47.953554+0000","last_active":"2024-09-19T14:14:47.953618+0000","last_peered":"2024-09-19T14:14:47.953618+0000","last_clean":"2024-09-19T14:14:47.953618+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:14:47.953618+0000","last_undegraded":"2024-09-19T14:14:47.953618+0000","last_fullsized":"2024-09-19T14:14:47.953618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.953461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.953461+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.953461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:30:45.295224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.611594+0000","last_change":"2024-09-19T13:51:15.737359+0000","last_active":"2024-09-19T14:11:16.611594+0000","last_peered":"2024-09-19T14:11:16.611594+0000","last_clean":"2024-09-19T14:11:16.611594+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:11:16.611594+0000","last_undegraded":"2024-09-19T14:11:16.611594+0000","last_fullsized":"2024-09-19T14:11:16.611594+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:50.162815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723353+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:10:26.723353+0000","last_peered":"2024-09-19T14:10:26.723353+0000","last_clean":"2024-09-19T14:10:26.723353+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:10:26.723353+0000","last_undegraded":"2024-09-19T14:10:26.723353+0000","last_fullsized":"2024-09-19T14:10:26.723353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:54.363715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:01.621708+0000","last_change":"2024-09-19T13:52:51.581539+0000","last_active":"2024-09-19T14:13:01.621708+0000","last_peered":"2024-09-19T14:13:01.621708+0000","last_clean":"2024-09-19T14:13:01.621708+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:13:01.621708+0000","last_undegraded":"2024-09-19T14:13:01.621708+0000","last_fullsized":"2024-09-19T14:13:01.621708+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733334+0000","last_change":"2024-09-19T13:52:48.553843+0000","last_active":"2024-09-19T14:11:36.733334+0000","last_peered":"2024-09-19T14:11:36.733334+0000","last_clean":"2024-09-19T14:11:36.733334+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:11:36.733334+0000","last_undegraded":"2024-09-19T14:11:36.733334+0000","last_fullsized":"2024-09-19T14:11:36.733334+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:42.945314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730599+0000","last_change":"2024-09-19T13:51:15.746581+0000","last_active":"2024-09-19T14:11:16.730599+0000","last_peered":"2024-09-19T14:11:16.730599+0000","last_clean":"2024-09-19T14:11:16.730599+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:11:16.730599+0000","last_undegraded":"2024-09-19T14:11:16.730599+0000","last_fullsized":"2024-09-19T14:11:16.730599+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:13.432237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:11.730008+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:11:11.730008+0000","last_peered":"2024-09-19T14:11:11.730008+0000","last_clean":"2024-09-19T14:11:11.730008+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:11:11.730008+0000","last_undegraded":"2024-09-19T14:11:11.730008+0000","last_fullsized":"2024-09-19T14:11:11.730008+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:59.519031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.617196+0000","last_change":"2024-09-19T13:53:44.846213+0000","last_active":"2024-09-19T14:12:16.617196+0000","last_peered":"2024-09-19T14:12:16.617196+0000","last_clean":"2024-09-19T14:12:16.617196+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:12:16.617196+0000","last_undegraded":"2024-09-19T14:12:16.617196+0000","last_fullsized":"2024-09-19T14:12:16.617196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'5","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.334223+0000","last_change":"2024-09-19T13:52:48.552836+0000","last_active":"2024-09-19T14:14:18.334223+0000","last_peered":"2024-09-19T14:14:18.334223+0000","last_clean":"2024-09-19T14:14:18.334223+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:14:18.334223+0000","last_undegraded":"2024-09-19T14:14:18.334223+0000","last_fullsized":"2024-09-19T14:14:18.334223+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":5,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.730570+0000","last_change":"2024-09-19T13:51:15.743989+0000","last_active":"2024-09-19T14:11:16.730570+0000","last_peered":"2024-09-19T14:11:16.730570+0000","last_clean":"2024-09-19T14:11:16.730570+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:11:16.730570+0000","last_undegraded":"2024-09-19T14:11:16.730570+0000","last_fullsized":"2024-09-19T14:11:16.730570+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:33.192776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.647908+0000","last_change":"2024-09-19T14:03:08.837855+0000","last_active":"2024-09-19T14:11:31.647908+0000","last_peered":"2024-09-19T14:11:31.647908+0000","last_clean":"2024-09-19T14:11:31.647908+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:11:31.647908+0000","last_undegraded":"2024-09-19T14:11:31.647908+0000","last_fullsized":"2024-09-19T14:11:31.647908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:17.620266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.466793+0000","last_change":"2024-09-19T14:15:00.466793+0000","last_active":"2024-09-19T14:15:00.466793+0000","last_peered":"2024-09-19T14:15:00.466793+0000","last_clean":"2024-09-19T14:15:00.466793+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:15:00.466793+0000","last_undegraded":"2024-09-19T14:15:00.466793+0000","last_fullsized":"2024-09-19T14:15:00.466793+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:15:00.466700+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:15:00.466700+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.466700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:36.437346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.333404+0000","last_change":"2024-09-19T13:52:48.553148+0000","last_active":"2024-09-19T14:14:18.333404+0000","last_peered":"2024-09-19T14:14:18.333404+0000","last_clean":"2024-09-19T14:14:18.333404+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:14:18.333404+0000","last_undegraded":"2024-09-19T14:14:18.333404+0000","last_fullsized":"2024-09-19T14:14:18.333404+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.457122+0000","last_change":"2024-09-19T14:14:54.457122+0000","last_active":"2024-09-19T14:14:54.457122+0000","last_peered":"2024-09-19T14:14:54.457122+0000","last_clean":"2024-09-19T14:14:54.457122+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:14:54.457122+0000","last_undegraded":"2024-09-19T14:14:54.457122+0000","last_fullsized":"2024-09-19T14:14:54.457122+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-09-19T14:14:54.457032+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-09-19T14:14:54.457032+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.457032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:45.706150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739569+0000","last_change":"2024-09-19T14:03:08.842863+0000","last_active":"2024-09-19T14:10:41.739569+0000","last_peered":"2024-09-19T14:10:41.739569+0000","last_clean":"2024-09-19T14:10:41.739569+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:10:41.739569+0000","last_undegraded":"2024-09-19T14:10:41.739569+0000","last_fullsized":"2024-09-19T14:10:41.739569+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:07.703304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.439026+0000","last_change":"2024-09-19T14:14:59.439026+0000","last_active":"2024-09-19T14:14:59.439026+0000","last_peered":"2024-09-19T14:14:59.439026+0000","last_clean":"2024-09-19T14:14:59.439026+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:14:59.439026+0000","last_undegraded":"2024-09-19T14:14:59.439026+0000","last_fullsized":"2024-09-19T14:14:59.439026+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:59.438939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:59.438939+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.438939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:35.216484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:21.723019+0000","last_change":"2024-09-19T13:52:48.556329+0000","last_active":"2024-09-19T14:10:21.723019+0000","last_peered":"2024-09-19T14:10:21.723019+0000","last_clean":"2024-09-19T14:10:21.723019+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:10:21.723019+0000","last_undegraded":"2024-09-19T14:10:21.723019+0000","last_fullsized":"2024-09-19T14:10:21.723019+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:39.632455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":103,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:23.222490+0000","last_change":"2024-09-19T13:51:15.738677+0000","last_active":"2024-09-19T14:11:23.222490+0000","last_peered":"2024-09-19T14:11:23.222490+0000","last_clean":"2024-09-19T14:11:23.222490+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:11:23.222490+0000","last_undegraded":"2024-09-19T14:11:23.222490+0000","last_fullsized":"2024-09-19T14:11:23.222490+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:11.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:41.739606+0000","last_change":"2024-09-19T14:03:08.844476+0000","last_active":"2024-09-19T14:10:41.739606+0000","last_peered":"2024-09-19T14:10:41.739606+0000","last_clean":"2024-09-19T14:10:41.739606+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:10:41.739606+0000","last_undegraded":"2024-09-19T14:10:41.739606+0000","last_fullsized":"2024-09-19T14:10:41.739606+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:07.162545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'8","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.372877+0000","last_change":"2024-09-19T13:52:51.580942+0000","last_active":"2024-09-19T14:14:18.372877+0000","last_peered":"2024-09-19T14:14:18.372877+0000","last_clean":"2024-09-19T14:14:18.372877+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:14:18.372877+0000","last_undegraded":"2024-09-19T14:14:18.372877+0000","last_fullsized":"2024-09-19T14:14:18.372877+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:13.538115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.623655+0000","last_change":"2024-09-19T13:52:48.559959+0000","last_active":"2024-09-19T14:12:51.623655+0000","last_peered":"2024-09-19T14:12:51.623655+0000","last_clean":"2024-09-19T14:12:51.623655+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:12:51.623655+0000","last_undegraded":"2024-09-19T14:12:51.623655+0000","last_fullsized":"2024-09-19T14:12:51.623655+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:01.163462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.419264+0000","last_change":"2024-09-19T14:14:53.419264+0000","last_active":"2024-09-19T14:14:53.419264+0000","last_peered":"2024-09-19T14:14:53.419264+0000","last_clean":"2024-09-19T14:14:53.419264+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:14:53.419264+0000","last_undegraded":"2024-09-19T14:14:53.419264+0000","last_fullsized":"2024-09-19T14:14:53.419264+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'13","last_scrub_stamp":"2024-09-19T14:14:53.419168+0000","last_deep_scrub":"260'13","last_deep_scrub_stamp":"2024-09-19T14:14:53.419168+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.419168+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:32.991423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.655228+0000","last_change":"2024-09-19T14:03:08.839816+0000","last_active":"2024-09-19T14:12:31.655228+0000","last_peered":"2024-09-19T14:12:31.655228+0000","last_clean":"2024-09-19T14:12:31.655228+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:12:31.655228+0000","last_undegraded":"2024-09-19T14:12:31.655228+0000","last_fullsized":"2024-09-19T14:12:31.655228+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'5","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.259053+0000","last_change":"2024-09-19T13:52:51.579222+0000","last_active":"2024-09-19T14:14:18.259053+0000","last_peered":"2024-09-19T14:14:18.259053+0000","last_clean":"2024-09-19T14:14:18.259053+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:14:18.259053+0000","last_undegraded":"2024-09-19T14:14:18.259053+0000","last_fullsized":"2024-09-19T14:14:18.259053+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:56.630186+0000","last_change":"2024-09-19T13:52:48.554787+0000","last_active":"2024-09-19T14:13:56.630186+0000","last_peered":"2024-09-19T14:13:56.630186+0000","last_clean":"2024-09-19T14:13:56.630186+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:13:56.630186+0000","last_undegraded":"2024-09-19T14:13:56.630186+0000","last_fullsized":"2024-09-19T14:13:56.630186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:28.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:01.128068+0000","last_change":"2024-09-19T13:51:15.739410+0000","last_active":"2024-09-19T14:12:01.128068+0000","last_peered":"2024-09-19T14:12:01.128068+0000","last_clean":"2024-09-19T14:12:01.128068+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:12:01.128068+0000","last_undegraded":"2024-09-19T14:12:01.128068+0000","last_fullsized":"2024-09-19T14:12:01.128068+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:59.512917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.881471+0000","last_change":"2024-09-19T14:14:49.881409+0000","last_active":"2024-09-19T14:14:49.881471+0000","last_peered":"2024-09-19T14:14:49.881471+0000","last_clean":"2024-09-19T14:14:49.881471+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:14:49.881471+0000","last_undegraded":"2024-09-19T14:14:49.881471+0000","last_fullsized":"2024-09-19T14:14:49.881471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:49.881313+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:49.881313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.881313+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:14.081295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733241+0000","last_change":"2024-09-19T13:52:51.578766+0000","last_active":"2024-09-19T14:11:36.733241+0000","last_peered":"2024-09-19T14:11:36.733241+0000","last_clean":"2024-09-19T14:11:36.733241+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:11:36.733241+0000","last_undegraded":"2024-09-19T14:11:36.733241+0000","last_fullsized":"2024-09-19T14:11:36.733241+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:06.602738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.460809+0000","last_change":"2024-09-19T13:52:48.554709+0000","last_active":"2024-09-19T14:14:18.460809+0000","last_peered":"2024-09-19T14:14:18.460809+0000","last_clean":"2024-09-19T14:14:18.460809+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:14:18.460809+0000","last_undegraded":"2024-09-19T14:14:18.460809+0000","last_fullsized":"2024-09-19T14:14:18.460809+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:36.724834+0000","last_change":"2024-09-19T13:51:15.744268+0000","last_active":"2024-09-19T14:10:36.724834+0000","last_peered":"2024-09-19T14:10:36.724834+0000","last_clean":"2024-09-19T14:10:36.724834+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:10:36.724834+0000","last_undegraded":"2024-09-19T14:10:36.724834+0000","last_fullsized":"2024-09-19T14:10:36.724834+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:44.697556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.755228+0000","last_change":"2024-09-19T14:03:08.840741+0000","last_active":"2024-09-19T14:12:31.755228+0000","last_peered":"2024-09-19T14:12:31.755228+0000","last_clean":"2024-09-19T14:12:31.755228+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:12:31.755228+0000","last_undegraded":"2024-09-19T14:12:31.755228+0000","last_fullsized":"2024-09-19T14:12:31.755228+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737854+0000","last_change":"2024-09-19T13:52:51.576629+0000","last_active":"2024-09-19T14:12:11.737854+0000","last_peered":"2024-09-19T14:12:11.737854+0000","last_clean":"2024-09-19T14:12:11.737854+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:12:11.737854+0000","last_undegraded":"2024-09-19T14:12:11.737854+0000","last_fullsized":"2024-09-19T14:12:11.737854+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.926906+0000","last_change":"2024-09-19T14:14:46.926906+0000","last_active":"2024-09-19T14:14:46.926906+0000","last_peered":"2024-09-19T14:14:46.926906+0000","last_clean":"2024-09-19T14:14:46.926906+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:14:46.926906+0000","last_undegraded":"2024-09-19T14:14:46.926906+0000","last_fullsized":"2024-09-19T14:14:46.926906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:46.926822+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:46.926822+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.926822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:46.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":92,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.994603+0000","last_change":"2024-09-19T14:14:42.994603+0000","last_active":"2024-09-19T14:14:42.994603+0000","last_peered":"2024-09-19T14:14:42.994603+0000","last_clean":"2024-09-19T14:14:42.994603+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:14:42.994603+0000","last_undegraded":"2024-09-19T14:14:42.994603+0000","last_fullsized":"2024-09-19T14:14:42.994603+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'17","last_scrub_stamp":"2024-09-19T14:14:42.994517+0000","last_deep_scrub":"260'17","last_deep_scrub_stamp":"2024-09-19T14:14:42.994517+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.994517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:21.285051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.619253+0000","last_change":"2024-09-19T14:03:08.838834+0000","last_active":"2024-09-19T14:12:31.619253+0000","last_peered":"2024-09-19T14:12:31.619253+0000","last_clean":"2024-09-19T14:12:31.619253+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:12:31.619253+0000","last_undegraded":"2024-09-19T14:12:31.619253+0000","last_fullsized":"2024-09-19T14:12:31.619253+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737705+0000","last_change":"2024-09-19T13:52:51.583920+0000","last_active":"2024-09-19T14:12:11.737705+0000","last_peered":"2024-09-19T14:12:11.737705+0000","last_clean":"2024-09-19T14:12:11.737705+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:12:11.737705+0000","last_undegraded":"2024-09-19T14:12:11.737705+0000","last_fullsized":"2024-09-19T14:12:11.737705+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'8","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.322159+0000","last_change":"2024-09-19T13:52:48.555699+0000","last_active":"2024-09-19T14:14:18.322159+0000","last_peered":"2024-09-19T14:14:18.322159+0000","last_clean":"2024-09-19T14:14:18.322159+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:14:18.322159+0000","last_undegraded":"2024-09-19T14:14:18.322159+0000","last_fullsized":"2024-09-19T14:14:18.322159+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.753938+0000","last_change":"2024-09-19T13:51:15.743134+0000","last_active":"2024-09-19T14:12:21.753938+0000","last_peered":"2024-09-19T14:12:21.753938+0000","last_clean":"2024-09-19T14:12:21.753938+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:12:21.753938+0000","last_undegraded":"2024-09-19T14:12:21.753938+0000","last_fullsized":"2024-09-19T14:12:21.753938+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723447+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:10:26.723447+0000","last_peered":"2024-09-19T14:10:26.723447+0000","last_clean":"2024-09-19T14:10:26.723447+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:10:26.723447+0000","last_undegraded":"2024-09-19T14:10:26.723447+0000","last_fullsized":"2024-09-19T14:10:26.723447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:46.882911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'14","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:51.665691+0000","last_change":"2024-09-19T13:52:51.584825+0000","last_active":"2024-09-19T14:13:51.665691+0000","last_peered":"2024-09-19T14:13:51.665691+0000","last_clean":"2024-09-19T14:13:51.665691+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:13:51.665691+0000","last_undegraded":"2024-09-19T14:13:51.665691+0000","last_fullsized":"2024-09-19T14:13:51.665691+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:27.438694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11793,"num_write":34,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732335+0000","last_change":"2024-09-19T13:52:48.558319+0000","last_active":"2024-09-19T14:11:31.732335+0000","last_peered":"2024-09-19T14:11:31.732335+0000","last_clean":"2024-09-19T14:11:31.732335+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:11:31.732335+0000","last_undegraded":"2024-09-19T14:11:31.732335+0000","last_fullsized":"2024-09-19T14:11:31.732335+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:02.238052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":99,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.753264+0000","last_change":"2024-09-19T13:51:15.743038+0000","last_active":"2024-09-19T14:12:16.753264+0000","last_peered":"2024-09-19T14:12:16.753264+0000","last_clean":"2024-09-19T14:12:16.753264+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:12:16.753264+0000","last_undegraded":"2024-09-19T14:12:16.753264+0000","last_fullsized":"2024-09-19T14:12:16.753264+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.604316+0000","last_change":"2024-09-19T14:03:08.842157+0000","last_active":"2024-09-19T14:10:26.604316+0000","last_peered":"2024-09-19T14:10:26.604316+0000","last_clean":"2024-09-19T14:10:26.604316+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:10:26.604316+0000","last_undegraded":"2024-09-19T14:10:26.604316+0000","last_fullsized":"2024-09-19T14:10:26.604316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.587582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.458805+0000","last_change":"2024-09-19T14:15:01.458805+0000","last_active":"2024-09-19T14:15:01.458805+0000","last_peered":"2024-09-19T14:15:01.458805+0000","last_clean":"2024-09-19T14:15:01.458805+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:15:01.458805+0000","last_undegraded":"2024-09-19T14:15:01.458805+0000","last_fullsized":"2024-09-19T14:15:01.458805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:01.458718+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:01.458718+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.458718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:20.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732554+0000","last_change":"2024-09-19T13:52:48.558710+0000","last_active":"2024-09-19T14:11:31.732554+0000","last_peered":"2024-09-19T14:11:31.732554+0000","last_clean":"2024-09-19T14:11:31.732554+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:11:31.732554+0000","last_undegraded":"2024-09-19T14:11:31.732554+0000","last_fullsized":"2024-09-19T14:11:31.732554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:43.224289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":70,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.619200+0000","last_change":"2024-09-19T13:51:15.739209+0000","last_active":"2024-09-19T14:12:16.619200+0000","last_peered":"2024-09-19T14:12:16.619200+0000","last_clean":"2024-09-19T14:12:16.619200+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:12:16.619200+0000","last_undegraded":"2024-09-19T14:12:16.619200+0000","last_fullsized":"2024-09-19T14:12:16.619200+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:36.621842+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:12:36.621842+0000","last_peered":"2024-09-19T14:12:36.621842+0000","last_clean":"2024-09-19T14:12:36.621842+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:12:36.621842+0000","last_undegraded":"2024-09-19T14:12:36.621842+0000","last_fullsized":"2024-09-19T14:12:36.621842+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732599+0000","last_change":"2024-09-19T13:52:51.580249+0000","last_active":"2024-09-19T14:11:31.732599+0000","last_peered":"2024-09-19T14:11:31.732599+0000","last_clean":"2024-09-19T14:11:31.732599+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:11:31.732599+0000","last_undegraded":"2024-09-19T14:11:31.732599+0000","last_fullsized":"2024-09-19T14:11:31.732599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:23.302145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.437176+0000","last_change":"2024-09-19T14:14:57.437176+0000","last_active":"2024-09-19T14:14:57.437176+0000","last_peered":"2024-09-19T14:14:57.437176+0000","last_clean":"2024-09-19T14:14:57.437176+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:14:57.437176+0000","last_undegraded":"2024-09-19T14:14:57.437176+0000","last_fullsized":"2024-09-19T14:14:57.437176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:14:57.437055+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:14:57.437055+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.437055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.642438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738310+0000","last_change":"2024-09-19T13:51:15.736147+0000","last_active":"2024-09-19T14:12:16.738310+0000","last_peered":"2024-09-19T14:12:16.738310+0000","last_clean":"2024-09-19T14:12:16.738310+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:12:16.738310+0000","last_undegraded":"2024-09-19T14:12:16.738310+0000","last_fullsized":"2024-09-19T14:12:16.738310+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:26.723422+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:10:26.723422+0000","last_peered":"2024-09-19T14:10:26.723422+0000","last_clean":"2024-09-19T14:10:26.723422+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:10:26.723422+0000","last_undegraded":"2024-09-19T14:10:26.723422+0000","last_fullsized":"2024-09-19T14:10:26.723422+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:18.667527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.472398+0000","last_change":"2024-09-19T14:14:58.472398+0000","last_active":"2024-09-19T14:14:58.472398+0000","last_peered":"2024-09-19T14:14:58.472398+0000","last_clean":"2024-09-19T14:14:58.472398+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:14:58.472398+0000","last_undegraded":"2024-09-19T14:14:58.472398+0000","last_fullsized":"2024-09-19T14:14:58.472398+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:14:58.472281+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:14:58.472281+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.472281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:14.088006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'10","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.402353+0000","last_change":"2024-09-19T13:52:48.547186+0000","last_active":"2024-09-19T14:14:18.402353+0000","last_peered":"2024-09-19T14:14:18.402353+0000","last_clean":"2024-09-19T14:14:18.402353+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:14:18.402353+0000","last_undegraded":"2024-09-19T14:14:18.402353+0000","last_fullsized":"2024-09-19T14:14:18.402353+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:31.825750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26674,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":151,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.738361+0000","last_change":"2024-09-19T13:51:15.745411+0000","last_active":"2024-09-19T14:12:16.738361+0000","last_peered":"2024-09-19T14:12:16.738361+0000","last_clean":"2024-09-19T14:12:16.738361+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:12:16.738361+0000","last_undegraded":"2024-09-19T14:12:16.738361+0000","last_fullsized":"2024-09-19T14:12:16.738361+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.907232+0000","last_change":"2024-09-19T14:14:48.907232+0000","last_active":"2024-09-19T14:14:48.907232+0000","last_peered":"2024-09-19T14:14:48.907232+0000","last_clean":"2024-09-19T14:14:48.907232+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:14:48.907232+0000","last_undegraded":"2024-09-19T14:14:48.907232+0000","last_fullsized":"2024-09-19T14:14:48.907232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:48.907148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:48.907148+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.907148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:32.974297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'7","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.622402+0000","last_change":"2024-09-19T13:52:51.578477+0000","last_active":"2024-09-19T14:13:06.622402+0000","last_peered":"2024-09-19T14:13:06.622402+0000","last_clean":"2024-09-19T14:13:06.622402+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:13:06.622402+0000","last_undegraded":"2024-09-19T14:13:06.622402+0000","last_fullsized":"2024-09-19T14:13:06.622402+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:50.156854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:06.760360+0000","last_change":"2024-09-19T13:52:48.558154+0000","last_active":"2024-09-19T14:13:06.760360+0000","last_peered":"2024-09-19T14:13:06.760360+0000","last_clean":"2024-09-19T14:13:06.760360+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:13:06.760360+0000","last_undegraded":"2024-09-19T14:13:06.760360+0000","last_fullsized":"2024-09-19T14:13:06.760360+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:57:17.554459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.733289+0000","last_change":"2024-09-19T13:51:15.743194+0000","last_active":"2024-09-19T14:11:36.733289+0000","last_peered":"2024-09-19T14:11:36.733289+0000","last_clean":"2024-09-19T14:11:36.733289+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:11:36.733289+0000","last_undegraded":"2024-09-19T14:11:36.733289+0000","last_fullsized":"2024-09-19T14:11:36.733289+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:50.338128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752603+0000","last_change":"2024-09-19T14:03:08.841430+0000","last_active":"2024-09-19T14:12:11.752603+0000","last_peered":"2024-09-19T14:12:11.752603+0000","last_clean":"2024-09-19T14:12:11.752603+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:12:11.752603+0000","last_undegraded":"2024-09-19T14:12:11.752603+0000","last_fullsized":"2024-09-19T14:12:11.752603+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.726947+0000","last_change":"2024-09-19T13:52:51.585844+0000","last_active":"2024-09-19T14:10:51.726947+0000","last_peered":"2024-09-19T14:10:51.726947+0000","last_clean":"2024-09-19T14:10:51.726947+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:10:51.726947+0000","last_undegraded":"2024-09-19T14:10:51.726947+0000","last_fullsized":"2024-09-19T14:10:51.726947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:51.625819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'6","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.944218+0000","last_change":"2024-09-19T14:14:45.944218+0000","last_active":"2024-09-19T14:14:45.944218+0000","last_peered":"2024-09-19T14:14:45.944218+0000","last_clean":"2024-09-19T14:14:45.944218+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:14:45.944218+0000","last_undegraded":"2024-09-19T14:14:45.944218+0000","last_fullsized":"2024-09-19T14:14:45.944218+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:14:45.944144+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:14:45.944144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.944144+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:16.135652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":233,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.589575+0000","last_change":"2024-09-19T14:15:01.589575+0000","last_active":"2024-09-19T14:15:01.589575+0000","last_peered":"2024-09-19T14:15:01.589575+0000","last_clean":"2024-09-19T14:15:01.589575+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:15:01.589575+0000","last_undegraded":"2024-09-19T14:15:01.589575+0000","last_fullsized":"2024-09-19T14:15:01.589575+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'64","last_scrub_stamp":"2024-09-19T14:15:01.589492+0000","last_deep_scrub":"260'64","last_deep_scrub_stamp":"2024-09-19T14:15:01.589492+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.589492+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:19:29.776594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.446730+0000","last_change":"2024-09-19T14:15:01.446730+0000","last_active":"2024-09-19T14:15:01.446730+0000","last_peered":"2024-09-19T14:15:01.446730+0000","last_clean":"2024-09-19T14:15:01.446730+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:15:01.446730+0000","last_undegraded":"2024-09-19T14:15:01.446730+0000","last_fullsized":"2024-09-19T14:15:01.446730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:01.446614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:01.446614+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.446614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:06.181987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.460227+0000","last_change":"2024-09-19T14:15:00.460227+0000","last_active":"2024-09-19T14:15:00.460227+0000","last_peered":"2024-09-19T14:15:00.460227+0000","last_clean":"2024-09-19T14:15:00.460227+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:15:00.460227+0000","last_undegraded":"2024-09-19T14:15:00.460227+0000","last_fullsized":"2024-09-19T14:15:00.460227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:00.460130+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:00.460130+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.460130+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:48.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.607991+0000","last_change":"2024-09-19T13:52:48.554380+0000","last_active":"2024-09-19T14:10:51.607991+0000","last_peered":"2024-09-19T14:10:51.607991+0000","last_clean":"2024-09-19T14:10:51.607991+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:10:51.607991+0000","last_undegraded":"2024-09-19T14:10:51.607991+0000","last_fullsized":"2024-09-19T14:10:51.607991+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:07.309256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.444451+0000","last_change":"2024-09-19T14:14:53.444451+0000","last_active":"2024-09-19T14:14:53.444451+0000","last_peered":"2024-09-19T14:14:53.444451+0000","last_clean":"2024-09-19T14:14:53.444451+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:14:53.444451+0000","last_undegraded":"2024-09-19T14:14:53.444451+0000","last_fullsized":"2024-09-19T14:14:53.444451+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-19T14:14:53.444377+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-19T14:14:53.444377+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.444377+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:45.326578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.749807+0000","last_change":"2024-09-19T14:03:08.841866+0000","last_active":"2024-09-19T14:11:51.749807+0000","last_peered":"2024-09-19T14:11:51.749807+0000","last_clean":"2024-09-19T14:11:51.749807+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:11:51.749807+0000","last_undegraded":"2024-09-19T14:11:51.749807+0000","last_fullsized":"2024-09-19T14:11:51.749807+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:36.658533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:51.727005+0000","last_change":"2024-09-19T13:52:51.582164+0000","last_active":"2024-09-19T14:10:51.727005+0000","last_peered":"2024-09-19T14:10:51.727005+0000","last_clean":"2024-09-19T14:10:51.727005+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:10:51.727005+0000","last_undegraded":"2024-09-19T14:10:51.727005+0000","last_fullsized":"2024-09-19T14:10:51.727005+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:27.713291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'8","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.392508+0000","last_change":"2024-09-19T14:14:54.392508+0000","last_active":"2024-09-19T14:14:54.392508+0000","last_peered":"2024-09-19T14:14:54.392508+0000","last_clean":"2024-09-19T14:14:54.392508+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:14:54.392508+0000","last_undegraded":"2024-09-19T14:14:54.392508+0000","last_fullsized":"2024-09-19T14:14:54.392508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:14:54.392427+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:14:54.392427+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.392427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:25.291069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.959800+0000","last_change":"2024-09-19T14:14:41.959800+0000","last_active":"2024-09-19T14:14:41.959800+0000","last_peered":"2024-09-19T14:14:41.959800+0000","last_clean":"2024-09-19T14:14:41.959800+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:14:41.959800+0000","last_undegraded":"2024-09-19T14:14:41.959800+0000","last_fullsized":"2024-09-19T14:14:41.959800+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'33","last_scrub_stamp":"2024-09-19T14:14:41.959718+0000","last_deep_scrub":"260'33","last_deep_scrub_stamp":"2024-09-19T14:14:41.959718+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.959718+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:54.621103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737832+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:12:11.737832+0000","last_peered":"2024-09-19T14:12:11.737832+0000","last_clean":"2024-09-19T14:12:11.737832+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:12:11.737832+0000","last_undegraded":"2024-09-19T14:12:11.737832+0000","last_fullsized":"2024-09-19T14:12:11.737832+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'5","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.422698+0000","last_change":"2024-09-19T13:52:51.584114+0000","last_active":"2024-09-19T14:14:18.422698+0000","last_peered":"2024-09-19T14:14:18.422698+0000","last_clean":"2024-09-19T14:14:18.422698+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:14:18.422698+0000","last_undegraded":"2024-09-19T14:14:18.422698+0000","last_fullsized":"2024-09-19T14:14:18.422698+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.619712+0000","last_change":"2024-09-19T13:52:48.555321+0000","last_active":"2024-09-19T14:12:21.619712+0000","last_peered":"2024-09-19T14:12:21.619712+0000","last_clean":"2024-09-19T14:12:21.619712+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:12:21.619712+0000","last_undegraded":"2024-09-19T14:12:21.619712+0000","last_fullsized":"2024-09-19T14:12:21.619712+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613130+0000","last_change":"2024-09-19T13:51:15.743442+0000","last_active":"2024-09-19T14:11:31.613130+0000","last_peered":"2024-09-19T14:11:31.613130+0000","last_clean":"2024-09-19T14:11:31.613130+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:11:31.613130+0000","last_undegraded":"2024-09-19T14:11:31.613130+0000","last_fullsized":"2024-09-19T14:11:31.613130+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:06.945466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:16.753347+0000","last_change":"2024-09-19T14:03:08.843681+0000","last_active":"2024-09-19T14:12:16.753347+0000","last_peered":"2024-09-19T14:12:16.753347+0000","last_clean":"2024-09-19T14:12:16.753347+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:12:16.753347+0000","last_undegraded":"2024-09-19T14:12:16.753347+0000","last_fullsized":"2024-09-19T14:12:16.753347+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.753845+0000","last_change":"2024-09-19T13:52:51.586345+0000","last_active":"2024-09-19T14:12:21.753845+0000","last_peered":"2024-09-19T14:12:21.753845+0000","last_clean":"2024-09-19T14:12:21.753845+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:12:21.753845+0000","last_undegraded":"2024-09-19T14:12:21.753845+0000","last_fullsized":"2024-09-19T14:12:21.753845+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.343218+0000","last_change":"2024-09-19T14:14:55.343218+0000","last_active":"2024-09-19T14:14:55.343218+0000","last_peered":"2024-09-19T14:14:55.343218+0000","last_clean":"2024-09-19T14:14:55.343218+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:14:55.343218+0000","last_undegraded":"2024-09-19T14:14:55.343218+0000","last_fullsized":"2024-09-19T14:14:55.343218+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:55.343135+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:55.343135+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.343135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:13.998712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":213,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.356578+0000","last_change":"2024-09-19T14:15:01.356578+0000","last_active":"2024-09-19T14:15:01.356578+0000","last_peered":"2024-09-19T14:15:01.356578+0000","last_clean":"2024-09-19T14:15:01.356578+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:15:01.356578+0000","last_undegraded":"2024-09-19T14:15:01.356578+0000","last_fullsized":"2024-09-19T14:15:01.356578+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'58","last_scrub_stamp":"2024-09-19T14:15:01.356496+0000","last_deep_scrub":"260'58","last_deep_scrub_stamp":"2024-09-19T14:15:01.356496+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.356496+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:40.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.752629+0000","last_change":"2024-09-19T14:03:08.842574+0000","last_active":"2024-09-19T14:12:11.752629+0000","last_peered":"2024-09-19T14:12:11.752629+0000","last_clean":"2024-09-19T14:12:11.752629+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:12:11.752629+0000","last_undegraded":"2024-09-19T14:12:11.752629+0000","last_fullsized":"2024-09-19T14:12:11.752629+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.436917+0000","last_change":"2024-09-19T14:14:59.436917+0000","last_active":"2024-09-19T14:14:59.436917+0000","last_peered":"2024-09-19T14:14:59.436917+0000","last_clean":"2024-09-19T14:14:59.436917+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:14:59.436917+0000","last_undegraded":"2024-09-19T14:14:59.436917+0000","last_fullsized":"2024-09-19T14:14:59.436917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:59.436823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:59.436823+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.436823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:55.959030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'4","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.416786+0000","last_change":"2024-09-19T13:52:48.557637+0000","last_active":"2024-09-19T14:14:18.416786+0000","last_peered":"2024-09-19T14:14:18.416786+0000","last_clean":"2024-09-19T14:14:18.416786+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:14:18.416786+0000","last_undegraded":"2024-09-19T14:14:18.416786+0000","last_fullsized":"2024-09-19T14:14:18.416786+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":138,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.726202+0000","last_change":"2024-09-19T13:51:15.742226+0000","last_active":"2024-09-19T14:10:46.726202+0000","last_peered":"2024-09-19T14:10:46.726202+0000","last_clean":"2024-09-19T14:10:46.726202+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:10:46.726202+0000","last_undegraded":"2024-09-19T14:10:46.726202+0000","last_fullsized":"2024-09-19T14:10:46.726202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:54.177354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.618684+0000","last_change":"2024-09-19T14:03:08.836511+0000","last_active":"2024-09-19T14:12:11.618684+0000","last_peered":"2024-09-19T14:12:11.618684+0000","last_clean":"2024-09-19T14:12:11.618684+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:12:11.618684+0000","last_undegraded":"2024-09-19T14:12:11.618684+0000","last_fullsized":"2024-09-19T14:12:11.618684+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:26.754582+0000","last_change":"2024-09-19T13:52:51.586838+0000","last_active":"2024-09-19T14:12:26.754582+0000","last_peered":"2024-09-19T14:12:26.754582+0000","last_clean":"2024-09-19T14:12:26.754582+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:12:26.754582+0000","last_undegraded":"2024-09-19T14:12:26.754582+0000","last_fullsized":"2024-09-19T14:12:26.754582+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.739365+0000","last_change":"2024-09-19T14:15:01.739365+0000","last_active":"2024-09-19T14:15:01.739365+0000","last_peered":"2024-09-19T14:15:01.739365+0000","last_clean":"2024-09-19T14:15:01.739365+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:15:01.739365+0000","last_undegraded":"2024-09-19T14:15:01.739365+0000","last_fullsized":"2024-09-19T14:15:01.739365+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:15:01.739263+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:15:01.739263+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.739263+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:49.014949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.406743+0000","last_change":"2024-09-19T14:14:52.406743+0000","last_active":"2024-09-19T14:14:52.406743+0000","last_peered":"2024-09-19T14:14:52.406743+0000","last_clean":"2024-09-19T14:14:52.406743+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:14:52.406743+0000","last_undegraded":"2024-09-19T14:14:52.406743+0000","last_fullsized":"2024-09-19T14:14:52.406743+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'31","last_scrub_stamp":"2024-09-19T14:14:52.406622+0000","last_deep_scrub":"257'31","last_deep_scrub_stamp":"2024-09-19T14:14:52.406622+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.406622+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:01.251978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.746520+0000","last_change":"2024-09-19T14:03:08.843561+0000","last_active":"2024-09-19T14:11:31.746520+0000","last_peered":"2024-09-19T14:11:31.746520+0000","last_clean":"2024-09-19T14:11:31.746520+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:11:31.746520+0000","last_undegraded":"2024-09-19T14:11:31.746520+0000","last_fullsized":"2024-09-19T14:11:31.746520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:24.992091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:46.630774+0000","last_change":"2024-09-19T13:52:51.586079+0000","last_active":"2024-09-19T14:13:46.630774+0000","last_peered":"2024-09-19T14:13:46.630774+0000","last_clean":"2024-09-19T14:13:46.630774+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:13:46.630774+0000","last_undegraded":"2024-09-19T14:13:46.630774+0000","last_fullsized":"2024-09-19T14:13:46.630774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:06.216009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:41.766339+0000","last_change":"2024-09-19T13:52:48.554440+0000","last_active":"2024-09-19T14:13:41.766339+0000","last_peered":"2024-09-19T14:13:41.766339+0000","last_clean":"2024-09-19T14:13:41.766339+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:13:41.766339+0000","last_undegraded":"2024-09-19T14:13:41.766339+0000","last_fullsized":"2024-09-19T14:13:41.766339+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:31.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:10:46.607300+0000","last_change":"2024-09-19T13:51:15.740499+0000","last_active":"2024-09-19T14:10:46.607300+0000","last_peered":"2024-09-19T14:10:46.607300+0000","last_clean":"2024-09-19T14:10:46.607300+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:10:46.607300+0000","last_undegraded":"2024-09-19T14:10:46.607300+0000","last_fullsized":"2024-09-19T14:10:46.607300+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:10.208746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.611531+0000","last_change":"2024-09-19T14:03:08.840165+0000","last_active":"2024-09-19T14:11:31.611531+0000","last_peered":"2024-09-19T14:11:31.611531+0000","last_clean":"2024-09-19T14:11:31.611531+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:11:31.611531+0000","last_undegraded":"2024-09-19T14:11:31.611531+0000","last_fullsized":"2024-09-19T14:11:31.611531+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:26.897102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.613946+0000","last_change":"2024-09-19T13:52:51.587531+0000","last_active":"2024-09-19T14:11:36.613946+0000","last_peered":"2024-09-19T14:11:36.613946+0000","last_clean":"2024-09-19T14:11:36.613946+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:11:36.613946+0000","last_undegraded":"2024-09-19T14:11:36.613946+0000","last_fullsized":"2024-09-19T14:11:36.613946+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:31.550230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.973143+0000","last_change":"2024-09-19T14:14:44.973143+0000","last_active":"2024-09-19T14:14:44.973143+0000","last_peered":"2024-09-19T14:14:44.973143+0000","last_clean":"2024-09-19T14:14:44.973143+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:14:44.973143+0000","last_undegraded":"2024-09-19T14:14:44.973143+0000","last_fullsized":"2024-09-19T14:14:44.973143+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.973056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.973056+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.973056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:59:37.180506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":144,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.356443+0000","last_change":"2024-09-19T14:14:51.356443+0000","last_active":"2024-09-19T14:14:51.356443+0000","last_peered":"2024-09-19T14:14:51.356443+0000","last_clean":"2024-09-19T14:14:51.356443+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:14:51.356443+0000","last_undegraded":"2024-09-19T14:14:51.356443+0000","last_fullsized":"2024-09-19T14:14:51.356443+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'34","last_scrub_stamp":"2024-09-19T14:14:51.356359+0000","last_deep_scrub":"260'34","last_deep_scrub_stamp":"2024-09-19T14:14:51.356359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.356359+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:37.031352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:16.645917+0000","last_change":"2024-09-19T14:03:08.834382+0000","last_active":"2024-09-19T14:11:16.645917+0000","last_peered":"2024-09-19T14:11:16.645917+0000","last_clean":"2024-09-19T14:11:16.645917+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:11:16.645917+0000","last_undegraded":"2024-09-19T14:11:16.645917+0000","last_fullsized":"2024-09-19T14:11:16.645917+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:23.550035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.423362+0000","last_change":"2024-09-19T13:52:51.587324+0000","last_active":"2024-09-19T14:14:18.423362+0000","last_peered":"2024-09-19T14:14:18.423362+0000","last_clean":"2024-09-19T14:14:18.423362+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:14:18.423362+0000","last_undegraded":"2024-09-19T14:14:18.423362+0000","last_fullsized":"2024-09-19T14:14:18.423362+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.617999+0000","last_change":"2024-09-19T13:52:48.553095+0000","last_active":"2024-09-19T14:12:21.617999+0000","last_peered":"2024-09-19T14:12:21.617999+0000","last_clean":"2024-09-19T14:12:21.617999+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:12:21.617999+0000","last_undegraded":"2024-09-19T14:12:21.617999+0000","last_fullsized":"2024-09-19T14:12:21.617999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.301644+0000","last_change":"2024-09-19T14:14:59.301644+0000","last_active":"2024-09-19T14:14:59.301644+0000","last_peered":"2024-09-19T14:14:59.301644+0000","last_clean":"2024-09-19T14:14:59.301644+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:14:59.301644+0000","last_undegraded":"2024-09-19T14:14:59.301644+0000","last_fullsized":"2024-09-19T14:14:59.301644+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'37","last_scrub_stamp":"2024-09-19T14:14:59.301562+0000","last_deep_scrub":"260'37","last_deep_scrub_stamp":"2024-09-19T14:14:59.301562+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.301562+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:22.479580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.732364+0000","last_change":"2024-09-19T14:03:08.839316+0000","last_active":"2024-09-19T14:11:31.732364+0000","last_peered":"2024-09-19T14:11:31.732364+0000","last_clean":"2024-09-19T14:11:31.732364+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:11:31.732364+0000","last_undegraded":"2024-09-19T14:11:31.732364+0000","last_fullsized":"2024-09-19T14:11:31.732364+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:47.115178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:21.739244+0000","last_change":"2024-09-19T13:52:51.583041+0000","last_active":"2024-09-19T14:12:21.739244+0000","last_peered":"2024-09-19T14:12:21.739244+0000","last_clean":"2024-09-19T14:12:21.739244+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:12:21.739244+0000","last_undegraded":"2024-09-19T14:12:21.739244+0000","last_fullsized":"2024-09-19T14:12:21.739244+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.304410+0000","last_change":"2024-09-19T13:52:48.558143+0000","last_active":"2024-09-19T14:14:18.304410+0000","last_peered":"2024-09-19T14:14:18.304410+0000","last_clean":"2024-09-19T14:14:18.304410+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:14:18.304410+0000","last_undegraded":"2024-09-19T14:14:18.304410+0000","last_fullsized":"2024-09-19T14:14:18.304410+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.445795+0000","last_change":"2024-09-19T14:14:51.445795+0000","last_active":"2024-09-19T14:14:51.445795+0000","last_peered":"2024-09-19T14:14:51.445795+0000","last_clean":"2024-09-19T14:14:51.445795+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:14:51.445795+0000","last_undegraded":"2024-09-19T14:14:51.445795+0000","last_fullsized":"2024-09-19T14:14:51.445795+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'248","last_scrub_stamp":"2024-09-19T14:14:51.445710+0000","last_deep_scrub":"257'248","last_deep_scrub_stamp":"2024-09-19T14:14:51.445710+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.445710+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:23.572561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.883369+0000","last_change":"2024-09-19T14:14:50.883369+0000","last_active":"2024-09-19T14:14:50.883369+0000","last_peered":"2024-09-19T14:14:50.883369+0000","last_clean":"2024-09-19T14:14:50.883369+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:14:50.883369+0000","last_undegraded":"2024-09-19T14:14:50.883369+0000","last_fullsized":"2024-09-19T14:14:50.883369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:50.883275+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:50.883275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.883275+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:11.827780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.401357+0000","last_change":"2024-09-19T14:14:58.401357+0000","last_active":"2024-09-19T14:14:58.401357+0000","last_peered":"2024-09-19T14:14:58.401357+0000","last_clean":"2024-09-19T14:14:58.401357+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:14:58.401357+0000","last_undegraded":"2024-09-19T14:14:58.401357+0000","last_fullsized":"2024-09-19T14:14:58.401357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:14:58.401253+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:14:58.401253+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.401253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:22.910974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:56.758773+0000","last_change":"2024-09-19T13:52:48.556826+0000","last_active":"2024-09-19T14:12:56.758773+0000","last_peered":"2024-09-19T14:12:56.758773+0000","last_clean":"2024-09-19T14:12:56.758773+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:12:56.758773+0000","last_undegraded":"2024-09-19T14:12:56.758773+0000","last_fullsized":"2024-09-19T14:12:56.758773+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:06.616079+0000","last_change":"2024-09-19T13:51:15.742662+0000","last_active":"2024-09-19T14:12:06.616079+0000","last_peered":"2024-09-19T14:12:06.616079+0000","last_clean":"2024-09-19T14:12:06.616079+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:12:06.616079+0000","last_undegraded":"2024-09-19T14:12:06.616079+0000","last_fullsized":"2024-09-19T14:12:06.616079+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:51:14.715276+0000","last_clean_scrub_stamp":"2024-09-19T13:51:14.715276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:47.205807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:51.616208+0000","last_change":"2024-09-19T14:03:08.837483+0000","last_active":"2024-09-19T14:11:51.616208+0000","last_peered":"2024-09-19T14:11:51.616208+0000","last_clean":"2024-09-19T14:11:51.616208+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:11:51.616208+0000","last_undegraded":"2024-09-19T14:11:51.616208+0000","last_fullsized":"2024-09-19T14:11:51.616208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:43.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:56.622640+0000","last_change":"2024-09-19T13:52:51.582481+0000","last_active":"2024-09-19T14:12:56.622640+0000","last_peered":"2024-09-19T14:12:56.622640+0000","last_clean":"2024-09-19T14:12:56.622640+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:12:56.622640+0000","last_undegraded":"2024-09-19T14:12:56.622640+0000","last_fullsized":"2024-09-19T14:12:56.622640+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747273+0000","last_change":"2024-09-19T13:52:48.558237+0000","last_active":"2024-09-19T14:11:36.747273+0000","last_peered":"2024-09-19T14:11:36.747273+0000","last_clean":"2024-09-19T14:11:36.747273+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:11:36.747273+0000","last_undegraded":"2024-09-19T14:11:36.747273+0000","last_fullsized":"2024-09-19T14:11:36.747273+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:47.533039+0000","last_clean_scrub_stamp":"2024-09-19T13:52:47.533039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:14.742516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.716000+0000","last_change":"2024-09-19T14:15:00.716000+0000","last_active":"2024-09-19T14:15:00.716000+0000","last_peered":"2024-09-19T14:15:00.716000+0000","last_clean":"2024-09-19T14:15:00.716000+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:15:00.716000+0000","last_undegraded":"2024-09-19T14:15:00.716000+0000","last_fullsized":"2024-09-19T14:15:00.716000+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-19T14:15:00.715916+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-19T14:15:00.715916+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.715916+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:55.850827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:31.613161+0000","last_change":"2024-09-19T14:03:08.843652+0000","last_active":"2024-09-19T14:11:31.613161+0000","last_peered":"2024-09-19T14:11:31.613161+0000","last_clean":"2024-09-19T14:11:31.613161+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:11:31.613161+0000","last_undegraded":"2024-09-19T14:11:31.613161+0000","last_fullsized":"2024-09-19T14:11:31.613161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:18.731796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'7","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.474343+0000","last_change":"2024-09-19T14:14:56.474343+0000","last_active":"2024-09-19T14:14:56.474343+0000","last_peered":"2024-09-19T14:14:56.474343+0000","last_clean":"2024-09-19T14:14:56.474343+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:14:56.474343+0000","last_undegraded":"2024-09-19T14:14:56.474343+0000","last_fullsized":"2024-09-19T14:14:56.474343+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-19T14:14:56.474264+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-19T14:14:56.474264+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.474264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:19.206700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.419389+0000","last_change":"2024-09-19T14:14:57.419389+0000","last_active":"2024-09-19T14:14:57.419389+0000","last_peered":"2024-09-19T14:14:57.419389+0000","last_clean":"2024-09-19T14:14:57.419389+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:14:57.419389+0000","last_undegraded":"2024-09-19T14:14:57.419389+0000","last_fullsized":"2024-09-19T14:14:57.419389+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:14:57.419144+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:14:57.419144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.419144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:50.391968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.319252+0000","last_change":"2024-09-19T14:14:50.319252+0000","last_active":"2024-09-19T14:14:50.319252+0000","last_peered":"2024-09-19T14:14:50.319252+0000","last_clean":"2024-09-19T14:14:50.319252+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:14:50.319252+0000","last_undegraded":"2024-09-19T14:14:50.319252+0000","last_fullsized":"2024-09-19T14:14:50.319252+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'65","last_scrub_stamp":"2024-09-19T14:14:50.319141+0000","last_deep_scrub":"260'65","last_deep_scrub_stamp":"2024-09-19T14:14:50.319141+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.319141+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:00.287119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:11:36.747359+0000","last_change":"2024-09-19T14:03:08.842987+0000","last_active":"2024-09-19T14:11:36.747359+0000","last_peered":"2024-09-19T14:11:36.747359+0000","last_clean":"2024-09-19T14:11:36.747359+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:11:36.747359+0000","last_undegraded":"2024-09-19T14:11:36.747359+0000","last_fullsized":"2024-09-19T14:11:36.747359+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:51.898754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:18.282359+0000","last_change":"2024-09-19T13:52:51.581838+0000","last_active":"2024-09-19T14:14:18.282359+0000","last_peered":"2024-09-19T14:14:18.282359+0000","last_clean":"2024-09-19T14:14:18.282359+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:14:18.282359+0000","last_undegraded":"2024-09-19T14:14:18.282359+0000","last_fullsized":"2024-09-19T14:14:18.282359+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:52:50.556068+0000","last_clean_scrub_stamp":"2024-09-19T13:52:50.556068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:20.245214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":214,"num_write":4,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.431200+0000","last_change":"2024-09-19T14:14:55.431200+0000","last_active":"2024-09-19T14:14:55.431200+0000","last_peered":"2024-09-19T14:14:55.431200+0000","last_clean":"2024-09-19T14:14:55.431200+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:14:55.431200+0000","last_undegraded":"2024-09-19T14:14:55.431200+0000","last_fullsized":"2024-09-19T14:14:55.431200+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:14:55.431115+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:14:55.431115+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.431115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:38:01.164802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.313688+0000","last_change":"2024-09-19T14:14:58.313688+0000","last_active":"2024-09-19T14:14:58.313688+0000","last_peered":"2024-09-19T14:14:58.313688+0000","last_clean":"2024-09-19T14:14:58.313688+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:14:58.313688+0000","last_undegraded":"2024-09-19T14:14:58.313688+0000","last_fullsized":"2024-09-19T14:14:58.313688+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'26","last_scrub_stamp":"2024-09-19T14:14:58.313601+0000","last_deep_scrub":"260'26","last_deep_scrub_stamp":"2024-09-19T14:14:58.313601+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.313601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:54.752333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'198","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.123580+0000","last_change":"2024-09-19T14:14:37.123580+0000","last_active":"2024-09-19T14:14:37.123580+0000","last_peered":"2024-09-19T14:14:37.123580+0000","last_clean":"2024-09-19T14:14:37.123580+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:14:37.123580+0000","last_undegraded":"2024-09-19T14:14:37.123580+0000","last_fullsized":"2024-09-19T14:14:37.123580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.123480+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:59.204973+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":14767,"num_write":959,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'809","reported_seq":2392,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.739943+0000","last_change":"2024-09-19T14:14:41.739943+0000","last_active":"2024-09-19T14:14:41.739943+0000","last_peered":"2024-09-19T14:14:41.739943+0000","last_clean":"2024-09-19T14:14:41.739943+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:14:41.739943+0000","last_undegraded":"2024-09-19T14:14:41.739943+0000","last_fullsized":"2024-09-19T14:14:41.739943+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'809","last_scrub_stamp":"2024-09-19T14:14:41.739846+0000","last_deep_scrub":"260'809","last_deep_scrub_stamp":"2024-09-19T14:14:41.739846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.739846+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:36.451126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'195","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.326367+0000","last_change":"2024-09-19T14:14:29.326367+0000","last_active":"2024-09-19T14:14:29.326367+0000","last_peered":"2024-09-19T14:14:29.326367+0000","last_clean":"2024-09-19T14:14:29.326367+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:14:29.326367+0000","last_undegraded":"2024-09-19T14:14:29.326367+0000","last_fullsized":"2024-09-19T14:14:29.326367+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.326239+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:00.504896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":5759,"num_write":878,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'702","reported_seq":2398,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.246546+0000","last_change":"2024-09-19T14:14:41.246546+0000","last_active":"2024-09-19T14:14:41.246546+0000","last_peered":"2024-09-19T14:14:41.246546+0000","last_clean":"2024-09-19T14:14:41.246546+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:14:41.246546+0000","last_undegraded":"2024-09-19T14:14:41.246546+0000","last_fullsized":"2024-09-19T14:14:41.246546+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'702","last_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_deep_scrub":"260'702","last_deep_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.246453+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:35.785088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'225","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.292915+0000","last_change":"2024-09-19T14:14:32.292915+0000","last_active":"2024-09-19T14:14:32.292915+0000","last_peered":"2024-09-19T14:14:32.292915+0000","last_clean":"2024-09-19T14:14:32.292915+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:14:32.292915+0000","last_undegraded":"2024-09-19T14:14:32.292915+0000","last_fullsized":"2024-09-19T14:14:32.292915+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.292807+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:56.116597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":12221,"num_write":1127,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'390","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.745712+0000","last_change":"2024-09-19T14:14:42.745712+0000","last_active":"2024-09-19T14:14:42.745712+0000","last_peered":"2024-09-19T14:14:42.745712+0000","last_clean":"2024-09-19T14:14:42.745712+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:14:42.745712+0000","last_undegraded":"2024-09-19T14:14:42.745712+0000","last_fullsized":"2024-09-19T14:14:42.745712+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-19T14:14:42.745623+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-19T14:14:42.745623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.745623+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.098393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'225","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.804464+0000","last_change":"2024-09-19T14:14:36.804464+0000","last_active":"2024-09-19T14:14:36.804464+0000","last_peered":"2024-09-19T14:14:36.804464+0000","last_clean":"2024-09-19T14:14:36.804464+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:14:36.804464+0000","last_undegraded":"2024-09-19T14:14:36.804464+0000","last_fullsized":"2024-09-19T14:14:36.804464+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.804346+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:50.761130+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311660,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":9100,"num_write":1128,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'994","reported_seq":2647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.190516+0000","last_change":"2024-09-19T14:14:40.190516+0000","last_active":"2024-09-19T14:14:40.190516+0000","last_peered":"2024-09-19T14:14:40.190516+0000","last_clean":"2024-09-19T14:14:40.190516+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:14:40.190516+0000","last_undegraded":"2024-09-19T14:14:40.190516+0000","last_fullsized":"2024-09-19T14:14:40.190516+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'994","last_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_deep_scrub":"260'994","last_deep_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.190428+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:54.056506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'203","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.089410+0000","last_change":"2024-09-19T14:14:36.089410+0000","last_active":"2024-09-19T14:14:36.089410+0000","last_peered":"2024-09-19T14:14:36.089410+0000","last_clean":"2024-09-19T14:14:36.089410+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:14:36.089410+0000","last_undegraded":"2024-09-19T14:14:36.089410+0000","last_fullsized":"2024-09-19T14:14:36.089410+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.089313+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:07.911503+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":762,"num_read_kb":134002,"num_write":945,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'559","reported_seq":2312,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.131013+0000","last_change":"2024-09-19T14:14:36.131013+0000","last_active":"2024-09-19T14:14:36.131013+0000","last_peered":"2024-09-19T14:14:36.131013+0000","last_clean":"2024-09-19T14:14:36.131013+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:14:36.131013+0000","last_undegraded":"2024-09-19T14:14:36.131013+0000","last_fullsized":"2024-09-19T14:14:36.131013+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.130918+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.095702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'193","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.782781+0000","last_change":"2024-09-19T14:14:35.782781+0000","last_active":"2024-09-19T14:14:35.782781+0000","last_peered":"2024-09-19T14:14:35.782781+0000","last_clean":"2024-09-19T14:14:35.782781+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:14:35.782781+0000","last_undegraded":"2024-09-19T14:14:35.782781+0000","last_fullsized":"2024-09-19T14:14:35.782781+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.782688+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.990734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":377,"num_write":871,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'838","reported_seq":2453,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.796490+0000","last_change":"2024-09-19T14:14:43.796490+0000","last_active":"2024-09-19T14:14:43.796490+0000","last_peered":"2024-09-19T14:14:43.796490+0000","last_clean":"2024-09-19T14:14:43.796490+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:14:43.796490+0000","last_undegraded":"2024-09-19T14:14:43.796490+0000","last_fullsized":"2024-09-19T14:14:43.796490+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:43.796410+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:43.796410+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.796410+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:49:51.893820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'192","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.091489+0000","last_change":"2024-09-19T14:14:35.091489+0000","last_active":"2024-09-19T14:14:35.091489+0000","last_peered":"2024-09-19T14:14:35.091489+0000","last_clean":"2024-09-19T14:14:35.091489+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:14:35.091489+0000","last_undegraded":"2024-09-19T14:14:35.091489+0000","last_fullsized":"2024-09-19T14:14:35.091489+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'192","last_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_deep_scrub":"260'192","last_deep_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.091359+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:04.394433+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":7782,"num_write":893,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'506","reported_seq":2295,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.741302+0000","last_change":"2024-09-19T14:14:43.741302+0000","last_active":"2024-09-19T14:14:43.741302+0000","last_peered":"2024-09-19T14:14:43.741302+0000","last_clean":"2024-09-19T14:14:43.741302+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:14:43.741302+0000","last_undegraded":"2024-09-19T14:14:43.741302+0000","last_fullsized":"2024-09-19T14:14:43.741302+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:43.741200+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:43.741200+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.741200+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:02.439155+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'196","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.298383+0000","last_change":"2024-09-19T14:14:32.298383+0000","last_active":"2024-09-19T14:14:32.298383+0000","last_peered":"2024-09-19T14:14:32.298383+0000","last_clean":"2024-09-19T14:14:32.298383+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:14:32.298383+0000","last_undegraded":"2024-09-19T14:14:32.298383+0000","last_fullsized":"2024-09-19T14:14:32.298383+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.298282+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:47.257623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1090,"num_read_kb":38780,"num_write":956,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'844","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.151176+0000","last_change":"2024-09-19T14:14:32.151176+0000","last_active":"2024-09-19T14:14:32.151176+0000","last_peered":"2024-09-19T14:14:32.151176+0000","last_clean":"2024-09-19T14:14:32.151176+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:14:32.151176+0000","last_undegraded":"2024-09-19T14:14:32.151176+0000","last_fullsized":"2024-09-19T14:14:32.151176+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.151071+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:53:10.742546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'554","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.736290+0000","last_change":"2024-09-19T14:14:41.736290+0000","last_active":"2024-09-19T14:14:41.736290+0000","last_peered":"2024-09-19T14:14:41.736290+0000","last_clean":"2024-09-19T14:14:41.736290+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:14:41.736290+0000","last_undegraded":"2024-09-19T14:14:41.736290+0000","last_fullsized":"2024-09-19T14:14:41.736290+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'554","last_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_deep_scrub":"260'554","last_deep_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.736205+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:58.060707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'193","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.105180+0000","last_change":"2024-09-19T14:14:34.105113+0000","last_active":"2024-09-19T14:14:34.105180+0000","last_peered":"2024-09-19T14:14:34.105180+0000","last_clean":"2024-09-19T14:14:34.105180+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:14:34.105180+0000","last_undegraded":"2024-09-19T14:14:34.105180+0000","last_fullsized":"2024-09-19T14:14:34.105180+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.105025+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:38.487293+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":11511,"num_write":896,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'383","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.214409+0000","last_change":"2024-09-19T14:14:40.214409+0000","last_active":"2024-09-19T14:14:40.214409+0000","last_peered":"2024-09-19T14:14:40.214409+0000","last_clean":"2024-09-19T14:14:40.214409+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:14:40.214409+0000","last_undegraded":"2024-09-19T14:14:40.214409+0000","last_fullsized":"2024-09-19T14:14:40.214409+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.214311+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:37:14.302323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'197","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.132706+0000","last_change":"2024-09-19T14:14:32.132624+0000","last_active":"2024-09-19T14:14:32.132706+0000","last_peered":"2024-09-19T14:14:32.132706+0000","last_clean":"2024-09-19T14:14:32.132706+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:14:32.132706+0000","last_undegraded":"2024-09-19T14:14:32.132706+0000","last_fullsized":"2024-09-19T14:14:32.132706+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.132498+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:29.891589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":26719,"num_write":915,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'559","reported_seq":2190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.704483+0000","last_change":"2024-09-19T14:14:40.704483+0000","last_active":"2024-09-19T14:14:40.704483+0000","last_peered":"2024-09-19T14:14:40.704483+0000","last_clean":"2024-09-19T14:14:40.704483+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:14:40.704483+0000","last_undegraded":"2024-09-19T14:14:40.704483+0000","last_fullsized":"2024-09-19T14:14:40.704483+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.704381+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:12.312285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'227","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.161781+0000","last_change":"2024-09-19T14:14:30.161690+0000","last_active":"2024-09-19T14:14:30.161781+0000","last_peered":"2024-09-19T14:14:30.161781+0000","last_clean":"2024-09-19T14:14:30.161781+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:14:30.161781+0000","last_undegraded":"2024-09-19T14:14:30.161781+0000","last_fullsized":"2024-09-19T14:14:30.161781+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'227","last_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_deep_scrub":"260'227","last_deep_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.161577+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:19.848076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":629,"num_read_kb":31855,"num_write":1145,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'379","reported_seq":1919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.163114+0000","last_change":"2024-09-19T14:14:30.163058+0000","last_active":"2024-09-19T14:14:30.163114+0000","last_peered":"2024-09-19T14:14:30.163114+0000","last_clean":"2024-09-19T14:14:30.163114+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:14:30.163114+0000","last_undegraded":"2024-09-19T14:14:30.163114+0000","last_fullsized":"2024-09-19T14:14:30.163114+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.162974+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:37.556799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'206","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.663752+0000","last_change":"2024-09-19T14:14:27.663692+0000","last_active":"2024-09-19T14:14:27.663752+0000","last_peered":"2024-09-19T14:14:27.663752+0000","last_clean":"2024-09-19T14:14:27.663752+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:14:27.663752+0000","last_undegraded":"2024-09-19T14:14:27.663752+0000","last_fullsized":"2024-09-19T14:14:27.663752+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.663598+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:54:59.757452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":49502,"num_write":988,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'394","reported_seq":2008,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.172308+0000","last_change":"2024-09-19T14:14:31.172225+0000","last_active":"2024-09-19T14:14:31.172308+0000","last_peered":"2024-09-19T14:14:31.172308+0000","last_clean":"2024-09-19T14:14:31.172308+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:14:31.172308+0000","last_undegraded":"2024-09-19T14:14:31.172308+0000","last_fullsized":"2024-09-19T14:14:31.172308+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'394","last_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_deep_scrub":"260'394","last_deep_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.172124+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:59.034171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'195","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.310130+0000","last_change":"2024-09-19T14:14:31.310078+0000","last_active":"2024-09-19T14:14:31.310130+0000","last_peered":"2024-09-19T14:14:31.310130+0000","last_clean":"2024-09-19T14:14:31.310130+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:14:31.310130+0000","last_undegraded":"2024-09-19T14:14:31.310130+0000","last_fullsized":"2024-09-19T14:14:31.310130+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.309994+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:02.549578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145924,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":176003,"num_write":888,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'910","reported_seq":2615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.755134+0000","last_change":"2024-09-19T14:14:40.755059+0000","last_active":"2024-09-19T14:14:40.755134+0000","last_peered":"2024-09-19T14:14:40.755134+0000","last_clean":"2024-09-19T14:14:40.755134+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:14:40.755134+0000","last_undegraded":"2024-09-19T14:14:40.755134+0000","last_fullsized":"2024-09-19T14:14:40.755134+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'910","last_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_deep_scrub":"260'910","last_deep_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.754973+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:03.252154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.263121+0000","last_change":"2024-09-19T14:14:30.263121+0000","last_active":"2024-09-19T14:14:30.263121+0000","last_peered":"2024-09-19T14:14:30.263121+0000","last_clean":"2024-09-19T14:14:30.263121+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:14:30.263121+0000","last_undegraded":"2024-09-19T14:14:30.263121+0000","last_fullsized":"2024-09-19T14:14:30.263121+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.263019+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:26.635817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":112164,"num_write":1137,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'139","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.770168+0000","last_change":"2024-09-19T14:14:58.770168+0000","last_active":"2024-09-19T14:14:58.770168+0000","last_peered":"2024-09-19T14:14:58.770168+0000","last_clean":"2024-09-19T14:14:58.770168+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:14:58.770168+0000","last_undegraded":"2024-09-19T14:14:58.770168+0000","last_fullsized":"2024-09-19T14:14:58.770168+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-19T14:14:58.770082+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-19T14:14:58.770082+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.770082+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:36:45.776897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'819","reported_seq":2323,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.328941+0000","last_change":"2024-09-19T14:14:36.328941+0000","last_active":"2024-09-19T14:14:36.328941+0000","last_peered":"2024-09-19T14:14:36.328941+0000","last_clean":"2024-09-19T14:14:36.328941+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:14:36.328941+0000","last_undegraded":"2024-09-19T14:14:36.328941+0000","last_fullsized":"2024-09-19T14:14:36.328941+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'819","last_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_deep_scrub":"260'819","last_deep_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.328841+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:46.293758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'177","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.117409+0000","last_change":"2024-09-19T14:14:31.117409+0000","last_active":"2024-09-19T14:14:31.117409+0000","last_peered":"2024-09-19T14:14:31.117409+0000","last_clean":"2024-09-19T14:14:31.117409+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:14:31.117409+0000","last_undegraded":"2024-09-19T14:14:31.117409+0000","last_fullsized":"2024-09-19T14:14:31.117409+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.117313+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:40.698859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":47147,"num_write":844,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.702330+0000","last_change":"2024-09-19T14:14:46.702269+0000","last_active":"2024-09-19T14:14:46.702330+0000","last_peered":"2024-09-19T14:14:46.702330+0000","last_clean":"2024-09-19T14:14:46.702330+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:14:46.702330+0000","last_undegraded":"2024-09-19T14:14:46.702330+0000","last_fullsized":"2024-09-19T14:14:46.702330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.702178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.702178+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.702178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:28.252054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'197","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.213989+0000","last_change":"2024-09-19T14:14:47.213911+0000","last_active":"2024-09-19T14:14:47.213989+0000","last_peered":"2024-09-19T14:14:47.213989+0000","last_clean":"2024-09-19T14:14:47.213989+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:14:47.213989+0000","last_undegraded":"2024-09-19T14:14:47.213989+0000","last_fullsized":"2024-09-19T14:14:47.213989+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:47.213829+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:47.213829+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.213829+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:52.269122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":375,"num_write":156,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.239283+0000","last_change":"2024-09-19T14:14:55.239180+0000","last_active":"2024-09-19T14:14:55.239283+0000","last_peered":"2024-09-19T14:14:55.239283+0000","last_clean":"2024-09-19T14:14:55.239283+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:14:55.239283+0000","last_undegraded":"2024-09-19T14:14:55.239283+0000","last_fullsized":"2024-09-19T14:14:55.239283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.239075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.239075+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.239075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:55.212000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2507","reported_seq":4328,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.590514+0000","last_change":"2024-09-19T14:14:59.590448+0000","last_active":"2024-09-19T14:14:59.590514+0000","last_peered":"2024-09-19T14:14:59.590514+0000","last_clean":"2024-09-19T14:14:59.590514+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:14:59.590514+0000","last_undegraded":"2024-09-19T14:14:59.590514+0000","last_fullsized":"2024-09-19T14:14:59.590514+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2507","last_scrub_stamp":"2024-09-19T14:14:59.590365+0000","last_deep_scrub":"260'2507","last_deep_scrub_stamp":"2024-09-19T14:14:59.590365+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.590365+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":2400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:38.558628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'479","reported_seq":2129,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.773886+0000","last_change":"2024-09-19T14:14:37.773810+0000","last_active":"2024-09-19T14:14:37.773886+0000","last_peered":"2024-09-19T14:14:37.773886+0000","last_clean":"2024-09-19T14:14:37.773886+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:14:37.773886+0000","last_undegraded":"2024-09-19T14:14:37.773886+0000","last_fullsized":"2024-09-19T14:14:37.773886+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'479","last_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_deep_scrub":"260'479","last_deep_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.773706+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:04.083276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'172","reported_seq":757,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.319675+0000","last_change":"2024-09-19T14:14:24.319675+0000","last_active":"2024-09-19T14:14:24.319675+0000","last_peered":"2024-09-19T14:14:24.319675+0000","last_clean":"2024-09-19T14:14:24.319675+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:14:24.319675+0000","last_undegraded":"2024-09-19T14:14:24.319675+0000","last_fullsized":"2024-09-19T14:14:24.319675+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'172","last_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_deep_scrub":"260'172","last_deep_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.319605+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:56.937149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":371,"num_read_kb":36151,"num_write":775,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.252761+0000","last_change":"2024-09-19T14:14:44.252761+0000","last_active":"2024-09-19T14:14:44.252761+0000","last_peered":"2024-09-19T14:14:44.252761+0000","last_clean":"2024-09-19T14:14:44.252761+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:14:44.252761+0000","last_undegraded":"2024-09-19T14:14:44.252761+0000","last_fullsized":"2024-09-19T14:14:44.252761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.252671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.252671+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.252671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:08.431300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'81","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.794184+0000","last_change":"2024-09-19T14:14:49.794123+0000","last_active":"2024-09-19T14:14:49.794184+0000","last_peered":"2024-09-19T14:14:49.794184+0000","last_clean":"2024-09-19T14:14:49.794184+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:14:49.794184+0000","last_undegraded":"2024-09-19T14:14:49.794184+0000","last_fullsized":"2024-09-19T14:14:49.794184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'81","last_scrub_stamp":"2024-09-19T14:14:49.794031+0000","last_deep_scrub":"260'81","last_deep_scrub_stamp":"2024-09-19T14:14:49.794031+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.794031+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:53.073294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.818300+0000","last_change":"2024-09-19T14:14:54.818226+0000","last_active":"2024-09-19T14:14:54.818300+0000","last_peered":"2024-09-19T14:14:54.818300+0000","last_clean":"2024-09-19T14:14:54.818300+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:14:54.818300+0000","last_undegraded":"2024-09-19T14:14:54.818300+0000","last_fullsized":"2024-09-19T14:14:54.818300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.818118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.818118+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.818118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:11.651936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'138","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.169897+0000","last_change":"2024-09-19T14:14:58.169897+0000","last_active":"2024-09-19T14:14:58.169897+0000","last_peered":"2024-09-19T14:14:58.169897+0000","last_clean":"2024-09-19T14:14:58.169897+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:14:58.169897+0000","last_undegraded":"2024-09-19T14:14:58.169897+0000","last_fullsized":"2024-09-19T14:14:58.169897+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'138","last_scrub_stamp":"2024-09-19T14:14:58.169814+0000","last_deep_scrub":"260'138","last_deep_scrub_stamp":"2024-09-19T14:14:58.169814+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.169814+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:59.894371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'837","reported_seq":2520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.219917+0000","last_change":"2024-09-19T14:14:35.219848+0000","last_active":"2024-09-19T14:14:35.219917+0000","last_peered":"2024-09-19T14:14:35.219917+0000","last_clean":"2024-09-19T14:14:35.219917+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:14:35.219917+0000","last_undegraded":"2024-09-19T14:14:35.219917+0000","last_fullsized":"2024-09-19T14:14:35.219917+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'837","last_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_deep_scrub":"260'837","last_deep_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.219760+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:28.048778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'169","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.152624+0000","last_change":"2024-09-19T14:14:29.152624+0000","last_active":"2024-09-19T14:14:29.152624+0000","last_peered":"2024-09-19T14:14:29.152624+0000","last_clean":"2024-09-19T14:14:29.152624+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:14:29.152624+0000","last_undegraded":"2024-09-19T14:14:29.152624+0000","last_fullsized":"2024-09-19T14:14:29.152624+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'169","last_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_deep_scrub":"260'169","last_deep_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.152542+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:24.812263+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":63998,"num_write":820,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.221945+0000","last_change":"2024-09-19T14:14:46.221891+0000","last_active":"2024-09-19T14:14:46.221945+0000","last_peered":"2024-09-19T14:14:46.221945+0000","last_clean":"2024-09-19T14:14:46.221945+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:14:46.221945+0000","last_undegraded":"2024-09-19T14:14:46.221945+0000","last_fullsized":"2024-09-19T14:14:46.221945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.221818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.221818+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.221818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:33.565654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'109","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.063068+0000","last_change":"2024-09-19T14:14:38.063068+0000","last_active":"2024-09-19T14:14:38.063068+0000","last_peered":"2024-09-19T14:14:38.063068+0000","last_clean":"2024-09-19T14:14:38.063068+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:14:38.063068+0000","last_undegraded":"2024-09-19T14:14:38.063068+0000","last_fullsized":"2024-09-19T14:14:38.063068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.062968+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:05.291095+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'764","reported_seq":2075,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.219729+0000","last_change":"2024-09-19T14:14:54.219640+0000","last_active":"2024-09-19T14:14:54.219729+0000","last_peered":"2024-09-19T14:14:54.219729+0000","last_clean":"2024-09-19T14:14:54.219729+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:14:54.219729+0000","last_undegraded":"2024-09-19T14:14:54.219729+0000","last_fullsized":"2024-09-19T14:14:54.219729+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'764","last_scrub_stamp":"2024-09-19T14:14:54.219557+0000","last_deep_scrub":"260'764","last_deep_scrub_stamp":"2024-09-19T14:14:54.219557+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.219557+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:45.057117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'278","reported_seq":1116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.743148+0000","last_change":"2024-09-19T14:14:59.743148+0000","last_active":"2024-09-19T14:14:59.743148+0000","last_peered":"2024-09-19T14:14:59.743148+0000","last_clean":"2024-09-19T14:14:59.743148+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:14:59.743148+0000","last_undegraded":"2024-09-19T14:14:59.743148+0000","last_fullsized":"2024-09-19T14:14:59.743148+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-09-19T14:14:59.743054+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-09-19T14:14:59.743054+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.743054+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:04.825781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'432","reported_seq":1989,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.369856+0000","last_change":"2024-09-19T14:14:37.369783+0000","last_active":"2024-09-19T14:14:37.369856+0000","last_peered":"2024-09-19T14:14:37.369856+0000","last_clean":"2024-09-19T14:14:37.369856+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:14:37.369856+0000","last_undegraded":"2024-09-19T14:14:37.369856+0000","last_fullsized":"2024-09-19T14:14:37.369856+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.369664+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:53.882937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.095470+0000","last_change":"2024-09-19T14:14:26.095470+0000","last_active":"2024-09-19T14:14:26.095470+0000","last_peered":"2024-09-19T14:14:26.095470+0000","last_clean":"2024-09-19T14:14:26.095470+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:14:26.095470+0000","last_undegraded":"2024-09-19T14:14:26.095470+0000","last_fullsized":"2024-09-19T14:14:26.095470+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'185","last_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_deep_scrub":"260'185","last_deep_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.095355+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:16.399362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":22529,"num_write":874,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.665020+0000","last_change":"2024-09-19T14:14:47.664954+0000","last_active":"2024-09-19T14:14:47.665020+0000","last_peered":"2024-09-19T14:14:47.665020+0000","last_clean":"2024-09-19T14:14:47.665020+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:14:47.665020+0000","last_undegraded":"2024-09-19T14:14:47.665020+0000","last_fullsized":"2024-09-19T14:14:47.665020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.664850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.664850+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.664850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:57.538937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'119","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.240368+0000","last_change":"2024-09-19T14:14:50.240296+0000","last_active":"2024-09-19T14:14:50.240368+0000","last_peered":"2024-09-19T14:14:50.240368+0000","last_clean":"2024-09-19T14:14:50.240368+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:14:50.240368+0000","last_undegraded":"2024-09-19T14:14:50.240368+0000","last_fullsized":"2024-09-19T14:14:50.240368+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-09-19T14:14:50.240208+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-09-19T14:14:50.240208+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.240208+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:02.074101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":261,"num_write":92,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'796","reported_seq":2175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.064370+0000","last_change":"2024-09-19T14:14:58.064370+0000","last_active":"2024-09-19T14:14:58.064370+0000","last_peered":"2024-09-19T14:14:58.064370+0000","last_clean":"2024-09-19T14:14:58.064370+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:14:58.064370+0000","last_undegraded":"2024-09-19T14:14:58.064370+0000","last_fullsized":"2024-09-19T14:14:58.064370+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'796","last_scrub_stamp":"2024-09-19T14:14:58.064253+0000","last_deep_scrub":"260'796","last_deep_scrub_stamp":"2024-09-19T14:14:58.064253+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.064253+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:36.368112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'452","reported_seq":2032,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.750189+0000","last_change":"2024-09-19T14:14:38.750189+0000","last_active":"2024-09-19T14:14:38.750189+0000","last_peered":"2024-09-19T14:14:38.750189+0000","last_clean":"2024-09-19T14:14:38.750189+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:14:38.750189+0000","last_undegraded":"2024-09-19T14:14:38.750189+0000","last_fullsized":"2024-09-19T14:14:38.750189+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'452","last_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_deep_scrub":"260'452","last_deep_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.750102+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:49.925244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'243","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.150348+0000","last_change":"2024-09-19T14:14:28.150279+0000","last_active":"2024-09-19T14:14:28.150348+0000","last_peered":"2024-09-19T14:14:28.150348+0000","last_clean":"2024-09-19T14:14:28.150348+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:14:28.150348+0000","last_undegraded":"2024-09-19T14:14:28.150348+0000","last_fullsized":"2024-09-19T14:14:28.150348+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'243","last_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_deep_scrub":"260'243","last_deep_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.150184+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:23.391140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":46832,"num_write":1033,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.263839+0000","last_change":"2024-09-19T14:14:43.263839+0000","last_active":"2024-09-19T14:14:43.263839+0000","last_peered":"2024-09-19T14:14:43.263839+0000","last_clean":"2024-09-19T14:14:43.263839+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:14:43.263839+0000","last_undegraded":"2024-09-19T14:14:43.263839+0000","last_fullsized":"2024-09-19T14:14:43.263839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.263742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.263742+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.263742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:03.888213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'198","reported_seq":796,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.740161+0000","last_change":"2024-09-19T14:14:50.740161+0000","last_active":"2024-09-19T14:14:50.740161+0000","last_peered":"2024-09-19T14:14:50.740161+0000","last_clean":"2024-09-19T14:14:50.740161+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:14:50.740161+0000","last_undegraded":"2024-09-19T14:14:50.740161+0000","last_fullsized":"2024-09-19T14:14:50.740161+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:50.740052+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:50.740052+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.740052+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:48.730209+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":253,"num_read_kb":317,"num_write":142,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.465022+0000","last_change":"2024-09-19T14:14:45.465022+0000","last_active":"2024-09-19T14:14:45.465022+0000","last_peered":"2024-09-19T14:14:45.465022+0000","last_clean":"2024-09-19T14:14:45.465022+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:14:45.465022+0000","last_undegraded":"2024-09-19T14:14:45.465022+0000","last_fullsized":"2024-09-19T14:14:45.465022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.464942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.464942+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.464942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:20.634984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'542","reported_seq":1364,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.614789+0000","last_change":"2024-09-19T14:14:55.614789+0000","last_active":"2024-09-19T14:14:55.614789+0000","last_peered":"2024-09-19T14:14:55.614789+0000","last_clean":"2024-09-19T14:14:55.614789+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:14:55.614789+0000","last_undegraded":"2024-09-19T14:14:55.614789+0000","last_fullsized":"2024-09-19T14:14:55.614789+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'542","last_scrub_stamp":"2024-09-19T14:14:55.614697+0000","last_deep_scrub":"260'542","last_deep_scrub_stamp":"2024-09-19T14:14:55.614697+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.614697+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:51.676971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2066,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.703272+0000","last_change":"2024-09-19T14:14:29.703272+0000","last_active":"2024-09-19T14:14:29.703272+0000","last_peered":"2024-09-19T14:14:29.703272+0000","last_clean":"2024-09-19T14:14:29.703272+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:14:29.703272+0000","last_undegraded":"2024-09-19T14:14:29.703272+0000","last_fullsized":"2024-09-19T14:14:29.703272+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'477","last_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_deep_scrub":"260'477","last_deep_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.703144+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:43.741727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'207","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.084574+0000","last_change":"2024-09-19T14:14:26.084488+0000","last_active":"2024-09-19T14:14:26.084574+0000","last_peered":"2024-09-19T14:14:26.084574+0000","last_clean":"2024-09-19T14:14:26.084574+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:14:26.084574+0000","last_undegraded":"2024-09-19T14:14:26.084574+0000","last_fullsized":"2024-09-19T14:14:26.084574+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'207","last_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_deep_scrub":"260'207","last_deep_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.084345+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:14.683841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":31454,"num_write":896,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"260'4","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.082578+0000","last_change":"2024-09-19T14:14:34.082578+0000","last_active":"2024-09-19T14:14:34.082578+0000","last_peered":"2024-09-19T14:14:34.082578+0000","last_clean":"2024-09-19T14:14:34.082578+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:14:34.082578+0000","last_undegraded":"2024-09-19T14:14:34.082578+0000","last_fullsized":"2024-09-19T14:14:34.082578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.082477+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:29.861443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'129","reported_seq":695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.207940+0000","last_change":"2024-09-19T14:14:48.207940+0000","last_active":"2024-09-19T14:14:48.207940+0000","last_peered":"2024-09-19T14:14:48.207940+0000","last_clean":"2024-09-19T14:14:48.207940+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:14:48.207940+0000","last_undegraded":"2024-09-19T14:14:48.207940+0000","last_fullsized":"2024-09-19T14:14:48.207940+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:48.207855+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:48.207855+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.207855+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:56.958935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10667,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.018990+0000","last_change":"2024-09-19T14:14:56.018990+0000","last_active":"2024-09-19T14:14:56.018990+0000","last_peered":"2024-09-19T14:14:56.018990+0000","last_clean":"2024-09-19T14:14:56.018990+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:14:56.018990+0000","last_undegraded":"2024-09-19T14:14:56.018990+0000","last_fullsized":"2024-09-19T14:14:56.018990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:56.018901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:56.018901+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.018901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:32.913138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'175","reported_seq":668,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.292890+0000","last_change":"2024-09-19T14:14:47.292890+0000","last_active":"2024-09-19T14:14:47.292890+0000","last_peered":"2024-09-19T14:14:47.292890+0000","last_clean":"2024-09-19T14:14:47.292890+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:14:47.292890+0000","last_undegraded":"2024-09-19T14:14:47.292890+0000","last_fullsized":"2024-09-19T14:14:47.292890+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-09-19T14:14:47.292772+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-09-19T14:14:47.292772+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.292772+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:16.886494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'344","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.128335+0000","last_change":"2024-09-19T14:14:34.128335+0000","last_active":"2024-09-19T14:14:34.128335+0000","last_peered":"2024-09-19T14:14:34.128335+0000","last_clean":"2024-09-19T14:14:34.128335+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:14:34.128335+0000","last_undegraded":"2024-09-19T14:14:34.128335+0000","last_fullsized":"2024-09-19T14:14:34.128335+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'344","last_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_deep_scrub":"260'344","last_deep_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.128247+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:06.144660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'241","reported_seq":1073,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.069250+0000","last_change":"2024-09-19T14:14:32.069250+0000","last_active":"2024-09-19T14:14:32.069250+0000","last_peered":"2024-09-19T14:14:32.069250+0000","last_clean":"2024-09-19T14:14:32.069250+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:14:32.069250+0000","last_undegraded":"2024-09-19T14:14:32.069250+0000","last_fullsized":"2024-09-19T14:14:32.069250+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.069155+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:39.354526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":168929,"num_write":1052,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.087218+0000","last_change":"2024-09-19T14:14:36.087218+0000","last_active":"2024-09-19T14:14:36.087218+0000","last_peered":"2024-09-19T14:14:36.087218+0000","last_clean":"2024-09-19T14:14:36.087218+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:14:36.087218+0000","last_undegraded":"2024-09-19T14:14:36.087218+0000","last_fullsized":"2024-09-19T14:14:36.087218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.087119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:15.398847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'168","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.150114+0000","last_change":"2024-09-19T14:14:46.150114+0000","last_active":"2024-09-19T14:14:46.150114+0000","last_peered":"2024-09-19T14:14:46.150114+0000","last_clean":"2024-09-19T14:14:46.150114+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:14:46.150114+0000","last_undegraded":"2024-09-19T14:14:46.150114+0000","last_fullsized":"2024-09-19T14:14:46.150114+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-09-19T14:14:46.150015+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-09-19T14:14:46.150015+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.150015+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:14.578493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":189,"num_read_kb":233,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'805","reported_seq":2367,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.216602+0000","last_change":"2024-09-19T14:14:51.216602+0000","last_active":"2024-09-19T14:14:51.216602+0000","last_peered":"2024-09-19T14:14:51.216602+0000","last_clean":"2024-09-19T14:14:51.216602+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:14:51.216602+0000","last_undegraded":"2024-09-19T14:14:51.216602+0000","last_fullsized":"2024-09-19T14:14:51.216602+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-19T14:14:51.216522+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-19T14:14:51.216522+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.216522+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:17.663430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.188724+0000","last_change":"2024-09-19T14:14:56.188724+0000","last_active":"2024-09-19T14:14:56.188724+0000","last_peered":"2024-09-19T14:14:56.188724+0000","last_clean":"2024-09-19T14:14:56.188724+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:14:56.188724+0000","last_undegraded":"2024-09-19T14:14:56.188724+0000","last_fullsized":"2024-09-19T14:14:56.188724+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-09-19T14:14:56.188636+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-09-19T14:14:56.188636+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.188636+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:38.609689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'429","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.275001+0000","last_change":"2024-09-19T14:14:33.275001+0000","last_active":"2024-09-19T14:14:33.275001+0000","last_peered":"2024-09-19T14:14:33.275001+0000","last_clean":"2024-09-19T14:14:33.275001+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:14:33.275001+0000","last_undegraded":"2024-09-19T14:14:33.275001+0000","last_fullsized":"2024-09-19T14:14:33.275001+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'429","last_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_deep_scrub":"260'429","last_deep_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.274911+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:04.889403+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'206","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.809045+0000","last_change":"2024-09-19T14:14:26.809045+0000","last_active":"2024-09-19T14:14:26.809045+0000","last_peered":"2024-09-19T14:14:26.809045+0000","last_clean":"2024-09-19T14:14:26.809045+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:14:26.809045+0000","last_undegraded":"2024-09-19T14:14:26.809045+0000","last_fullsized":"2024-09-19T14:14:26.809045+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.808956+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:42.176771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":543,"num_read_kb":50665,"num_write":1025,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.119264+0000","last_change":"2024-09-19T14:14:35.119264+0000","last_active":"2024-09-19T14:14:35.119264+0000","last_peered":"2024-09-19T14:14:35.119264+0000","last_clean":"2024-09-19T14:14:35.119264+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:14:35.119264+0000","last_undegraded":"2024-09-19T14:14:35.119264+0000","last_fullsized":"2024-09-19T14:14:35.119264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.119157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:35:11.867701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'193","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.199552+0000","last_change":"2024-09-19T14:14:45.199552+0000","last_active":"2024-09-19T14:14:45.199552+0000","last_peered":"2024-09-19T14:14:45.199552+0000","last_clean":"2024-09-19T14:14:45.199552+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:14:45.199552+0000","last_undegraded":"2024-09-19T14:14:45.199552+0000","last_fullsized":"2024-09-19T14:14:45.199552+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:45.199463+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:45.199463+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.199463+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:27.643129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20793,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":404,"num_write":130,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.985385+0000","last_change":"2024-09-19T14:14:39.985385+0000","last_active":"2024-09-19T14:14:39.985385+0000","last_peered":"2024-09-19T14:14:39.985385+0000","last_clean":"2024-09-19T14:14:39.985385+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:14:39.985385+0000","last_undegraded":"2024-09-19T14:14:39.985385+0000","last_fullsized":"2024-09-19T14:14:39.985385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:14.242432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'171","reported_seq":693,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.418181+0000","last_change":"2024-09-19T14:14:50.418181+0000","last_active":"2024-09-19T14:14:50.418181+0000","last_peered":"2024-09-19T14:14:50.418181+0000","last_clean":"2024-09-19T14:14:50.418181+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:14:50.418181+0000","last_undegraded":"2024-09-19T14:14:50.418181+0000","last_fullsized":"2024-09-19T14:14:50.418181+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'171","last_scrub_stamp":"2024-09-19T14:14:50.418094+0000","last_deep_scrub":"260'171","last_deep_scrub_stamp":"2024-09-19T14:14:50.418094+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.418094+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:41.041552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1299","reported_seq":3081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.665018+0000","last_change":"2024-09-19T14:14:30.665018+0000","last_active":"2024-09-19T14:14:30.665018+0000","last_peered":"2024-09-19T14:14:30.665018+0000","last_clean":"2024-09-19T14:14:30.665018+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:14:30.665018+0000","last_undegraded":"2024-09-19T14:14:30.665018+0000","last_fullsized":"2024-09-19T14:14:30.665018+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1299","last_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_deep_scrub":"260'1299","last_deep_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.664940+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":1200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:04.360372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'194","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.386580+0000","last_change":"2024-09-19T14:14:27.386580+0000","last_active":"2024-09-19T14:14:27.386580+0000","last_peered":"2024-09-19T14:14:27.386580+0000","last_clean":"2024-09-19T14:14:27.386580+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:14:27.386580+0000","last_undegraded":"2024-09-19T14:14:27.386580+0000","last_fullsized":"2024-09-19T14:14:27.386580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.386475+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:11.179031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":2025,"num_write":905,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.084095+0000","last_change":"2024-09-19T14:14:37.084095+0000","last_active":"2024-09-19T14:14:37.084095+0000","last_peered":"2024-09-19T14:14:37.084095+0000","last_clean":"2024-09-19T14:14:37.084095+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:14:37.084095+0000","last_undegraded":"2024-09-19T14:14:37.084095+0000","last_fullsized":"2024-09-19T14:14:37.084095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.084002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:24.084032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'152","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.803330+0000","last_change":"2024-09-19T14:14:50.803330+0000","last_active":"2024-09-19T14:14:50.803330+0000","last_peered":"2024-09-19T14:14:50.803330+0000","last_clean":"2024-09-19T14:14:50.803330+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:14:50.803330+0000","last_undegraded":"2024-09-19T14:14:50.803330+0000","last_fullsized":"2024-09-19T14:14:50.803330+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:50.803244+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:50.803244+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.803244+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:55.132678+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":203,"num_read_kb":278,"num_write":160,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.204653+0000","last_change":"2024-09-19T14:14:52.204653+0000","last_active":"2024-09-19T14:14:52.204653+0000","last_peered":"2024-09-19T14:14:52.204653+0000","last_clean":"2024-09-19T14:14:52.204653+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:14:52.204653+0000","last_undegraded":"2024-09-19T14:14:52.204653+0000","last_fullsized":"2024-09-19T14:14:52.204653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:52.204570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:52.204570+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.204570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:02.183773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'121","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.055536+0000","last_change":"2024-09-19T14:14:59.055536+0000","last_active":"2024-09-19T14:14:59.055536+0000","last_peered":"2024-09-19T14:14:59.055536+0000","last_clean":"2024-09-19T14:14:59.055536+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:14:59.055536+0000","last_undegraded":"2024-09-19T14:14:59.055536+0000","last_fullsized":"2024-09-19T14:14:59.055536+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'121","last_scrub_stamp":"2024-09-19T14:14:59.055434+0000","last_deep_scrub":"260'121","last_deep_scrub_stamp":"2024-09-19T14:14:59.055434+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.055434+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:34.842983+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'471","reported_seq":2101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.635975+0000","last_change":"2024-09-19T14:14:31.635975+0000","last_active":"2024-09-19T14:14:31.635975+0000","last_peered":"2024-09-19T14:14:31.635975+0000","last_clean":"2024-09-19T14:14:31.635975+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:14:31.635975+0000","last_undegraded":"2024-09-19T14:14:31.635975+0000","last_fullsized":"2024-09-19T14:14:31.635975+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'471","last_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_deep_scrub":"260'471","last_deep_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.635871+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:59.000822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'218","reported_seq":858,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.107934+0000","last_change":"2024-09-19T14:14:28.107934+0000","last_active":"2024-09-19T14:14:28.107934+0000","last_peered":"2024-09-19T14:14:28.107934+0000","last_clean":"2024-09-19T14:14:28.107934+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:14:28.107934+0000","last_undegraded":"2024-09-19T14:14:28.107934+0000","last_fullsized":"2024-09-19T14:14:28.107934+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.107813+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:25.599144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":62927,"num_write":1024,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.387905+0000","last_change":"2024-09-19T14:14:38.387905+0000","last_active":"2024-09-19T14:14:38.387905+0000","last_peered":"2024-09-19T14:14:38.387905+0000","last_clean":"2024-09-19T14:14:38.387905+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:14:38.387905+0000","last_undegraded":"2024-09-19T14:14:38.387905+0000","last_fullsized":"2024-09-19T14:14:38.387905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.387808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:10.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'152","reported_seq":732,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.019987+0000","last_change":"2024-09-19T14:14:39.019987+0000","last_active":"2024-09-19T14:14:39.019987+0000","last_peered":"2024-09-19T14:14:39.019987+0000","last_clean":"2024-09-19T14:14:39.019987+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:14:39.019987+0000","last_undegraded":"2024-09-19T14:14:39.019987+0000","last_fullsized":"2024-09-19T14:14:39.019987+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.019863+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:04.873037+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":180,"num_read_kb":188,"num_write":94,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'736","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.008665+0000","last_change":"2024-09-19T14:14:41.008665+0000","last_active":"2024-09-19T14:14:41.008665+0000","last_peered":"2024-09-19T14:14:41.008665+0000","last_clean":"2024-09-19T14:14:41.008665+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:14:41.008665+0000","last_undegraded":"2024-09-19T14:14:41.008665+0000","last_fullsized":"2024-09-19T14:14:41.008665+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'736","last_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_deep_scrub":"260'736","last_deep_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.008532+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:52.770410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'123","reported_seq":642,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.413838+0000","last_change":"2024-09-19T14:14:48.413838+0000","last_active":"2024-09-19T14:14:48.413838+0000","last_peered":"2024-09-19T14:14:48.413838+0000","last_clean":"2024-09-19T14:14:48.413838+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:14:48.413838+0000","last_undegraded":"2024-09-19T14:14:48.413838+0000","last_fullsized":"2024-09-19T14:14:48.413838+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'123","last_scrub_stamp":"2024-09-19T14:14:48.413746+0000","last_deep_scrub":"260'123","last_deep_scrub_stamp":"2024-09-19T14:14:48.413746+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.413746+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.347352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1577","reported_seq":3205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.622853+0000","last_change":"2024-09-19T14:14:32.622853+0000","last_active":"2024-09-19T14:14:32.622853+0000","last_peered":"2024-09-19T14:14:32.622853+0000","last_clean":"2024-09-19T14:14:32.622853+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:14:32.622853+0000","last_undegraded":"2024-09-19T14:14:32.622853+0000","last_fullsized":"2024-09-19T14:14:32.622853+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1577","last_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_deep_scrub":"260'1577","last_deep_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.622730+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":1500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:37.492268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'202","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.599775+0000","last_change":"2024-09-19T14:14:24.599775+0000","last_active":"2024-09-19T14:14:24.599775+0000","last_peered":"2024-09-19T14:14:24.599775+0000","last_clean":"2024-09-19T14:14:24.599775+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:14:24.599775+0000","last_undegraded":"2024-09-19T14:14:24.599775+0000","last_fullsized":"2024-09-19T14:14:24.599775+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.599680+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.795340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":26305,"num_write":903,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"260'9","reported_seq":1934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.736639+0000","last_change":"2024-09-19T14:14:45.736639+0000","last_active":"2024-09-19T14:14:45.736639+0000","last_peered":"2024-09-19T14:14:45.736639+0000","last_clean":"2024-09-19T14:14:45.736639+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:14:45.736639+0000","last_undegraded":"2024-09-19T14:14:45.736639+0000","last_fullsized":"2024-09-19T14:14:45.736639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-19T14:14:45.736528+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-19T14:14:45.736528+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.736528+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:03.389967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1680,"num_read_kb":2149,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'80","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.214532+0000","last_change":"2024-09-19T14:14:49.214532+0000","last_active":"2024-09-19T14:14:49.214532+0000","last_peered":"2024-09-19T14:14:49.214532+0000","last_clean":"2024-09-19T14:14:49.214532+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:14:49.214532+0000","last_undegraded":"2024-09-19T14:14:49.214532+0000","last_fullsized":"2024-09-19T14:14:49.214532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'80","last_scrub_stamp":"2024-09-19T14:14:49.214444+0000","last_deep_scrub":"260'80","last_deep_scrub_stamp":"2024-09-19T14:14:49.214444+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.214444+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:00.195139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'779","reported_seq":4746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.272223+0000","last_change":"2024-09-19T14:14:43.272223+0000","last_active":"2024-09-19T14:14:43.272223+0000","last_peered":"2024-09-19T14:14:43.272223+0000","last_clean":"2024-09-19T14:14:43.272223+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:14:43.272223+0000","last_undegraded":"2024-09-19T14:14:43.272223+0000","last_fullsized":"2024-09-19T14:14:43.272223+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'779","last_scrub_stamp":"2024-09-19T14:14:43.272137+0000","last_deep_scrub":"260'779","last_deep_scrub_stamp":"2024-09-19T14:14:43.272137+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.272137+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:40.042664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'129","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.801351+0000","last_change":"2024-09-19T14:14:56.801351+0000","last_active":"2024-09-19T14:14:56.801351+0000","last_peered":"2024-09-19T14:14:56.801351+0000","last_clean":"2024-09-19T14:14:56.801351+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:14:56.801351+0000","last_undegraded":"2024-09-19T14:14:56.801351+0000","last_fullsized":"2024-09-19T14:14:56.801351+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:56.801262+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:56.801262+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.801262+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:57.529161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'913","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.399491+0000","last_change":"2024-09-19T14:14:34.399491+0000","last_active":"2024-09-19T14:14:34.399491+0000","last_peered":"2024-09-19T14:14:34.399491+0000","last_clean":"2024-09-19T14:14:34.399491+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:14:34.399491+0000","last_undegraded":"2024-09-19T14:14:34.399491+0000","last_fullsized":"2024-09-19T14:14:34.399491+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.399381+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:04.254432+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'181","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.387106+0000","last_change":"2024-09-19T14:14:24.387106+0000","last_active":"2024-09-19T14:14:24.387106+0000","last_peered":"2024-09-19T14:14:24.387106+0000","last_clean":"2024-09-19T14:14:24.387106+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:14:24.387106+0000","last_undegraded":"2024-09-19T14:14:24.387106+0000","last_fullsized":"2024-09-19T14:14:24.387106+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'181","last_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_deep_scrub":"260'181","last_deep_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.387035+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:58.069276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.789131+0000","last_change":"2024-09-19T14:14:45.789131+0000","last_active":"2024-09-19T14:14:45.789131+0000","last_peered":"2024-09-19T14:14:45.789131+0000","last_clean":"2024-09-19T14:14:45.789131+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:14:45.789131+0000","last_undegraded":"2024-09-19T14:14:45.789131+0000","last_fullsized":"2024-09-19T14:14:45.789131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.789031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.789031+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.789031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:15.046433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'204","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.703399+0000","last_change":"2024-09-19T14:14:51.703399+0000","last_active":"2024-09-19T14:14:51.703399+0000","last_peered":"2024-09-19T14:14:51.703399+0000","last_clean":"2024-09-19T14:14:51.703399+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:14:51.703399+0000","last_undegraded":"2024-09-19T14:14:51.703399+0000","last_fullsized":"2024-09-19T14:14:51.703399+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'204","last_scrub_stamp":"2024-09-19T14:14:51.703300+0000","last_deep_scrub":"260'204","last_deep_scrub_stamp":"2024-09-19T14:14:51.703300+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.703300+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:45.051594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":866,"num_read_kb":913,"num_write":1382,"num_write_kb":1260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516348,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.214279+0000","last_change":"2024-09-19T14:14:39.214279+0000","last_active":"2024-09-19T14:14:39.214279+0000","last_peered":"2024-09-19T14:14:39.214279+0000","last_clean":"2024-09-19T14:14:39.214279+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:14:39.214279+0000","last_undegraded":"2024-09-19T14:14:39.214279+0000","last_fullsized":"2024-09-19T14:14:39.214279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.214191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:32.459392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.449989+0000","last_change":"2024-09-19T14:14:49.449989+0000","last_active":"2024-09-19T14:14:49.449989+0000","last_peered":"2024-09-19T14:14:49.449989+0000","last_clean":"2024-09-19T14:14:49.449989+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:14:49.449989+0000","last_undegraded":"2024-09-19T14:14:49.449989+0000","last_fullsized":"2024-09-19T14:14:49.449989+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-09-19T14:14:49.449885+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-09-19T14:14:49.449885+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.449885+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:16.393490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.142395+0000","last_change":"2024-09-19T14:14:33.142395+0000","last_active":"2024-09-19T14:14:33.142395+0000","last_peered":"2024-09-19T14:14:33.142395+0000","last_clean":"2024-09-19T14:14:33.142395+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:14:33.142395+0000","last_undegraded":"2024-09-19T14:14:33.142395+0000","last_fullsized":"2024-09-19T14:14:33.142395+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.142301+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:53:23.111973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.090762+0000","last_change":"2024-09-19T14:14:25.090762+0000","last_active":"2024-09-19T14:14:25.090762+0000","last_peered":"2024-09-19T14:14:25.090762+0000","last_clean":"2024-09-19T14:14:25.090762+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:14:25.090762+0000","last_undegraded":"2024-09-19T14:14:25.090762+0000","last_fullsized":"2024-09-19T14:14:25.090762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.090660+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:42.554407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":518,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.846077+0000","last_change":"2024-09-19T14:14:24.846077+0000","last_active":"2024-09-19T14:14:24.846077+0000","last_peered":"2024-09-19T14:14:24.846077+0000","last_clean":"2024-09-19T14:14:24.846077+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:14:24.846077+0000","last_undegraded":"2024-09-19T14:14:24.846077+0000","last_fullsized":"2024-09-19T14:14:24.846077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.845991+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:12.158112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'234","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.365639+0000","last_change":"2024-09-19T14:14:23.365639+0000","last_active":"2024-09-19T14:14:23.365639+0000","last_peered":"2024-09-19T14:14:23.365639+0000","last_clean":"2024-09-19T14:14:23.365639+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:14:23.365639+0000","last_undegraded":"2024-09-19T14:14:23.365639+0000","last_fullsized":"2024-09-19T14:14:23.365639+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'234","last_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_deep_scrub":"260'234","last_deep_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.365567+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:40:16.918810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":4147,"num_write":1074,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.276710+0000","last_change":"2024-09-19T14:14:42.276710+0000","last_active":"2024-09-19T14:14:42.276710+0000","last_peered":"2024-09-19T14:14:42.276710+0000","last_clean":"2024-09-19T14:14:42.276710+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:14:42.276710+0000","last_undegraded":"2024-09-19T14:14:42.276710+0000","last_fullsized":"2024-09-19T14:14:42.276710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.276595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.276595+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.276595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:58:08.758004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'341","reported_seq":1035,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.731106+0000","last_change":"2024-09-19T14:14:49.731106+0000","last_active":"2024-09-19T14:14:49.731106+0000","last_peered":"2024-09-19T14:14:49.731106+0000","last_clean":"2024-09-19T14:14:49.731106+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:14:49.731106+0000","last_undegraded":"2024-09-19T14:14:49.731106+0000","last_fullsized":"2024-09-19T14:14:49.731106+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-19T14:14:49.730990+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-19T14:14:49.730990+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.730990+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:57.630554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":939,"num_write":532,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107642,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.185647+0000","last_change":"2024-09-19T14:14:50.185647+0000","last_active":"2024-09-19T14:14:50.185647+0000","last_peered":"2024-09-19T14:14:50.185647+0000","last_clean":"2024-09-19T14:14:50.185647+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:14:50.185647+0000","last_undegraded":"2024-09-19T14:14:50.185647+0000","last_fullsized":"2024-09-19T14:14:50.185647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:50.185520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:50.185520+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.185520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:59.119852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'191","reported_seq":889,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.336239+0000","last_change":"2024-09-19T14:14:48.336239+0000","last_active":"2024-09-19T14:14:48.336239+0000","last_peered":"2024-09-19T14:14:48.336239+0000","last_clean":"2024-09-19T14:14:48.336239+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:14:48.336239+0000","last_undegraded":"2024-09-19T14:14:48.336239+0000","last_fullsized":"2024-09-19T14:14:48.336239+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-09-19T14:14:48.336158+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-09-19T14:14:48.336158+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.336158+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:21.500227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'976","reported_seq":2587,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.255104+0000","last_change":"2024-09-19T14:14:34.255104+0000","last_active":"2024-09-19T14:14:34.255104+0000","last_peered":"2024-09-19T14:14:34.255104+0000","last_clean":"2024-09-19T14:14:34.255104+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:14:34.255104+0000","last_undegraded":"2024-09-19T14:14:34.255104+0000","last_fullsized":"2024-09-19T14:14:34.255104+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'976","last_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_deep_scrub":"260'976","last_deep_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.255007+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:17.054045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.122612+0000","last_change":"2024-09-19T14:14:27.122612+0000","last_active":"2024-09-19T14:14:27.122612+0000","last_peered":"2024-09-19T14:14:27.122612+0000","last_clean":"2024-09-19T14:14:27.122612+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:14:27.122612+0000","last_undegraded":"2024-09-19T14:14:27.122612+0000","last_fullsized":"2024-09-19T14:14:27.122612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.122523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:34.702946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'215","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.355899+0000","last_change":"2024-09-19T14:14:23.355899+0000","last_active":"2024-09-19T14:14:23.355899+0000","last_peered":"2024-09-19T14:14:23.355899+0000","last_clean":"2024-09-19T14:14:23.355899+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:14:23.355899+0000","last_undegraded":"2024-09-19T14:14:23.355899+0000","last_fullsized":"2024-09-19T14:14:23.355899+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.355816+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:31.085121+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":42960,"num_write":983,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.727854+0000","last_change":"2024-09-19T14:14:44.727854+0000","last_active":"2024-09-19T14:14:44.727854+0000","last_peered":"2024-09-19T14:14:44.727854+0000","last_clean":"2024-09-19T14:14:44.727854+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:14:44.727854+0000","last_undegraded":"2024-09-19T14:14:44.727854+0000","last_fullsized":"2024-09-19T14:14:44.727854+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.727726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.727726+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.727726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:09.947880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'830","reported_seq":2218,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.397591+0000","last_change":"2024-09-19T14:14:43.397591+0000","last_active":"2024-09-19T14:14:43.397591+0000","last_peered":"2024-09-19T14:14:43.397591+0000","last_clean":"2024-09-19T14:14:43.397591+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:14:43.397591+0000","last_undegraded":"2024-09-19T14:14:43.397591+0000","last_fullsized":"2024-09-19T14:14:43.397591+0000","mapping_epoch":28,"log_start":"260'800","ondisk_log_start":"260'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'830","last_scrub_stamp":"2024-09-19T14:14:43.397471+0000","last_deep_scrub":"260'830","last_deep_scrub_stamp":"2024-09-19T14:14:43.397471+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.397471+0000","objects_scrubbed":11,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:58:39.866036+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1143,"num_read_kb":1321,"num_write":246,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.220809+0000","last_change":"2024-09-19T14:14:52.220809+0000","last_active":"2024-09-19T14:14:52.220809+0000","last_peered":"2024-09-19T14:14:52.220809+0000","last_clean":"2024-09-19T14:14:52.220809+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:14:52.220809+0000","last_undegraded":"2024-09-19T14:14:52.220809+0000","last_fullsized":"2024-09-19T14:14:52.220809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:52.220717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:52.220717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.220717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:57.489976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'129","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.427846+0000","last_change":"2024-09-19T14:14:52.427846+0000","last_active":"2024-09-19T14:14:52.427846+0000","last_peered":"2024-09-19T14:14:52.427846+0000","last_clean":"2024-09-19T14:14:52.427846+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:14:52.427846+0000","last_undegraded":"2024-09-19T14:14:52.427846+0000","last_fullsized":"2024-09-19T14:14:52.427846+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:52.427757+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:52.427757+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.427757+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:50.156910+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'772","reported_seq":2375,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.370868+0000","last_change":"2024-09-19T14:14:32.370868+0000","last_active":"2024-09-19T14:14:32.370868+0000","last_peered":"2024-09-19T14:14:32.370868+0000","last_clean":"2024-09-19T14:14:32.370868+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:14:32.370868+0000","last_undegraded":"2024-09-19T14:14:32.370868+0000","last_fullsized":"2024-09-19T14:14:32.370868+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'772","last_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_deep_scrub":"260'772","last_deep_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.370749+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.543791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.186455+0000","last_change":"2024-09-19T14:14:24.186455+0000","last_active":"2024-09-19T14:14:24.186455+0000","last_peered":"2024-09-19T14:14:24.186455+0000","last_clean":"2024-09-19T14:14:24.186455+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:14:24.186455+0000","last_undegraded":"2024-09-19T14:14:24.186455+0000","last_fullsized":"2024-09-19T14:14:24.186455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.186357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:33.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'184","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.246955+0000","last_change":"2024-09-19T14:14:24.246955+0000","last_active":"2024-09-19T14:14:24.246955+0000","last_peered":"2024-09-19T14:14:24.246955+0000","last_clean":"2024-09-19T14:14:24.246955+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:14:24.246955+0000","last_undegraded":"2024-09-19T14:14:24.246955+0000","last_fullsized":"2024-09-19T14:14:24.246955+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.246846+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:34.062372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":6136,"num_write":878,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.120713+0000","last_change":"2024-09-19T14:14:33.120713+0000","last_active":"2024-09-19T14:14:33.120713+0000","last_peered":"2024-09-19T14:14:33.120713+0000","last_clean":"2024-09-19T14:14:33.120713+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:14:33.120713+0000","last_undegraded":"2024-09-19T14:14:33.120713+0000","last_fullsized":"2024-09-19T14:14:33.120713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.120629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.158421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'210","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.171630+0000","last_change":"2024-09-19T14:14:48.171630+0000","last_active":"2024-09-19T14:14:48.171630+0000","last_peered":"2024-09-19T14:14:48.171630+0000","last_clean":"2024-09-19T14:14:48.171630+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:14:48.171630+0000","last_undegraded":"2024-09-19T14:14:48.171630+0000","last_fullsized":"2024-09-19T14:14:48.171630+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:48.171510+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:48.171510+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.171510+0000","objects_scrubbed":9,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:18.235764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.218523+0000","last_change":"2024-09-19T14:14:49.218523+0000","last_active":"2024-09-19T14:14:49.218523+0000","last_peered":"2024-09-19T14:14:49.218523+0000","last_clean":"2024-09-19T14:14:49.218523+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:14:49.218523+0000","last_undegraded":"2024-09-19T14:14:49.218523+0000","last_fullsized":"2024-09-19T14:14:49.218523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:49.218432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:49.218432+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.218432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:13.814133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'244","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.032600+0000","last_change":"2024-09-19T14:15:00.032600+0000","last_active":"2024-09-19T14:15:00.032600+0000","last_peered":"2024-09-19T14:15:00.032600+0000","last_clean":"2024-09-19T14:15:00.032600+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:15:00.032600+0000","last_undegraded":"2024-09-19T14:15:00.032600+0000","last_fullsized":"2024-09-19T14:15:00.032600+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:15:00.032503+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:15:00.032503+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.032503+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:07.050608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'352","reported_seq":1880,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.371001+0000","last_change":"2024-09-19T14:14:30.371001+0000","last_active":"2024-09-19T14:14:30.371001+0000","last_peered":"2024-09-19T14:14:30.371001+0000","last_clean":"2024-09-19T14:14:30.371001+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:14:30.371001+0000","last_undegraded":"2024-09-19T14:14:30.371001+0000","last_fullsized":"2024-09-19T14:14:30.371001+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.370905+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:22.516405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.799062+0000","last_change":"2024-09-19T14:14:23.799062+0000","last_active":"2024-09-19T14:14:23.799062+0000","last_peered":"2024-09-19T14:14:23.799062+0000","last_clean":"2024-09-19T14:14:23.799062+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:14:23.799062+0000","last_undegraded":"2024-09-19T14:14:23.799062+0000","last_fullsized":"2024-09-19T14:14:23.799062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.798956+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:54.613030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'228","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.574659+0000","last_change":"2024-09-19T14:14:23.574659+0000","last_active":"2024-09-19T14:14:23.574659+0000","last_peered":"2024-09-19T14:14:23.574659+0000","last_clean":"2024-09-19T14:14:23.574659+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:14:23.574659+0000","last_undegraded":"2024-09-19T14:14:23.574659+0000","last_fullsized":"2024-09-19T14:14:23.574659+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'228","last_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_deep_scrub":"260'228","last_deep_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.574564+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:46.444524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":5696,"num_write":1072,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.179926+0000","last_change":"2024-09-19T14:14:43.179926+0000","last_active":"2024-09-19T14:14:43.179926+0000","last_peered":"2024-09-19T14:14:43.179926+0000","last_clean":"2024-09-19T14:14:43.179926+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:14:43.179926+0000","last_undegraded":"2024-09-19T14:14:43.179926+0000","last_fullsized":"2024-09-19T14:14:43.179926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.179836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.179836+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.179836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:12.637353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'113","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.244204+0000","last_change":"2024-09-19T14:14:47.244204+0000","last_active":"2024-09-19T14:14:47.244204+0000","last_peered":"2024-09-19T14:14:47.244204+0000","last_clean":"2024-09-19T14:14:47.244204+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:14:47.244204+0000","last_undegraded":"2024-09-19T14:14:47.244204+0000","last_fullsized":"2024-09-19T14:14:47.244204+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'113","last_scrub_stamp":"2024-09-19T14:14:47.244112+0000","last_deep_scrub":"260'113","last_deep_scrub_stamp":"2024-09-19T14:14:47.244112+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.244112+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:45.237429+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.224975+0000","last_change":"2024-09-19T14:14:41.224975+0000","last_active":"2024-09-19T14:14:41.224975+0000","last_peered":"2024-09-19T14:14:41.224975+0000","last_clean":"2024-09-19T14:14:41.224975+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:14:41.224975+0000","last_undegraded":"2024-09-19T14:14:41.224975+0000","last_fullsized":"2024-09-19T14:14:41.224975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.224899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:53.063511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'107","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.579227+0000","last_change":"2024-09-19T14:14:56.579227+0000","last_active":"2024-09-19T14:14:56.579227+0000","last_peered":"2024-09-19T14:14:56.579227+0000","last_clean":"2024-09-19T14:14:56.579227+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:14:56.579227+0000","last_undegraded":"2024-09-19T14:14:56.579227+0000","last_fullsized":"2024-09-19T14:14:56.579227+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'107","last_scrub_stamp":"2024-09-19T14:14:56.579142+0000","last_deep_scrub":"260'107","last_deep_scrub_stamp":"2024-09-19T14:14:56.579142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.579142+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:09.076208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'601","reported_seq":2326,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.333499+0000","last_change":"2024-09-19T14:14:31.333499+0000","last_active":"2024-09-19T14:14:31.333499+0000","last_peered":"2024-09-19T14:14:31.333499+0000","last_clean":"2024-09-19T14:14:31.333499+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:14:31.333499+0000","last_undegraded":"2024-09-19T14:14:31.333499+0000","last_fullsized":"2024-09-19T14:14:31.333499+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'601","last_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_deep_scrub":"260'601","last_deep_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.333408+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:33.805427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'206","reported_seq":853,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.807429+0000","last_change":"2024-09-19T14:14:25.807429+0000","last_active":"2024-09-19T14:14:25.807429+0000","last_peered":"2024-09-19T14:14:25.807429+0000","last_clean":"2024-09-19T14:14:25.807429+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:14:25.807429+0000","last_undegraded":"2024-09-19T14:14:25.807429+0000","last_fullsized":"2024-09-19T14:14:25.807429+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.807326+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:54.324076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":24801,"num_write":998,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.271878+0000","last_change":"2024-09-19T14:14:22.271878+0000","last_active":"2024-09-19T14:14:22.271878+0000","last_peered":"2024-09-19T14:14:22.271878+0000","last_clean":"2024-09-19T14:14:22.271878+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:14:22.271878+0000","last_undegraded":"2024-09-19T14:14:22.271878+0000","last_fullsized":"2024-09-19T14:14:22.271878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.271798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:15.460044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.211839+0000","last_change":"2024-09-19T14:14:41.211839+0000","last_active":"2024-09-19T14:14:41.211839+0000","last_peered":"2024-09-19T14:14:41.211839+0000","last_clean":"2024-09-19T14:14:41.211839+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:14:41.211839+0000","last_undegraded":"2024-09-19T14:14:41.211839+0000","last_fullsized":"2024-09-19T14:14:41.211839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.211717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:50.720540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'272","reported_seq":926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.229777+0000","last_change":"2024-09-19T14:14:44.229777+0000","last_active":"2024-09-19T14:14:44.229777+0000","last_peered":"2024-09-19T14:14:44.229777+0000","last_clean":"2024-09-19T14:14:44.229777+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:14:44.229777+0000","last_undegraded":"2024-09-19T14:14:44.229777+0000","last_fullsized":"2024-09-19T14:14:44.229777+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'272","last_scrub_stamp":"2024-09-19T14:14:44.229683+0000","last_deep_scrub":"260'272","last_deep_scrub_stamp":"2024-09-19T14:14:44.229683+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.229683+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:29.728099+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12301,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":381,"num_read_kb":528,"num_write":240,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.787040+0000","last_change":"2024-09-19T14:14:53.787040+0000","last_active":"2024-09-19T14:14:53.787040+0000","last_peered":"2024-09-19T14:14:53.787040+0000","last_clean":"2024-09-19T14:14:53.787040+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:14:53.787040+0000","last_undegraded":"2024-09-19T14:14:53.787040+0000","last_fullsized":"2024-09-19T14:14:53.787040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.786945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.786945+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.786945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:21.722947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'130","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.233247+0000","last_change":"2024-09-19T14:15:00.233247+0000","last_active":"2024-09-19T14:15:00.233247+0000","last_peered":"2024-09-19T14:15:00.233247+0000","last_clean":"2024-09-19T14:15:00.233247+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:15:00.233247+0000","last_undegraded":"2024-09-19T14:15:00.233247+0000","last_fullsized":"2024-09-19T14:15:00.233247+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-09-19T14:15:00.233162+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-09-19T14:15:00.233162+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.233162+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:07.109767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1173","reported_seq":2702,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.253870+0000","last_change":"2024-09-19T14:14:31.253870+0000","last_active":"2024-09-19T14:14:31.253870+0000","last_peered":"2024-09-19T14:14:31.253870+0000","last_clean":"2024-09-19T14:14:31.253870+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:14:31.253870+0000","last_undegraded":"2024-09-19T14:14:31.253870+0000","last_fullsized":"2024-09-19T14:14:31.253870+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1173","last_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_deep_scrub":"260'1173","last_deep_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.253789+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":1100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:19.605470+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'241","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.269778+0000","last_change":"2024-09-19T14:14:25.269778+0000","last_active":"2024-09-19T14:14:25.269778+0000","last_peered":"2024-09-19T14:14:25.269778+0000","last_clean":"2024-09-19T14:14:25.269778+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:14:25.269778+0000","last_undegraded":"2024-09-19T14:14:25.269778+0000","last_fullsized":"2024-09-19T14:14:25.269778+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.269708+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:59.804876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":611,"num_read_kb":113129,"num_write":1047,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.132997+0000","last_change":"2024-09-19T14:14:30.132997+0000","last_active":"2024-09-19T14:14:30.132997+0000","last_peered":"2024-09-19T14:14:30.132997+0000","last_clean":"2024-09-19T14:14:30.132997+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:14:30.132997+0000","last_undegraded":"2024-09-19T14:14:30.132997+0000","last_fullsized":"2024-09-19T14:14:30.132997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.132909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:09:35.776106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.210314+0000","last_change":"2024-09-19T14:14:38.210314+0000","last_active":"2024-09-19T14:14:38.210314+0000","last_peered":"2024-09-19T14:14:38.210314+0000","last_clean":"2024-09-19T14:14:38.210314+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:14:38.210314+0000","last_undegraded":"2024-09-19T14:14:38.210314+0000","last_fullsized":"2024-09-19T14:14:38.210314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.210233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:40.582675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'153","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.431223+0000","last_change":"2024-09-19T14:14:42.431223+0000","last_active":"2024-09-19T14:14:42.431223+0000","last_peered":"2024-09-19T14:14:42.431223+0000","last_clean":"2024-09-19T14:14:42.431223+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:14:42.431223+0000","last_undegraded":"2024-09-19T14:14:42.431223+0000","last_fullsized":"2024-09-19T14:14:42.431223+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-09-19T14:14:42.431130+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-09-19T14:14:42.431130+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.431130+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:19.187356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'789","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.655888+0000","last_change":"2024-09-19T14:14:53.655888+0000","last_active":"2024-09-19T14:14:53.655888+0000","last_peered":"2024-09-19T14:14:53.655888+0000","last_clean":"2024-09-19T14:14:53.655888+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:14:53.655888+0000","last_undegraded":"2024-09-19T14:14:53.655888+0000","last_fullsized":"2024-09-19T14:14:53.655888+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-19T14:14:53.655783+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-19T14:14:53.655783+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.655783+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:57.878586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'141","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.000825+0000","last_change":"2024-09-19T14:15:01.000825+0000","last_active":"2024-09-19T14:15:01.000825+0000","last_peered":"2024-09-19T14:15:01.000825+0000","last_clean":"2024-09-19T14:15:01.000825+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:15:01.000825+0000","last_undegraded":"2024-09-19T14:15:01.000825+0000","last_fullsized":"2024-09-19T14:15:01.000825+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-09-19T14:15:01.000739+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-09-19T14:15:01.000739+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.000739+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:43.347659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.313938+0000","last_change":"2024-09-19T14:14:34.313938+0000","last_active":"2024-09-19T14:14:34.313938+0000","last_peered":"2024-09-19T14:14:34.313938+0000","last_clean":"2024-09-19T14:14:34.313938+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:14:34.313938+0000","last_undegraded":"2024-09-19T14:14:34.313938+0000","last_fullsized":"2024-09-19T14:14:34.313938+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'349","last_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_deep_scrub":"260'349","last_deep_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.313853+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:03.281146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'210","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.389550+0000","last_change":"2024-09-19T14:14:25.389550+0000","last_active":"2024-09-19T14:14:25.389550+0000","last_peered":"2024-09-19T14:14:25.389550+0000","last_clean":"2024-09-19T14:14:25.389550+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:14:25.389550+0000","last_undegraded":"2024-09-19T14:14:25.389550+0000","last_fullsized":"2024-09-19T14:14:25.389550+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.389494+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:57.196831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":8334,"num_write":1024,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.254812+0000","last_change":"2024-09-19T14:14:23.254724+0000","last_active":"2024-09-19T14:14:23.254812+0000","last_peered":"2024-09-19T14:14:23.254812+0000","last_clean":"2024-09-19T14:14:23.254812+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:14:23.254812+0000","last_undegraded":"2024-09-19T14:14:23.254812+0000","last_fullsized":"2024-09-19T14:14:23.254812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.254647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:57.792058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.814330+0000","last_change":"2024-09-19T14:14:44.814330+0000","last_active":"2024-09-19T14:14:44.814330+0000","last_peered":"2024-09-19T14:14:44.814330+0000","last_clean":"2024-09-19T14:14:44.814330+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:14:44.814330+0000","last_undegraded":"2024-09-19T14:14:44.814330+0000","last_fullsized":"2024-09-19T14:14:44.814330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.814245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.814245+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.814245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:05.603181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":624,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.799856+0000","last_change":"2024-09-19T14:14:47.799856+0000","last_active":"2024-09-19T14:14:47.799856+0000","last_peered":"2024-09-19T14:14:47.799856+0000","last_clean":"2024-09-19T14:14:47.799856+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:14:47.799856+0000","last_undegraded":"2024-09-19T14:14:47.799856+0000","last_fullsized":"2024-09-19T14:14:47.799856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'92","last_scrub_stamp":"2024-09-19T14:14:47.799733+0000","last_deep_scrub":"260'92","last_deep_scrub_stamp":"2024-09-19T14:14:47.799733+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.799733+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:15.665895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'798","reported_seq":2387,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.067387+0000","last_change":"2024-09-19T14:14:55.067387+0000","last_active":"2024-09-19T14:14:55.067387+0000","last_peered":"2024-09-19T14:14:55.067387+0000","last_clean":"2024-09-19T14:14:55.067387+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:14:55.067387+0000","last_undegraded":"2024-09-19T14:14:55.067387+0000","last_fullsized":"2024-09-19T14:14:55.067387+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:55.067292+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:55.067292+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.067292+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:51.523534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'295","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.199741+0000","last_change":"2024-09-19T14:14:57.199741+0000","last_active":"2024-09-19T14:14:57.199741+0000","last_peered":"2024-09-19T14:14:57.199741+0000","last_clean":"2024-09-19T14:14:57.199741+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:14:57.199741+0000","last_undegraded":"2024-09-19T14:14:57.199741+0000","last_fullsized":"2024-09-19T14:14:57.199741+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'295","last_scrub_stamp":"2024-09-19T14:14:57.199654+0000","last_deep_scrub":"260'295","last_deep_scrub_stamp":"2024-09-19T14:14:57.199654+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.199654+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:54:15.911982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'725","reported_seq":2605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.675073+0000","last_change":"2024-09-19T14:14:28.675073+0000","last_active":"2024-09-19T14:14:28.675073+0000","last_peered":"2024-09-19T14:14:28.675073+0000","last_clean":"2024-09-19T14:14:28.675073+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:14:28.675073+0000","last_undegraded":"2024-09-19T14:14:28.675073+0000","last_fullsized":"2024-09-19T14:14:28.675073+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'725","last_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_deep_scrub":"260'725","last_deep_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.674989+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.706637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3080,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'226","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.314956+0000","last_change":"2024-09-19T14:14:22.314956+0000","last_active":"2024-09-19T14:14:22.314956+0000","last_peered":"2024-09-19T14:14:22.314956+0000","last_clean":"2024-09-19T14:14:22.314956+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:14:22.314956+0000","last_undegraded":"2024-09-19T14:14:22.314956+0000","last_fullsized":"2024-09-19T14:14:22.314956+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.314854+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:16.077018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":41557,"num_write":1060,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.131236+0000","last_change":"2024-09-19T14:14:25.131186+0000","last_active":"2024-09-19T14:14:25.131236+0000","last_peered":"2024-09-19T14:14:25.131236+0000","last_clean":"2024-09-19T14:14:25.131236+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:14:25.131236+0000","last_undegraded":"2024-09-19T14:14:25.131236+0000","last_fullsized":"2024-09-19T14:14:25.131236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.131106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:59.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.280601+0000","last_change":"2024-09-19T14:14:43.280601+0000","last_active":"2024-09-19T14:14:43.280601+0000","last_peered":"2024-09-19T14:14:43.280601+0000","last_clean":"2024-09-19T14:14:43.280601+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:14:43.280601+0000","last_undegraded":"2024-09-19T14:14:43.280601+0000","last_fullsized":"2024-09-19T14:14:43.280601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.280506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.280506+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.280506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:33.983298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'309","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.193778+0000","last_change":"2024-09-19T14:14:47.193778+0000","last_active":"2024-09-19T14:14:47.193778+0000","last_peered":"2024-09-19T14:14:47.193778+0000","last_clean":"2024-09-19T14:14:47.193778+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:14:47.193778+0000","last_undegraded":"2024-09-19T14:14:47.193778+0000","last_fullsized":"2024-09-19T14:14:47.193778+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'309","last_scrub_stamp":"2024-09-19T14:14:47.193662+0000","last_deep_scrub":"260'309","last_deep_scrub_stamp":"2024-09-19T14:14:47.193662+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.193662+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:33.116186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16920,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":432,"num_read_kb":558,"num_write":210,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.075533+0000","last_change":"2024-09-19T14:14:54.075533+0000","last_active":"2024-09-19T14:14:54.075533+0000","last_peered":"2024-09-19T14:14:54.075533+0000","last_clean":"2024-09-19T14:14:54.075533+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:14:54.075533+0000","last_undegraded":"2024-09-19T14:14:54.075533+0000","last_fullsized":"2024-09-19T14:14:54.075533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.075442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.075442+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.075442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:42.751459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'163","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.603741+0000","last_change":"2024-09-19T14:14:57.603741+0000","last_active":"2024-09-19T14:14:57.603741+0000","last_peered":"2024-09-19T14:14:57.603741+0000","last_clean":"2024-09-19T14:14:57.603741+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:14:57.603741+0000","last_undegraded":"2024-09-19T14:14:57.603741+0000","last_fullsized":"2024-09-19T14:14:57.603741+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-09-19T14:14:57.603637+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-09-19T14:14:57.603637+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.603637+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:31.917350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'146","reported_seq":717,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.192822+0000","last_change":"2024-09-19T14:15:01.192822+0000","last_active":"2024-09-19T14:15:01.192822+0000","last_peered":"2024-09-19T14:15:01.192822+0000","last_clean":"2024-09-19T14:15:01.192822+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:15:01.192822+0000","last_undegraded":"2024-09-19T14:15:01.192822+0000","last_fullsized":"2024-09-19T14:15:01.192822+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-09-19T14:15:01.192741+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-09-19T14:15:01.192741+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.192741+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:32.255912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'780","reported_seq":2484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.645115+0000","last_change":"2024-09-19T14:14:33.645115+0000","last_active":"2024-09-19T14:14:33.645115+0000","last_peered":"2024-09-19T14:14:33.645115+0000","last_clean":"2024-09-19T14:14:33.645115+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:14:33.645115+0000","last_undegraded":"2024-09-19T14:14:33.645115+0000","last_fullsized":"2024-09-19T14:14:33.645115+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'780","last_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_deep_scrub":"260'780","last_deep_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.645030+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:38.455079+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'201","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.669948+0000","last_change":"2024-09-19T14:14:26.669948+0000","last_active":"2024-09-19T14:14:26.669948+0000","last_peered":"2024-09-19T14:14:26.669948+0000","last_clean":"2024-09-19T14:14:26.669948+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:14:26.669948+0000","last_undegraded":"2024-09-19T14:14:26.669948+0000","last_fullsized":"2024-09-19T14:14:26.669948+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.669848+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.636524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":235834,"num_write":982,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.369204+0000","last_change":"2024-09-19T14:14:39.369204+0000","last_active":"2024-09-19T14:14:39.369204+0000","last_peered":"2024-09-19T14:14:39.369204+0000","last_clean":"2024-09-19T14:14:39.369204+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:14:39.369204+0000","last_undegraded":"2024-09-19T14:14:39.369204+0000","last_fullsized":"2024-09-19T14:14:39.369204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.369113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:47.710446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'145","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.226227+0000","last_change":"2024-09-19T14:14:50.226227+0000","last_active":"2024-09-19T14:14:50.226227+0000","last_peered":"2024-09-19T14:14:50.226227+0000","last_clean":"2024-09-19T14:14:50.226227+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:14:50.226227+0000","last_undegraded":"2024-09-19T14:14:50.226227+0000","last_fullsized":"2024-09-19T14:14:50.226227+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-09-19T14:14:50.226133+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-09-19T14:14:50.226133+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.226133+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:40.245409+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":264,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.018323+0000","last_change":"2024-09-19T14:14:57.018323+0000","last_active":"2024-09-19T14:14:57.018323+0000","last_peered":"2024-09-19T14:14:57.018323+0000","last_clean":"2024-09-19T14:14:57.018323+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:14:57.018323+0000","last_undegraded":"2024-09-19T14:14:57.018323+0000","last_fullsized":"2024-09-19T14:14:57.018323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:57.018222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:57.018222+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.018222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:27.098198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'125","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.754232+0000","last_change":"2024-09-19T13:36:17.361898+0000","last_active":"2024-09-19T14:12:27.754232+0000","last_peered":"2024-09-19T14:12:27.754232+0000","last_clean":"2024-09-19T14:12:27.754232+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:12:27.754232+0000","last_undegraded":"2024-09-19T14:12:27.754232+0000","last_fullsized":"2024-09-19T14:12:27.754232+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'451","reported_seq":2142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.385125+0000","last_change":"2024-09-19T14:14:33.385125+0000","last_active":"2024-09-19T14:14:33.385125+0000","last_peered":"2024-09-19T14:14:33.385125+0000","last_clean":"2024-09-19T14:14:33.385125+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:14:33.385125+0000","last_undegraded":"2024-09-19T14:14:33.385125+0000","last_fullsized":"2024-09-19T14:14:33.385125+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.385044+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:40.641199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'206","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.184238+0000","last_change":"2024-09-19T14:14:29.184238+0000","last_active":"2024-09-19T14:14:29.184238+0000","last_peered":"2024-09-19T14:14:29.184238+0000","last_clean":"2024-09-19T14:14:29.184238+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:14:29.184238+0000","last_undegraded":"2024-09-19T14:14:29.184238+0000","last_fullsized":"2024-09-19T14:14:29.184238+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.184140+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:52.173970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":26124,"num_write":1061,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.262863+0000","last_change":"2024-09-19T14:14:45.262863+0000","last_active":"2024-09-19T14:14:45.262863+0000","last_peered":"2024-09-19T14:14:45.262863+0000","last_clean":"2024-09-19T14:14:45.262863+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:14:45.262863+0000","last_undegraded":"2024-09-19T14:14:45.262863+0000","last_fullsized":"2024-09-19T14:14:45.262863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.262794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.262794+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.262794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:11.511930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'51","reported_seq":549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.167410+0000","last_change":"2024-09-19T14:14:46.167410+0000","last_active":"2024-09-19T14:14:46.167410+0000","last_peered":"2024-09-19T14:14:46.167410+0000","last_clean":"2024-09-19T14:14:46.167410+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:14:46.167410+0000","last_undegraded":"2024-09-19T14:14:46.167410+0000","last_fullsized":"2024-09-19T14:14:46.167410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'51","last_scrub_stamp":"2024-09-19T14:14:46.167332+0000","last_deep_scrub":"260'51","last_deep_scrub_stamp":"2024-09-19T14:14:46.167332+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.167332+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:27.825629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.229878+0000","last_change":"2024-09-19T14:14:53.229878+0000","last_active":"2024-09-19T14:14:53.229878+0000","last_peered":"2024-09-19T14:14:53.229878+0000","last_clean":"2024-09-19T14:14:53.229878+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:14:53.229878+0000","last_undegraded":"2024-09-19T14:14:53.229878+0000","last_fullsized":"2024-09-19T14:14:53.229878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.229785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.229785+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.229785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:19.760091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'217","reported_seq":731,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.200730+0000","last_change":"2024-09-19T14:14:59.200730+0000","last_active":"2024-09-19T14:14:59.200730+0000","last_peered":"2024-09-19T14:14:59.200730+0000","last_clean":"2024-09-19T14:14:59.200730+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:14:59.200730+0000","last_undegraded":"2024-09-19T14:14:59.200730+0000","last_fullsized":"2024-09-19T14:14:59.200730+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'217","last_scrub_stamp":"2024-09-19T14:14:59.200634+0000","last_deep_scrub":"260'217","last_deep_scrub_stamp":"2024-09-19T14:14:59.200634+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.200634+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:57.519787+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'398","reported_seq":1849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.336463+0000","last_change":"2024-09-19T14:14:35.336463+0000","last_active":"2024-09-19T14:14:35.336463+0000","last_peered":"2024-09-19T14:14:35.336463+0000","last_clean":"2024-09-19T14:14:35.336463+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:14:35.336463+0000","last_undegraded":"2024-09-19T14:14:35.336463+0000","last_fullsized":"2024-09-19T14:14:35.336463+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'398","last_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_deep_scrub":"260'398","last_deep_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.336359+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:33.204997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'215","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.823196+0000","last_change":"2024-09-19T14:14:27.823104+0000","last_active":"2024-09-19T14:14:27.823196+0000","last_peered":"2024-09-19T14:14:27.823196+0000","last_clean":"2024-09-19T14:14:27.823196+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:14:27.823196+0000","last_undegraded":"2024-09-19T14:14:27.823196+0000","last_fullsized":"2024-09-19T14:14:27.823196+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.822984+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:08.778750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":16519,"num_write":1037,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.215103+0000","last_change":"2024-09-19T14:14:44.215103+0000","last_active":"2024-09-19T14:14:44.215103+0000","last_peered":"2024-09-19T14:14:44.215103+0000","last_clean":"2024-09-19T14:14:44.215103+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:14:44.215103+0000","last_undegraded":"2024-09-19T14:14:44.215103+0000","last_fullsized":"2024-09-19T14:14:44.215103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.215012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.215012+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.215012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:26.236101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'149","reported_seq":734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.188758+0000","last_change":"2024-09-19T14:14:51.188758+0000","last_active":"2024-09-19T14:14:51.188758+0000","last_peered":"2024-09-19T14:14:51.188758+0000","last_clean":"2024-09-19T14:14:51.188758+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:14:51.188758+0000","last_undegraded":"2024-09-19T14:14:51.188758+0000","last_fullsized":"2024-09-19T14:14:51.188758+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-09-19T14:14:51.188664+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-09-19T14:14:51.188664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.188664+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:49.379920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":198,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.230017+0000","last_change":"2024-09-19T14:14:44.230017+0000","last_active":"2024-09-19T14:14:44.230017+0000","last_peered":"2024-09-19T14:14:44.230017+0000","last_clean":"2024-09-19T14:14:44.230017+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:14:44.230017+0000","last_undegraded":"2024-09-19T14:14:44.230017+0000","last_fullsized":"2024-09-19T14:14:44.230017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.229930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.229930+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.229930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:59.977901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'182","reported_seq":747,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.639043+0000","last_change":"2024-09-19T14:15:00.639043+0000","last_active":"2024-09-19T14:15:00.639043+0000","last_peered":"2024-09-19T14:15:00.639043+0000","last_clean":"2024-09-19T14:15:00.639043+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:15:00.639043+0000","last_undegraded":"2024-09-19T14:15:00.639043+0000","last_fullsized":"2024-09-19T14:15:00.639043+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'182","last_scrub_stamp":"2024-09-19T14:15:00.638945+0000","last_deep_scrub":"260'182","last_deep_scrub_stamp":"2024-09-19T14:15:00.638945+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.638945+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.573733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'410","reported_seq":1901,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.343318+0000","last_change":"2024-09-19T14:14:33.343318+0000","last_active":"2024-09-19T14:14:33.343318+0000","last_peered":"2024-09-19T14:14:33.343318+0000","last_clean":"2024-09-19T14:14:33.343318+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:14:33.343318+0000","last_undegraded":"2024-09-19T14:14:33.343318+0000","last_fullsized":"2024-09-19T14:14:33.343318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'410","last_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_deep_scrub":"260'410","last_deep_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.343234+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:26.919333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3249,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'225","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.302152+0000","last_change":"2024-09-19T14:14:25.302102+0000","last_active":"2024-09-19T14:14:25.302152+0000","last_peered":"2024-09-19T14:14:25.302152+0000","last_clean":"2024-09-19T14:14:25.302152+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:14:25.302152+0000","last_undegraded":"2024-09-19T14:14:25.302152+0000","last_fullsized":"2024-09-19T14:14:25.302152+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.302035+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:39.521325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":697,"num_read_kb":42518,"num_write":1086,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.200192+0000","last_change":"2024-09-19T14:14:40.200192+0000","last_active":"2024-09-19T14:14:40.200192+0000","last_peered":"2024-09-19T14:14:40.200192+0000","last_clean":"2024-09-19T14:14:40.200192+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:14:40.200192+0000","last_undegraded":"2024-09-19T14:14:40.200192+0000","last_fullsized":"2024-09-19T14:14:40.200192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.200107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:09.154313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'133","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.217377+0000","last_change":"2024-09-19T14:14:49.217377+0000","last_active":"2024-09-19T14:14:49.217377+0000","last_peered":"2024-09-19T14:14:49.217377+0000","last_clean":"2024-09-19T14:14:49.217377+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:14:49.217377+0000","last_undegraded":"2024-09-19T14:14:49.217377+0000","last_fullsized":"2024-09-19T14:14:49.217377+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-09-19T14:14:49.217265+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-09-19T14:14:49.217265+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.217265+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:25.483828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.186875+0000","last_change":"2024-09-19T14:14:53.186875+0000","last_active":"2024-09-19T14:14:53.186875+0000","last_peered":"2024-09-19T14:14:53.186875+0000","last_clean":"2024-09-19T14:14:53.186875+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:14:53.186875+0000","last_undegraded":"2024-09-19T14:14:53.186875+0000","last_fullsized":"2024-09-19T14:14:53.186875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.186792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.186792+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.186792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:13.861721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'843","reported_seq":2334,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.153572+0000","last_change":"2024-09-19T14:14:35.153572+0000","last_active":"2024-09-19T14:14:35.153572+0000","last_peered":"2024-09-19T14:14:35.153572+0000","last_clean":"2024-09-19T14:14:35.153572+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:14:35.153572+0000","last_undegraded":"2024-09-19T14:14:35.153572+0000","last_fullsized":"2024-09-19T14:14:35.153572+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'843","last_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_deep_scrub":"260'843","last_deep_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.153464+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:33.436497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'213","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.383864+0000","last_change":"2024-09-19T14:14:26.383816+0000","last_active":"2024-09-19T14:14:26.383864+0000","last_peered":"2024-09-19T14:14:26.383864+0000","last_clean":"2024-09-19T14:14:26.383864+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:14:26.383864+0000","last_undegraded":"2024-09-19T14:14:26.383864+0000","last_fullsized":"2024-09-19T14:14:26.383864+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.383747+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:29.585612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":34256,"num_write":1036,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.228558+0000","last_change":"2024-09-19T14:14:42.228558+0000","last_active":"2024-09-19T14:14:42.228558+0000","last_peered":"2024-09-19T14:14:42.228558+0000","last_clean":"2024-09-19T14:14:42.228558+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:14:42.228558+0000","last_undegraded":"2024-09-19T14:14:42.228558+0000","last_fullsized":"2024-09-19T14:14:42.228558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.228473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.228473+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.228473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:59:51.937204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'190","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.429807+0000","last_change":"2024-09-19T14:14:44.429807+0000","last_active":"2024-09-19T14:14:44.429807+0000","last_peered":"2024-09-19T14:14:44.429807+0000","last_clean":"2024-09-19T14:14:44.429807+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:14:44.429807+0000","last_undegraded":"2024-09-19T14:14:44.429807+0000","last_fullsized":"2024-09-19T14:14:44.429807+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'190","last_scrub_stamp":"2024-09-19T14:14:44.429692+0000","last_deep_scrub":"260'190","last_deep_scrub_stamp":"2024-09-19T14:14:44.429692+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.429692+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:03.688402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":293,"num_read_kb":440,"num_write":180,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.609408+0000","last_change":"2024-09-19T14:14:54.609408+0000","last_active":"2024-09-19T14:14:54.609408+0000","last_peered":"2024-09-19T14:14:54.609408+0000","last_clean":"2024-09-19T14:14:54.609408+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:14:54.609408+0000","last_undegraded":"2024-09-19T14:14:54.609408+0000","last_fullsized":"2024-09-19T14:14:54.609408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.609322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.609322+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.609322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:03.584374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'194","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:27.814286+0000","last_change":"2024-09-19T13:36:17.363573+0000","last_active":"2024-09-19T14:12:27.814286+0000","last_peered":"2024-09-19T14:12:27.814286+0000","last_clean":"2024-09-19T14:12:27.814286+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:12:27.814286+0000","last_undegraded":"2024-09-19T14:12:27.814286+0000","last_fullsized":"2024-09-19T14:12:27.814286+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:00:53.961300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.197145+0000","last_change":"2024-09-19T14:14:37.197145+0000","last_active":"2024-09-19T14:14:37.197145+0000","last_peered":"2024-09-19T14:14:37.197145+0000","last_clean":"2024-09-19T14:14:37.197145+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:14:37.197145+0000","last_undegraded":"2024-09-19T14:14:37.197145+0000","last_fullsized":"2024-09-19T14:14:37.197145+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.197060+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:42.296752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'195","reported_seq":940,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.278558+0000","last_change":"2024-09-19T14:14:26.278507+0000","last_active":"2024-09-19T14:14:26.278558+0000","last_peered":"2024-09-19T14:14:26.278558+0000","last_clean":"2024-09-19T14:14:26.278558+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:14:26.278558+0000","last_undegraded":"2024-09-19T14:14:26.278558+0000","last_fullsized":"2024-09-19T14:14:26.278558+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.278417+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:45.039194+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":906,"num_read_kb":49787,"num_write":936,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.244914+0000","last_change":"2024-09-19T14:14:42.244914+0000","last_active":"2024-09-19T14:14:42.244914+0000","last_peered":"2024-09-19T14:14:42.244914+0000","last_clean":"2024-09-19T14:14:42.244914+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:14:42.244914+0000","last_undegraded":"2024-09-19T14:14:42.244914+0000","last_fullsized":"2024-09-19T14:14:42.244914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.244809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.244809+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.244809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:20.570407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'139","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.206362+0000","last_change":"2024-09-19T14:14:51.206362+0000","last_active":"2024-09-19T14:14:51.206362+0000","last_peered":"2024-09-19T14:14:51.206362+0000","last_clean":"2024-09-19T14:14:51.206362+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:14:51.206362+0000","last_undegraded":"2024-09-19T14:14:51.206362+0000","last_fullsized":"2024-09-19T14:14:51.206362+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-19T14:14:51.206266+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-19T14:14:51.206266+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.206266+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:30.621888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.449794+0000","last_change":"2024-09-19T14:14:46.449794+0000","last_active":"2024-09-19T14:14:46.449794+0000","last_peered":"2024-09-19T14:14:46.449794+0000","last_clean":"2024-09-19T14:14:46.449794+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:14:46.449794+0000","last_undegraded":"2024-09-19T14:14:46.449794+0000","last_fullsized":"2024-09-19T14:14:46.449794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.449716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.449716+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.449716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'159","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.346944+0000","last_change":"2024-09-19T14:14:49.346944+0000","last_active":"2024-09-19T14:14:49.346944+0000","last_peered":"2024-09-19T14:14:49.346944+0000","last_clean":"2024-09-19T14:14:49.346944+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:14:49.346944+0000","last_undegraded":"2024-09-19T14:14:49.346944+0000","last_fullsized":"2024-09-19T14:14:49.346944+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'159","last_scrub_stamp":"2024-09-19T14:14:49.346845+0000","last_deep_scrub":"260'159","last_deep_scrub_stamp":"2024-09-19T14:14:49.346845+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.346845+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:54.114382+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'365","reported_seq":1770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.344661+0000","last_change":"2024-09-19T14:14:38.344661+0000","last_active":"2024-09-19T14:14:38.344661+0000","last_peered":"2024-09-19T14:14:38.344661+0000","last_clean":"2024-09-19T14:14:38.344661+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:14:38.344661+0000","last_undegraded":"2024-09-19T14:14:38.344661+0000","last_fullsized":"2024-09-19T14:14:38.344661+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'365","last_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_deep_scrub":"260'365","last_deep_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.344573+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:24.841460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'205","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.620062+0000","last_change":"2024-09-19T14:14:25.620062+0000","last_active":"2024-09-19T14:14:25.620062+0000","last_peered":"2024-09-19T14:14:25.620062+0000","last_clean":"2024-09-19T14:14:25.620062+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:14:25.620062+0000","last_undegraded":"2024-09-19T14:14:25.620062+0000","last_fullsized":"2024-09-19T14:14:25.620062+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.619965+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:40.388409+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":98647,"num_write":933,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.822035+0000","last_change":"2024-09-19T14:14:51.822035+0000","last_active":"2024-09-19T14:14:51.822035+0000","last_peered":"2024-09-19T14:14:51.822035+0000","last_clean":"2024-09-19T14:14:51.822035+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:14:51.822035+0000","last_undegraded":"2024-09-19T14:14:51.822035+0000","last_fullsized":"2024-09-19T14:14:51.822035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:51.821944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:51.821944+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.821944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:29.667562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'128","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.118261+0000","last_change":"2024-09-19T14:14:53.118261+0000","last_active":"2024-09-19T14:14:53.118261+0000","last_peered":"2024-09-19T14:14:53.118261+0000","last_clean":"2024-09-19T14:14:53.118261+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:14:53.118261+0000","last_undegraded":"2024-09-19T14:14:53.118261+0000","last_fullsized":"2024-09-19T14:14:53.118261+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'128","last_scrub_stamp":"2024-09-19T14:14:53.118178+0000","last_deep_scrub":"260'128","last_deep_scrub_stamp":"2024-09-19T14:14:53.118178+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.118178+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:45.968519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7162,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":222,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.407146+0000","last_change":"2024-09-19T14:14:47.407146+0000","last_active":"2024-09-19T14:14:47.407146+0000","last_peered":"2024-09-19T14:14:47.407146+0000","last_clean":"2024-09-19T14:14:47.407146+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:14:47.407146+0000","last_undegraded":"2024-09-19T14:14:47.407146+0000","last_fullsized":"2024-09-19T14:14:47.407146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.407057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.407057+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.407057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:58.345273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'115","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.610611+0000","last_change":"2024-09-19T14:14:58.610611+0000","last_active":"2024-09-19T14:14:58.610611+0000","last_peered":"2024-09-19T14:14:58.610611+0000","last_clean":"2024-09-19T14:14:58.610611+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:14:58.610611+0000","last_undegraded":"2024-09-19T14:14:58.610611+0000","last_fullsized":"2024-09-19T14:14:58.610611+0000","mapping_epoch":32,"log_start":"260'101","ondisk_log_start":"260'101","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'115","last_scrub_stamp":"2024-09-19T14:14:58.610517+0000","last_deep_scrub":"260'115","last_deep_scrub_stamp":"2024-09-19T14:14:58.610517+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.610517+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:48.477399+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'868","reported_seq":2584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.153740+0000","last_change":"2024-09-19T14:14:26.153740+0000","last_active":"2024-09-19T14:14:26.153740+0000","last_peered":"2024-09-19T14:14:26.153740+0000","last_clean":"2024-09-19T14:14:26.153740+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:14:26.153740+0000","last_undegraded":"2024-09-19T14:14:26.153740+0000","last_fullsized":"2024-09-19T14:14:26.153740+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'868","last_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_deep_scrub":"260'868","last_deep_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.153669+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:07.343986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2999,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'241","reported_seq":860,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.275883+0000","last_change":"2024-09-19T14:14:26.275883+0000","last_active":"2024-09-19T14:14:26.275883+0000","last_peered":"2024-09-19T14:14:26.275883+0000","last_clean":"2024-09-19T14:14:26.275883+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:14:26.275883+0000","last_undegraded":"2024-09-19T14:14:26.275883+0000","last_fullsized":"2024-09-19T14:14:26.275883+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.275769+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:42.512214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":17644,"num_write":972,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.450775+0000","last_change":"2024-09-19T14:14:41.450775+0000","last_active":"2024-09-19T14:14:41.450775+0000","last_peered":"2024-09-19T14:14:41.450775+0000","last_clean":"2024-09-19T14:14:41.450775+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:14:41.450775+0000","last_undegraded":"2024-09-19T14:14:41.450775+0000","last_fullsized":"2024-09-19T14:14:41.450775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.450684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:36.944231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.824859+0000","last_change":"2024-09-19T14:14:52.824859+0000","last_active":"2024-09-19T14:14:52.824859+0000","last_peered":"2024-09-19T14:14:52.824859+0000","last_clean":"2024-09-19T14:14:52.824859+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:14:52.824859+0000","last_undegraded":"2024-09-19T14:14:52.824859+0000","last_fullsized":"2024-09-19T14:14:52.824859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'79","last_scrub_stamp":"2024-09-19T14:14:52.824746+0000","last_deep_scrub":"260'79","last_deep_scrub_stamp":"2024-09-19T14:14:52.824746+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.824746+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:43.682521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'779","reported_seq":4117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.275263+0000","last_change":"2024-09-19T14:14:46.275263+0000","last_active":"2024-09-19T14:14:46.275263+0000","last_peered":"2024-09-19T14:14:46.275263+0000","last_clean":"2024-09-19T14:14:46.275263+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:14:46.275263+0000","last_undegraded":"2024-09-19T14:14:46.275263+0000","last_fullsized":"2024-09-19T14:14:46.275263+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'779","last_scrub_stamp":"2024-09-19T14:14:46.275174+0000","last_deep_scrub":"260'779","last_deep_scrub_stamp":"2024-09-19T14:14:46.275174+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.275174+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:16.885230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'117","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.283773+0000","last_change":"2024-09-19T14:14:56.283773+0000","last_active":"2024-09-19T14:14:56.283773+0000","last_peered":"2024-09-19T14:14:56.283773+0000","last_clean":"2024-09-19T14:14:56.283773+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:14:56.283773+0000","last_undegraded":"2024-09-19T14:14:56.283773+0000","last_fullsized":"2024-09-19T14:14:56.283773+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-09-19T14:14:56.283687+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-09-19T14:14:56.283687+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.283687+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:49.798497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'838","reported_seq":2313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.704717+0000","last_change":"2024-09-19T14:14:36.704717+0000","last_active":"2024-09-19T14:14:36.704717+0000","last_peered":"2024-09-19T14:14:36.704717+0000","last_clean":"2024-09-19T14:14:36.704717+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:14:36.704717+0000","last_undegraded":"2024-09-19T14:14:36.704717+0000","last_fullsized":"2024-09-19T14:14:36.704717+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.704635+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:10.522393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'179","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.802969+0000","last_change":"2024-09-19T14:14:28.802969+0000","last_active":"2024-09-19T14:14:28.802969+0000","last_peered":"2024-09-19T14:14:28.802969+0000","last_clean":"2024-09-19T14:14:28.802969+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:14:28.802969+0000","last_undegraded":"2024-09-19T14:14:28.802969+0000","last_fullsized":"2024-09-19T14:14:28.802969+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'179","last_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_deep_scrub":"260'179","last_deep_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.802887+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:55.372480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":5488,"num_write":868,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.182462+0000","last_change":"2024-09-19T14:14:45.182462+0000","last_active":"2024-09-19T14:14:45.182462+0000","last_peered":"2024-09-19T14:14:45.182462+0000","last_clean":"2024-09-19T14:14:45.182462+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:14:45.182462+0000","last_undegraded":"2024-09-19T14:14:45.182462+0000","last_fullsized":"2024-09-19T14:14:45.182462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.182364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.182364+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.182364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:28.117734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'154","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.693486+0000","last_change":"2024-09-19T14:14:52.693429+0000","last_active":"2024-09-19T14:14:52.693486+0000","last_peered":"2024-09-19T14:14:52.693486+0000","last_clean":"2024-09-19T14:14:52.693486+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:14:52.693486+0000","last_undegraded":"2024-09-19T14:14:52.693486+0000","last_fullsized":"2024-09-19T14:14:52.693486+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'154","last_scrub_stamp":"2024-09-19T14:14:52.693341+0000","last_deep_scrub":"260'154","last_deep_scrub_stamp":"2024-09-19T14:14:52.693341+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.693341+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:38.128913+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7396,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":254,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.208002+0000","last_change":"2024-09-19T14:14:54.207936+0000","last_active":"2024-09-19T14:14:54.208002+0000","last_peered":"2024-09-19T14:14:54.208002+0000","last_clean":"2024-09-19T14:14:54.208002+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:14:54.208002+0000","last_undegraded":"2024-09-19T14:14:54.208002+0000","last_fullsized":"2024-09-19T14:14:54.208002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.207851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.207851+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.207851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:34.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'116","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.332277+0000","last_change":"2024-09-19T14:15:00.332277+0000","last_active":"2024-09-19T14:15:00.332277+0000","last_peered":"2024-09-19T14:15:00.332277+0000","last_clean":"2024-09-19T14:15:00.332277+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:15:00.332277+0000","last_undegraded":"2024-09-19T14:15:00.332277+0000","last_fullsized":"2024-09-19T14:15:00.332277+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-09-19T14:15:00.332193+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-09-19T14:15:00.332193+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.332193+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:08.555607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.694724+0000","last_change":"2024-09-19T14:14:35.694724+0000","last_active":"2024-09-19T14:14:35.694724+0000","last_peered":"2024-09-19T14:14:35.694724+0000","last_clean":"2024-09-19T14:14:35.694724+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:14:35.694724+0000","last_undegraded":"2024-09-19T14:14:35.694724+0000","last_fullsized":"2024-09-19T14:14:35.694724+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'888","last_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_deep_scrub":"260'888","last_deep_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.694623+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:14.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'245","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.794846+0000","last_change":"2024-09-19T14:14:30.794846+0000","last_active":"2024-09-19T14:14:30.794846+0000","last_peered":"2024-09-19T14:14:30.794846+0000","last_clean":"2024-09-19T14:14:30.794846+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:14:30.794846+0000","last_undegraded":"2024-09-19T14:14:30.794846+0000","last_fullsized":"2024-09-19T14:14:30.794846+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'245","last_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_deep_scrub":"260'245","last_deep_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.794729+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:31.629348+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":59575,"num_write":1084,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.692404+0000","last_change":"2024-09-19T14:14:48.692404+0000","last_active":"2024-09-19T14:14:48.692404+0000","last_peered":"2024-09-19T14:14:48.692404+0000","last_clean":"2024-09-19T14:14:48.692404+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:14:48.692404+0000","last_undegraded":"2024-09-19T14:14:48.692404+0000","last_fullsized":"2024-09-19T14:14:48.692404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:48.692312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:48.692312+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.692312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:23.065865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'136","reported_seq":698,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.226171+0000","last_change":"2024-09-19T14:14:48.226112+0000","last_active":"2024-09-19T14:14:48.226171+0000","last_peered":"2024-09-19T14:14:48.226171+0000","last_clean":"2024-09-19T14:14:48.226171+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:14:48.226171+0000","last_undegraded":"2024-09-19T14:14:48.226171+0000","last_fullsized":"2024-09-19T14:14:48.226171+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'136","last_scrub_stamp":"2024-09-19T14:14:48.226013+0000","last_deep_scrub":"260'136","last_deep_scrub_stamp":"2024-09-19T14:14:48.226013+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.226013+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:06.268321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.245865+0000","last_change":"2024-09-19T14:14:45.245797+0000","last_active":"2024-09-19T14:14:45.245865+0000","last_peered":"2024-09-19T14:14:45.245865+0000","last_clean":"2024-09-19T14:14:45.245865+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:14:45.245865+0000","last_undegraded":"2024-09-19T14:14:45.245865+0000","last_fullsized":"2024-09-19T14:14:45.245865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.245715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.245715+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.245715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:20.002903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'82","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:31.740279+0000","last_change":"2024-09-19T13:36:17.361965+0000","last_active":"2024-09-19T14:12:31.740279+0000","last_peered":"2024-09-19T14:12:31.740279+0000","last_clean":"2024-09-19T14:12:31.740279+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:12:31.740279+0000","last_undegraded":"2024-09-19T14:12:31.740279+0000","last_fullsized":"2024-09-19T14:12:31.740279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:36:16.335647+0000","last_clean_scrub_stamp":"2024-09-19T13:36:16.335647+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'389","reported_seq":1831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.339492+0000","last_change":"2024-09-19T14:14:39.339428+0000","last_active":"2024-09-19T14:14:39.339492+0000","last_peered":"2024-09-19T14:14:39.339492+0000","last_clean":"2024-09-19T14:14:39.339492+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:14:39.339492+0000","last_undegraded":"2024-09-19T14:14:39.339492+0000","last_fullsized":"2024-09-19T14:14:39.339492+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.339324+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:46.745230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'201","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.141292+0000","last_change":"2024-09-19T14:14:23.141243+0000","last_active":"2024-09-19T14:14:23.141292+0000","last_peered":"2024-09-19T14:14:23.141292+0000","last_clean":"2024-09-19T14:14:23.141292+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:14:23.141292+0000","last_undegraded":"2024-09-19T14:14:23.141292+0000","last_fullsized":"2024-09-19T14:14:23.141292+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.141172+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:48:13.237318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":516,"num_read_kb":9219,"num_write":929,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.789205+0000","last_change":"2024-09-19T14:14:46.789120+0000","last_active":"2024-09-19T14:14:46.789205+0000","last_peered":"2024-09-19T14:14:46.789205+0000","last_clean":"2024-09-19T14:14:46.789205+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:14:46.789205+0000","last_undegraded":"2024-09-19T14:14:46.789205+0000","last_fullsized":"2024-09-19T14:14:46.789205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.789009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.789009+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.789009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:00.687915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'118","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.154803+0000","last_change":"2024-09-19T14:14:52.154803+0000","last_active":"2024-09-19T14:14:52.154803+0000","last_peered":"2024-09-19T14:14:52.154803+0000","last_clean":"2024-09-19T14:14:52.154803+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:14:52.154803+0000","last_undegraded":"2024-09-19T14:14:52.154803+0000","last_fullsized":"2024-09-19T14:14:52.154803+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-09-19T14:14:52.154713+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-09-19T14:14:52.154713+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.154713+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:53.703773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7954,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":214,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.779162+0000","last_change":"2024-09-19T14:14:55.779162+0000","last_active":"2024-09-19T14:14:55.779162+0000","last_peered":"2024-09-19T14:14:55.779162+0000","last_clean":"2024-09-19T14:14:55.779162+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:14:55.779162+0000","last_undegraded":"2024-09-19T14:14:55.779162+0000","last_fullsized":"2024-09-19T14:14:55.779162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.779074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.779074+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.779074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:00.069996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'168","reported_seq":1629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.329648+0000","last_change":"2024-09-19T14:14:57.329648+0000","last_active":"2024-09-19T14:14:57.329648+0000","last_peered":"2024-09-19T14:14:57.329648+0000","last_clean":"2024-09-19T14:14:57.329648+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:14:57.329648+0000","last_undegraded":"2024-09-19T14:14:57.329648+0000","last_fullsized":"2024-09-19T14:14:57.329648+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-09-19T14:14:57.329529+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-09-19T14:14:57.329529+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.329529+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:18.582411+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1273","reported_seq":2995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.694661+0000","last_change":"2024-09-19T14:14:34.694601+0000","last_active":"2024-09-19T14:14:34.694661+0000","last_peered":"2024-09-19T14:14:34.694661+0000","last_clean":"2024-09-19T14:14:34.694661+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:14:34.694661+0000","last_undegraded":"2024-09-19T14:14:34.694661+0000","last_fullsized":"2024-09-19T14:14:34.694661+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1273","last_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_deep_scrub":"260'1273","last_deep_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.694504+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:28.668229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'210","reported_seq":895,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.226451+0000","last_change":"2024-09-19T14:14:27.226451+0000","last_active":"2024-09-19T14:14:27.226451+0000","last_peered":"2024-09-19T14:14:27.226451+0000","last_clean":"2024-09-19T14:14:27.226451+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:14:27.226451+0000","last_undegraded":"2024-09-19T14:14:27.226451+0000","last_fullsized":"2024-09-19T14:14:27.226451+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.226323+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:19.006735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":101743,"num_write":1010,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.411709+0000","last_change":"2024-09-19T14:14:40.411618+0000","last_active":"2024-09-19T14:14:40.411709+0000","last_peered":"2024-09-19T14:14:40.411709+0000","last_clean":"2024-09-19T14:14:40.411709+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:14:40.411709+0000","last_undegraded":"2024-09-19T14:14:40.411709+0000","last_fullsized":"2024-09-19T14:14:40.411709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.411523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:59.159110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'164","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.788064+0000","last_change":"2024-09-19T14:14:48.788064+0000","last_active":"2024-09-19T14:14:48.788064+0000","last_peered":"2024-09-19T14:14:48.788064+0000","last_clean":"2024-09-19T14:14:48.788064+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:14:48.788064+0000","last_undegraded":"2024-09-19T14:14:48.788064+0000","last_fullsized":"2024-09-19T14:14:48.788064+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-19T14:14:48.787980+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-19T14:14:48.787980+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.787980+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:44.951134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9862,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":313,"num_write":122,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.204420+0000","last_change":"2024-09-19T14:14:55.204420+0000","last_active":"2024-09-19T14:14:55.204420+0000","last_peered":"2024-09-19T14:14:55.204420+0000","last_clean":"2024-09-19T14:14:55.204420+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:14:55.204420+0000","last_undegraded":"2024-09-19T14:14:55.204420+0000","last_fullsized":"2024-09-19T14:14:55.204420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.204309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.204309+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.204309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:17.732329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'160","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.769228+0000","last_change":"2024-09-19T14:14:57.769228+0000","last_active":"2024-09-19T14:14:57.769228+0000","last_peered":"2024-09-19T14:14:57.769228+0000","last_clean":"2024-09-19T14:14:57.769228+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:14:57.769228+0000","last_undegraded":"2024-09-19T14:14:57.769228+0000","last_fullsized":"2024-09-19T14:14:57.769228+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'160","last_scrub_stamp":"2024-09-19T14:14:57.769136+0000","last_deep_scrub":"260'160","last_deep_scrub_stamp":"2024-09-19T14:14:57.769136+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.769136+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:34.077896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'836","reported_seq":2520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.397395+0000","last_change":"2024-09-19T14:14:37.397395+0000","last_active":"2024-09-19T14:14:37.397395+0000","last_peered":"2024-09-19T14:14:37.397395+0000","last_clean":"2024-09-19T14:14:37.397395+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:14:37.397395+0000","last_undegraded":"2024-09-19T14:14:37.397395+0000","last_fullsized":"2024-09-19T14:14:37.397395+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'836","last_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_deep_scrub":"260'836","last_deep_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.397294+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:44.618601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'249","reported_seq":948,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.176212+0000","last_change":"2024-09-19T14:14:31.176212+0000","last_active":"2024-09-19T14:14:31.176212+0000","last_peered":"2024-09-19T14:14:31.176212+0000","last_clean":"2024-09-19T14:14:31.176212+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:14:31.176212+0000","last_undegraded":"2024-09-19T14:14:31.176212+0000","last_fullsized":"2024-09-19T14:14:31.176212+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'249","last_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_deep_scrub":"260'249","last_deep_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.176114+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:57.461970+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":888,"num_read_kb":7647,"num_write":1101,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.436486+0000","last_change":"2024-09-19T14:14:36.436486+0000","last_active":"2024-09-19T14:14:36.436486+0000","last_peered":"2024-09-19T14:14:36.436486+0000","last_clean":"2024-09-19T14:14:36.436486+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:14:36.436486+0000","last_undegraded":"2024-09-19T14:14:36.436486+0000","last_fullsized":"2024-09-19T14:14:36.436486+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'447","last_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_deep_scrub":"260'447","last_deep_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.436372+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:10.165233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'218","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.173076+0000","last_change":"2024-09-19T14:14:27.173076+0000","last_active":"2024-09-19T14:14:27.173076+0000","last_peered":"2024-09-19T14:14:27.173076+0000","last_clean":"2024-09-19T14:14:27.173076+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:14:27.173076+0000","last_undegraded":"2024-09-19T14:14:27.173076+0000","last_fullsized":"2024-09-19T14:14:27.173076+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.172984+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:42.410826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":577,"num_read_kb":9780,"num_write":1046,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'455","reported_seq":2088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.752784+0000","last_change":"2024-09-19T14:14:39.752784+0000","last_active":"2024-09-19T14:14:39.752784+0000","last_peered":"2024-09-19T14:14:39.752784+0000","last_clean":"2024-09-19T14:14:39.752784+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:14:39.752784+0000","last_undegraded":"2024-09-19T14:14:39.752784+0000","last_fullsized":"2024-09-19T14:14:39.752784+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'455","last_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_deep_scrub":"260'455","last_deep_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.752704+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:34.065704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'211","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.759444+0000","last_change":"2024-09-19T14:14:29.759444+0000","last_active":"2024-09-19T14:14:29.759444+0000","last_peered":"2024-09-19T14:14:29.759444+0000","last_clean":"2024-09-19T14:14:29.759444+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:14:29.759444+0000","last_undegraded":"2024-09-19T14:14:29.759444+0000","last_fullsized":"2024-09-19T14:14:29.759444+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'211","last_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_deep_scrub":"260'211","last_deep_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.759339+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.186994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":691,"num_read_kb":41340,"num_write":997,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'838","reported_seq":2606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.446544+0000","last_change":"2024-09-19T14:14:35.446544+0000","last_active":"2024-09-19T14:14:35.446544+0000","last_peered":"2024-09-19T14:14:35.446544+0000","last_clean":"2024-09-19T14:14:35.446544+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:14:35.446544+0000","last_undegraded":"2024-09-19T14:14:35.446544+0000","last_fullsized":"2024-09-19T14:14:35.446544+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.446452+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:35.254669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'348","reported_seq":1037,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.265255+0000","last_change":"2024-09-19T14:14:28.265255+0000","last_active":"2024-09-19T14:14:28.265255+0000","last_peered":"2024-09-19T14:14:28.265255+0000","last_clean":"2024-09-19T14:14:28.265255+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:14:28.265255+0000","last_undegraded":"2024-09-19T14:14:28.265255+0000","last_fullsized":"2024-09-19T14:14:28.265255+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.265167+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:06.385286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":988,"num_read_kb":17821,"num_write":1252,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1315","reported_seq":2976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.329566+0000","last_change":"2024-09-19T14:14:41.329566+0000","last_active":"2024-09-19T14:14:41.329566+0000","last_peered":"2024-09-19T14:14:41.329566+0000","last_clean":"2024-09-19T14:14:41.329566+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:14:41.329566+0000","last_undegraded":"2024-09-19T14:14:41.329566+0000","last_fullsized":"2024-09-19T14:14:41.329566+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1315","last_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_deep_scrub":"260'1315","last_deep_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.329479+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:37.922023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'188","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.334879+0000","last_change":"2024-09-19T14:14:28.334879+0000","last_active":"2024-09-19T14:14:28.334879+0000","last_peered":"2024-09-19T14:14:28.334879+0000","last_clean":"2024-09-19T14:14:28.334879+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:14:28.334879+0000","last_undegraded":"2024-09-19T14:14:28.334879+0000","last_fullsized":"2024-09-19T14:14:28.334879+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.334791+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:30.887824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170303,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":35047,"num_write":889,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'461","reported_seq":2160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.731079+0000","last_change":"2024-09-19T14:14:37.731079+0000","last_active":"2024-09-19T14:14:37.731079+0000","last_peered":"2024-09-19T14:14:37.731079+0000","last_clean":"2024-09-19T14:14:37.731079+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:14:37.731079+0000","last_undegraded":"2024-09-19T14:14:37.731079+0000","last_fullsized":"2024-09-19T14:14:37.731079+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'461","last_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_deep_scrub":"260'461","last_deep_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.730982+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:25.634386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'263","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.272920+0000","last_change":"2024-09-19T14:14:27.272920+0000","last_active":"2024-09-19T14:14:27.272920+0000","last_peered":"2024-09-19T14:14:27.272920+0000","last_clean":"2024-09-19T14:14:27.272920+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:14:27.272920+0000","last_undegraded":"2024-09-19T14:14:27.272920+0000","last_fullsized":"2024-09-19T14:14:27.272920+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'263","last_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_deep_scrub":"260'263","last_deep_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.272800+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:17.008251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'506","reported_seq":2130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.307274+0000","last_change":"2024-09-19T14:14:40.307274+0000","last_active":"2024-09-19T14:14:40.307274+0000","last_peered":"2024-09-19T14:14:40.307274+0000","last_clean":"2024-09-19T14:14:40.307274+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:14:40.307274+0000","last_undegraded":"2024-09-19T14:14:40.307274+0000","last_fullsized":"2024-09-19T14:14:40.307274+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.307175+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:34.215410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'215","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.144807+0000","last_change":"2024-09-19T14:14:27.144807+0000","last_active":"2024-09-19T14:14:27.144807+0000","last_peered":"2024-09-19T14:14:27.144807+0000","last_clean":"2024-09-19T14:14:27.144807+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:14:27.144807+0000","last_undegraded":"2024-09-19T14:14:27.144807+0000","last_fullsized":"2024-09-19T14:14:27.144807+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.144709+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:35.772460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":13499,"num_write":1011,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'444","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.179317+0000","last_change":"2024-09-19T14:14:37.179317+0000","last_active":"2024-09-19T14:14:37.179317+0000","last_peered":"2024-09-19T14:14:37.179317+0000","last_clean":"2024-09-19T14:14:37.179317+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:14:37.179317+0000","last_undegraded":"2024-09-19T14:14:37.179317+0000","last_fullsized":"2024-09-19T14:14:37.179317+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'444","last_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_deep_scrub":"260'444","last_deep_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.179230+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:09.695208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'244","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.284232+0000","last_change":"2024-09-19T14:14:29.284232+0000","last_active":"2024-09-19T14:14:29.284232+0000","last_peered":"2024-09-19T14:14:29.284232+0000","last_clean":"2024-09-19T14:14:29.284232+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:14:29.284232+0000","last_undegraded":"2024-09-19T14:14:29.284232+0000","last_fullsized":"2024-09-19T14:14:29.284232+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.284150+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:03.574863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":662,"num_read_kb":12703,"num_write":1156,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'798","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.184755+0000","last_change":"2024-09-19T14:14:38.184755+0000","last_active":"2024-09-19T14:14:38.184755+0000","last_peered":"2024-09-19T14:14:38.184755+0000","last_clean":"2024-09-19T14:14:38.184755+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:14:38.184755+0000","last_undegraded":"2024-09-19T14:14:38.184755+0000","last_fullsized":"2024-09-19T14:14:38.184755+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.184639+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:45.021809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'200","reported_seq":820,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.783242+0000","last_change":"2024-09-19T14:14:32.783242+0000","last_active":"2024-09-19T14:14:32.783242+0000","last_peered":"2024-09-19T14:14:32.783242+0000","last_clean":"2024-09-19T14:14:32.783242+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:14:32.783242+0000","last_undegraded":"2024-09-19T14:14:32.783242+0000","last_fullsized":"2024-09-19T14:14:32.783242+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.783156+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.959321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":31175,"num_write":936,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'412","reported_seq":1863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.794667+0000","last_change":"2024-09-19T14:14:39.794667+0000","last_active":"2024-09-19T14:14:39.794667+0000","last_peered":"2024-09-19T14:14:39.794667+0000","last_clean":"2024-09-19T14:14:39.794667+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:14:39.794667+0000","last_undegraded":"2024-09-19T14:14:39.794667+0000","last_fullsized":"2024-09-19T14:14:39.794667+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'412","last_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_deep_scrub":"260'412","last_deep_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.794561+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:17.283150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'220","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.300531+0000","last_change":"2024-09-19T14:14:30.300531+0000","last_active":"2024-09-19T14:14:30.300531+0000","last_peered":"2024-09-19T14:14:30.300531+0000","last_clean":"2024-09-19T14:14:30.300531+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:14:30.300531+0000","last_undegraded":"2024-09-19T14:14:30.300531+0000","last_fullsized":"2024-09-19T14:14:30.300531+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.300443+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:44.686591+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":31236,"num_write":1023,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'417","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.201597+0000","last_change":"2024-09-19T14:14:28.201597+0000","last_active":"2024-09-19T14:14:28.201597+0000","last_peered":"2024-09-19T14:14:28.201597+0000","last_clean":"2024-09-19T14:14:28.201597+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:14:28.201597+0000","last_undegraded":"2024-09-19T14:14:28.201597+0000","last_fullsized":"2024-09-19T14:14:28.201597+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.201511+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:48.368700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'290","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.793178+0000","last_change":"2024-09-19T14:14:31.793178+0000","last_active":"2024-09-19T14:14:31.793178+0000","last_peered":"2024-09-19T14:14:31.793178+0000","last_clean":"2024-09-19T14:14:31.793178+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:14:31.793178+0000","last_undegraded":"2024-09-19T14:14:31.793178+0000","last_fullsized":"2024-09-19T14:14:31.793178+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.793101+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:55.675665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":11922,"num_write":1198,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'364","reported_seq":1810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.759457+0000","last_change":"2024-09-19T14:14:38.759457+0000","last_active":"2024-09-19T14:14:38.759457+0000","last_peered":"2024-09-19T14:14:38.759457+0000","last_clean":"2024-09-19T14:14:38.759457+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:14:38.759457+0000","last_undegraded":"2024-09-19T14:14:38.759457+0000","last_fullsized":"2024-09-19T14:14:38.759457+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.759372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:34.123627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'216","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.274839+0000","last_change":"2024-09-19T14:14:29.274839+0000","last_active":"2024-09-19T14:14:29.274839+0000","last_peered":"2024-09-19T14:14:29.274839+0000","last_clean":"2024-09-19T14:14:29.274839+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:14:29.274839+0000","last_undegraded":"2024-09-19T14:14:29.274839+0000","last_fullsized":"2024-09-19T14:14:29.274839+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.274732+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:54.840076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":593,"num_read_kb":98527,"num_write":1024,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'870","reported_seq":2506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.147163+0000","last_change":"2024-09-19T14:14:38.147163+0000","last_active":"2024-09-19T14:14:38.147163+0000","last_peered":"2024-09-19T14:14:38.147163+0000","last_clean":"2024-09-19T14:14:38.147163+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:14:38.147163+0000","last_undegraded":"2024-09-19T14:14:38.147163+0000","last_fullsized":"2024-09-19T14:14:38.147163+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'870","last_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_deep_scrub":"260'870","last_deep_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.147083+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:06:43.098776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'246","reported_seq":936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.136442+0000","last_change":"2024-09-19T14:14:29.136442+0000","last_active":"2024-09-19T14:14:29.136442+0000","last_peered":"2024-09-19T14:14:29.136442+0000","last_clean":"2024-09-19T14:14:29.136442+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:14:29.136442+0000","last_undegraded":"2024-09-19T14:14:29.136442+0000","last_fullsized":"2024-09-19T14:14:29.136442+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'246","last_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_deep_scrub":"260'246","last_deep_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.136336+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:58.288005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":868,"num_read_kb":9315,"num_write":1049,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3085,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.236512+0000","last_change":"2024-09-19T14:14:36.236512+0000","last_active":"2024-09-19T14:14:36.236512+0000","last_peered":"2024-09-19T14:14:36.236512+0000","last_clean":"2024-09-19T14:14:36.236512+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:14:36.236512+0000","last_undegraded":"2024-09-19T14:14:36.236512+0000","last_fullsized":"2024-09-19T14:14:36.236512+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1368","last_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_deep_scrub":"260'1368","last_deep_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.236418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:57.105756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'257","reported_seq":891,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.074777+0000","last_change":"2024-09-19T14:14:33.074714+0000","last_active":"2024-09-19T14:14:33.074777+0000","last_peered":"2024-09-19T14:14:33.074777+0000","last_clean":"2024-09-19T14:14:33.074777+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:14:33.074777+0000","last_undegraded":"2024-09-19T14:14:33.074777+0000","last_fullsized":"2024-09-19T14:14:33.074777+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'257","last_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_deep_scrub":"260'257","last_deep_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.074609+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:15.486564+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":13968,"num_write":1077,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'510","reported_seq":2135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.286931+0000","last_change":"2024-09-19T14:14:42.286931+0000","last_active":"2024-09-19T14:14:42.286931+0000","last_peered":"2024-09-19T14:14:42.286931+0000","last_clean":"2024-09-19T14:14:42.286931+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:14:42.286931+0000","last_undegraded":"2024-09-19T14:14:42.286931+0000","last_fullsized":"2024-09-19T14:14:42.286931+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'510","last_scrub_stamp":"2024-09-19T14:14:42.286833+0000","last_deep_scrub":"260'510","last_deep_scrub_stamp":"2024-09-19T14:14:42.286833+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.286833+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:27.122118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'223","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.140942+0000","last_change":"2024-09-19T14:14:25.140942+0000","last_active":"2024-09-19T14:14:25.140942+0000","last_peered":"2024-09-19T14:14:25.140942+0000","last_clean":"2024-09-19T14:14:25.140942+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:14:25.140942+0000","last_undegraded":"2024-09-19T14:14:25.140942+0000","last_fullsized":"2024-09-19T14:14:25.140942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'223","last_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_deep_scrub":"260'223","last_deep_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.140874+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:35.398581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":601,"num_read_kb":75622,"num_write":971,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'451","reported_seq":1955,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.168465+0000","last_change":"2024-09-19T14:14:39.168465+0000","last_active":"2024-09-19T14:14:39.168465+0000","last_peered":"2024-09-19T14:14:39.168465+0000","last_clean":"2024-09-19T14:14:39.168465+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:14:39.168465+0000","last_undegraded":"2024-09-19T14:14:39.168465+0000","last_fullsized":"2024-09-19T14:14:39.168465+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.168391+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:37.445191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'200","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.769229+0000","last_change":"2024-09-19T14:14:33.769229+0000","last_active":"2024-09-19T14:14:33.769229+0000","last_peered":"2024-09-19T14:14:33.769229+0000","last_clean":"2024-09-19T14:14:33.769229+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:14:33.769229+0000","last_undegraded":"2024-09-19T14:14:33.769229+0000","last_fullsized":"2024-09-19T14:14:33.769229+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.769142+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:16.153085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":10629,"num_write":1012,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'199","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.744446+0000","last_change":"2024-09-19T14:14:34.744446+0000","last_active":"2024-09-19T14:14:34.744446+0000","last_peered":"2024-09-19T14:14:34.744446+0000","last_clean":"2024-09-19T14:14:34.744446+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:14:34.744446+0000","last_undegraded":"2024-09-19T14:14:34.744446+0000","last_fullsized":"2024-09-19T14:14:34.744446+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'199","last_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_deep_scrub":"260'199","last_deep_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.744323+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:13.419758+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":6982,"num_write":950,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'989","reported_seq":2920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.211591+0000","last_change":"2024-09-19T14:14:39.211498+0000","last_active":"2024-09-19T14:14:39.211591+0000","last_peered":"2024-09-19T14:14:39.211591+0000","last_clean":"2024-09-19T14:14:39.211591+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:14:39.211591+0000","last_undegraded":"2024-09-19T14:14:39.211591+0000","last_fullsized":"2024-09-19T14:14:39.211591+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'989","last_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_deep_scrub":"260'989","last_deep_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.211398+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:47.763679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4337,"num_omap_keys":17,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'233","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.306234+0000","last_change":"2024-09-19T14:14:28.306234+0000","last_active":"2024-09-19T14:14:28.306234+0000","last_peered":"2024-09-19T14:14:28.306234+0000","last_clean":"2024-09-19T14:14:28.306234+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:14:28.306234+0000","last_undegraded":"2024-09-19T14:14:28.306234+0000","last_fullsized":"2024-09-19T14:14:28.306234+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'233","last_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_deep_scrub":"260'233","last_deep_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.306126+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.168938+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":54230,"num_write":1173,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'388","reported_seq":1934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.732752+0000","last_change":"2024-09-19T14:14:42.732692+0000","last_active":"2024-09-19T14:14:42.732752+0000","last_peered":"2024-09-19T14:14:42.732752+0000","last_clean":"2024-09-19T14:14:42.732752+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:14:42.732752+0000","last_undegraded":"2024-09-19T14:14:42.732752+0000","last_fullsized":"2024-09-19T14:14:42.732752+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-19T14:14:42.732611+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-19T14:14:42.732611+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.732611+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.549453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1662,"ondisk_log_size":1662,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":646,"ondisk_log_size":646,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314615,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7869,"num_read_kb":9932,"num_write":5261,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702536,"num_omap_keys":1622,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1988,"ondisk_log_size":1988,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2874,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35717,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40883929,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38761,"num_read_kb":2616727,"num_write":63893,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":81767858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4188,"ondisk_log_size":4188,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":176453,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":179418,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542617,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235860,"kb_used_data":15876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94135980,"statfs":{"total":96636764160,"available":96395243520,"internally_reserved":0,"allocated":16257024,"data_stored":14556338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542618,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230792,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94141048,"statfs":{"total":96636764160,"available":96400433152,"internally_reserved":0,"allocated":15327232,"data_stored":13795194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542618,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102852,"kb_used_data":13428,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94268988,"statfs":{"total":96636764160,"available":96531443712,"internally_reserved":0,"allocated":13750272,"data_stored":12053849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542621,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94804,"kb_used_data":19204,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94277036,"statfs":{"total":96636764160,"available":96539684864,"internally_reserved":0,"allocated":19664896,"data_stored":18070568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542619,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248784,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123056,"statfs":{"total":96636764160,"available":96382009344,"internally_reserved":0,"allocated":19529728,"data_stored":17906941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542619,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75700,"kb_used_data":8420,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296140,"statfs":{"total":96636764160,"available":96559247360,"internally_reserved":0,"allocated":8622080,"data_stored":7083388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542618,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128220,"kb_used_data":6860,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94243620,"statfs":{"total":96636764160,"available":96505466880,"internally_reserved":0,"allocated":7024640,"data_stored":5427412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542619,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242092,"kb_used_data":12380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94129748,"statfs":{"total":96636764160,"available":96388861952,"internally_reserved":0,"allocated":12677120,"data_stored":10986646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8458240,"data_stored":8279931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3432448,"data_stored":3312234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5058560,"data_stored":4967857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":15790141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":15955950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10084352,"data_stored":9935554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11751424,"data_stored":11680028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":11846163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:15:05.919 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.919 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.919 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.919 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.920 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.921 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.922 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.923 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.923 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.923 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.923 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.923 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.923 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.924 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.925 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.926 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.927 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.928 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.929 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T13:51:14.715276+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=51, tm_sec=14, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T13:52:47.533039+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=47, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.930 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.931 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.931 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T13:52:50.556068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=52, tm_sec=50, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.933 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.933 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.934 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T13:36:16.335647+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=36, tm_sec=16, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:05.935 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T14:15:25.935 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:15:26.271 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:15:26.283 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:15:26.286 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1440,"stamp":"2024-09-19T14:15:25.737206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41806249,"num_objects":632,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":296329,"num_read_kb":3211329,"num_write":145619,"num_write_kb":2512533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741704,"num_omap_keys":1791,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13972,"ondisk_log_size":13972,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1359104,"kb_used_data":110208,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753615616,"statfs":{"total":773094113280,"available":771702390784,"internally_reserved":0,"allocated":112852992,"data_stored":99880336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005408"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.610266+0000","last_change":"2024-09-19T14:15:10.610266+0000","last_active":"2024-09-19T14:15:10.610266+0000","last_peered":"2024-09-19T14:15:10.610266+0000","last_clean":"2024-09-19T14:15:10.610266+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:15:10.610266+0000","last_undegraded":"2024-09-19T14:15:10.610266+0000","last_fullsized":"2024-09-19T14:15:10.610266+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:10.610172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:10.610172+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.610172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:57.446956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.611382+0000","last_change":"2024-09-19T14:15:07.611311+0000","last_active":"2024-09-19T14:15:07.611382+0000","last_peered":"2024-09-19T14:15:07.611382+0000","last_clean":"2024-09-19T14:15:07.611382+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:15:07.611382+0000","last_undegraded":"2024-09-19T14:15:07.611382+0000","last_fullsized":"2024-09-19T14:15:07.611382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:07.611193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:07.611193+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.611193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:24.619774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:13.919874+0000","last_change":"2024-09-19T14:15:13.919804+0000","last_active":"2024-09-19T14:15:13.919874+0000","last_peered":"2024-09-19T14:15:13.919874+0000","last_clean":"2024-09-19T14:15:13.919874+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:15:13.919874+0000","last_undegraded":"2024-09-19T14:15:13.919874+0000","last_fullsized":"2024-09-19T14:15:13.919874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:15:13.919706+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:15:13.919706+0000","last_clean_scrub_stamp":"2024-09-19T14:15:13.919706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:55.825932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.208161+0000","last_change":"2024-09-19T14:15:10.208161+0000","last_active":"2024-09-19T14:15:10.208161+0000","last_peered":"2024-09-19T14:15:10.208161+0000","last_clean":"2024-09-19T14:15:10.208161+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:15:10.208161+0000","last_undegraded":"2024-09-19T14:15:10.208161+0000","last_fullsized":"2024-09-19T14:15:10.208161+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-19T14:15:10.208073+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-19T14:15:10.208073+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.208073+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:03.900577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.846653+0000","last_change":"2024-09-19T14:14:51.846653+0000","last_active":"2024-09-19T14:14:51.846653+0000","last_peered":"2024-09-19T14:14:51.846653+0000","last_clean":"2024-09-19T14:14:51.846653+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:14:51.846653+0000","last_undegraded":"2024-09-19T14:14:51.846653+0000","last_fullsized":"2024-09-19T14:14:51.846653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:51.846559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:51.846559+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.846559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:04.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.655141+0000","last_change":"2024-09-19T14:15:12.655077+0000","last_active":"2024-09-19T14:15:12.655141+0000","last_peered":"2024-09-19T14:15:12.655141+0000","last_clean":"2024-09-19T14:15:12.655141+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:15:12.655141+0000","last_undegraded":"2024-09-19T14:15:12.655141+0000","last_fullsized":"2024-09-19T14:15:12.655141+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:12.654986+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:12.654986+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.654986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:16.230105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.392895+0000","last_change":"2024-09-19T14:14:56.392837+0000","last_active":"2024-09-19T14:14:56.392895+0000","last_peered":"2024-09-19T14:14:56.392895+0000","last_clean":"2024-09-19T14:14:56.392895+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:14:56.392895+0000","last_undegraded":"2024-09-19T14:14:56.392895+0000","last_fullsized":"2024-09-19T14:14:56.392895+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:56.392758+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:56.392758+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.392758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:53.408517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.009526+0000","last_change":"2024-09-19T14:14:44.009429+0000","last_active":"2024-09-19T14:14:44.009526+0000","last_peered":"2024-09-19T14:14:44.009526+0000","last_clean":"2024-09-19T14:14:44.009526+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:14:44.009526+0000","last_undegraded":"2024-09-19T14:14:44.009526+0000","last_fullsized":"2024-09-19T14:14:44.009526+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'21","last_scrub_stamp":"2024-09-19T14:14:44.009304+0000","last_deep_scrub":"260'21","last_deep_scrub_stamp":"2024-09-19T14:14:44.009304+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.009304+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.426501+0000","last_change":"2024-09-19T14:15:02.426435+0000","last_active":"2024-09-19T14:15:02.426501+0000","last_peered":"2024-09-19T14:15:02.426501+0000","last_clean":"2024-09-19T14:15:02.426501+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:15:02.426501+0000","last_undegraded":"2024-09-19T14:15:02.426501+0000","last_fullsized":"2024-09-19T14:15:02.426501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:02.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:02.426354+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:54.564072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:17.233068+0000","last_change":"2024-09-19T14:15:17.233068+0000","last_active":"2024-09-19T14:15:17.233068+0000","last_peered":"2024-09-19T14:15:17.233068+0000","last_clean":"2024-09-19T14:15:17.233068+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:15:17.233068+0000","last_undegraded":"2024-09-19T14:15:17.233068+0000","last_fullsized":"2024-09-19T14:15:17.233068+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:17.232955+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:17.232955+0000","last_clean_scrub_stamp":"2024-09-19T14:15:17.232955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:12.618684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.953618+0000","last_change":"2024-09-19T14:14:47.953554+0000","last_active":"2024-09-19T14:14:47.953618+0000","last_peered":"2024-09-19T14:14:47.953618+0000","last_clean":"2024-09-19T14:14:47.953618+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:14:47.953618+0000","last_undegraded":"2024-09-19T14:14:47.953618+0000","last_fullsized":"2024-09-19T14:14:47.953618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.953461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.953461+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.953461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:30:45.295224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.165251+0000","last_change":"2024-09-19T14:15:07.165251+0000","last_active":"2024-09-19T14:15:07.165251+0000","last_peered":"2024-09-19T14:15:07.165251+0000","last_clean":"2024-09-19T14:15:07.165251+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:15:07.165251+0000","last_undegraded":"2024-09-19T14:15:07.165251+0000","last_fullsized":"2024-09-19T14:15:07.165251+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-09-19T14:15:07.165163+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-09-19T14:15:07.165163+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.165163+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:21.641381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:56.621117+0000","last_change":"2024-09-19T14:03:08.833968+0000","last_active":"2024-09-19T14:12:56.621117+0000","last_peered":"2024-09-19T14:12:56.621117+0000","last_clean":"2024-09-19T14:12:56.621117+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:12:56.621117+0000","last_undegraded":"2024-09-19T14:12:56.621117+0000","last_fullsized":"2024-09-19T14:12:56.621117+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:20.991585+0000","last_change":"2024-09-19T14:15:20.991585+0000","last_active":"2024-09-19T14:15:20.991585+0000","last_peered":"2024-09-19T14:15:20.991585+0000","last_clean":"2024-09-19T14:15:20.991585+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:15:20.991585+0000","last_undegraded":"2024-09-19T14:15:20.991585+0000","last_fullsized":"2024-09-19T14:15:20.991585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:20.991495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:20.991495+0000","last_clean_scrub_stamp":"2024-09-19T14:15:20.991495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:33.097015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.607376+0000","last_change":"2024-09-19T14:15:06.607376+0000","last_active":"2024-09-19T14:15:06.607376+0000","last_peered":"2024-09-19T14:15:06.607376+0000","last_clean":"2024-09-19T14:15:06.607376+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:15:06.607376+0000","last_undegraded":"2024-09-19T14:15:06.607376+0000","last_fullsized":"2024-09-19T14:15:06.607376+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:15:06.607277+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:15:06.607277+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.607277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:10.495395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.937491+0000","last_change":"2024-09-19T14:15:09.937491+0000","last_active":"2024-09-19T14:15:09.937491+0000","last_peered":"2024-09-19T14:15:09.937491+0000","last_clean":"2024-09-19T14:15:09.937491+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:15:09.937491+0000","last_undegraded":"2024-09-19T14:15:09.937491+0000","last_fullsized":"2024-09-19T14:15:09.937491+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'40","last_scrub_stamp":"2024-09-19T14:15:09.937408+0000","last_deep_scrub":"260'40","last_deep_scrub_stamp":"2024-09-19T14:15:09.937408+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.937408+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:32.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:13:16.623847+0000","last_change":"2024-09-19T14:03:08.839846+0000","last_active":"2024-09-19T14:13:16.623847+0000","last_peered":"2024-09-19T14:13:16.623847+0000","last_clean":"2024-09-19T14:13:16.623847+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:13:16.623847+0000","last_undegraded":"2024-09-19T14:13:16.623847+0000","last_fullsized":"2024-09-19T14:13:16.623847+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.622977+0000","last_change":"2024-09-19T14:15:06.622977+0000","last_active":"2024-09-19T14:15:06.622977+0000","last_peered":"2024-09-19T14:15:06.622977+0000","last_clean":"2024-09-19T14:15:06.622977+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:15:06.622977+0000","last_undegraded":"2024-09-19T14:15:06.622977+0000","last_fullsized":"2024-09-19T14:15:06.622977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:06.622900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:06.622900+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.622900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:16.104547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'5","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:13.231976+0000","last_change":"2024-09-19T14:15:13.231976+0000","last_active":"2024-09-19T14:15:13.231976+0000","last_peered":"2024-09-19T14:15:13.231976+0000","last_clean":"2024-09-19T14:15:13.231976+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:15:13.231976+0000","last_undegraded":"2024-09-19T14:15:13.231976+0000","last_fullsized":"2024-09-19T14:15:13.231976+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-19T14:15:13.231875+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-19T14:15:13.231875+0000","last_clean_scrub_stamp":"2024-09-19T14:15:13.231875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:27.673301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":5,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.924637+0000","last_change":"2024-09-19T14:15:07.924637+0000","last_active":"2024-09-19T14:15:07.924637+0000","last_peered":"2024-09-19T14:15:07.924637+0000","last_clean":"2024-09-19T14:15:07.924637+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:15:07.924637+0000","last_undegraded":"2024-09-19T14:15:07.924637+0000","last_fullsized":"2024-09-19T14:15:07.924637+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'31","last_scrub_stamp":"2024-09-19T14:15:07.924548+0000","last_deep_scrub":"260'31","last_deep_scrub_stamp":"2024-09-19T14:15:07.924548+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.924548+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:36.819345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.494663+0000","last_change":"2024-09-19T14:15:05.494663+0000","last_active":"2024-09-19T14:15:05.494663+0000","last_peered":"2024-09-19T14:15:05.494663+0000","last_clean":"2024-09-19T14:15:05.494663+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:15:05.494663+0000","last_undegraded":"2024-09-19T14:15:05.494663+0000","last_fullsized":"2024-09-19T14:15:05.494663+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:05.494574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:05.494574+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.494574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:39.245848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.466793+0000","last_change":"2024-09-19T14:15:00.466793+0000","last_active":"2024-09-19T14:15:00.466793+0000","last_peered":"2024-09-19T14:15:00.466793+0000","last_clean":"2024-09-19T14:15:00.466793+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:15:00.466793+0000","last_undegraded":"2024-09-19T14:15:00.466793+0000","last_fullsized":"2024-09-19T14:15:00.466793+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:15:00.466700+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:15:00.466700+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.466700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:36.437346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'3","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.655766+0000","last_change":"2024-09-19T14:15:08.655766+0000","last_active":"2024-09-19T14:15:08.655766+0000","last_peered":"2024-09-19T14:15:08.655766+0000","last_clean":"2024-09-19T14:15:08.655766+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:15:08.655766+0000","last_undegraded":"2024-09-19T14:15:08.655766+0000","last_fullsized":"2024-09-19T14:15:08.655766+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:08.655680+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:08.655680+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.655680+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:44.662906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.457122+0000","last_change":"2024-09-19T14:14:54.457122+0000","last_active":"2024-09-19T14:14:54.457122+0000","last_peered":"2024-09-19T14:14:54.457122+0000","last_clean":"2024-09-19T14:14:54.457122+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:14:54.457122+0000","last_undegraded":"2024-09-19T14:14:54.457122+0000","last_fullsized":"2024-09-19T14:14:54.457122+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-09-19T14:14:54.457032+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-09-19T14:14:54.457032+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.457032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:45.706150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'2","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:20.173171+0000","last_change":"2024-09-19T14:15:20.173171+0000","last_active":"2024-09-19T14:15:20.173171+0000","last_peered":"2024-09-19T14:15:20.173171+0000","last_clean":"2024-09-19T14:15:20.173171+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:15:20.173171+0000","last_undegraded":"2024-09-19T14:15:20.173171+0000","last_fullsized":"2024-09-19T14:15:20.173171+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:20.173085+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:20.173085+0000","last_clean_scrub_stamp":"2024-09-19T14:15:20.173085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:50:52.365318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.439083+0000","last_change":"2024-09-19T14:14:59.439026+0000","last_active":"2024-09-19T14:14:59.439083+0000","last_peered":"2024-09-19T14:14:59.439083+0000","last_clean":"2024-09-19T14:14:59.439083+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:14:59.439083+0000","last_undegraded":"2024-09-19T14:14:59.439083+0000","last_fullsized":"2024-09-19T14:14:59.439083+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:59.438939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:59.438939+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.438939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:35.216484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.695573+0000","last_change":"2024-09-19T14:15:04.695515+0000","last_active":"2024-09-19T14:15:04.695573+0000","last_peered":"2024-09-19T14:15:04.695573+0000","last_clean":"2024-09-19T14:15:04.695573+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:15:04.695573+0000","last_undegraded":"2024-09-19T14:15:04.695573+0000","last_fullsized":"2024-09-19T14:15:04.695573+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:04.695427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:04.695427+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.695427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:44.629273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":111,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.148076+0000","last_change":"2024-09-19T14:15:06.148076+0000","last_active":"2024-09-19T14:15:06.148076+0000","last_peered":"2024-09-19T14:15:06.148076+0000","last_clean":"2024-09-19T14:15:06.148076+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:15:06.148076+0000","last_undegraded":"2024-09-19T14:15:06.148076+0000","last_fullsized":"2024-09-19T14:15:06.148076+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-19T14:15:06.148005+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-19T14:15:06.148005+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.148005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:35.685405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:21.137211+0000","last_change":"2024-09-19T14:15:21.137211+0000","last_active":"2024-09-19T14:15:21.137211+0000","last_peered":"2024-09-19T14:15:21.137211+0000","last_clean":"2024-09-19T14:15:21.137211+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:15:21.137211+0000","last_undegraded":"2024-09-19T14:15:21.137211+0000","last_fullsized":"2024-09-19T14:15:21.137211+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:21.137116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:21.137116+0000","last_clean_scrub_stamp":"2024-09-19T14:15:21.137116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:53.164623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'8","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:19.946212+0000","last_change":"2024-09-19T14:15:19.946140+0000","last_active":"2024-09-19T14:15:19.946212+0000","last_peered":"2024-09-19T14:15:19.946212+0000","last_clean":"2024-09-19T14:15:19.946212+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:15:19.946212+0000","last_undegraded":"2024-09-19T14:15:19.946212+0000","last_fullsized":"2024-09-19T14:15:19.946212+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:15:19.946035+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:15:19.946035+0000","last_clean_scrub_stamp":"2024-09-19T14:15:19.946035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:57:26.937572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:14.260399+0000","last_change":"2024-09-19T14:15:14.260324+0000","last_active":"2024-09-19T14:15:14.260399+0000","last_peered":"2024-09-19T14:15:14.260399+0000","last_clean":"2024-09-19T14:15:14.260399+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:15:14.260399+0000","last_undegraded":"2024-09-19T14:15:14.260399+0000","last_fullsized":"2024-09-19T14:15:14.260399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:14.260225+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:14.260225+0000","last_clean_scrub_stamp":"2024-09-19T14:15:14.260225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:53:22.907945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.419264+0000","last_change":"2024-09-19T14:14:53.419264+0000","last_active":"2024-09-19T14:14:53.419264+0000","last_peered":"2024-09-19T14:14:53.419264+0000","last_clean":"2024-09-19T14:14:53.419264+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:14:53.419264+0000","last_undegraded":"2024-09-19T14:14:53.419264+0000","last_fullsized":"2024-09-19T14:14:53.419264+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'13","last_scrub_stamp":"2024-09-19T14:14:53.419168+0000","last_deep_scrub":"260'13","last_deep_scrub_stamp":"2024-09-19T14:14:53.419168+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.419168+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:32.991423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.496017+0000","last_change":"2024-09-19T14:15:04.496017+0000","last_active":"2024-09-19T14:15:04.496017+0000","last_peered":"2024-09-19T14:15:04.496017+0000","last_clean":"2024-09-19T14:15:04.496017+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:15:04.496017+0000","last_undegraded":"2024-09-19T14:15:04.496017+0000","last_fullsized":"2024-09-19T14:15:04.496017+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:04.495924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:04.495924+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.495924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:48.287933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'5","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:18.919134+0000","last_change":"2024-09-19T14:15:18.919134+0000","last_active":"2024-09-19T14:15:18.919134+0000","last_peered":"2024-09-19T14:15:18.919134+0000","last_clean":"2024-09-19T14:15:18.919134+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:15:18.919134+0000","last_undegraded":"2024-09-19T14:15:18.919134+0000","last_fullsized":"2024-09-19T14:15:18.919134+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-19T14:15:18.919023+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-19T14:15:18.919023+0000","last_clean_scrub_stamp":"2024-09-19T14:15:18.919023+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:06.522877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.598551+0000","last_change":"2024-09-19T14:15:05.598551+0000","last_active":"2024-09-19T14:15:05.598551+0000","last_peered":"2024-09-19T14:15:05.598551+0000","last_clean":"2024-09-19T14:15:05.598551+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:15:05.598551+0000","last_undegraded":"2024-09-19T14:15:05.598551+0000","last_fullsized":"2024-09-19T14:15:05.598551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-19T14:15:05.598433+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-19T14:15:05.598433+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.598433+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:51.185214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.193858+0000","last_change":"2024-09-19T14:15:05.193858+0000","last_active":"2024-09-19T14:15:05.193858+0000","last_peered":"2024-09-19T14:15:05.193858+0000","last_clean":"2024-09-19T14:15:05.193858+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:15:05.193858+0000","last_undegraded":"2024-09-19T14:15:05.193858+0000","last_fullsized":"2024-09-19T14:15:05.193858+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'39","last_scrub_stamp":"2024-09-19T14:15:05.193755+0000","last_deep_scrub":"260'39","last_deep_scrub_stamp":"2024-09-19T14:15:05.193755+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.193755+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:54.011214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.881471+0000","last_change":"2024-09-19T14:14:49.881409+0000","last_active":"2024-09-19T14:14:49.881471+0000","last_peered":"2024-09-19T14:14:49.881471+0000","last_clean":"2024-09-19T14:14:49.881471+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:14:49.881471+0000","last_undegraded":"2024-09-19T14:14:49.881471+0000","last_fullsized":"2024-09-19T14:14:49.881471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:49.881313+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:49.881313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.881313+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:14.081295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:16.932519+0000","last_change":"2024-09-19T14:15:16.932519+0000","last_active":"2024-09-19T14:15:16.932519+0000","last_peered":"2024-09-19T14:15:16.932519+0000","last_clean":"2024-09-19T14:15:16.932519+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:15:16.932519+0000","last_undegraded":"2024-09-19T14:15:16.932519+0000","last_fullsized":"2024-09-19T14:15:16.932519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:16.932422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:16.932422+0000","last_clean_scrub_stamp":"2024-09-19T14:15:16.932422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:09.242445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.370849+0000","last_change":"2024-09-19T14:15:09.370849+0000","last_active":"2024-09-19T14:15:09.370849+0000","last_peered":"2024-09-19T14:15:09.370849+0000","last_clean":"2024-09-19T14:15:09.370849+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:15:09.370849+0000","last_undegraded":"2024-09-19T14:15:09.370849+0000","last_fullsized":"2024-09-19T14:15:09.370849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:09.370741+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:09.370741+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.370741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:34.311632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":161,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.958885+0000","last_change":"2024-09-19T14:15:06.958885+0000","last_active":"2024-09-19T14:15:06.958885+0000","last_peered":"2024-09-19T14:15:06.958885+0000","last_clean":"2024-09-19T14:15:06.958885+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:15:06.958885+0000","last_undegraded":"2024-09-19T14:15:06.958885+0000","last_fullsized":"2024-09-19T14:15:06.958885+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'41","last_scrub_stamp":"2024-09-19T14:15:06.958806+0000","last_deep_scrub":"260'41","last_deep_scrub_stamp":"2024-09-19T14:15:06.958806+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.958806+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:41.977158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:19.189389+0000","last_change":"2024-09-19T14:15:19.189389+0000","last_active":"2024-09-19T14:15:19.189389+0000","last_peered":"2024-09-19T14:15:19.189389+0000","last_clean":"2024-09-19T14:15:19.189389+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:15:19.189389+0000","last_undegraded":"2024-09-19T14:15:19.189389+0000","last_fullsized":"2024-09-19T14:15:19.189389+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:19.189298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:19.189298+0000","last_clean_scrub_stamp":"2024-09-19T14:15:19.189298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:35.706672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:17.901460+0000","last_change":"2024-09-19T14:15:17.901460+0000","last_active":"2024-09-19T14:15:17.901460+0000","last_peered":"2024-09-19T14:15:17.901460+0000","last_clean":"2024-09-19T14:15:17.901460+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:15:17.901460+0000","last_undegraded":"2024-09-19T14:15:17.901460+0000","last_fullsized":"2024-09-19T14:15:17.901460+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:17.901370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:17.901370+0000","last_clean_scrub_stamp":"2024-09-19T14:15:17.901370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:43.649938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.926906+0000","last_change":"2024-09-19T14:14:46.926906+0000","last_active":"2024-09-19T14:14:46.926906+0000","last_peered":"2024-09-19T14:14:46.926906+0000","last_clean":"2024-09-19T14:14:46.926906+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:14:46.926906+0000","last_undegraded":"2024-09-19T14:14:46.926906+0000","last_fullsized":"2024-09-19T14:14:46.926906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:46.926822+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:46.926822+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.926822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:46.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":92,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.994603+0000","last_change":"2024-09-19T14:14:42.994603+0000","last_active":"2024-09-19T14:14:42.994603+0000","last_peered":"2024-09-19T14:14:42.994603+0000","last_clean":"2024-09-19T14:14:42.994603+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:14:42.994603+0000","last_undegraded":"2024-09-19T14:14:42.994603+0000","last_fullsized":"2024-09-19T14:14:42.994603+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'17","last_scrub_stamp":"2024-09-19T14:14:42.994517+0000","last_deep_scrub":"260'17","last_deep_scrub_stamp":"2024-09-19T14:14:42.994517+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.994517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:21.285051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.611737+0000","last_change":"2024-09-19T14:15:11.611737+0000","last_active":"2024-09-19T14:15:11.611737+0000","last_peered":"2024-09-19T14:15:11.611737+0000","last_clean":"2024-09-19T14:15:11.611737+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:15:11.611737+0000","last_undegraded":"2024-09-19T14:15:11.611737+0000","last_fullsized":"2024-09-19T14:15:11.611737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.611643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.611643+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.611643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:35:12.597118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.621036+0000","last_change":"2024-09-19T14:15:10.621036+0000","last_active":"2024-09-19T14:15:10.621036+0000","last_peered":"2024-09-19T14:15:10.621036+0000","last_clean":"2024-09-19T14:15:10.621036+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:15:10.621036+0000","last_undegraded":"2024-09-19T14:15:10.621036+0000","last_fullsized":"2024-09-19T14:15:10.621036+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:10.620953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:10.620953+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.620953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:37.295128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'8","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.248053+0000","last_change":"2024-09-19T14:15:12.248053+0000","last_active":"2024-09-19T14:15:12.248053+0000","last_peered":"2024-09-19T14:15:12.248053+0000","last_clean":"2024-09-19T14:15:12.248053+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:15:12.248053+0000","last_undegraded":"2024-09-19T14:15:12.248053+0000","last_fullsized":"2024-09-19T14:15:12.248053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:15:12.247922+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:15:12.247922+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.247922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:00:47.210429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.398926+0000","last_change":"2024-09-19T14:15:02.398926+0000","last_active":"2024-09-19T14:15:02.398926+0000","last_peered":"2024-09-19T14:15:02.398926+0000","last_clean":"2024-09-19T14:15:02.398926+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:15:02.398926+0000","last_undegraded":"2024-09-19T14:15:02.398926+0000","last_fullsized":"2024-09-19T14:15:02.398926+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'38","last_scrub_stamp":"2024-09-19T14:15:02.398844+0000","last_deep_scrub":"260'38","last_deep_scrub_stamp":"2024-09-19T14:15:02.398844+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.398844+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:46.346823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.620585+0000","last_change":"2024-09-19T14:03:08.839069+0000","last_active":"2024-09-19T14:12:51.620585+0000","last_peered":"2024-09-19T14:12:51.620585+0000","last_clean":"2024-09-19T14:12:51.620585+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:12:51.620585+0000","last_undegraded":"2024-09-19T14:12:51.620585+0000","last_fullsized":"2024-09-19T14:12:51.620585+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'14","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.459253+0000","last_change":"2024-09-19T14:15:02.459253+0000","last_active":"2024-09-19T14:15:02.459253+0000","last_peered":"2024-09-19T14:15:02.459253+0000","last_clean":"2024-09-19T14:15:02.459253+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:15:02.459253+0000","last_undegraded":"2024-09-19T14:15:02.459253+0000","last_fullsized":"2024-09-19T14:15:02.459253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-19T14:15:02.459165+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-19T14:15:02.459165+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.459165+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:49.616451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11793,"num_write":34,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.740275+0000","last_change":"2024-09-19T14:15:02.740275+0000","last_active":"2024-09-19T14:15:02.740275+0000","last_peered":"2024-09-19T14:15:02.740275+0000","last_clean":"2024-09-19T14:15:02.740275+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:15:02.740275+0000","last_undegraded":"2024-09-19T14:15:02.740275+0000","last_fullsized":"2024-09-19T14:15:02.740275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:02.740161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:02.740161+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.740161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:24.678974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.403295+0000","last_change":"2024-09-19T14:15:04.403295+0000","last_active":"2024-09-19T14:15:04.403295+0000","last_peered":"2024-09-19T14:15:04.403295+0000","last_clean":"2024-09-19T14:15:04.403295+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:15:04.403295+0000","last_undegraded":"2024-09-19T14:15:04.403295+0000","last_fullsized":"2024-09-19T14:15:04.403295+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-19T14:15:04.403195+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-19T14:15:04.403195+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.403195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:11.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:21.319472+0000","last_change":"2024-09-19T14:15:21.319472+0000","last_active":"2024-09-19T14:15:21.319472+0000","last_peered":"2024-09-19T14:15:21.319472+0000","last_clean":"2024-09-19T14:15:21.319472+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:15:21.319472+0000","last_undegraded":"2024-09-19T14:15:21.319472+0000","last_fullsized":"2024-09-19T14:15:21.319472+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:21.319373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:21.319373+0000","last_clean_scrub_stamp":"2024-09-19T14:15:21.319373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:41.729827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.458805+0000","last_change":"2024-09-19T14:15:01.458805+0000","last_active":"2024-09-19T14:15:01.458805+0000","last_peered":"2024-09-19T14:15:01.458805+0000","last_clean":"2024-09-19T14:15:01.458805+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:15:01.458805+0000","last_undegraded":"2024-09-19T14:15:01.458805+0000","last_fullsized":"2024-09-19T14:15:01.458805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:01.458718+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:01.458718+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.458718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:20.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.933103+0000","last_change":"2024-09-19T14:15:10.933103+0000","last_active":"2024-09-19T14:15:10.933103+0000","last_peered":"2024-09-19T14:15:10.933103+0000","last_clean":"2024-09-19T14:15:10.933103+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:15:10.933103+0000","last_undegraded":"2024-09-19T14:15:10.933103+0000","last_fullsized":"2024-09-19T14:15:10.933103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:10.933001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:10.933001+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.933001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:10:36.311311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.181180+0000","last_change":"2024-09-19T14:15:04.181180+0000","last_active":"2024-09-19T14:15:04.181180+0000","last_peered":"2024-09-19T14:15:04.181180+0000","last_clean":"2024-09-19T14:15:04.181180+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:15:04.181180+0000","last_undegraded":"2024-09-19T14:15:04.181180+0000","last_fullsized":"2024-09-19T14:15:04.181180+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'11","last_scrub_stamp":"2024-09-19T14:15:04.181090+0000","last_deep_scrub":"260'11","last_deep_scrub_stamp":"2024-09-19T14:15:04.181090+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.181090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:09.746349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:36.621842+0000","last_change":"2024-09-19T14:03:08.837544+0000","last_active":"2024-09-19T14:12:36.621842+0000","last_peered":"2024-09-19T14:12:36.621842+0000","last_clean":"2024-09-19T14:12:36.621842+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:12:36.621842+0000","last_undegraded":"2024-09-19T14:12:36.621842+0000","last_fullsized":"2024-09-19T14:12:36.621842+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:15.920753+0000","last_change":"2024-09-19T14:15:15.920753+0000","last_active":"2024-09-19T14:15:15.920753+0000","last_peered":"2024-09-19T14:15:15.920753+0000","last_clean":"2024-09-19T14:15:15.920753+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:15:15.920753+0000","last_undegraded":"2024-09-19T14:15:15.920753+0000","last_fullsized":"2024-09-19T14:15:15.920753+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:15.920655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:15.920655+0000","last_clean_scrub_stamp":"2024-09-19T14:15:15.920655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:57.968812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.437176+0000","last_change":"2024-09-19T14:14:57.437176+0000","last_active":"2024-09-19T14:14:57.437176+0000","last_peered":"2024-09-19T14:14:57.437176+0000","last_clean":"2024-09-19T14:14:57.437176+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:14:57.437176+0000","last_undegraded":"2024-09-19T14:14:57.437176+0000","last_fullsized":"2024-09-19T14:14:57.437176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:14:57.437055+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:14:57.437055+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.437055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.642438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.735800+0000","last_change":"2024-09-19T14:15:03.735800+0000","last_active":"2024-09-19T14:15:03.735800+0000","last_peered":"2024-09-19T14:15:03.735800+0000","last_clean":"2024-09-19T14:15:03.735800+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:15:03.735800+0000","last_undegraded":"2024-09-19T14:15:03.735800+0000","last_fullsized":"2024-09-19T14:15:03.735800+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'60","last_scrub_stamp":"2024-09-19T14:15:03.735712+0000","last_deep_scrub":"260'60","last_deep_scrub_stamp":"2024-09-19T14:15:03.735712+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.735712+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:00.243992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:51.620561+0000","last_change":"2024-09-19T14:03:08.837999+0000","last_active":"2024-09-19T14:12:51.620561+0000","last_peered":"2024-09-19T14:12:51.620561+0000","last_clean":"2024-09-19T14:12:51.620561+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:12:51.620561+0000","last_undegraded":"2024-09-19T14:12:51.620561+0000","last_fullsized":"2024-09-19T14:12:51.620561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.472398+0000","last_change":"2024-09-19T14:14:58.472398+0000","last_active":"2024-09-19T14:14:58.472398+0000","last_peered":"2024-09-19T14:14:58.472398+0000","last_clean":"2024-09-19T14:14:58.472398+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:14:58.472398+0000","last_undegraded":"2024-09-19T14:14:58.472398+0000","last_fullsized":"2024-09-19T14:14:58.472398+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:14:58.472281+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:14:58.472281+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.472281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:14.088006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'10","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.597665+0000","last_change":"2024-09-19T14:15:03.597665+0000","last_active":"2024-09-19T14:15:03.597665+0000","last_peered":"2024-09-19T14:15:03.597665+0000","last_clean":"2024-09-19T14:15:03.597665+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:15:03.597665+0000","last_undegraded":"2024-09-19T14:15:03.597665+0000","last_fullsized":"2024-09-19T14:15:03.597665+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-19T14:15:03.597576+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-19T14:15:03.597576+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.597576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:12.886619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26674,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.948840+0000","last_change":"2024-09-19T14:15:08.948840+0000","last_active":"2024-09-19T14:15:08.948840+0000","last_peered":"2024-09-19T14:15:08.948840+0000","last_clean":"2024-09-19T14:15:08.948840+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:15:08.948840+0000","last_undegraded":"2024-09-19T14:15:08.948840+0000","last_fullsized":"2024-09-19T14:15:08.948840+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-09-19T14:15:08.948731+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-09-19T14:15:08.948731+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.948731+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:03.316574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.907232+0000","last_change":"2024-09-19T14:14:48.907232+0000","last_active":"2024-09-19T14:14:48.907232+0000","last_peered":"2024-09-19T14:14:48.907232+0000","last_clean":"2024-09-19T14:14:48.907232+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:14:48.907232+0000","last_undegraded":"2024-09-19T14:14:48.907232+0000","last_fullsized":"2024-09-19T14:14:48.907232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:48.907148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:48.907148+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.907148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:32.974297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'7","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.909915+0000","last_change":"2024-09-19T14:15:12.909858+0000","last_active":"2024-09-19T14:15:12.909915+0000","last_peered":"2024-09-19T14:15:12.909915+0000","last_clean":"2024-09-19T14:15:12.909915+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:15:12.909915+0000","last_undegraded":"2024-09-19T14:15:12.909915+0000","last_fullsized":"2024-09-19T14:15:12.909915+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-19T14:15:12.909772+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-19T14:15:12.909772+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.909772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:49:24.602438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.366281+0000","last_change":"2024-09-19T14:15:08.366219+0000","last_active":"2024-09-19T14:15:08.366281+0000","last_peered":"2024-09-19T14:15:08.366281+0000","last_clean":"2024-09-19T14:15:08.366281+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:15:08.366281+0000","last_undegraded":"2024-09-19T14:15:08.366281+0000","last_fullsized":"2024-09-19T14:15:08.366281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:08.366090+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:08.366090+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.366090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:27.241621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":89,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.911897+0000","last_change":"2024-09-19T14:15:05.911897+0000","last_active":"2024-09-19T14:15:05.911897+0000","last_peered":"2024-09-19T14:15:05.911897+0000","last_clean":"2024-09-19T14:15:05.911897+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:15:05.911897+0000","last_undegraded":"2024-09-19T14:15:05.911897+0000","last_fullsized":"2024-09-19T14:15:05.911897+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-19T14:15:05.911821+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-19T14:15:05.911821+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.911821+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:26.933947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:16.280073+0000","last_change":"2024-09-19T14:15:16.280073+0000","last_active":"2024-09-19T14:15:16.280073+0000","last_peered":"2024-09-19T14:15:16.280073+0000","last_clean":"2024-09-19T14:15:16.280073+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:15:16.280073+0000","last_undegraded":"2024-09-19T14:15:16.280073+0000","last_fullsized":"2024-09-19T14:15:16.280073+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:16.279982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:16.279982+0000","last_clean_scrub_stamp":"2024-09-19T14:15:16.279982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:17:20.725265+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.955019+0000","last_change":"2024-09-19T14:15:11.954950+0000","last_active":"2024-09-19T14:15:11.955019+0000","last_peered":"2024-09-19T14:15:11.955019+0000","last_clean":"2024-09-19T14:15:11.955019+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:15:11.955019+0000","last_undegraded":"2024-09-19T14:15:11.955019+0000","last_fullsized":"2024-09-19T14:15:11.955019+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.954861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.954861+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.954861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:44.561504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'6","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.944278+0000","last_change":"2024-09-19T14:14:45.944218+0000","last_active":"2024-09-19T14:14:45.944278+0000","last_peered":"2024-09-19T14:14:45.944278+0000","last_clean":"2024-09-19T14:14:45.944278+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:14:45.944278+0000","last_undegraded":"2024-09-19T14:14:45.944278+0000","last_fullsized":"2024-09-19T14:14:45.944278+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:14:45.944144+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:14:45.944144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.944144+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:16.135652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":233,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.589575+0000","last_change":"2024-09-19T14:15:01.589575+0000","last_active":"2024-09-19T14:15:01.589575+0000","last_peered":"2024-09-19T14:15:01.589575+0000","last_clean":"2024-09-19T14:15:01.589575+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:15:01.589575+0000","last_undegraded":"2024-09-19T14:15:01.589575+0000","last_fullsized":"2024-09-19T14:15:01.589575+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'64","last_scrub_stamp":"2024-09-19T14:15:01.589492+0000","last_deep_scrub":"260'64","last_deep_scrub_stamp":"2024-09-19T14:15:01.589492+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.589492+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:19:29.776594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.446730+0000","last_change":"2024-09-19T14:15:01.446730+0000","last_active":"2024-09-19T14:15:01.446730+0000","last_peered":"2024-09-19T14:15:01.446730+0000","last_clean":"2024-09-19T14:15:01.446730+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:15:01.446730+0000","last_undegraded":"2024-09-19T14:15:01.446730+0000","last_fullsized":"2024-09-19T14:15:01.446730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:01.446614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:01.446614+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.446614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:06.181987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.460227+0000","last_change":"2024-09-19T14:15:00.460227+0000","last_active":"2024-09-19T14:15:00.460227+0000","last_peered":"2024-09-19T14:15:00.460227+0000","last_clean":"2024-09-19T14:15:00.460227+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:15:00.460227+0000","last_undegraded":"2024-09-19T14:15:00.460227+0000","last_fullsized":"2024-09-19T14:15:00.460227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:00.460130+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:00.460130+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.460130+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:48.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.214774+0000","last_change":"2024-09-19T14:15:11.214707+0000","last_active":"2024-09-19T14:15:11.214774+0000","last_peered":"2024-09-19T14:15:11.214774+0000","last_clean":"2024-09-19T14:15:11.214774+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:15:11.214774+0000","last_undegraded":"2024-09-19T14:15:11.214774+0000","last_fullsized":"2024-09-19T14:15:11.214774+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.214616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.214616+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.214616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:01:07.590123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.444451+0000","last_change":"2024-09-19T14:14:53.444451+0000","last_active":"2024-09-19T14:14:53.444451+0000","last_peered":"2024-09-19T14:14:53.444451+0000","last_clean":"2024-09-19T14:14:53.444451+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:14:53.444451+0000","last_undegraded":"2024-09-19T14:14:53.444451+0000","last_fullsized":"2024-09-19T14:14:53.444451+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-19T14:14:53.444377+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-19T14:14:53.444377+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.444377+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:45.326578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:17.244684+0000","last_change":"2024-09-19T14:15:17.244684+0000","last_active":"2024-09-19T14:15:17.244684+0000","last_peered":"2024-09-19T14:15:17.244684+0000","last_clean":"2024-09-19T14:15:17.244684+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:15:17.244684+0000","last_undegraded":"2024-09-19T14:15:17.244684+0000","last_fullsized":"2024-09-19T14:15:17.244684+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:17.244573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:17.244573+0000","last_clean_scrub_stamp":"2024-09-19T14:15:17.244573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:55.999582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:14.950032+0000","last_change":"2024-09-19T14:15:14.949928+0000","last_active":"2024-09-19T14:15:14.950032+0000","last_peered":"2024-09-19T14:15:14.950032+0000","last_clean":"2024-09-19T14:15:14.950032+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:15:14.950032+0000","last_undegraded":"2024-09-19T14:15:14.950032+0000","last_fullsized":"2024-09-19T14:15:14.950032+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:14.949833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:14.949833+0000","last_clean_scrub_stamp":"2024-09-19T14:15:14.949833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:40.450631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'8","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.392508+0000","last_change":"2024-09-19T14:14:54.392508+0000","last_active":"2024-09-19T14:14:54.392508+0000","last_peered":"2024-09-19T14:14:54.392508+0000","last_clean":"2024-09-19T14:14:54.392508+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:14:54.392508+0000","last_undegraded":"2024-09-19T14:14:54.392508+0000","last_fullsized":"2024-09-19T14:14:54.392508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:14:54.392427+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:14:54.392427+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.392427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:25.291069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.959800+0000","last_change":"2024-09-19T14:14:41.959800+0000","last_active":"2024-09-19T14:14:41.959800+0000","last_peered":"2024-09-19T14:14:41.959800+0000","last_clean":"2024-09-19T14:14:41.959800+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:14:41.959800+0000","last_undegraded":"2024-09-19T14:14:41.959800+0000","last_fullsized":"2024-09-19T14:14:41.959800+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'33","last_scrub_stamp":"2024-09-19T14:14:41.959718+0000","last_deep_scrub":"260'33","last_deep_scrub_stamp":"2024-09-19T14:14:41.959718+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.959718+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:54.621103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:12:11.737832+0000","last_change":"2024-09-19T14:03:08.839338+0000","last_active":"2024-09-19T14:12:11.737832+0000","last_peered":"2024-09-19T14:12:11.737832+0000","last_clean":"2024-09-19T14:12:11.737832+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:12:11.737832+0000","last_undegraded":"2024-09-19T14:12:11.737832+0000","last_fullsized":"2024-09-19T14:12:11.737832+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:03:07.814600+0000","last_clean_scrub_stamp":"2024-09-19T14:03:07.814600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'5","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.631826+0000","last_change":"2024-09-19T14:15:09.631826+0000","last_active":"2024-09-19T14:15:09.631826+0000","last_peered":"2024-09-19T14:15:09.631826+0000","last_clean":"2024-09-19T14:15:09.631826+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:15:09.631826+0000","last_undegraded":"2024-09-19T14:15:09.631826+0000","last_fullsized":"2024-09-19T14:15:09.631826+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-19T14:15:09.631702+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-19T14:15:09.631702+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.631702+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:46.447470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.127297+0000","last_change":"2024-09-19T14:15:08.127297+0000","last_active":"2024-09-19T14:15:08.127297+0000","last_peered":"2024-09-19T14:15:08.127297+0000","last_clean":"2024-09-19T14:15:08.127297+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:15:08.127297+0000","last_undegraded":"2024-09-19T14:15:08.127297+0000","last_fullsized":"2024-09-19T14:15:08.127297+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:08.127203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:08.127203+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.127203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:45.450270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.204017+0000","last_change":"2024-09-19T14:15:02.204017+0000","last_active":"2024-09-19T14:15:02.204017+0000","last_peered":"2024-09-19T14:15:02.204017+0000","last_clean":"2024-09-19T14:15:02.204017+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:15:02.204017+0000","last_undegraded":"2024-09-19T14:15:02.204017+0000","last_fullsized":"2024-09-19T14:15:02.204017+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'18","last_scrub_stamp":"2024-09-19T14:15:02.203930+0000","last_deep_scrub":"260'18","last_deep_scrub_stamp":"2024-09-19T14:15:02.203930+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.203930+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:22:26.895274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:18.231865+0000","last_change":"2024-09-19T14:15:18.231865+0000","last_active":"2024-09-19T14:15:18.231865+0000","last_peered":"2024-09-19T14:15:18.231865+0000","last_clean":"2024-09-19T14:15:18.231865+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:15:18.231865+0000","last_undegraded":"2024-09-19T14:15:18.231865+0000","last_fullsized":"2024-09-19T14:15:18.231865+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:18.231758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:18.231758+0000","last_clean_scrub_stamp":"2024-09-19T14:15:18.231758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:37.573477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.422999+0000","last_change":"2024-09-19T14:15:11.422999+0000","last_active":"2024-09-19T14:15:11.422999+0000","last_peered":"2024-09-19T14:15:11.422999+0000","last_clean":"2024-09-19T14:15:11.422999+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:15:11.422999+0000","last_undegraded":"2024-09-19T14:15:11.422999+0000","last_fullsized":"2024-09-19T14:15:11.422999+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.422879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.422879+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.422879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:32.738045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.343218+0000","last_change":"2024-09-19T14:14:55.343218+0000","last_active":"2024-09-19T14:14:55.343218+0000","last_peered":"2024-09-19T14:14:55.343218+0000","last_clean":"2024-09-19T14:14:55.343218+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:14:55.343218+0000","last_undegraded":"2024-09-19T14:14:55.343218+0000","last_fullsized":"2024-09-19T14:14:55.343218+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:55.343135+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:55.343135+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.343135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:13.998712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":214,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.356650+0000","last_change":"2024-09-19T14:15:01.356578+0000","last_active":"2024-09-19T14:15:01.356650+0000","last_peered":"2024-09-19T14:15:01.356650+0000","last_clean":"2024-09-19T14:15:01.356650+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:15:01.356650+0000","last_undegraded":"2024-09-19T14:15:01.356650+0000","last_fullsized":"2024-09-19T14:15:01.356650+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'58","last_scrub_stamp":"2024-09-19T14:15:01.356496+0000","last_deep_scrub":"260'58","last_deep_scrub_stamp":"2024-09-19T14:15:01.356496+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.356496+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:40.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:15.304799+0000","last_change":"2024-09-19T14:15:15.304799+0000","last_active":"2024-09-19T14:15:15.304799+0000","last_peered":"2024-09-19T14:15:15.304799+0000","last_clean":"2024-09-19T14:15:15.304799+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:15:15.304799+0000","last_undegraded":"2024-09-19T14:15:15.304799+0000","last_fullsized":"2024-09-19T14:15:15.304799+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:15.304711+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:15.304711+0000","last_clean_scrub_stamp":"2024-09-19T14:15:15.304711+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.210111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.437000+0000","last_change":"2024-09-19T14:14:59.436917+0000","last_active":"2024-09-19T14:14:59.437000+0000","last_peered":"2024-09-19T14:14:59.437000+0000","last_clean":"2024-09-19T14:14:59.437000+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:14:59.437000+0000","last_undegraded":"2024-09-19T14:14:59.437000+0000","last_fullsized":"2024-09-19T14:14:59.437000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:59.436823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:59.436823+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.436823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:55.959030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'4","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.171002+0000","last_change":"2024-09-19T14:15:09.171002+0000","last_active":"2024-09-19T14:15:09.171002+0000","last_peered":"2024-09-19T14:15:09.171002+0000","last_clean":"2024-09-19T14:15:09.171002+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:15:09.171002+0000","last_undegraded":"2024-09-19T14:15:09.171002+0000","last_fullsized":"2024-09-19T14:15:09.171002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:15:09.170874+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:15:09.170874+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.170874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:35.329268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":147,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.916782+0000","last_change":"2024-09-19T14:15:04.916726+0000","last_active":"2024-09-19T14:15:04.916782+0000","last_peered":"2024-09-19T14:15:04.916782+0000","last_clean":"2024-09-19T14:15:04.916782+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:15:04.916782+0000","last_undegraded":"2024-09-19T14:15:04.916782+0000","last_fullsized":"2024-09-19T14:15:04.916782+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-19T14:15:04.916642+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-19T14:15:04.916642+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.916642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:47.438969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:20.283087+0000","last_change":"2024-09-19T14:15:20.283087+0000","last_active":"2024-09-19T14:15:20.283087+0000","last_peered":"2024-09-19T14:15:20.283087+0000","last_clean":"2024-09-19T14:15:20.283087+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:15:20.283087+0000","last_undegraded":"2024-09-19T14:15:20.283087+0000","last_fullsized":"2024-09-19T14:15:20.283087+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:20.282982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:20.282982+0000","last_clean_scrub_stamp":"2024-09-19T14:15:20.282982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:47.271552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.409271+0000","last_change":"2024-09-19T14:15:12.409271+0000","last_active":"2024-09-19T14:15:12.409271+0000","last_peered":"2024-09-19T14:15:12.409271+0000","last_clean":"2024-09-19T14:15:12.409271+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:15:12.409271+0000","last_undegraded":"2024-09-19T14:15:12.409271+0000","last_fullsized":"2024-09-19T14:15:12.409271+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:12.409180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:12.409180+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.409180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:03.371193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.739455+0000","last_change":"2024-09-19T14:15:01.739365+0000","last_active":"2024-09-19T14:15:01.739455+0000","last_peered":"2024-09-19T14:15:01.739455+0000","last_clean":"2024-09-19T14:15:01.739455+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:15:01.739455+0000","last_undegraded":"2024-09-19T14:15:01.739455+0000","last_fullsized":"2024-09-19T14:15:01.739455+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:15:01.739263+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:15:01.739263+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.739263+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:49.014949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.406840+0000","last_change":"2024-09-19T14:14:52.406743+0000","last_active":"2024-09-19T14:14:52.406840+0000","last_peered":"2024-09-19T14:14:52.406840+0000","last_clean":"2024-09-19T14:14:52.406840+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:14:52.406840+0000","last_undegraded":"2024-09-19T14:14:52.406840+0000","last_fullsized":"2024-09-19T14:14:52.406840+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'31","last_scrub_stamp":"2024-09-19T14:14:52.406622+0000","last_deep_scrub":"257'31","last_deep_scrub_stamp":"2024-09-19T14:14:52.406622+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.406622+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:01.251978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:13.360672+0000","last_change":"2024-09-19T14:15:13.360672+0000","last_active":"2024-09-19T14:15:13.360672+0000","last_peered":"2024-09-19T14:15:13.360672+0000","last_clean":"2024-09-19T14:15:13.360672+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:15:13.360672+0000","last_undegraded":"2024-09-19T14:15:13.360672+0000","last_fullsized":"2024-09-19T14:15:13.360672+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:13.360586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:13.360586+0000","last_clean_scrub_stamp":"2024-09-19T14:15:13.360586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:16.259340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:15.227967+0000","last_change":"2024-09-19T14:15:15.227967+0000","last_active":"2024-09-19T14:15:15.227967+0000","last_peered":"2024-09-19T14:15:15.227967+0000","last_clean":"2024-09-19T14:15:15.227967+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:15:15.227967+0000","last_undegraded":"2024-09-19T14:15:15.227967+0000","last_fullsized":"2024-09-19T14:15:15.227967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:15:15.227877+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:15:15.227877+0000","last_clean_scrub_stamp":"2024-09-19T14:15:15.227877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:22:54.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.405371+0000","last_change":"2024-09-19T14:15:06.405371+0000","last_active":"2024-09-19T14:15:06.405371+0000","last_peered":"2024-09-19T14:15:06.405371+0000","last_clean":"2024-09-19T14:15:06.405371+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:15:06.405371+0000","last_undegraded":"2024-09-19T14:15:06.405371+0000","last_fullsized":"2024-09-19T14:15:06.405371+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:06.405281+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:06.405281+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.405281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:57.593072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.163847+0000","last_change":"2024-09-19T14:15:03.163754+0000","last_active":"2024-09-19T14:15:03.163847+0000","last_peered":"2024-09-19T14:15:03.163847+0000","last_clean":"2024-09-19T14:15:03.163847+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:15:03.163847+0000","last_undegraded":"2024-09-19T14:15:03.163847+0000","last_fullsized":"2024-09-19T14:15:03.163847+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'13","last_scrub_stamp":"2024-09-19T14:15:03.163638+0000","last_deep_scrub":"260'13","last_deep_scrub_stamp":"2024-09-19T14:15:03.163638+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.163638+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:07.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.642582+0000","last_change":"2024-09-19T14:15:09.642582+0000","last_active":"2024-09-19T14:15:09.642582+0000","last_peered":"2024-09-19T14:15:09.642582+0000","last_clean":"2024-09-19T14:15:09.642582+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:15:09.642582+0000","last_undegraded":"2024-09-19T14:15:09.642582+0000","last_fullsized":"2024-09-19T14:15:09.642582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:09.642501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:09.642501+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.642501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:17.722038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:16.217390+0000","last_change":"2024-09-19T14:15:16.217390+0000","last_active":"2024-09-19T14:15:16.217390+0000","last_peered":"2024-09-19T14:15:16.217390+0000","last_clean":"2024-09-19T14:15:16.217390+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:15:16.217390+0000","last_undegraded":"2024-09-19T14:15:16.217390+0000","last_fullsized":"2024-09-19T14:15:16.217390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:15:16.217272+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:15:16.217272+0000","last_clean_scrub_stamp":"2024-09-19T14:15:16.217272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.508090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.973143+0000","last_change":"2024-09-19T14:14:44.973143+0000","last_active":"2024-09-19T14:14:44.973143+0000","last_peered":"2024-09-19T14:14:44.973143+0000","last_clean":"2024-09-19T14:14:44.973143+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:14:44.973143+0000","last_undegraded":"2024-09-19T14:14:44.973143+0000","last_fullsized":"2024-09-19T14:14:44.973143+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.973056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.973056+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.973056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:59:37.180506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.356498+0000","last_change":"2024-09-19T14:14:51.356443+0000","last_active":"2024-09-19T14:14:51.356498+0000","last_peered":"2024-09-19T14:14:51.356498+0000","last_clean":"2024-09-19T14:14:51.356498+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:14:51.356498+0000","last_undegraded":"2024-09-19T14:14:51.356498+0000","last_fullsized":"2024-09-19T14:14:51.356498+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'34","last_scrub_stamp":"2024-09-19T14:14:51.356359+0000","last_deep_scrub":"260'34","last_deep_scrub_stamp":"2024-09-19T14:14:51.356359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.356359+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:37.031352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.507056+0000","last_change":"2024-09-19T14:15:03.506948+0000","last_active":"2024-09-19T14:15:03.507056+0000","last_peered":"2024-09-19T14:15:03.507056+0000","last_clean":"2024-09-19T14:15:03.507056+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:15:03.507056+0000","last_undegraded":"2024-09-19T14:15:03.507056+0000","last_fullsized":"2024-09-19T14:15:03.507056+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:03.506858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:03.506858+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.506858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:15.332807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.421362+0000","last_change":"2024-09-19T14:15:10.421362+0000","last_active":"2024-09-19T14:15:10.421362+0000","last_peered":"2024-09-19T14:15:10.421362+0000","last_clean":"2024-09-19T14:15:10.421362+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:15:10.421362+0000","last_undegraded":"2024-09-19T14:15:10.421362+0000","last_fullsized":"2024-09-19T14:15:10.421362+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:10.421271+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:10.421271+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.421271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:00.557794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.626625+0000","last_change":"2024-09-19T14:15:04.626625+0000","last_active":"2024-09-19T14:15:04.626625+0000","last_peered":"2024-09-19T14:15:04.626625+0000","last_clean":"2024-09-19T14:15:04.626625+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:15:04.626625+0000","last_undegraded":"2024-09-19T14:15:04.626625+0000","last_fullsized":"2024-09-19T14:15:04.626625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:04.626541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:04.626541+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.626541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.301644+0000","last_change":"2024-09-19T14:14:59.301644+0000","last_active":"2024-09-19T14:14:59.301644+0000","last_peered":"2024-09-19T14:14:59.301644+0000","last_clean":"2024-09-19T14:14:59.301644+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:14:59.301644+0000","last_undegraded":"2024-09-19T14:14:59.301644+0000","last_fullsized":"2024-09-19T14:14:59.301644+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'37","last_scrub_stamp":"2024-09-19T14:14:59.301562+0000","last_deep_scrub":"260'37","last_deep_scrub_stamp":"2024-09-19T14:14:59.301562+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.301562+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:22.479580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.630607+0000","last_change":"2024-09-19T14:15:11.630607+0000","last_active":"2024-09-19T14:15:11.630607+0000","last_peered":"2024-09-19T14:15:11.630607+0000","last_clean":"2024-09-19T14:15:11.630607+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:15:11.630607+0000","last_undegraded":"2024-09-19T14:15:11.630607+0000","last_fullsized":"2024-09-19T14:15:11.630607+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.630525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.630525+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.630525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:14.164058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.646918+0000","last_change":"2024-09-19T14:15:05.646918+0000","last_active":"2024-09-19T14:15:05.646918+0000","last_peered":"2024-09-19T14:15:05.646918+0000","last_clean":"2024-09-19T14:15:05.646918+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:15:05.646918+0000","last_undegraded":"2024-09-19T14:15:05.646918+0000","last_fullsized":"2024-09-19T14:15:05.646918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:05.646786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:05.646786+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.646786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:40.605145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.368409+0000","last_change":"2024-09-19T14:15:07.368409+0000","last_active":"2024-09-19T14:15:07.368409+0000","last_peered":"2024-09-19T14:15:07.368409+0000","last_clean":"2024-09-19T14:15:07.368409+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:15:07.368409+0000","last_undegraded":"2024-09-19T14:15:07.368409+0000","last_fullsized":"2024-09-19T14:15:07.368409+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:07.368311+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:07.368311+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.368311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:38.449295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.445795+0000","last_change":"2024-09-19T14:14:51.445795+0000","last_active":"2024-09-19T14:14:51.445795+0000","last_peered":"2024-09-19T14:14:51.445795+0000","last_clean":"2024-09-19T14:14:51.445795+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:14:51.445795+0000","last_undegraded":"2024-09-19T14:14:51.445795+0000","last_fullsized":"2024-09-19T14:14:51.445795+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'248","last_scrub_stamp":"2024-09-19T14:14:51.445710+0000","last_deep_scrub":"257'248","last_deep_scrub_stamp":"2024-09-19T14:14:51.445710+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.445710+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:23.572561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.883369+0000","last_change":"2024-09-19T14:14:50.883369+0000","last_active":"2024-09-19T14:14:50.883369+0000","last_peered":"2024-09-19T14:14:50.883369+0000","last_clean":"2024-09-19T14:14:50.883369+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:14:50.883369+0000","last_undegraded":"2024-09-19T14:14:50.883369+0000","last_fullsized":"2024-09-19T14:14:50.883369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:50.883275+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:50.883275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.883275+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:11.827780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.401357+0000","last_change":"2024-09-19T14:14:58.401357+0000","last_active":"2024-09-19T14:14:58.401357+0000","last_peered":"2024-09-19T14:14:58.401357+0000","last_clean":"2024-09-19T14:14:58.401357+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:14:58.401357+0000","last_undegraded":"2024-09-19T14:14:58.401357+0000","last_fullsized":"2024-09-19T14:14:58.401357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:14:58.401253+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:14:58.401253+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.401253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:22.910974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.374717+0000","last_change":"2024-09-19T14:15:03.374717+0000","last_active":"2024-09-19T14:15:03.374717+0000","last_peered":"2024-09-19T14:15:03.374717+0000","last_clean":"2024-09-19T14:15:03.374717+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:15:03.374717+0000","last_undegraded":"2024-09-19T14:15:03.374717+0000","last_fullsized":"2024-09-19T14:15:03.374717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:03.374621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:03.374621+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.374621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:38.238150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.575272+0000","last_change":"2024-09-19T14:15:02.575272+0000","last_active":"2024-09-19T14:15:02.575272+0000","last_peered":"2024-09-19T14:15:02.575272+0000","last_clean":"2024-09-19T14:15:02.575272+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:15:02.575272+0000","last_undegraded":"2024-09-19T14:15:02.575272+0000","last_fullsized":"2024-09-19T14:15:02.575272+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-19T14:15:02.575187+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-19T14:15:02.575187+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.575187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:21.697759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:18.264814+0000","last_change":"2024-09-19T14:15:18.264814+0000","last_active":"2024-09-19T14:15:18.264814+0000","last_peered":"2024-09-19T14:15:18.264814+0000","last_clean":"2024-09-19T14:15:18.264814+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:15:18.264814+0000","last_undegraded":"2024-09-19T14:15:18.264814+0000","last_fullsized":"2024-09-19T14:15:18.264814+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:18.264690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:18.264690+0000","last_clean_scrub_stamp":"2024-09-19T14:15:18.264690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:43.470646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.653353+0000","last_change":"2024-09-19T14:15:08.653353+0000","last_active":"2024-09-19T14:15:08.653353+0000","last_peered":"2024-09-19T14:15:08.653353+0000","last_clean":"2024-09-19T14:15:08.653353+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:15:08.653353+0000","last_undegraded":"2024-09-19T14:15:08.653353+0000","last_fullsized":"2024-09-19T14:15:08.653353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:08.653265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:08.653265+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.653265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:02.246708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.402996+0000","last_change":"2024-09-19T14:15:05.402996+0000","last_active":"2024-09-19T14:15:05.402996+0000","last_peered":"2024-09-19T14:15:05.402996+0000","last_clean":"2024-09-19T14:15:05.402996+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:15:05.402996+0000","last_undegraded":"2024-09-19T14:15:05.402996+0000","last_fullsized":"2024-09-19T14:15:05.402996+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:05.402901+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:05.402901+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.402901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:20.756508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.716000+0000","last_change":"2024-09-19T14:15:00.716000+0000","last_active":"2024-09-19T14:15:00.716000+0000","last_peered":"2024-09-19T14:15:00.716000+0000","last_clean":"2024-09-19T14:15:00.716000+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:15:00.716000+0000","last_undegraded":"2024-09-19T14:15:00.716000+0000","last_fullsized":"2024-09-19T14:15:00.716000+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-19T14:15:00.715916+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-19T14:15:00.715916+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.715916+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:55.850827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:19.249836+0000","last_change":"2024-09-19T14:15:19.249836+0000","last_active":"2024-09-19T14:15:19.249836+0000","last_peered":"2024-09-19T14:15:19.249836+0000","last_clean":"2024-09-19T14:15:19.249836+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:15:19.249836+0000","last_undegraded":"2024-09-19T14:15:19.249836+0000","last_fullsized":"2024-09-19T14:15:19.249836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:19.249748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:19.249748+0000","last_clean_scrub_stamp":"2024-09-19T14:15:19.249748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:59.123358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'7","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.474343+0000","last_change":"2024-09-19T14:14:56.474343+0000","last_active":"2024-09-19T14:14:56.474343+0000","last_peered":"2024-09-19T14:14:56.474343+0000","last_clean":"2024-09-19T14:14:56.474343+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:14:56.474343+0000","last_undegraded":"2024-09-19T14:14:56.474343+0000","last_fullsized":"2024-09-19T14:14:56.474343+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-19T14:14:56.474264+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-19T14:14:56.474264+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.474264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:19.206700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.419389+0000","last_change":"2024-09-19T14:14:57.419389+0000","last_active":"2024-09-19T14:14:57.419389+0000","last_peered":"2024-09-19T14:14:57.419389+0000","last_clean":"2024-09-19T14:14:57.419389+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:14:57.419389+0000","last_undegraded":"2024-09-19T14:14:57.419389+0000","last_fullsized":"2024-09-19T14:14:57.419389+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:14:57.419144+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:14:57.419144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.419144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:50.391968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.319252+0000","last_change":"2024-09-19T14:14:50.319252+0000","last_active":"2024-09-19T14:14:50.319252+0000","last_peered":"2024-09-19T14:14:50.319252+0000","last_clean":"2024-09-19T14:14:50.319252+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:14:50.319252+0000","last_undegraded":"2024-09-19T14:14:50.319252+0000","last_fullsized":"2024-09-19T14:14:50.319252+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'65","last_scrub_stamp":"2024-09-19T14:14:50.319141+0000","last_deep_scrub":"260'65","last_deep_scrub_stamp":"2024-09-19T14:14:50.319141+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.319141+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:00.287119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:14.350456+0000","last_change":"2024-09-19T14:15:14.350456+0000","last_active":"2024-09-19T14:15:14.350456+0000","last_peered":"2024-09-19T14:15:14.350456+0000","last_clean":"2024-09-19T14:15:14.350456+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:15:14.350456+0000","last_undegraded":"2024-09-19T14:15:14.350456+0000","last_fullsized":"2024-09-19T14:15:14.350456+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:14.350357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:14.350357+0000","last_clean_scrub_stamp":"2024-09-19T14:15:14.350357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:05.785545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.652585+0000","last_change":"2024-09-19T14:15:07.652585+0000","last_active":"2024-09-19T14:15:07.652585+0000","last_peered":"2024-09-19T14:15:07.652585+0000","last_clean":"2024-09-19T14:15:07.652585+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:15:07.652585+0000","last_undegraded":"2024-09-19T14:15:07.652585+0000","last_fullsized":"2024-09-19T14:15:07.652585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:15:07.652502+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:15:07.652502+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.652502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:47.010354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":214,"num_write":4,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.431200+0000","last_change":"2024-09-19T14:14:55.431200+0000","last_active":"2024-09-19T14:14:55.431200+0000","last_peered":"2024-09-19T14:14:55.431200+0000","last_clean":"2024-09-19T14:14:55.431200+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:14:55.431200+0000","last_undegraded":"2024-09-19T14:14:55.431200+0000","last_fullsized":"2024-09-19T14:14:55.431200+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:14:55.431115+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:14:55.431115+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.431115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:38:01.164802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":124,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.313755+0000","last_change":"2024-09-19T14:14:58.313688+0000","last_active":"2024-09-19T14:14:58.313755+0000","last_peered":"2024-09-19T14:14:58.313755+0000","last_clean":"2024-09-19T14:14:58.313755+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:14:58.313755+0000","last_undegraded":"2024-09-19T14:14:58.313755+0000","last_fullsized":"2024-09-19T14:14:58.313755+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'26","last_scrub_stamp":"2024-09-19T14:14:58.313601+0000","last_deep_scrub":"260'26","last_deep_scrub_stamp":"2024-09-19T14:14:58.313601+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.313601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:54.752333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'198","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.123580+0000","last_change":"2024-09-19T14:14:37.123580+0000","last_active":"2024-09-19T14:14:37.123580+0000","last_peered":"2024-09-19T14:14:37.123580+0000","last_clean":"2024-09-19T14:14:37.123580+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:14:37.123580+0000","last_undegraded":"2024-09-19T14:14:37.123580+0000","last_fullsized":"2024-09-19T14:14:37.123580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.123480+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:59.204973+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":14767,"num_write":959,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'809","reported_seq":2392,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.739943+0000","last_change":"2024-09-19T14:14:41.739943+0000","last_active":"2024-09-19T14:14:41.739943+0000","last_peered":"2024-09-19T14:14:41.739943+0000","last_clean":"2024-09-19T14:14:41.739943+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:14:41.739943+0000","last_undegraded":"2024-09-19T14:14:41.739943+0000","last_fullsized":"2024-09-19T14:14:41.739943+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'809","last_scrub_stamp":"2024-09-19T14:14:41.739846+0000","last_deep_scrub":"260'809","last_deep_scrub_stamp":"2024-09-19T14:14:41.739846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.739846+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:36.451126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'195","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.326367+0000","last_change":"2024-09-19T14:14:29.326367+0000","last_active":"2024-09-19T14:14:29.326367+0000","last_peered":"2024-09-19T14:14:29.326367+0000","last_clean":"2024-09-19T14:14:29.326367+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:14:29.326367+0000","last_undegraded":"2024-09-19T14:14:29.326367+0000","last_fullsized":"2024-09-19T14:14:29.326367+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.326239+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:00.504896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":5759,"num_write":878,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'702","reported_seq":2398,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.246546+0000","last_change":"2024-09-19T14:14:41.246546+0000","last_active":"2024-09-19T14:14:41.246546+0000","last_peered":"2024-09-19T14:14:41.246546+0000","last_clean":"2024-09-19T14:14:41.246546+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:14:41.246546+0000","last_undegraded":"2024-09-19T14:14:41.246546+0000","last_fullsized":"2024-09-19T14:14:41.246546+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'702","last_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_deep_scrub":"260'702","last_deep_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.246453+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:35.785088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'225","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.292915+0000","last_change":"2024-09-19T14:14:32.292915+0000","last_active":"2024-09-19T14:14:32.292915+0000","last_peered":"2024-09-19T14:14:32.292915+0000","last_clean":"2024-09-19T14:14:32.292915+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:14:32.292915+0000","last_undegraded":"2024-09-19T14:14:32.292915+0000","last_fullsized":"2024-09-19T14:14:32.292915+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.292807+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:56.116597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":12221,"num_write":1127,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'390","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.745712+0000","last_change":"2024-09-19T14:14:42.745712+0000","last_active":"2024-09-19T14:14:42.745712+0000","last_peered":"2024-09-19T14:14:42.745712+0000","last_clean":"2024-09-19T14:14:42.745712+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:14:42.745712+0000","last_undegraded":"2024-09-19T14:14:42.745712+0000","last_fullsized":"2024-09-19T14:14:42.745712+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-19T14:14:42.745623+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-19T14:14:42.745623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.745623+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.098393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'225","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.804464+0000","last_change":"2024-09-19T14:14:36.804464+0000","last_active":"2024-09-19T14:14:36.804464+0000","last_peered":"2024-09-19T14:14:36.804464+0000","last_clean":"2024-09-19T14:14:36.804464+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:14:36.804464+0000","last_undegraded":"2024-09-19T14:14:36.804464+0000","last_fullsized":"2024-09-19T14:14:36.804464+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.804346+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:50.761130+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311660,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":9100,"num_write":1128,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'994","reported_seq":2647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.190516+0000","last_change":"2024-09-19T14:14:40.190516+0000","last_active":"2024-09-19T14:14:40.190516+0000","last_peered":"2024-09-19T14:14:40.190516+0000","last_clean":"2024-09-19T14:14:40.190516+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:14:40.190516+0000","last_undegraded":"2024-09-19T14:14:40.190516+0000","last_fullsized":"2024-09-19T14:14:40.190516+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'994","last_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_deep_scrub":"260'994","last_deep_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.190428+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:54.056506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'203","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.089410+0000","last_change":"2024-09-19T14:14:36.089410+0000","last_active":"2024-09-19T14:14:36.089410+0000","last_peered":"2024-09-19T14:14:36.089410+0000","last_clean":"2024-09-19T14:14:36.089410+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:14:36.089410+0000","last_undegraded":"2024-09-19T14:14:36.089410+0000","last_fullsized":"2024-09-19T14:14:36.089410+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.089313+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:07.911503+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":762,"num_read_kb":134002,"num_write":945,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'559","reported_seq":2312,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.131013+0000","last_change":"2024-09-19T14:14:36.131013+0000","last_active":"2024-09-19T14:14:36.131013+0000","last_peered":"2024-09-19T14:14:36.131013+0000","last_clean":"2024-09-19T14:14:36.131013+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:14:36.131013+0000","last_undegraded":"2024-09-19T14:14:36.131013+0000","last_fullsized":"2024-09-19T14:14:36.131013+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.130918+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.095702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'193","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.782781+0000","last_change":"2024-09-19T14:14:35.782781+0000","last_active":"2024-09-19T14:14:35.782781+0000","last_peered":"2024-09-19T14:14:35.782781+0000","last_clean":"2024-09-19T14:14:35.782781+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:14:35.782781+0000","last_undegraded":"2024-09-19T14:14:35.782781+0000","last_fullsized":"2024-09-19T14:14:35.782781+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.782688+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.990734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":377,"num_write":871,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'838","reported_seq":2453,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.796490+0000","last_change":"2024-09-19T14:14:43.796490+0000","last_active":"2024-09-19T14:14:43.796490+0000","last_peered":"2024-09-19T14:14:43.796490+0000","last_clean":"2024-09-19T14:14:43.796490+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:14:43.796490+0000","last_undegraded":"2024-09-19T14:14:43.796490+0000","last_fullsized":"2024-09-19T14:14:43.796490+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:43.796410+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:43.796410+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.796410+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:49:51.893820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'192","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.091489+0000","last_change":"2024-09-19T14:14:35.091489+0000","last_active":"2024-09-19T14:14:35.091489+0000","last_peered":"2024-09-19T14:14:35.091489+0000","last_clean":"2024-09-19T14:14:35.091489+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:14:35.091489+0000","last_undegraded":"2024-09-19T14:14:35.091489+0000","last_fullsized":"2024-09-19T14:14:35.091489+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'192","last_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_deep_scrub":"260'192","last_deep_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.091359+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:04.394433+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":7782,"num_write":893,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'506","reported_seq":2295,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.741302+0000","last_change":"2024-09-19T14:14:43.741302+0000","last_active":"2024-09-19T14:14:43.741302+0000","last_peered":"2024-09-19T14:14:43.741302+0000","last_clean":"2024-09-19T14:14:43.741302+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:14:43.741302+0000","last_undegraded":"2024-09-19T14:14:43.741302+0000","last_fullsized":"2024-09-19T14:14:43.741302+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:43.741200+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:43.741200+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.741200+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:02.439155+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'196","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.298383+0000","last_change":"2024-09-19T14:14:32.298383+0000","last_active":"2024-09-19T14:14:32.298383+0000","last_peered":"2024-09-19T14:14:32.298383+0000","last_clean":"2024-09-19T14:14:32.298383+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:14:32.298383+0000","last_undegraded":"2024-09-19T14:14:32.298383+0000","last_fullsized":"2024-09-19T14:14:32.298383+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.298282+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:47.257623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1090,"num_read_kb":38780,"num_write":956,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'844","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.151176+0000","last_change":"2024-09-19T14:14:32.151176+0000","last_active":"2024-09-19T14:14:32.151176+0000","last_peered":"2024-09-19T14:14:32.151176+0000","last_clean":"2024-09-19T14:14:32.151176+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:14:32.151176+0000","last_undegraded":"2024-09-19T14:14:32.151176+0000","last_fullsized":"2024-09-19T14:14:32.151176+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.151071+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:53:10.742546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'554","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.736290+0000","last_change":"2024-09-19T14:14:41.736290+0000","last_active":"2024-09-19T14:14:41.736290+0000","last_peered":"2024-09-19T14:14:41.736290+0000","last_clean":"2024-09-19T14:14:41.736290+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:14:41.736290+0000","last_undegraded":"2024-09-19T14:14:41.736290+0000","last_fullsized":"2024-09-19T14:14:41.736290+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'554","last_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_deep_scrub":"260'554","last_deep_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.736205+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:58.060707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'193","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.105180+0000","last_change":"2024-09-19T14:14:34.105113+0000","last_active":"2024-09-19T14:14:34.105180+0000","last_peered":"2024-09-19T14:14:34.105180+0000","last_clean":"2024-09-19T14:14:34.105180+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:14:34.105180+0000","last_undegraded":"2024-09-19T14:14:34.105180+0000","last_fullsized":"2024-09-19T14:14:34.105180+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.105025+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:38.487293+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":11511,"num_write":896,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'383","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.214409+0000","last_change":"2024-09-19T14:14:40.214409+0000","last_active":"2024-09-19T14:14:40.214409+0000","last_peered":"2024-09-19T14:14:40.214409+0000","last_clean":"2024-09-19T14:14:40.214409+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:14:40.214409+0000","last_undegraded":"2024-09-19T14:14:40.214409+0000","last_fullsized":"2024-09-19T14:14:40.214409+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.214311+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:37:14.302323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'197","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.132706+0000","last_change":"2024-09-19T14:14:32.132624+0000","last_active":"2024-09-19T14:14:32.132706+0000","last_peered":"2024-09-19T14:14:32.132706+0000","last_clean":"2024-09-19T14:14:32.132706+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:14:32.132706+0000","last_undegraded":"2024-09-19T14:14:32.132706+0000","last_fullsized":"2024-09-19T14:14:32.132706+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.132498+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:29.891589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":26719,"num_write":915,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'559","reported_seq":2190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.704483+0000","last_change":"2024-09-19T14:14:40.704483+0000","last_active":"2024-09-19T14:14:40.704483+0000","last_peered":"2024-09-19T14:14:40.704483+0000","last_clean":"2024-09-19T14:14:40.704483+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:14:40.704483+0000","last_undegraded":"2024-09-19T14:14:40.704483+0000","last_fullsized":"2024-09-19T14:14:40.704483+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.704381+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:12.312285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'227","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.161781+0000","last_change":"2024-09-19T14:14:30.161690+0000","last_active":"2024-09-19T14:14:30.161781+0000","last_peered":"2024-09-19T14:14:30.161781+0000","last_clean":"2024-09-19T14:14:30.161781+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:14:30.161781+0000","last_undegraded":"2024-09-19T14:14:30.161781+0000","last_fullsized":"2024-09-19T14:14:30.161781+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'227","last_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_deep_scrub":"260'227","last_deep_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.161577+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:19.848076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":629,"num_read_kb":31855,"num_write":1145,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'379","reported_seq":1919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.163114+0000","last_change":"2024-09-19T14:14:30.163058+0000","last_active":"2024-09-19T14:14:30.163114+0000","last_peered":"2024-09-19T14:14:30.163114+0000","last_clean":"2024-09-19T14:14:30.163114+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:14:30.163114+0000","last_undegraded":"2024-09-19T14:14:30.163114+0000","last_fullsized":"2024-09-19T14:14:30.163114+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.162974+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:37.556799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'206","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.663752+0000","last_change":"2024-09-19T14:14:27.663692+0000","last_active":"2024-09-19T14:14:27.663752+0000","last_peered":"2024-09-19T14:14:27.663752+0000","last_clean":"2024-09-19T14:14:27.663752+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:14:27.663752+0000","last_undegraded":"2024-09-19T14:14:27.663752+0000","last_fullsized":"2024-09-19T14:14:27.663752+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.663598+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:54:59.757452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":49502,"num_write":988,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'394","reported_seq":2008,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.172308+0000","last_change":"2024-09-19T14:14:31.172225+0000","last_active":"2024-09-19T14:14:31.172308+0000","last_peered":"2024-09-19T14:14:31.172308+0000","last_clean":"2024-09-19T14:14:31.172308+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:14:31.172308+0000","last_undegraded":"2024-09-19T14:14:31.172308+0000","last_fullsized":"2024-09-19T14:14:31.172308+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'394","last_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_deep_scrub":"260'394","last_deep_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.172124+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:59.034171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'195","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.310130+0000","last_change":"2024-09-19T14:14:31.310078+0000","last_active":"2024-09-19T14:14:31.310130+0000","last_peered":"2024-09-19T14:14:31.310130+0000","last_clean":"2024-09-19T14:14:31.310130+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:14:31.310130+0000","last_undegraded":"2024-09-19T14:14:31.310130+0000","last_fullsized":"2024-09-19T14:14:31.310130+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.309994+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:02.549578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145924,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":176003,"num_write":888,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'910","reported_seq":2615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.755134+0000","last_change":"2024-09-19T14:14:40.755059+0000","last_active":"2024-09-19T14:14:40.755134+0000","last_peered":"2024-09-19T14:14:40.755134+0000","last_clean":"2024-09-19T14:14:40.755134+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:14:40.755134+0000","last_undegraded":"2024-09-19T14:14:40.755134+0000","last_fullsized":"2024-09-19T14:14:40.755134+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'910","last_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_deep_scrub":"260'910","last_deep_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.754973+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:03.252154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.263121+0000","last_change":"2024-09-19T14:14:30.263121+0000","last_active":"2024-09-19T14:14:30.263121+0000","last_peered":"2024-09-19T14:14:30.263121+0000","last_clean":"2024-09-19T14:14:30.263121+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:14:30.263121+0000","last_undegraded":"2024-09-19T14:14:30.263121+0000","last_fullsized":"2024-09-19T14:14:30.263121+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.263019+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:26.635817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":112164,"num_write":1137,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'139","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.770168+0000","last_change":"2024-09-19T14:14:58.770168+0000","last_active":"2024-09-19T14:14:58.770168+0000","last_peered":"2024-09-19T14:14:58.770168+0000","last_clean":"2024-09-19T14:14:58.770168+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:14:58.770168+0000","last_undegraded":"2024-09-19T14:14:58.770168+0000","last_fullsized":"2024-09-19T14:14:58.770168+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-19T14:14:58.770082+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-19T14:14:58.770082+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.770082+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:36:45.776897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'819","reported_seq":2323,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.328941+0000","last_change":"2024-09-19T14:14:36.328941+0000","last_active":"2024-09-19T14:14:36.328941+0000","last_peered":"2024-09-19T14:14:36.328941+0000","last_clean":"2024-09-19T14:14:36.328941+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:14:36.328941+0000","last_undegraded":"2024-09-19T14:14:36.328941+0000","last_fullsized":"2024-09-19T14:14:36.328941+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'819","last_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_deep_scrub":"260'819","last_deep_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.328841+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:46.293758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'177","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.117409+0000","last_change":"2024-09-19T14:14:31.117409+0000","last_active":"2024-09-19T14:14:31.117409+0000","last_peered":"2024-09-19T14:14:31.117409+0000","last_clean":"2024-09-19T14:14:31.117409+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:14:31.117409+0000","last_undegraded":"2024-09-19T14:14:31.117409+0000","last_fullsized":"2024-09-19T14:14:31.117409+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.117313+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:40.698859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":47147,"num_write":844,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.702330+0000","last_change":"2024-09-19T14:14:46.702269+0000","last_active":"2024-09-19T14:14:46.702330+0000","last_peered":"2024-09-19T14:14:46.702330+0000","last_clean":"2024-09-19T14:14:46.702330+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:14:46.702330+0000","last_undegraded":"2024-09-19T14:14:46.702330+0000","last_fullsized":"2024-09-19T14:14:46.702330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.702178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.702178+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.702178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:28.252054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'197","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.213989+0000","last_change":"2024-09-19T14:14:47.213911+0000","last_active":"2024-09-19T14:14:47.213989+0000","last_peered":"2024-09-19T14:14:47.213989+0000","last_clean":"2024-09-19T14:14:47.213989+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:14:47.213989+0000","last_undegraded":"2024-09-19T14:14:47.213989+0000","last_fullsized":"2024-09-19T14:14:47.213989+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:47.213829+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:47.213829+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.213829+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:52.269122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":375,"num_write":156,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.239283+0000","last_change":"2024-09-19T14:14:55.239180+0000","last_active":"2024-09-19T14:14:55.239283+0000","last_peered":"2024-09-19T14:14:55.239283+0000","last_clean":"2024-09-19T14:14:55.239283+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:14:55.239283+0000","last_undegraded":"2024-09-19T14:14:55.239283+0000","last_fullsized":"2024-09-19T14:14:55.239283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.239075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.239075+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.239075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:55.212000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2507","reported_seq":4328,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.590514+0000","last_change":"2024-09-19T14:14:59.590448+0000","last_active":"2024-09-19T14:14:59.590514+0000","last_peered":"2024-09-19T14:14:59.590514+0000","last_clean":"2024-09-19T14:14:59.590514+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:14:59.590514+0000","last_undegraded":"2024-09-19T14:14:59.590514+0000","last_fullsized":"2024-09-19T14:14:59.590514+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2507","last_scrub_stamp":"2024-09-19T14:14:59.590365+0000","last_deep_scrub":"260'2507","last_deep_scrub_stamp":"2024-09-19T14:14:59.590365+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.590365+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":2400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:38.558628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'479","reported_seq":2129,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.773886+0000","last_change":"2024-09-19T14:14:37.773810+0000","last_active":"2024-09-19T14:14:37.773886+0000","last_peered":"2024-09-19T14:14:37.773886+0000","last_clean":"2024-09-19T14:14:37.773886+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:14:37.773886+0000","last_undegraded":"2024-09-19T14:14:37.773886+0000","last_fullsized":"2024-09-19T14:14:37.773886+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'479","last_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_deep_scrub":"260'479","last_deep_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.773706+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:04.083276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'172","reported_seq":757,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.319675+0000","last_change":"2024-09-19T14:14:24.319675+0000","last_active":"2024-09-19T14:14:24.319675+0000","last_peered":"2024-09-19T14:14:24.319675+0000","last_clean":"2024-09-19T14:14:24.319675+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:14:24.319675+0000","last_undegraded":"2024-09-19T14:14:24.319675+0000","last_fullsized":"2024-09-19T14:14:24.319675+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'172","last_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_deep_scrub":"260'172","last_deep_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.319605+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:56.937149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":371,"num_read_kb":36151,"num_write":775,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.252761+0000","last_change":"2024-09-19T14:14:44.252761+0000","last_active":"2024-09-19T14:14:44.252761+0000","last_peered":"2024-09-19T14:14:44.252761+0000","last_clean":"2024-09-19T14:14:44.252761+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:14:44.252761+0000","last_undegraded":"2024-09-19T14:14:44.252761+0000","last_fullsized":"2024-09-19T14:14:44.252761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.252671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.252671+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.252671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:08.431300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'81","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.794184+0000","last_change":"2024-09-19T14:14:49.794123+0000","last_active":"2024-09-19T14:14:49.794184+0000","last_peered":"2024-09-19T14:14:49.794184+0000","last_clean":"2024-09-19T14:14:49.794184+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:14:49.794184+0000","last_undegraded":"2024-09-19T14:14:49.794184+0000","last_fullsized":"2024-09-19T14:14:49.794184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'81","last_scrub_stamp":"2024-09-19T14:14:49.794031+0000","last_deep_scrub":"260'81","last_deep_scrub_stamp":"2024-09-19T14:14:49.794031+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.794031+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:53.073294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.818300+0000","last_change":"2024-09-19T14:14:54.818226+0000","last_active":"2024-09-19T14:14:54.818300+0000","last_peered":"2024-09-19T14:14:54.818300+0000","last_clean":"2024-09-19T14:14:54.818300+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:14:54.818300+0000","last_undegraded":"2024-09-19T14:14:54.818300+0000","last_fullsized":"2024-09-19T14:14:54.818300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.818118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.818118+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.818118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:11.651936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'138","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.169897+0000","last_change":"2024-09-19T14:14:58.169897+0000","last_active":"2024-09-19T14:14:58.169897+0000","last_peered":"2024-09-19T14:14:58.169897+0000","last_clean":"2024-09-19T14:14:58.169897+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:14:58.169897+0000","last_undegraded":"2024-09-19T14:14:58.169897+0000","last_fullsized":"2024-09-19T14:14:58.169897+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'138","last_scrub_stamp":"2024-09-19T14:14:58.169814+0000","last_deep_scrub":"260'138","last_deep_scrub_stamp":"2024-09-19T14:14:58.169814+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.169814+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:59.894371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'837","reported_seq":2520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.219917+0000","last_change":"2024-09-19T14:14:35.219848+0000","last_active":"2024-09-19T14:14:35.219917+0000","last_peered":"2024-09-19T14:14:35.219917+0000","last_clean":"2024-09-19T14:14:35.219917+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:14:35.219917+0000","last_undegraded":"2024-09-19T14:14:35.219917+0000","last_fullsized":"2024-09-19T14:14:35.219917+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'837","last_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_deep_scrub":"260'837","last_deep_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.219760+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:28.048778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'169","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.152624+0000","last_change":"2024-09-19T14:14:29.152624+0000","last_active":"2024-09-19T14:14:29.152624+0000","last_peered":"2024-09-19T14:14:29.152624+0000","last_clean":"2024-09-19T14:14:29.152624+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:14:29.152624+0000","last_undegraded":"2024-09-19T14:14:29.152624+0000","last_fullsized":"2024-09-19T14:14:29.152624+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'169","last_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_deep_scrub":"260'169","last_deep_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.152542+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:24.812263+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":63998,"num_write":820,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.221945+0000","last_change":"2024-09-19T14:14:46.221891+0000","last_active":"2024-09-19T14:14:46.221945+0000","last_peered":"2024-09-19T14:14:46.221945+0000","last_clean":"2024-09-19T14:14:46.221945+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:14:46.221945+0000","last_undegraded":"2024-09-19T14:14:46.221945+0000","last_fullsized":"2024-09-19T14:14:46.221945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.221818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.221818+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.221818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:33.565654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'109","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.063068+0000","last_change":"2024-09-19T14:14:38.063068+0000","last_active":"2024-09-19T14:14:38.063068+0000","last_peered":"2024-09-19T14:14:38.063068+0000","last_clean":"2024-09-19T14:14:38.063068+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:14:38.063068+0000","last_undegraded":"2024-09-19T14:14:38.063068+0000","last_fullsized":"2024-09-19T14:14:38.063068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.062968+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:05.291095+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'764","reported_seq":2075,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.219729+0000","last_change":"2024-09-19T14:14:54.219640+0000","last_active":"2024-09-19T14:14:54.219729+0000","last_peered":"2024-09-19T14:14:54.219729+0000","last_clean":"2024-09-19T14:14:54.219729+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:14:54.219729+0000","last_undegraded":"2024-09-19T14:14:54.219729+0000","last_fullsized":"2024-09-19T14:14:54.219729+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'764","last_scrub_stamp":"2024-09-19T14:14:54.219557+0000","last_deep_scrub":"260'764","last_deep_scrub_stamp":"2024-09-19T14:14:54.219557+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.219557+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:45.057117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'278","reported_seq":1116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.743148+0000","last_change":"2024-09-19T14:14:59.743148+0000","last_active":"2024-09-19T14:14:59.743148+0000","last_peered":"2024-09-19T14:14:59.743148+0000","last_clean":"2024-09-19T14:14:59.743148+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:14:59.743148+0000","last_undegraded":"2024-09-19T14:14:59.743148+0000","last_fullsized":"2024-09-19T14:14:59.743148+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-09-19T14:14:59.743054+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-09-19T14:14:59.743054+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.743054+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:04.825781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'432","reported_seq":1989,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.369856+0000","last_change":"2024-09-19T14:14:37.369783+0000","last_active":"2024-09-19T14:14:37.369856+0000","last_peered":"2024-09-19T14:14:37.369856+0000","last_clean":"2024-09-19T14:14:37.369856+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:14:37.369856+0000","last_undegraded":"2024-09-19T14:14:37.369856+0000","last_fullsized":"2024-09-19T14:14:37.369856+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.369664+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:53.882937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.095470+0000","last_change":"2024-09-19T14:14:26.095470+0000","last_active":"2024-09-19T14:14:26.095470+0000","last_peered":"2024-09-19T14:14:26.095470+0000","last_clean":"2024-09-19T14:14:26.095470+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:14:26.095470+0000","last_undegraded":"2024-09-19T14:14:26.095470+0000","last_fullsized":"2024-09-19T14:14:26.095470+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'185","last_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_deep_scrub":"260'185","last_deep_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.095355+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:16.399362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":22529,"num_write":874,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.665020+0000","last_change":"2024-09-19T14:14:47.664954+0000","last_active":"2024-09-19T14:14:47.665020+0000","last_peered":"2024-09-19T14:14:47.665020+0000","last_clean":"2024-09-19T14:14:47.665020+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:14:47.665020+0000","last_undegraded":"2024-09-19T14:14:47.665020+0000","last_fullsized":"2024-09-19T14:14:47.665020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.664850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.664850+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.664850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:57.538937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'119","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.240368+0000","last_change":"2024-09-19T14:14:50.240296+0000","last_active":"2024-09-19T14:14:50.240368+0000","last_peered":"2024-09-19T14:14:50.240368+0000","last_clean":"2024-09-19T14:14:50.240368+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:14:50.240368+0000","last_undegraded":"2024-09-19T14:14:50.240368+0000","last_fullsized":"2024-09-19T14:14:50.240368+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-09-19T14:14:50.240208+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-09-19T14:14:50.240208+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.240208+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:02.074101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":261,"num_write":92,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'796","reported_seq":2175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.064370+0000","last_change":"2024-09-19T14:14:58.064370+0000","last_active":"2024-09-19T14:14:58.064370+0000","last_peered":"2024-09-19T14:14:58.064370+0000","last_clean":"2024-09-19T14:14:58.064370+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:14:58.064370+0000","last_undegraded":"2024-09-19T14:14:58.064370+0000","last_fullsized":"2024-09-19T14:14:58.064370+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'796","last_scrub_stamp":"2024-09-19T14:14:58.064253+0000","last_deep_scrub":"260'796","last_deep_scrub_stamp":"2024-09-19T14:14:58.064253+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.064253+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:36.368112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'452","reported_seq":2033,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.750257+0000","last_change":"2024-09-19T14:14:38.750189+0000","last_active":"2024-09-19T14:14:38.750257+0000","last_peered":"2024-09-19T14:14:38.750257+0000","last_clean":"2024-09-19T14:14:38.750257+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:14:38.750257+0000","last_undegraded":"2024-09-19T14:14:38.750257+0000","last_fullsized":"2024-09-19T14:14:38.750257+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'452","last_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_deep_scrub":"260'452","last_deep_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.750102+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:49.925244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'243","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.150348+0000","last_change":"2024-09-19T14:14:28.150279+0000","last_active":"2024-09-19T14:14:28.150348+0000","last_peered":"2024-09-19T14:14:28.150348+0000","last_clean":"2024-09-19T14:14:28.150348+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:14:28.150348+0000","last_undegraded":"2024-09-19T14:14:28.150348+0000","last_fullsized":"2024-09-19T14:14:28.150348+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'243","last_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_deep_scrub":"260'243","last_deep_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.150184+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:23.391140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":46832,"num_write":1033,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.263893+0000","last_change":"2024-09-19T14:14:43.263839+0000","last_active":"2024-09-19T14:14:43.263893+0000","last_peered":"2024-09-19T14:14:43.263893+0000","last_clean":"2024-09-19T14:14:43.263893+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:14:43.263893+0000","last_undegraded":"2024-09-19T14:14:43.263893+0000","last_fullsized":"2024-09-19T14:14:43.263893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.263742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.263742+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.263742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:03.888213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'198","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.740221+0000","last_change":"2024-09-19T14:14:50.740161+0000","last_active":"2024-09-19T14:14:50.740221+0000","last_peered":"2024-09-19T14:14:50.740221+0000","last_clean":"2024-09-19T14:14:50.740221+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:14:50.740221+0000","last_undegraded":"2024-09-19T14:14:50.740221+0000","last_fullsized":"2024-09-19T14:14:50.740221+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:50.740052+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:50.740052+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.740052+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:48.730209+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":253,"num_read_kb":317,"num_write":142,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.465022+0000","last_change":"2024-09-19T14:14:45.465022+0000","last_active":"2024-09-19T14:14:45.465022+0000","last_peered":"2024-09-19T14:14:45.465022+0000","last_clean":"2024-09-19T14:14:45.465022+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:14:45.465022+0000","last_undegraded":"2024-09-19T14:14:45.465022+0000","last_fullsized":"2024-09-19T14:14:45.465022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.464942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.464942+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.464942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:20.634984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'542","reported_seq":1364,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.614789+0000","last_change":"2024-09-19T14:14:55.614789+0000","last_active":"2024-09-19T14:14:55.614789+0000","last_peered":"2024-09-19T14:14:55.614789+0000","last_clean":"2024-09-19T14:14:55.614789+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:14:55.614789+0000","last_undegraded":"2024-09-19T14:14:55.614789+0000","last_fullsized":"2024-09-19T14:14:55.614789+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'542","last_scrub_stamp":"2024-09-19T14:14:55.614697+0000","last_deep_scrub":"260'542","last_deep_scrub_stamp":"2024-09-19T14:14:55.614697+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.614697+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:51.676971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2067,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.703369+0000","last_change":"2024-09-19T14:14:29.703272+0000","last_active":"2024-09-19T14:14:29.703369+0000","last_peered":"2024-09-19T14:14:29.703369+0000","last_clean":"2024-09-19T14:14:29.703369+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:14:29.703369+0000","last_undegraded":"2024-09-19T14:14:29.703369+0000","last_fullsized":"2024-09-19T14:14:29.703369+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'477","last_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_deep_scrub":"260'477","last_deep_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.703144+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:43.741727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'207","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.084574+0000","last_change":"2024-09-19T14:14:26.084488+0000","last_active":"2024-09-19T14:14:26.084574+0000","last_peered":"2024-09-19T14:14:26.084574+0000","last_clean":"2024-09-19T14:14:26.084574+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:14:26.084574+0000","last_undegraded":"2024-09-19T14:14:26.084574+0000","last_fullsized":"2024-09-19T14:14:26.084574+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'207","last_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_deep_scrub":"260'207","last_deep_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.084345+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:14.683841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":31454,"num_write":896,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"260'4","reported_seq":984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.082679+0000","last_change":"2024-09-19T14:14:34.082578+0000","last_active":"2024-09-19T14:14:34.082679+0000","last_peered":"2024-09-19T14:14:34.082679+0000","last_clean":"2024-09-19T14:14:34.082679+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:14:34.082679+0000","last_undegraded":"2024-09-19T14:14:34.082679+0000","last_fullsized":"2024-09-19T14:14:34.082679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.082477+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:29.861443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'129","reported_seq":695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.207940+0000","last_change":"2024-09-19T14:14:48.207940+0000","last_active":"2024-09-19T14:14:48.207940+0000","last_peered":"2024-09-19T14:14:48.207940+0000","last_clean":"2024-09-19T14:14:48.207940+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:14:48.207940+0000","last_undegraded":"2024-09-19T14:14:48.207940+0000","last_fullsized":"2024-09-19T14:14:48.207940+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:48.207855+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:48.207855+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.207855+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:56.958935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10667,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.018990+0000","last_change":"2024-09-19T14:14:56.018990+0000","last_active":"2024-09-19T14:14:56.018990+0000","last_peered":"2024-09-19T14:14:56.018990+0000","last_clean":"2024-09-19T14:14:56.018990+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:14:56.018990+0000","last_undegraded":"2024-09-19T14:14:56.018990+0000","last_fullsized":"2024-09-19T14:14:56.018990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:56.018901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:56.018901+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.018901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:32.913138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'175","reported_seq":668,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.292890+0000","last_change":"2024-09-19T14:14:47.292890+0000","last_active":"2024-09-19T14:14:47.292890+0000","last_peered":"2024-09-19T14:14:47.292890+0000","last_clean":"2024-09-19T14:14:47.292890+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:14:47.292890+0000","last_undegraded":"2024-09-19T14:14:47.292890+0000","last_fullsized":"2024-09-19T14:14:47.292890+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-09-19T14:14:47.292772+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-09-19T14:14:47.292772+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.292772+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:16.886494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'344","reported_seq":1852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.128389+0000","last_change":"2024-09-19T14:14:34.128335+0000","last_active":"2024-09-19T14:14:34.128389+0000","last_peered":"2024-09-19T14:14:34.128389+0000","last_clean":"2024-09-19T14:14:34.128389+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:14:34.128389+0000","last_undegraded":"2024-09-19T14:14:34.128389+0000","last_fullsized":"2024-09-19T14:14:34.128389+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'344","last_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_deep_scrub":"260'344","last_deep_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.128247+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:06.144660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'241","reported_seq":1073,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.069250+0000","last_change":"2024-09-19T14:14:32.069250+0000","last_active":"2024-09-19T14:14:32.069250+0000","last_peered":"2024-09-19T14:14:32.069250+0000","last_clean":"2024-09-19T14:14:32.069250+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:14:32.069250+0000","last_undegraded":"2024-09-19T14:14:32.069250+0000","last_fullsized":"2024-09-19T14:14:32.069250+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.069155+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:39.354526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":168929,"num_write":1052,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.087218+0000","last_change":"2024-09-19T14:14:36.087218+0000","last_active":"2024-09-19T14:14:36.087218+0000","last_peered":"2024-09-19T14:14:36.087218+0000","last_clean":"2024-09-19T14:14:36.087218+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:14:36.087218+0000","last_undegraded":"2024-09-19T14:14:36.087218+0000","last_fullsized":"2024-09-19T14:14:36.087218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.087119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:15.398847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'168","reported_seq":746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.150173+0000","last_change":"2024-09-19T14:14:46.150114+0000","last_active":"2024-09-19T14:14:46.150173+0000","last_peered":"2024-09-19T14:14:46.150173+0000","last_clean":"2024-09-19T14:14:46.150173+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:14:46.150173+0000","last_undegraded":"2024-09-19T14:14:46.150173+0000","last_fullsized":"2024-09-19T14:14:46.150173+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-09-19T14:14:46.150015+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-09-19T14:14:46.150015+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.150015+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:14.578493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":189,"num_read_kb":233,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'805","reported_seq":2368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.216679+0000","last_change":"2024-09-19T14:14:51.216602+0000","last_active":"2024-09-19T14:14:51.216679+0000","last_peered":"2024-09-19T14:14:51.216679+0000","last_clean":"2024-09-19T14:14:51.216679+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:14:51.216679+0000","last_undegraded":"2024-09-19T14:14:51.216679+0000","last_fullsized":"2024-09-19T14:14:51.216679+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-19T14:14:51.216522+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-19T14:14:51.216522+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.216522+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:17.663430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":628,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.188797+0000","last_change":"2024-09-19T14:14:56.188724+0000","last_active":"2024-09-19T14:14:56.188797+0000","last_peered":"2024-09-19T14:14:56.188797+0000","last_clean":"2024-09-19T14:14:56.188797+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:14:56.188797+0000","last_undegraded":"2024-09-19T14:14:56.188797+0000","last_fullsized":"2024-09-19T14:14:56.188797+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-09-19T14:14:56.188636+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-09-19T14:14:56.188636+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.188636+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:38.609689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'429","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.275001+0000","last_change":"2024-09-19T14:14:33.275001+0000","last_active":"2024-09-19T14:14:33.275001+0000","last_peered":"2024-09-19T14:14:33.275001+0000","last_clean":"2024-09-19T14:14:33.275001+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:14:33.275001+0000","last_undegraded":"2024-09-19T14:14:33.275001+0000","last_fullsized":"2024-09-19T14:14:33.275001+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'429","last_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_deep_scrub":"260'429","last_deep_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.274911+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:04.889403+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'206","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.809045+0000","last_change":"2024-09-19T14:14:26.809045+0000","last_active":"2024-09-19T14:14:26.809045+0000","last_peered":"2024-09-19T14:14:26.809045+0000","last_clean":"2024-09-19T14:14:26.809045+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:14:26.809045+0000","last_undegraded":"2024-09-19T14:14:26.809045+0000","last_fullsized":"2024-09-19T14:14:26.809045+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.808956+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:42.176771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":543,"num_read_kb":50665,"num_write":1025,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.119360+0000","last_change":"2024-09-19T14:14:35.119264+0000","last_active":"2024-09-19T14:14:35.119360+0000","last_peered":"2024-09-19T14:14:35.119360+0000","last_clean":"2024-09-19T14:14:35.119360+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:14:35.119360+0000","last_undegraded":"2024-09-19T14:14:35.119360+0000","last_fullsized":"2024-09-19T14:14:35.119360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.119157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:35:11.867701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'193","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.199619+0000","last_change":"2024-09-19T14:14:45.199552+0000","last_active":"2024-09-19T14:14:45.199619+0000","last_peered":"2024-09-19T14:14:45.199619+0000","last_clean":"2024-09-19T14:14:45.199619+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:14:45.199619+0000","last_undegraded":"2024-09-19T14:14:45.199619+0000","last_fullsized":"2024-09-19T14:14:45.199619+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:45.199463+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:45.199463+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.199463+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:27.643129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20793,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":404,"num_write":130,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.985454+0000","last_change":"2024-09-19T14:14:39.985385+0000","last_active":"2024-09-19T14:14:39.985454+0000","last_peered":"2024-09-19T14:14:39.985454+0000","last_clean":"2024-09-19T14:14:39.985454+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:14:39.985454+0000","last_undegraded":"2024-09-19T14:14:39.985454+0000","last_fullsized":"2024-09-19T14:14:39.985454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:14.242432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'171","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.418240+0000","last_change":"2024-09-19T14:14:50.418181+0000","last_active":"2024-09-19T14:14:50.418240+0000","last_peered":"2024-09-19T14:14:50.418240+0000","last_clean":"2024-09-19T14:14:50.418240+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:14:50.418240+0000","last_undegraded":"2024-09-19T14:14:50.418240+0000","last_fullsized":"2024-09-19T14:14:50.418240+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'171","last_scrub_stamp":"2024-09-19T14:14:50.418094+0000","last_deep_scrub":"260'171","last_deep_scrub_stamp":"2024-09-19T14:14:50.418094+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.418094+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:41.041552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1299","reported_seq":3081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.665018+0000","last_change":"2024-09-19T14:14:30.665018+0000","last_active":"2024-09-19T14:14:30.665018+0000","last_peered":"2024-09-19T14:14:30.665018+0000","last_clean":"2024-09-19T14:14:30.665018+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:14:30.665018+0000","last_undegraded":"2024-09-19T14:14:30.665018+0000","last_fullsized":"2024-09-19T14:14:30.665018+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1299","last_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_deep_scrub":"260'1299","last_deep_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.664940+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":1200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:04.360372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'194","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.386580+0000","last_change":"2024-09-19T14:14:27.386580+0000","last_active":"2024-09-19T14:14:27.386580+0000","last_peered":"2024-09-19T14:14:27.386580+0000","last_clean":"2024-09-19T14:14:27.386580+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:14:27.386580+0000","last_undegraded":"2024-09-19T14:14:27.386580+0000","last_fullsized":"2024-09-19T14:14:27.386580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.386475+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:11.179031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":2025,"num_write":905,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.084095+0000","last_change":"2024-09-19T14:14:37.084095+0000","last_active":"2024-09-19T14:14:37.084095+0000","last_peered":"2024-09-19T14:14:37.084095+0000","last_clean":"2024-09-19T14:14:37.084095+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:14:37.084095+0000","last_undegraded":"2024-09-19T14:14:37.084095+0000","last_fullsized":"2024-09-19T14:14:37.084095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.084002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:24.084032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'152","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.803330+0000","last_change":"2024-09-19T14:14:50.803330+0000","last_active":"2024-09-19T14:14:50.803330+0000","last_peered":"2024-09-19T14:14:50.803330+0000","last_clean":"2024-09-19T14:14:50.803330+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:14:50.803330+0000","last_undegraded":"2024-09-19T14:14:50.803330+0000","last_fullsized":"2024-09-19T14:14:50.803330+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:50.803244+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:50.803244+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.803244+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:55.132678+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":203,"num_read_kb":278,"num_write":160,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.204653+0000","last_change":"2024-09-19T14:14:52.204653+0000","last_active":"2024-09-19T14:14:52.204653+0000","last_peered":"2024-09-19T14:14:52.204653+0000","last_clean":"2024-09-19T14:14:52.204653+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:14:52.204653+0000","last_undegraded":"2024-09-19T14:14:52.204653+0000","last_fullsized":"2024-09-19T14:14:52.204653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:52.204570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:52.204570+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.204570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:02.183773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'121","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.055536+0000","last_change":"2024-09-19T14:14:59.055536+0000","last_active":"2024-09-19T14:14:59.055536+0000","last_peered":"2024-09-19T14:14:59.055536+0000","last_clean":"2024-09-19T14:14:59.055536+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:14:59.055536+0000","last_undegraded":"2024-09-19T14:14:59.055536+0000","last_fullsized":"2024-09-19T14:14:59.055536+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'121","last_scrub_stamp":"2024-09-19T14:14:59.055434+0000","last_deep_scrub":"260'121","last_deep_scrub_stamp":"2024-09-19T14:14:59.055434+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.055434+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:34.842983+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'471","reported_seq":2101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.635975+0000","last_change":"2024-09-19T14:14:31.635975+0000","last_active":"2024-09-19T14:14:31.635975+0000","last_peered":"2024-09-19T14:14:31.635975+0000","last_clean":"2024-09-19T14:14:31.635975+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:14:31.635975+0000","last_undegraded":"2024-09-19T14:14:31.635975+0000","last_fullsized":"2024-09-19T14:14:31.635975+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'471","last_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_deep_scrub":"260'471","last_deep_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.635871+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:59.000822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'218","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.108020+0000","last_change":"2024-09-19T14:14:28.107934+0000","last_active":"2024-09-19T14:14:28.108020+0000","last_peered":"2024-09-19T14:14:28.108020+0000","last_clean":"2024-09-19T14:14:28.108020+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:14:28.108020+0000","last_undegraded":"2024-09-19T14:14:28.108020+0000","last_fullsized":"2024-09-19T14:14:28.108020+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.107813+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:25.599144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":62927,"num_write":1024,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.387905+0000","last_change":"2024-09-19T14:14:38.387905+0000","last_active":"2024-09-19T14:14:38.387905+0000","last_peered":"2024-09-19T14:14:38.387905+0000","last_clean":"2024-09-19T14:14:38.387905+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:14:38.387905+0000","last_undegraded":"2024-09-19T14:14:38.387905+0000","last_fullsized":"2024-09-19T14:14:38.387905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.387808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:10.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'152","reported_seq":732,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.019987+0000","last_change":"2024-09-19T14:14:39.019987+0000","last_active":"2024-09-19T14:14:39.019987+0000","last_peered":"2024-09-19T14:14:39.019987+0000","last_clean":"2024-09-19T14:14:39.019987+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:14:39.019987+0000","last_undegraded":"2024-09-19T14:14:39.019987+0000","last_fullsized":"2024-09-19T14:14:39.019987+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.019863+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:04.873037+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":180,"num_read_kb":188,"num_write":94,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'736","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.008665+0000","last_change":"2024-09-19T14:14:41.008665+0000","last_active":"2024-09-19T14:14:41.008665+0000","last_peered":"2024-09-19T14:14:41.008665+0000","last_clean":"2024-09-19T14:14:41.008665+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:14:41.008665+0000","last_undegraded":"2024-09-19T14:14:41.008665+0000","last_fullsized":"2024-09-19T14:14:41.008665+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'736","last_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_deep_scrub":"260'736","last_deep_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.008532+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:52.770410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'123","reported_seq":642,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.413838+0000","last_change":"2024-09-19T14:14:48.413838+0000","last_active":"2024-09-19T14:14:48.413838+0000","last_peered":"2024-09-19T14:14:48.413838+0000","last_clean":"2024-09-19T14:14:48.413838+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:14:48.413838+0000","last_undegraded":"2024-09-19T14:14:48.413838+0000","last_fullsized":"2024-09-19T14:14:48.413838+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'123","last_scrub_stamp":"2024-09-19T14:14:48.413746+0000","last_deep_scrub":"260'123","last_deep_scrub_stamp":"2024-09-19T14:14:48.413746+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.413746+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.347352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1577","reported_seq":3205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.622853+0000","last_change":"2024-09-19T14:14:32.622853+0000","last_active":"2024-09-19T14:14:32.622853+0000","last_peered":"2024-09-19T14:14:32.622853+0000","last_clean":"2024-09-19T14:14:32.622853+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:14:32.622853+0000","last_undegraded":"2024-09-19T14:14:32.622853+0000","last_fullsized":"2024-09-19T14:14:32.622853+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1577","last_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_deep_scrub":"260'1577","last_deep_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.622730+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":1500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:37.492268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'202","reported_seq":828,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.599843+0000","last_change":"2024-09-19T14:14:24.599775+0000","last_active":"2024-09-19T14:14:24.599843+0000","last_peered":"2024-09-19T14:14:24.599843+0000","last_clean":"2024-09-19T14:14:24.599843+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:14:24.599843+0000","last_undegraded":"2024-09-19T14:14:24.599843+0000","last_fullsized":"2024-09-19T14:14:24.599843+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.599680+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.795340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":26305,"num_write":903,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"260'9","reported_seq":1934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.736639+0000","last_change":"2024-09-19T14:14:45.736639+0000","last_active":"2024-09-19T14:14:45.736639+0000","last_peered":"2024-09-19T14:14:45.736639+0000","last_clean":"2024-09-19T14:14:45.736639+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:14:45.736639+0000","last_undegraded":"2024-09-19T14:14:45.736639+0000","last_fullsized":"2024-09-19T14:14:45.736639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-19T14:14:45.736528+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-19T14:14:45.736528+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.736528+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:03.389967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1680,"num_read_kb":2149,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'80","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.214532+0000","last_change":"2024-09-19T14:14:49.214532+0000","last_active":"2024-09-19T14:14:49.214532+0000","last_peered":"2024-09-19T14:14:49.214532+0000","last_clean":"2024-09-19T14:14:49.214532+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:14:49.214532+0000","last_undegraded":"2024-09-19T14:14:49.214532+0000","last_fullsized":"2024-09-19T14:14:49.214532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'80","last_scrub_stamp":"2024-09-19T14:14:49.214444+0000","last_deep_scrub":"260'80","last_deep_scrub_stamp":"2024-09-19T14:14:49.214444+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.214444+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:00.195139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'779","reported_seq":4746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.272223+0000","last_change":"2024-09-19T14:14:43.272223+0000","last_active":"2024-09-19T14:14:43.272223+0000","last_peered":"2024-09-19T14:14:43.272223+0000","last_clean":"2024-09-19T14:14:43.272223+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:14:43.272223+0000","last_undegraded":"2024-09-19T14:14:43.272223+0000","last_fullsized":"2024-09-19T14:14:43.272223+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'779","last_scrub_stamp":"2024-09-19T14:14:43.272137+0000","last_deep_scrub":"260'779","last_deep_scrub_stamp":"2024-09-19T14:14:43.272137+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.272137+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:40.042664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'129","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.801351+0000","last_change":"2024-09-19T14:14:56.801351+0000","last_active":"2024-09-19T14:14:56.801351+0000","last_peered":"2024-09-19T14:14:56.801351+0000","last_clean":"2024-09-19T14:14:56.801351+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:14:56.801351+0000","last_undegraded":"2024-09-19T14:14:56.801351+0000","last_fullsized":"2024-09-19T14:14:56.801351+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:56.801262+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:56.801262+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.801262+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:57.529161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'913","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.399491+0000","last_change":"2024-09-19T14:14:34.399491+0000","last_active":"2024-09-19T14:14:34.399491+0000","last_peered":"2024-09-19T14:14:34.399491+0000","last_clean":"2024-09-19T14:14:34.399491+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:14:34.399491+0000","last_undegraded":"2024-09-19T14:14:34.399491+0000","last_fullsized":"2024-09-19T14:14:34.399491+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.399381+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:04.254432+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'181","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.387161+0000","last_change":"2024-09-19T14:14:24.387106+0000","last_active":"2024-09-19T14:14:24.387161+0000","last_peered":"2024-09-19T14:14:24.387161+0000","last_clean":"2024-09-19T14:14:24.387161+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:14:24.387161+0000","last_undegraded":"2024-09-19T14:14:24.387161+0000","last_fullsized":"2024-09-19T14:14:24.387161+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'181","last_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_deep_scrub":"260'181","last_deep_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.387035+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:58.069276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.789131+0000","last_change":"2024-09-19T14:14:45.789131+0000","last_active":"2024-09-19T14:14:45.789131+0000","last_peered":"2024-09-19T14:14:45.789131+0000","last_clean":"2024-09-19T14:14:45.789131+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:14:45.789131+0000","last_undegraded":"2024-09-19T14:14:45.789131+0000","last_fullsized":"2024-09-19T14:14:45.789131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.789031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.789031+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.789031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:15.046433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'204","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.703399+0000","last_change":"2024-09-19T14:14:51.703399+0000","last_active":"2024-09-19T14:14:51.703399+0000","last_peered":"2024-09-19T14:14:51.703399+0000","last_clean":"2024-09-19T14:14:51.703399+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:14:51.703399+0000","last_undegraded":"2024-09-19T14:14:51.703399+0000","last_fullsized":"2024-09-19T14:14:51.703399+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'204","last_scrub_stamp":"2024-09-19T14:14:51.703300+0000","last_deep_scrub":"260'204","last_deep_scrub_stamp":"2024-09-19T14:14:51.703300+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.703300+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:45.051594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":866,"num_read_kb":913,"num_write":1382,"num_write_kb":1260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516348,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.214279+0000","last_change":"2024-09-19T14:14:39.214279+0000","last_active":"2024-09-19T14:14:39.214279+0000","last_peered":"2024-09-19T14:14:39.214279+0000","last_clean":"2024-09-19T14:14:39.214279+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:14:39.214279+0000","last_undegraded":"2024-09-19T14:14:39.214279+0000","last_fullsized":"2024-09-19T14:14:39.214279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.214191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:32.459392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.449989+0000","last_change":"2024-09-19T14:14:49.449989+0000","last_active":"2024-09-19T14:14:49.449989+0000","last_peered":"2024-09-19T14:14:49.449989+0000","last_clean":"2024-09-19T14:14:49.449989+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:14:49.449989+0000","last_undegraded":"2024-09-19T14:14:49.449989+0000","last_fullsized":"2024-09-19T14:14:49.449989+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-09-19T14:14:49.449885+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-09-19T14:14:49.449885+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.449885+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:16.393490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.142395+0000","last_change":"2024-09-19T14:14:33.142395+0000","last_active":"2024-09-19T14:14:33.142395+0000","last_peered":"2024-09-19T14:14:33.142395+0000","last_clean":"2024-09-19T14:14:33.142395+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:14:33.142395+0000","last_undegraded":"2024-09-19T14:14:33.142395+0000","last_fullsized":"2024-09-19T14:14:33.142395+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.142301+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:53:23.111973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.090762+0000","last_change":"2024-09-19T14:14:25.090762+0000","last_active":"2024-09-19T14:14:25.090762+0000","last_peered":"2024-09-19T14:14:25.090762+0000","last_clean":"2024-09-19T14:14:25.090762+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:14:25.090762+0000","last_undegraded":"2024-09-19T14:14:25.090762+0000","last_fullsized":"2024-09-19T14:14:25.090762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.090660+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:42.554407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":518,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.846077+0000","last_change":"2024-09-19T14:14:24.846077+0000","last_active":"2024-09-19T14:14:24.846077+0000","last_peered":"2024-09-19T14:14:24.846077+0000","last_clean":"2024-09-19T14:14:24.846077+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:14:24.846077+0000","last_undegraded":"2024-09-19T14:14:24.846077+0000","last_fullsized":"2024-09-19T14:14:24.846077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.845991+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:12.158112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'234","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.365639+0000","last_change":"2024-09-19T14:14:23.365639+0000","last_active":"2024-09-19T14:14:23.365639+0000","last_peered":"2024-09-19T14:14:23.365639+0000","last_clean":"2024-09-19T14:14:23.365639+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:14:23.365639+0000","last_undegraded":"2024-09-19T14:14:23.365639+0000","last_fullsized":"2024-09-19T14:14:23.365639+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'234","last_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_deep_scrub":"260'234","last_deep_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.365567+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:40:16.918810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":4147,"num_write":1074,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.276710+0000","last_change":"2024-09-19T14:14:42.276710+0000","last_active":"2024-09-19T14:14:42.276710+0000","last_peered":"2024-09-19T14:14:42.276710+0000","last_clean":"2024-09-19T14:14:42.276710+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:14:42.276710+0000","last_undegraded":"2024-09-19T14:14:42.276710+0000","last_fullsized":"2024-09-19T14:14:42.276710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.276595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.276595+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.276595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:58:08.758004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'341","reported_seq":1036,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.731198+0000","last_change":"2024-09-19T14:14:49.731106+0000","last_active":"2024-09-19T14:14:49.731198+0000","last_peered":"2024-09-19T14:14:49.731198+0000","last_clean":"2024-09-19T14:14:49.731198+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:14:49.731198+0000","last_undegraded":"2024-09-19T14:14:49.731198+0000","last_fullsized":"2024-09-19T14:14:49.731198+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-19T14:14:49.730990+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-19T14:14:49.730990+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.730990+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:57.630554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":939,"num_write":532,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107642,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.185727+0000","last_change":"2024-09-19T14:14:50.185647+0000","last_active":"2024-09-19T14:14:50.185727+0000","last_peered":"2024-09-19T14:14:50.185727+0000","last_clean":"2024-09-19T14:14:50.185727+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:14:50.185727+0000","last_undegraded":"2024-09-19T14:14:50.185727+0000","last_fullsized":"2024-09-19T14:14:50.185727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:50.185520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:50.185520+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.185520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:59.119852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'191","reported_seq":890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.336293+0000","last_change":"2024-09-19T14:14:48.336239+0000","last_active":"2024-09-19T14:14:48.336293+0000","last_peered":"2024-09-19T14:14:48.336293+0000","last_clean":"2024-09-19T14:14:48.336293+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:14:48.336293+0000","last_undegraded":"2024-09-19T14:14:48.336293+0000","last_fullsized":"2024-09-19T14:14:48.336293+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-09-19T14:14:48.336158+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-09-19T14:14:48.336158+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.336158+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:21.500227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'976","reported_seq":2588,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.255176+0000","last_change":"2024-09-19T14:14:34.255104+0000","last_active":"2024-09-19T14:14:34.255176+0000","last_peered":"2024-09-19T14:14:34.255176+0000","last_clean":"2024-09-19T14:14:34.255176+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:14:34.255176+0000","last_undegraded":"2024-09-19T14:14:34.255176+0000","last_fullsized":"2024-09-19T14:14:34.255176+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'976","last_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_deep_scrub":"260'976","last_deep_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.255007+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:17.054045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.122612+0000","last_change":"2024-09-19T14:14:27.122612+0000","last_active":"2024-09-19T14:14:27.122612+0000","last_peered":"2024-09-19T14:14:27.122612+0000","last_clean":"2024-09-19T14:14:27.122612+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:14:27.122612+0000","last_undegraded":"2024-09-19T14:14:27.122612+0000","last_fullsized":"2024-09-19T14:14:27.122612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.122523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:34.702946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'215","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.355899+0000","last_change":"2024-09-19T14:14:23.355899+0000","last_active":"2024-09-19T14:14:23.355899+0000","last_peered":"2024-09-19T14:14:23.355899+0000","last_clean":"2024-09-19T14:14:23.355899+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:14:23.355899+0000","last_undegraded":"2024-09-19T14:14:23.355899+0000","last_fullsized":"2024-09-19T14:14:23.355899+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.355816+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:31.085121+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":42960,"num_write":983,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.727911+0000","last_change":"2024-09-19T14:14:44.727854+0000","last_active":"2024-09-19T14:14:44.727911+0000","last_peered":"2024-09-19T14:14:44.727911+0000","last_clean":"2024-09-19T14:14:44.727911+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:14:44.727911+0000","last_undegraded":"2024-09-19T14:14:44.727911+0000","last_fullsized":"2024-09-19T14:14:44.727911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.727726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.727726+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.727726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:09.947880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'830","reported_seq":2218,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.397591+0000","last_change":"2024-09-19T14:14:43.397591+0000","last_active":"2024-09-19T14:14:43.397591+0000","last_peered":"2024-09-19T14:14:43.397591+0000","last_clean":"2024-09-19T14:14:43.397591+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:14:43.397591+0000","last_undegraded":"2024-09-19T14:14:43.397591+0000","last_fullsized":"2024-09-19T14:14:43.397591+0000","mapping_epoch":28,"log_start":"260'800","ondisk_log_start":"260'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'830","last_scrub_stamp":"2024-09-19T14:14:43.397471+0000","last_deep_scrub":"260'830","last_deep_scrub_stamp":"2024-09-19T14:14:43.397471+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.397471+0000","objects_scrubbed":11,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:58:39.866036+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1143,"num_read_kb":1321,"num_write":246,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.220809+0000","last_change":"2024-09-19T14:14:52.220809+0000","last_active":"2024-09-19T14:14:52.220809+0000","last_peered":"2024-09-19T14:14:52.220809+0000","last_clean":"2024-09-19T14:14:52.220809+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:14:52.220809+0000","last_undegraded":"2024-09-19T14:14:52.220809+0000","last_fullsized":"2024-09-19T14:14:52.220809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:52.220717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:52.220717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.220717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:57.489976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'129","reported_seq":637,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.427909+0000","last_change":"2024-09-19T14:14:52.427846+0000","last_active":"2024-09-19T14:14:52.427909+0000","last_peered":"2024-09-19T14:14:52.427909+0000","last_clean":"2024-09-19T14:14:52.427909+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:14:52.427909+0000","last_undegraded":"2024-09-19T14:14:52.427909+0000","last_fullsized":"2024-09-19T14:14:52.427909+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:52.427757+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:52.427757+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.427757+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:50.156910+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'772","reported_seq":2376,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.370974+0000","last_change":"2024-09-19T14:14:32.370868+0000","last_active":"2024-09-19T14:14:32.370974+0000","last_peered":"2024-09-19T14:14:32.370974+0000","last_clean":"2024-09-19T14:14:32.370974+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:14:32.370974+0000","last_undegraded":"2024-09-19T14:14:32.370974+0000","last_fullsized":"2024-09-19T14:14:32.370974+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'772","last_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_deep_scrub":"260'772","last_deep_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.370749+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.543791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.186455+0000","last_change":"2024-09-19T14:14:24.186455+0000","last_active":"2024-09-19T14:14:24.186455+0000","last_peered":"2024-09-19T14:14:24.186455+0000","last_clean":"2024-09-19T14:14:24.186455+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:14:24.186455+0000","last_undegraded":"2024-09-19T14:14:24.186455+0000","last_fullsized":"2024-09-19T14:14:24.186455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.186357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:33.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'184","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.246955+0000","last_change":"2024-09-19T14:14:24.246955+0000","last_active":"2024-09-19T14:14:24.246955+0000","last_peered":"2024-09-19T14:14:24.246955+0000","last_clean":"2024-09-19T14:14:24.246955+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:14:24.246955+0000","last_undegraded":"2024-09-19T14:14:24.246955+0000","last_fullsized":"2024-09-19T14:14:24.246955+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.246846+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:34.062372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":6136,"num_write":878,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.120781+0000","last_change":"2024-09-19T14:14:33.120713+0000","last_active":"2024-09-19T14:14:33.120781+0000","last_peered":"2024-09-19T14:14:33.120781+0000","last_clean":"2024-09-19T14:14:33.120781+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:14:33.120781+0000","last_undegraded":"2024-09-19T14:14:33.120781+0000","last_fullsized":"2024-09-19T14:14:33.120781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.120629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.158421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'210","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.171630+0000","last_change":"2024-09-19T14:14:48.171630+0000","last_active":"2024-09-19T14:14:48.171630+0000","last_peered":"2024-09-19T14:14:48.171630+0000","last_clean":"2024-09-19T14:14:48.171630+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:14:48.171630+0000","last_undegraded":"2024-09-19T14:14:48.171630+0000","last_fullsized":"2024-09-19T14:14:48.171630+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:48.171510+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:48.171510+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.171510+0000","objects_scrubbed":9,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:18.235764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.218523+0000","last_change":"2024-09-19T14:14:49.218523+0000","last_active":"2024-09-19T14:14:49.218523+0000","last_peered":"2024-09-19T14:14:49.218523+0000","last_clean":"2024-09-19T14:14:49.218523+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:14:49.218523+0000","last_undegraded":"2024-09-19T14:14:49.218523+0000","last_fullsized":"2024-09-19T14:14:49.218523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:49.218432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:49.218432+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.218432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:13.814133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'244","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.032600+0000","last_change":"2024-09-19T14:15:00.032600+0000","last_active":"2024-09-19T14:15:00.032600+0000","last_peered":"2024-09-19T14:15:00.032600+0000","last_clean":"2024-09-19T14:15:00.032600+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:15:00.032600+0000","last_undegraded":"2024-09-19T14:15:00.032600+0000","last_fullsized":"2024-09-19T14:15:00.032600+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:15:00.032503+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:15:00.032503+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.032503+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:07.050608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'352","reported_seq":1880,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.371001+0000","last_change":"2024-09-19T14:14:30.371001+0000","last_active":"2024-09-19T14:14:30.371001+0000","last_peered":"2024-09-19T14:14:30.371001+0000","last_clean":"2024-09-19T14:14:30.371001+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:14:30.371001+0000","last_undegraded":"2024-09-19T14:14:30.371001+0000","last_fullsized":"2024-09-19T14:14:30.371001+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.370905+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:22.516405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.799062+0000","last_change":"2024-09-19T14:14:23.799062+0000","last_active":"2024-09-19T14:14:23.799062+0000","last_peered":"2024-09-19T14:14:23.799062+0000","last_clean":"2024-09-19T14:14:23.799062+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:14:23.799062+0000","last_undegraded":"2024-09-19T14:14:23.799062+0000","last_fullsized":"2024-09-19T14:14:23.799062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.798956+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:54.613030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'228","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.574659+0000","last_change":"2024-09-19T14:14:23.574659+0000","last_active":"2024-09-19T14:14:23.574659+0000","last_peered":"2024-09-19T14:14:23.574659+0000","last_clean":"2024-09-19T14:14:23.574659+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:14:23.574659+0000","last_undegraded":"2024-09-19T14:14:23.574659+0000","last_fullsized":"2024-09-19T14:14:23.574659+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'228","last_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_deep_scrub":"260'228","last_deep_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.574564+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:46.444524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":5696,"num_write":1072,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.179926+0000","last_change":"2024-09-19T14:14:43.179926+0000","last_active":"2024-09-19T14:14:43.179926+0000","last_peered":"2024-09-19T14:14:43.179926+0000","last_clean":"2024-09-19T14:14:43.179926+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:14:43.179926+0000","last_undegraded":"2024-09-19T14:14:43.179926+0000","last_fullsized":"2024-09-19T14:14:43.179926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.179836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.179836+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.179836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:12.637353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'113","reported_seq":648,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.244263+0000","last_change":"2024-09-19T14:14:47.244204+0000","last_active":"2024-09-19T14:14:47.244263+0000","last_peered":"2024-09-19T14:14:47.244263+0000","last_clean":"2024-09-19T14:14:47.244263+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:14:47.244263+0000","last_undegraded":"2024-09-19T14:14:47.244263+0000","last_fullsized":"2024-09-19T14:14:47.244263+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'113","last_scrub_stamp":"2024-09-19T14:14:47.244112+0000","last_deep_scrub":"260'113","last_deep_scrub_stamp":"2024-09-19T14:14:47.244112+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.244112+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:45.237429+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.225037+0000","last_change":"2024-09-19T14:14:41.224975+0000","last_active":"2024-09-19T14:14:41.225037+0000","last_peered":"2024-09-19T14:14:41.225037+0000","last_clean":"2024-09-19T14:14:41.225037+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:14:41.225037+0000","last_undegraded":"2024-09-19T14:14:41.225037+0000","last_fullsized":"2024-09-19T14:14:41.225037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.224899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:53.063511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'107","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.579290+0000","last_change":"2024-09-19T14:14:56.579227+0000","last_active":"2024-09-19T14:14:56.579290+0000","last_peered":"2024-09-19T14:14:56.579290+0000","last_clean":"2024-09-19T14:14:56.579290+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:14:56.579290+0000","last_undegraded":"2024-09-19T14:14:56.579290+0000","last_fullsized":"2024-09-19T14:14:56.579290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'107","last_scrub_stamp":"2024-09-19T14:14:56.579142+0000","last_deep_scrub":"260'107","last_deep_scrub_stamp":"2024-09-19T14:14:56.579142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.579142+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:09.076208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'601","reported_seq":2326,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.333499+0000","last_change":"2024-09-19T14:14:31.333499+0000","last_active":"2024-09-19T14:14:31.333499+0000","last_peered":"2024-09-19T14:14:31.333499+0000","last_clean":"2024-09-19T14:14:31.333499+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:14:31.333499+0000","last_undegraded":"2024-09-19T14:14:31.333499+0000","last_fullsized":"2024-09-19T14:14:31.333499+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'601","last_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_deep_scrub":"260'601","last_deep_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.333408+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:33.805427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'206","reported_seq":853,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.807429+0000","last_change":"2024-09-19T14:14:25.807429+0000","last_active":"2024-09-19T14:14:25.807429+0000","last_peered":"2024-09-19T14:14:25.807429+0000","last_clean":"2024-09-19T14:14:25.807429+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:14:25.807429+0000","last_undegraded":"2024-09-19T14:14:25.807429+0000","last_fullsized":"2024-09-19T14:14:25.807429+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.807326+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:54.324076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":24801,"num_write":998,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.271878+0000","last_change":"2024-09-19T14:14:22.271878+0000","last_active":"2024-09-19T14:14:22.271878+0000","last_peered":"2024-09-19T14:14:22.271878+0000","last_clean":"2024-09-19T14:14:22.271878+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:14:22.271878+0000","last_undegraded":"2024-09-19T14:14:22.271878+0000","last_fullsized":"2024-09-19T14:14:22.271878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.271798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:15.460044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.211839+0000","last_change":"2024-09-19T14:14:41.211839+0000","last_active":"2024-09-19T14:14:41.211839+0000","last_peered":"2024-09-19T14:14:41.211839+0000","last_clean":"2024-09-19T14:14:41.211839+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:14:41.211839+0000","last_undegraded":"2024-09-19T14:14:41.211839+0000","last_fullsized":"2024-09-19T14:14:41.211839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.211717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:50.720540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'272","reported_seq":926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.229777+0000","last_change":"2024-09-19T14:14:44.229777+0000","last_active":"2024-09-19T14:14:44.229777+0000","last_peered":"2024-09-19T14:14:44.229777+0000","last_clean":"2024-09-19T14:14:44.229777+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:14:44.229777+0000","last_undegraded":"2024-09-19T14:14:44.229777+0000","last_fullsized":"2024-09-19T14:14:44.229777+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'272","last_scrub_stamp":"2024-09-19T14:14:44.229683+0000","last_deep_scrub":"260'272","last_deep_scrub_stamp":"2024-09-19T14:14:44.229683+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.229683+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:29.728099+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12301,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":381,"num_read_kb":528,"num_write":240,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.787040+0000","last_change":"2024-09-19T14:14:53.787040+0000","last_active":"2024-09-19T14:14:53.787040+0000","last_peered":"2024-09-19T14:14:53.787040+0000","last_clean":"2024-09-19T14:14:53.787040+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:14:53.787040+0000","last_undegraded":"2024-09-19T14:14:53.787040+0000","last_fullsized":"2024-09-19T14:14:53.787040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.786945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.786945+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.786945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:21.722947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'130","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.233247+0000","last_change":"2024-09-19T14:15:00.233247+0000","last_active":"2024-09-19T14:15:00.233247+0000","last_peered":"2024-09-19T14:15:00.233247+0000","last_clean":"2024-09-19T14:15:00.233247+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:15:00.233247+0000","last_undegraded":"2024-09-19T14:15:00.233247+0000","last_fullsized":"2024-09-19T14:15:00.233247+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-09-19T14:15:00.233162+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-09-19T14:15:00.233162+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.233162+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:07.109767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1173","reported_seq":2702,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.253870+0000","last_change":"2024-09-19T14:14:31.253870+0000","last_active":"2024-09-19T14:14:31.253870+0000","last_peered":"2024-09-19T14:14:31.253870+0000","last_clean":"2024-09-19T14:14:31.253870+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:14:31.253870+0000","last_undegraded":"2024-09-19T14:14:31.253870+0000","last_fullsized":"2024-09-19T14:14:31.253870+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1173","last_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_deep_scrub":"260'1173","last_deep_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.253789+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":1100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:19.605470+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'241","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.269778+0000","last_change":"2024-09-19T14:14:25.269778+0000","last_active":"2024-09-19T14:14:25.269778+0000","last_peered":"2024-09-19T14:14:25.269778+0000","last_clean":"2024-09-19T14:14:25.269778+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:14:25.269778+0000","last_undegraded":"2024-09-19T14:14:25.269778+0000","last_fullsized":"2024-09-19T14:14:25.269778+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.269708+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:59.804876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":611,"num_read_kb":113129,"num_write":1047,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.132997+0000","last_change":"2024-09-19T14:14:30.132997+0000","last_active":"2024-09-19T14:14:30.132997+0000","last_peered":"2024-09-19T14:14:30.132997+0000","last_clean":"2024-09-19T14:14:30.132997+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:14:30.132997+0000","last_undegraded":"2024-09-19T14:14:30.132997+0000","last_fullsized":"2024-09-19T14:14:30.132997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.132909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:09:35.776106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.210314+0000","last_change":"2024-09-19T14:14:38.210314+0000","last_active":"2024-09-19T14:14:38.210314+0000","last_peered":"2024-09-19T14:14:38.210314+0000","last_clean":"2024-09-19T14:14:38.210314+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:14:38.210314+0000","last_undegraded":"2024-09-19T14:14:38.210314+0000","last_fullsized":"2024-09-19T14:14:38.210314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.210233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:40.582675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'153","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.431223+0000","last_change":"2024-09-19T14:14:42.431223+0000","last_active":"2024-09-19T14:14:42.431223+0000","last_peered":"2024-09-19T14:14:42.431223+0000","last_clean":"2024-09-19T14:14:42.431223+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:14:42.431223+0000","last_undegraded":"2024-09-19T14:14:42.431223+0000","last_fullsized":"2024-09-19T14:14:42.431223+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-09-19T14:14:42.431130+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-09-19T14:14:42.431130+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.431130+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:19.187356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'789","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.655888+0000","last_change":"2024-09-19T14:14:53.655888+0000","last_active":"2024-09-19T14:14:53.655888+0000","last_peered":"2024-09-19T14:14:53.655888+0000","last_clean":"2024-09-19T14:14:53.655888+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:14:53.655888+0000","last_undegraded":"2024-09-19T14:14:53.655888+0000","last_fullsized":"2024-09-19T14:14:53.655888+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-19T14:14:53.655783+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-19T14:14:53.655783+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.655783+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:57.878586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'141","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.000825+0000","last_change":"2024-09-19T14:15:01.000825+0000","last_active":"2024-09-19T14:15:01.000825+0000","last_peered":"2024-09-19T14:15:01.000825+0000","last_clean":"2024-09-19T14:15:01.000825+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:15:01.000825+0000","last_undegraded":"2024-09-19T14:15:01.000825+0000","last_fullsized":"2024-09-19T14:15:01.000825+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-09-19T14:15:01.000739+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-09-19T14:15:01.000739+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.000739+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:43.347659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.313938+0000","last_change":"2024-09-19T14:14:34.313938+0000","last_active":"2024-09-19T14:14:34.313938+0000","last_peered":"2024-09-19T14:14:34.313938+0000","last_clean":"2024-09-19T14:14:34.313938+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:14:34.313938+0000","last_undegraded":"2024-09-19T14:14:34.313938+0000","last_fullsized":"2024-09-19T14:14:34.313938+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'349","last_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_deep_scrub":"260'349","last_deep_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.313853+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:03.281146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'210","reported_seq":836,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.389595+0000","last_change":"2024-09-19T14:14:25.389550+0000","last_active":"2024-09-19T14:14:25.389595+0000","last_peered":"2024-09-19T14:14:25.389595+0000","last_clean":"2024-09-19T14:14:25.389595+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:14:25.389595+0000","last_undegraded":"2024-09-19T14:14:25.389595+0000","last_fullsized":"2024-09-19T14:14:25.389595+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.389494+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:57.196831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":8334,"num_write":1024,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.254812+0000","last_change":"2024-09-19T14:14:23.254724+0000","last_active":"2024-09-19T14:14:23.254812+0000","last_peered":"2024-09-19T14:14:23.254812+0000","last_clean":"2024-09-19T14:14:23.254812+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:14:23.254812+0000","last_undegraded":"2024-09-19T14:14:23.254812+0000","last_fullsized":"2024-09-19T14:14:23.254812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.254647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:57.792058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.814330+0000","last_change":"2024-09-19T14:14:44.814330+0000","last_active":"2024-09-19T14:14:44.814330+0000","last_peered":"2024-09-19T14:14:44.814330+0000","last_clean":"2024-09-19T14:14:44.814330+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:14:44.814330+0000","last_undegraded":"2024-09-19T14:14:44.814330+0000","last_fullsized":"2024-09-19T14:14:44.814330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.814245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.814245+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.814245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:05.603181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":624,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.799856+0000","last_change":"2024-09-19T14:14:47.799856+0000","last_active":"2024-09-19T14:14:47.799856+0000","last_peered":"2024-09-19T14:14:47.799856+0000","last_clean":"2024-09-19T14:14:47.799856+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:14:47.799856+0000","last_undegraded":"2024-09-19T14:14:47.799856+0000","last_fullsized":"2024-09-19T14:14:47.799856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'92","last_scrub_stamp":"2024-09-19T14:14:47.799733+0000","last_deep_scrub":"260'92","last_deep_scrub_stamp":"2024-09-19T14:14:47.799733+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.799733+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:15.665895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'798","reported_seq":2387,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.067387+0000","last_change":"2024-09-19T14:14:55.067387+0000","last_active":"2024-09-19T14:14:55.067387+0000","last_peered":"2024-09-19T14:14:55.067387+0000","last_clean":"2024-09-19T14:14:55.067387+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:14:55.067387+0000","last_undegraded":"2024-09-19T14:14:55.067387+0000","last_fullsized":"2024-09-19T14:14:55.067387+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:55.067292+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:55.067292+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.067292+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:51.523534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'295","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.199741+0000","last_change":"2024-09-19T14:14:57.199741+0000","last_active":"2024-09-19T14:14:57.199741+0000","last_peered":"2024-09-19T14:14:57.199741+0000","last_clean":"2024-09-19T14:14:57.199741+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:14:57.199741+0000","last_undegraded":"2024-09-19T14:14:57.199741+0000","last_fullsized":"2024-09-19T14:14:57.199741+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'295","last_scrub_stamp":"2024-09-19T14:14:57.199654+0000","last_deep_scrub":"260'295","last_deep_scrub_stamp":"2024-09-19T14:14:57.199654+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.199654+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:54:15.911982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'725","reported_seq":2605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.675073+0000","last_change":"2024-09-19T14:14:28.675073+0000","last_active":"2024-09-19T14:14:28.675073+0000","last_peered":"2024-09-19T14:14:28.675073+0000","last_clean":"2024-09-19T14:14:28.675073+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:14:28.675073+0000","last_undegraded":"2024-09-19T14:14:28.675073+0000","last_fullsized":"2024-09-19T14:14:28.675073+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'725","last_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_deep_scrub":"260'725","last_deep_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.674989+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.706637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3080,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'226","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.315006+0000","last_change":"2024-09-19T14:14:22.314956+0000","last_active":"2024-09-19T14:14:22.315006+0000","last_peered":"2024-09-19T14:14:22.315006+0000","last_clean":"2024-09-19T14:14:22.315006+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:14:22.315006+0000","last_undegraded":"2024-09-19T14:14:22.315006+0000","last_fullsized":"2024-09-19T14:14:22.315006+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.314854+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:16.077018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":41557,"num_write":1060,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.131236+0000","last_change":"2024-09-19T14:14:25.131186+0000","last_active":"2024-09-19T14:14:25.131236+0000","last_peered":"2024-09-19T14:14:25.131236+0000","last_clean":"2024-09-19T14:14:25.131236+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:14:25.131236+0000","last_undegraded":"2024-09-19T14:14:25.131236+0000","last_fullsized":"2024-09-19T14:14:25.131236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.131106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:59.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.280601+0000","last_change":"2024-09-19T14:14:43.280601+0000","last_active":"2024-09-19T14:14:43.280601+0000","last_peered":"2024-09-19T14:14:43.280601+0000","last_clean":"2024-09-19T14:14:43.280601+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:14:43.280601+0000","last_undegraded":"2024-09-19T14:14:43.280601+0000","last_fullsized":"2024-09-19T14:14:43.280601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.280506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.280506+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.280506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:33.983298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'309","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.193778+0000","last_change":"2024-09-19T14:14:47.193778+0000","last_active":"2024-09-19T14:14:47.193778+0000","last_peered":"2024-09-19T14:14:47.193778+0000","last_clean":"2024-09-19T14:14:47.193778+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:14:47.193778+0000","last_undegraded":"2024-09-19T14:14:47.193778+0000","last_fullsized":"2024-09-19T14:14:47.193778+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'309","last_scrub_stamp":"2024-09-19T14:14:47.193662+0000","last_deep_scrub":"260'309","last_deep_scrub_stamp":"2024-09-19T14:14:47.193662+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.193662+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:33.116186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16920,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":432,"num_read_kb":558,"num_write":210,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.075533+0000","last_change":"2024-09-19T14:14:54.075533+0000","last_active":"2024-09-19T14:14:54.075533+0000","last_peered":"2024-09-19T14:14:54.075533+0000","last_clean":"2024-09-19T14:14:54.075533+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:14:54.075533+0000","last_undegraded":"2024-09-19T14:14:54.075533+0000","last_fullsized":"2024-09-19T14:14:54.075533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.075442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.075442+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.075442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:42.751459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'163","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.603741+0000","last_change":"2024-09-19T14:14:57.603741+0000","last_active":"2024-09-19T14:14:57.603741+0000","last_peered":"2024-09-19T14:14:57.603741+0000","last_clean":"2024-09-19T14:14:57.603741+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:14:57.603741+0000","last_undegraded":"2024-09-19T14:14:57.603741+0000","last_fullsized":"2024-09-19T14:14:57.603741+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-09-19T14:14:57.603637+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-09-19T14:14:57.603637+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.603637+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:31.917350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'146","reported_seq":717,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.192822+0000","last_change":"2024-09-19T14:15:01.192822+0000","last_active":"2024-09-19T14:15:01.192822+0000","last_peered":"2024-09-19T14:15:01.192822+0000","last_clean":"2024-09-19T14:15:01.192822+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:15:01.192822+0000","last_undegraded":"2024-09-19T14:15:01.192822+0000","last_fullsized":"2024-09-19T14:15:01.192822+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-09-19T14:15:01.192741+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-09-19T14:15:01.192741+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.192741+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:32.255912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'780","reported_seq":2484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.645115+0000","last_change":"2024-09-19T14:14:33.645115+0000","last_active":"2024-09-19T14:14:33.645115+0000","last_peered":"2024-09-19T14:14:33.645115+0000","last_clean":"2024-09-19T14:14:33.645115+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:14:33.645115+0000","last_undegraded":"2024-09-19T14:14:33.645115+0000","last_fullsized":"2024-09-19T14:14:33.645115+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'780","last_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_deep_scrub":"260'780","last_deep_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.645030+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:38.455079+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'201","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.669948+0000","last_change":"2024-09-19T14:14:26.669948+0000","last_active":"2024-09-19T14:14:26.669948+0000","last_peered":"2024-09-19T14:14:26.669948+0000","last_clean":"2024-09-19T14:14:26.669948+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:14:26.669948+0000","last_undegraded":"2024-09-19T14:14:26.669948+0000","last_fullsized":"2024-09-19T14:14:26.669948+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.669848+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.636524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":235834,"num_write":982,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.369204+0000","last_change":"2024-09-19T14:14:39.369204+0000","last_active":"2024-09-19T14:14:39.369204+0000","last_peered":"2024-09-19T14:14:39.369204+0000","last_clean":"2024-09-19T14:14:39.369204+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:14:39.369204+0000","last_undegraded":"2024-09-19T14:14:39.369204+0000","last_fullsized":"2024-09-19T14:14:39.369204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.369113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:47.710446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'145","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.226227+0000","last_change":"2024-09-19T14:14:50.226227+0000","last_active":"2024-09-19T14:14:50.226227+0000","last_peered":"2024-09-19T14:14:50.226227+0000","last_clean":"2024-09-19T14:14:50.226227+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:14:50.226227+0000","last_undegraded":"2024-09-19T14:14:50.226227+0000","last_fullsized":"2024-09-19T14:14:50.226227+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-09-19T14:14:50.226133+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-09-19T14:14:50.226133+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.226133+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:40.245409+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":264,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.018323+0000","last_change":"2024-09-19T14:14:57.018323+0000","last_active":"2024-09-19T14:14:57.018323+0000","last_peered":"2024-09-19T14:14:57.018323+0000","last_clean":"2024-09-19T14:14:57.018323+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:14:57.018323+0000","last_undegraded":"2024-09-19T14:14:57.018323+0000","last_fullsized":"2024-09-19T14:14:57.018323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:57.018222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:57.018222+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.018222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:27.098198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'127","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.921729+0000","last_change":"2024-09-19T14:15:03.921729+0000","last_active":"2024-09-19T14:15:03.921729+0000","last_peered":"2024-09-19T14:15:03.921729+0000","last_clean":"2024-09-19T14:15:03.921729+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:15:03.921729+0000","last_undegraded":"2024-09-19T14:15:03.921729+0000","last_fullsized":"2024-09-19T14:15:03.921729+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-19T14:15:03.921646+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-19T14:15:03.921646+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.921646+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:32.648247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'451","reported_seq":2142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.385125+0000","last_change":"2024-09-19T14:14:33.385125+0000","last_active":"2024-09-19T14:14:33.385125+0000","last_peered":"2024-09-19T14:14:33.385125+0000","last_clean":"2024-09-19T14:14:33.385125+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:14:33.385125+0000","last_undegraded":"2024-09-19T14:14:33.385125+0000","last_fullsized":"2024-09-19T14:14:33.385125+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.385044+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:40.641199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'206","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.184238+0000","last_change":"2024-09-19T14:14:29.184238+0000","last_active":"2024-09-19T14:14:29.184238+0000","last_peered":"2024-09-19T14:14:29.184238+0000","last_clean":"2024-09-19T14:14:29.184238+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:14:29.184238+0000","last_undegraded":"2024-09-19T14:14:29.184238+0000","last_fullsized":"2024-09-19T14:14:29.184238+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.184140+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:52.173970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":26124,"num_write":1061,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.262863+0000","last_change":"2024-09-19T14:14:45.262863+0000","last_active":"2024-09-19T14:14:45.262863+0000","last_peered":"2024-09-19T14:14:45.262863+0000","last_clean":"2024-09-19T14:14:45.262863+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:14:45.262863+0000","last_undegraded":"2024-09-19T14:14:45.262863+0000","last_fullsized":"2024-09-19T14:14:45.262863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.262794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.262794+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.262794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:11.511930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'51","reported_seq":549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.167410+0000","last_change":"2024-09-19T14:14:46.167410+0000","last_active":"2024-09-19T14:14:46.167410+0000","last_peered":"2024-09-19T14:14:46.167410+0000","last_clean":"2024-09-19T14:14:46.167410+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:14:46.167410+0000","last_undegraded":"2024-09-19T14:14:46.167410+0000","last_fullsized":"2024-09-19T14:14:46.167410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'51","last_scrub_stamp":"2024-09-19T14:14:46.167332+0000","last_deep_scrub":"260'51","last_deep_scrub_stamp":"2024-09-19T14:14:46.167332+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.167332+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:27.825629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.229878+0000","last_change":"2024-09-19T14:14:53.229878+0000","last_active":"2024-09-19T14:14:53.229878+0000","last_peered":"2024-09-19T14:14:53.229878+0000","last_clean":"2024-09-19T14:14:53.229878+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:14:53.229878+0000","last_undegraded":"2024-09-19T14:14:53.229878+0000","last_fullsized":"2024-09-19T14:14:53.229878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.229785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.229785+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.229785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:19.760091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'217","reported_seq":731,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.200730+0000","last_change":"2024-09-19T14:14:59.200730+0000","last_active":"2024-09-19T14:14:59.200730+0000","last_peered":"2024-09-19T14:14:59.200730+0000","last_clean":"2024-09-19T14:14:59.200730+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:14:59.200730+0000","last_undegraded":"2024-09-19T14:14:59.200730+0000","last_fullsized":"2024-09-19T14:14:59.200730+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'217","last_scrub_stamp":"2024-09-19T14:14:59.200634+0000","last_deep_scrub":"260'217","last_deep_scrub_stamp":"2024-09-19T14:14:59.200634+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.200634+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:57.519787+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'398","reported_seq":1849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.336463+0000","last_change":"2024-09-19T14:14:35.336463+0000","last_active":"2024-09-19T14:14:35.336463+0000","last_peered":"2024-09-19T14:14:35.336463+0000","last_clean":"2024-09-19T14:14:35.336463+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:14:35.336463+0000","last_undegraded":"2024-09-19T14:14:35.336463+0000","last_fullsized":"2024-09-19T14:14:35.336463+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'398","last_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_deep_scrub":"260'398","last_deep_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.336359+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:33.204997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'215","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.823196+0000","last_change":"2024-09-19T14:14:27.823104+0000","last_active":"2024-09-19T14:14:27.823196+0000","last_peered":"2024-09-19T14:14:27.823196+0000","last_clean":"2024-09-19T14:14:27.823196+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:14:27.823196+0000","last_undegraded":"2024-09-19T14:14:27.823196+0000","last_fullsized":"2024-09-19T14:14:27.823196+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.822984+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:08.778750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":16519,"num_write":1037,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.215103+0000","last_change":"2024-09-19T14:14:44.215103+0000","last_active":"2024-09-19T14:14:44.215103+0000","last_peered":"2024-09-19T14:14:44.215103+0000","last_clean":"2024-09-19T14:14:44.215103+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:14:44.215103+0000","last_undegraded":"2024-09-19T14:14:44.215103+0000","last_fullsized":"2024-09-19T14:14:44.215103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.215012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.215012+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.215012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:26.236101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'149","reported_seq":734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.188758+0000","last_change":"2024-09-19T14:14:51.188758+0000","last_active":"2024-09-19T14:14:51.188758+0000","last_peered":"2024-09-19T14:14:51.188758+0000","last_clean":"2024-09-19T14:14:51.188758+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:14:51.188758+0000","last_undegraded":"2024-09-19T14:14:51.188758+0000","last_fullsized":"2024-09-19T14:14:51.188758+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-09-19T14:14:51.188664+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-09-19T14:14:51.188664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.188664+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:49.379920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":198,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.230017+0000","last_change":"2024-09-19T14:14:44.230017+0000","last_active":"2024-09-19T14:14:44.230017+0000","last_peered":"2024-09-19T14:14:44.230017+0000","last_clean":"2024-09-19T14:14:44.230017+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:14:44.230017+0000","last_undegraded":"2024-09-19T14:14:44.230017+0000","last_fullsized":"2024-09-19T14:14:44.230017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.229930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.229930+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.229930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:59.977901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'182","reported_seq":747,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.639043+0000","last_change":"2024-09-19T14:15:00.639043+0000","last_active":"2024-09-19T14:15:00.639043+0000","last_peered":"2024-09-19T14:15:00.639043+0000","last_clean":"2024-09-19T14:15:00.639043+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:15:00.639043+0000","last_undegraded":"2024-09-19T14:15:00.639043+0000","last_fullsized":"2024-09-19T14:15:00.639043+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'182","last_scrub_stamp":"2024-09-19T14:15:00.638945+0000","last_deep_scrub":"260'182","last_deep_scrub_stamp":"2024-09-19T14:15:00.638945+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.638945+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.573733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'410","reported_seq":1901,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.343318+0000","last_change":"2024-09-19T14:14:33.343318+0000","last_active":"2024-09-19T14:14:33.343318+0000","last_peered":"2024-09-19T14:14:33.343318+0000","last_clean":"2024-09-19T14:14:33.343318+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:14:33.343318+0000","last_undegraded":"2024-09-19T14:14:33.343318+0000","last_fullsized":"2024-09-19T14:14:33.343318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'410","last_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_deep_scrub":"260'410","last_deep_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.343234+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:26.919333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3249,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'225","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.302152+0000","last_change":"2024-09-19T14:14:25.302102+0000","last_active":"2024-09-19T14:14:25.302152+0000","last_peered":"2024-09-19T14:14:25.302152+0000","last_clean":"2024-09-19T14:14:25.302152+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:14:25.302152+0000","last_undegraded":"2024-09-19T14:14:25.302152+0000","last_fullsized":"2024-09-19T14:14:25.302152+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.302035+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:39.521325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":697,"num_read_kb":42518,"num_write":1086,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.200192+0000","last_change":"2024-09-19T14:14:40.200192+0000","last_active":"2024-09-19T14:14:40.200192+0000","last_peered":"2024-09-19T14:14:40.200192+0000","last_clean":"2024-09-19T14:14:40.200192+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:14:40.200192+0000","last_undegraded":"2024-09-19T14:14:40.200192+0000","last_fullsized":"2024-09-19T14:14:40.200192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.200107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:09.154313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'133","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.217377+0000","last_change":"2024-09-19T14:14:49.217377+0000","last_active":"2024-09-19T14:14:49.217377+0000","last_peered":"2024-09-19T14:14:49.217377+0000","last_clean":"2024-09-19T14:14:49.217377+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:14:49.217377+0000","last_undegraded":"2024-09-19T14:14:49.217377+0000","last_fullsized":"2024-09-19T14:14:49.217377+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-09-19T14:14:49.217265+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-09-19T14:14:49.217265+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.217265+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:25.483828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.186875+0000","last_change":"2024-09-19T14:14:53.186875+0000","last_active":"2024-09-19T14:14:53.186875+0000","last_peered":"2024-09-19T14:14:53.186875+0000","last_clean":"2024-09-19T14:14:53.186875+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:14:53.186875+0000","last_undegraded":"2024-09-19T14:14:53.186875+0000","last_fullsized":"2024-09-19T14:14:53.186875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.186792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.186792+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.186792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:13.861721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'843","reported_seq":2334,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.153572+0000","last_change":"2024-09-19T14:14:35.153572+0000","last_active":"2024-09-19T14:14:35.153572+0000","last_peered":"2024-09-19T14:14:35.153572+0000","last_clean":"2024-09-19T14:14:35.153572+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:14:35.153572+0000","last_undegraded":"2024-09-19T14:14:35.153572+0000","last_fullsized":"2024-09-19T14:14:35.153572+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'843","last_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_deep_scrub":"260'843","last_deep_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.153464+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:33.436497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'213","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.383864+0000","last_change":"2024-09-19T14:14:26.383816+0000","last_active":"2024-09-19T14:14:26.383864+0000","last_peered":"2024-09-19T14:14:26.383864+0000","last_clean":"2024-09-19T14:14:26.383864+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:14:26.383864+0000","last_undegraded":"2024-09-19T14:14:26.383864+0000","last_fullsized":"2024-09-19T14:14:26.383864+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.383747+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:29.585612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":34256,"num_write":1036,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.228558+0000","last_change":"2024-09-19T14:14:42.228558+0000","last_active":"2024-09-19T14:14:42.228558+0000","last_peered":"2024-09-19T14:14:42.228558+0000","last_clean":"2024-09-19T14:14:42.228558+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:14:42.228558+0000","last_undegraded":"2024-09-19T14:14:42.228558+0000","last_fullsized":"2024-09-19T14:14:42.228558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.228473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.228473+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.228473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:59:51.937204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'190","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.429807+0000","last_change":"2024-09-19T14:14:44.429807+0000","last_active":"2024-09-19T14:14:44.429807+0000","last_peered":"2024-09-19T14:14:44.429807+0000","last_clean":"2024-09-19T14:14:44.429807+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:14:44.429807+0000","last_undegraded":"2024-09-19T14:14:44.429807+0000","last_fullsized":"2024-09-19T14:14:44.429807+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'190","last_scrub_stamp":"2024-09-19T14:14:44.429692+0000","last_deep_scrub":"260'190","last_deep_scrub_stamp":"2024-09-19T14:14:44.429692+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.429692+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:03.688402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":293,"num_read_kb":440,"num_write":180,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.609408+0000","last_change":"2024-09-19T14:14:54.609408+0000","last_active":"2024-09-19T14:14:54.609408+0000","last_peered":"2024-09-19T14:14:54.609408+0000","last_clean":"2024-09-19T14:14:54.609408+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:14:54.609408+0000","last_undegraded":"2024-09-19T14:14:54.609408+0000","last_fullsized":"2024-09-19T14:14:54.609408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.609322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.609322+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.609322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:03.584374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'197","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.965648+0000","last_change":"2024-09-19T14:15:02.965648+0000","last_active":"2024-09-19T14:15:02.965648+0000","last_peered":"2024-09-19T14:15:02.965648+0000","last_clean":"2024-09-19T14:15:02.965648+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:15:02.965648+0000","last_undegraded":"2024-09-19T14:15:02.965648+0000","last_fullsized":"2024-09-19T14:15:02.965648+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:15:02.965563+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:15:02.965563+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.965563+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:53.492217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.197145+0000","last_change":"2024-09-19T14:14:37.197145+0000","last_active":"2024-09-19T14:14:37.197145+0000","last_peered":"2024-09-19T14:14:37.197145+0000","last_clean":"2024-09-19T14:14:37.197145+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:14:37.197145+0000","last_undegraded":"2024-09-19T14:14:37.197145+0000","last_fullsized":"2024-09-19T14:14:37.197145+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.197060+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:42.296752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'195","reported_seq":940,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.278558+0000","last_change":"2024-09-19T14:14:26.278507+0000","last_active":"2024-09-19T14:14:26.278558+0000","last_peered":"2024-09-19T14:14:26.278558+0000","last_clean":"2024-09-19T14:14:26.278558+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:14:26.278558+0000","last_undegraded":"2024-09-19T14:14:26.278558+0000","last_fullsized":"2024-09-19T14:14:26.278558+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.278417+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:45.039194+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":906,"num_read_kb":49787,"num_write":936,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.244914+0000","last_change":"2024-09-19T14:14:42.244914+0000","last_active":"2024-09-19T14:14:42.244914+0000","last_peered":"2024-09-19T14:14:42.244914+0000","last_clean":"2024-09-19T14:14:42.244914+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:14:42.244914+0000","last_undegraded":"2024-09-19T14:14:42.244914+0000","last_fullsized":"2024-09-19T14:14:42.244914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.244809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.244809+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.244809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:20.570407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'139","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.206362+0000","last_change":"2024-09-19T14:14:51.206362+0000","last_active":"2024-09-19T14:14:51.206362+0000","last_peered":"2024-09-19T14:14:51.206362+0000","last_clean":"2024-09-19T14:14:51.206362+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:14:51.206362+0000","last_undegraded":"2024-09-19T14:14:51.206362+0000","last_fullsized":"2024-09-19T14:14:51.206362+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-19T14:14:51.206266+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-19T14:14:51.206266+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.206266+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:30.621888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.449794+0000","last_change":"2024-09-19T14:14:46.449794+0000","last_active":"2024-09-19T14:14:46.449794+0000","last_peered":"2024-09-19T14:14:46.449794+0000","last_clean":"2024-09-19T14:14:46.449794+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:14:46.449794+0000","last_undegraded":"2024-09-19T14:14:46.449794+0000","last_fullsized":"2024-09-19T14:14:46.449794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.449716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.449716+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.449716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'159","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.346944+0000","last_change":"2024-09-19T14:14:49.346944+0000","last_active":"2024-09-19T14:14:49.346944+0000","last_peered":"2024-09-19T14:14:49.346944+0000","last_clean":"2024-09-19T14:14:49.346944+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:14:49.346944+0000","last_undegraded":"2024-09-19T14:14:49.346944+0000","last_fullsized":"2024-09-19T14:14:49.346944+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'159","last_scrub_stamp":"2024-09-19T14:14:49.346845+0000","last_deep_scrub":"260'159","last_deep_scrub_stamp":"2024-09-19T14:14:49.346845+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.346845+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:54.114382+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'365","reported_seq":1770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.344661+0000","last_change":"2024-09-19T14:14:38.344661+0000","last_active":"2024-09-19T14:14:38.344661+0000","last_peered":"2024-09-19T14:14:38.344661+0000","last_clean":"2024-09-19T14:14:38.344661+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:14:38.344661+0000","last_undegraded":"2024-09-19T14:14:38.344661+0000","last_fullsized":"2024-09-19T14:14:38.344661+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'365","last_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_deep_scrub":"260'365","last_deep_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.344573+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:24.841460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'205","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.620062+0000","last_change":"2024-09-19T14:14:25.620062+0000","last_active":"2024-09-19T14:14:25.620062+0000","last_peered":"2024-09-19T14:14:25.620062+0000","last_clean":"2024-09-19T14:14:25.620062+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:14:25.620062+0000","last_undegraded":"2024-09-19T14:14:25.620062+0000","last_fullsized":"2024-09-19T14:14:25.620062+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.619965+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:40.388409+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":98647,"num_write":933,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.822035+0000","last_change":"2024-09-19T14:14:51.822035+0000","last_active":"2024-09-19T14:14:51.822035+0000","last_peered":"2024-09-19T14:14:51.822035+0000","last_clean":"2024-09-19T14:14:51.822035+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:14:51.822035+0000","last_undegraded":"2024-09-19T14:14:51.822035+0000","last_fullsized":"2024-09-19T14:14:51.822035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:51.821944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:51.821944+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.821944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:29.667562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'128","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.118261+0000","last_change":"2024-09-19T14:14:53.118261+0000","last_active":"2024-09-19T14:14:53.118261+0000","last_peered":"2024-09-19T14:14:53.118261+0000","last_clean":"2024-09-19T14:14:53.118261+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:14:53.118261+0000","last_undegraded":"2024-09-19T14:14:53.118261+0000","last_fullsized":"2024-09-19T14:14:53.118261+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'128","last_scrub_stamp":"2024-09-19T14:14:53.118178+0000","last_deep_scrub":"260'128","last_deep_scrub_stamp":"2024-09-19T14:14:53.118178+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.118178+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:45.968519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7162,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":222,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.407146+0000","last_change":"2024-09-19T14:14:47.407146+0000","last_active":"2024-09-19T14:14:47.407146+0000","last_peered":"2024-09-19T14:14:47.407146+0000","last_clean":"2024-09-19T14:14:47.407146+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:14:47.407146+0000","last_undegraded":"2024-09-19T14:14:47.407146+0000","last_fullsized":"2024-09-19T14:14:47.407146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.407057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.407057+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.407057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:58.345273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'115","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.610611+0000","last_change":"2024-09-19T14:14:58.610611+0000","last_active":"2024-09-19T14:14:58.610611+0000","last_peered":"2024-09-19T14:14:58.610611+0000","last_clean":"2024-09-19T14:14:58.610611+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:14:58.610611+0000","last_undegraded":"2024-09-19T14:14:58.610611+0000","last_fullsized":"2024-09-19T14:14:58.610611+0000","mapping_epoch":32,"log_start":"260'101","ondisk_log_start":"260'101","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'115","last_scrub_stamp":"2024-09-19T14:14:58.610517+0000","last_deep_scrub":"260'115","last_deep_scrub_stamp":"2024-09-19T14:14:58.610517+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.610517+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:48.477399+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'868","reported_seq":2584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.153740+0000","last_change":"2024-09-19T14:14:26.153740+0000","last_active":"2024-09-19T14:14:26.153740+0000","last_peered":"2024-09-19T14:14:26.153740+0000","last_clean":"2024-09-19T14:14:26.153740+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:14:26.153740+0000","last_undegraded":"2024-09-19T14:14:26.153740+0000","last_fullsized":"2024-09-19T14:14:26.153740+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'868","last_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_deep_scrub":"260'868","last_deep_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.153669+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:07.343986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2999,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'241","reported_seq":860,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.275883+0000","last_change":"2024-09-19T14:14:26.275883+0000","last_active":"2024-09-19T14:14:26.275883+0000","last_peered":"2024-09-19T14:14:26.275883+0000","last_clean":"2024-09-19T14:14:26.275883+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:14:26.275883+0000","last_undegraded":"2024-09-19T14:14:26.275883+0000","last_fullsized":"2024-09-19T14:14:26.275883+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.275769+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:42.512214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":17644,"num_write":972,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.450775+0000","last_change":"2024-09-19T14:14:41.450775+0000","last_active":"2024-09-19T14:14:41.450775+0000","last_peered":"2024-09-19T14:14:41.450775+0000","last_clean":"2024-09-19T14:14:41.450775+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:14:41.450775+0000","last_undegraded":"2024-09-19T14:14:41.450775+0000","last_fullsized":"2024-09-19T14:14:41.450775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.450684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:36.944231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.824859+0000","last_change":"2024-09-19T14:14:52.824859+0000","last_active":"2024-09-19T14:14:52.824859+0000","last_peered":"2024-09-19T14:14:52.824859+0000","last_clean":"2024-09-19T14:14:52.824859+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:14:52.824859+0000","last_undegraded":"2024-09-19T14:14:52.824859+0000","last_fullsized":"2024-09-19T14:14:52.824859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'79","last_scrub_stamp":"2024-09-19T14:14:52.824746+0000","last_deep_scrub":"260'79","last_deep_scrub_stamp":"2024-09-19T14:14:52.824746+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.824746+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:43.682521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'779","reported_seq":4117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.275263+0000","last_change":"2024-09-19T14:14:46.275263+0000","last_active":"2024-09-19T14:14:46.275263+0000","last_peered":"2024-09-19T14:14:46.275263+0000","last_clean":"2024-09-19T14:14:46.275263+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:14:46.275263+0000","last_undegraded":"2024-09-19T14:14:46.275263+0000","last_fullsized":"2024-09-19T14:14:46.275263+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'779","last_scrub_stamp":"2024-09-19T14:14:46.275174+0000","last_deep_scrub":"260'779","last_deep_scrub_stamp":"2024-09-19T14:14:46.275174+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.275174+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:16.885230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'117","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.283773+0000","last_change":"2024-09-19T14:14:56.283773+0000","last_active":"2024-09-19T14:14:56.283773+0000","last_peered":"2024-09-19T14:14:56.283773+0000","last_clean":"2024-09-19T14:14:56.283773+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:14:56.283773+0000","last_undegraded":"2024-09-19T14:14:56.283773+0000","last_fullsized":"2024-09-19T14:14:56.283773+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-09-19T14:14:56.283687+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-09-19T14:14:56.283687+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.283687+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:49.798497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'838","reported_seq":2313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.704717+0000","last_change":"2024-09-19T14:14:36.704717+0000","last_active":"2024-09-19T14:14:36.704717+0000","last_peered":"2024-09-19T14:14:36.704717+0000","last_clean":"2024-09-19T14:14:36.704717+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:14:36.704717+0000","last_undegraded":"2024-09-19T14:14:36.704717+0000","last_fullsized":"2024-09-19T14:14:36.704717+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.704635+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:10.522393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'179","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.802969+0000","last_change":"2024-09-19T14:14:28.802969+0000","last_active":"2024-09-19T14:14:28.802969+0000","last_peered":"2024-09-19T14:14:28.802969+0000","last_clean":"2024-09-19T14:14:28.802969+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:14:28.802969+0000","last_undegraded":"2024-09-19T14:14:28.802969+0000","last_fullsized":"2024-09-19T14:14:28.802969+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'179","last_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_deep_scrub":"260'179","last_deep_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.802887+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:55.372480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":5488,"num_write":868,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.182462+0000","last_change":"2024-09-19T14:14:45.182462+0000","last_active":"2024-09-19T14:14:45.182462+0000","last_peered":"2024-09-19T14:14:45.182462+0000","last_clean":"2024-09-19T14:14:45.182462+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:14:45.182462+0000","last_undegraded":"2024-09-19T14:14:45.182462+0000","last_fullsized":"2024-09-19T14:14:45.182462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.182364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.182364+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.182364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:28.117734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'154","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.693486+0000","last_change":"2024-09-19T14:14:52.693429+0000","last_active":"2024-09-19T14:14:52.693486+0000","last_peered":"2024-09-19T14:14:52.693486+0000","last_clean":"2024-09-19T14:14:52.693486+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:14:52.693486+0000","last_undegraded":"2024-09-19T14:14:52.693486+0000","last_fullsized":"2024-09-19T14:14:52.693486+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'154","last_scrub_stamp":"2024-09-19T14:14:52.693341+0000","last_deep_scrub":"260'154","last_deep_scrub_stamp":"2024-09-19T14:14:52.693341+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.693341+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:38.128913+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7396,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":254,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.208002+0000","last_change":"2024-09-19T14:14:54.207936+0000","last_active":"2024-09-19T14:14:54.208002+0000","last_peered":"2024-09-19T14:14:54.208002+0000","last_clean":"2024-09-19T14:14:54.208002+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:14:54.208002+0000","last_undegraded":"2024-09-19T14:14:54.208002+0000","last_fullsized":"2024-09-19T14:14:54.208002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.207851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.207851+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.207851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:34.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'116","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.332277+0000","last_change":"2024-09-19T14:15:00.332277+0000","last_active":"2024-09-19T14:15:00.332277+0000","last_peered":"2024-09-19T14:15:00.332277+0000","last_clean":"2024-09-19T14:15:00.332277+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:15:00.332277+0000","last_undegraded":"2024-09-19T14:15:00.332277+0000","last_fullsized":"2024-09-19T14:15:00.332277+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-09-19T14:15:00.332193+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-09-19T14:15:00.332193+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.332193+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:08.555607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.694724+0000","last_change":"2024-09-19T14:14:35.694724+0000","last_active":"2024-09-19T14:14:35.694724+0000","last_peered":"2024-09-19T14:14:35.694724+0000","last_clean":"2024-09-19T14:14:35.694724+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:14:35.694724+0000","last_undegraded":"2024-09-19T14:14:35.694724+0000","last_fullsized":"2024-09-19T14:14:35.694724+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'888","last_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_deep_scrub":"260'888","last_deep_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.694623+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:14.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'245","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.794846+0000","last_change":"2024-09-19T14:14:30.794846+0000","last_active":"2024-09-19T14:14:30.794846+0000","last_peered":"2024-09-19T14:14:30.794846+0000","last_clean":"2024-09-19T14:14:30.794846+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:14:30.794846+0000","last_undegraded":"2024-09-19T14:14:30.794846+0000","last_fullsized":"2024-09-19T14:14:30.794846+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'245","last_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_deep_scrub":"260'245","last_deep_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.794729+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:31.629348+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":59575,"num_write":1084,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.692404+0000","last_change":"2024-09-19T14:14:48.692404+0000","last_active":"2024-09-19T14:14:48.692404+0000","last_peered":"2024-09-19T14:14:48.692404+0000","last_clean":"2024-09-19T14:14:48.692404+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:14:48.692404+0000","last_undegraded":"2024-09-19T14:14:48.692404+0000","last_fullsized":"2024-09-19T14:14:48.692404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:48.692312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:48.692312+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.692312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:23.065865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'136","reported_seq":698,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.226171+0000","last_change":"2024-09-19T14:14:48.226112+0000","last_active":"2024-09-19T14:14:48.226171+0000","last_peered":"2024-09-19T14:14:48.226171+0000","last_clean":"2024-09-19T14:14:48.226171+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:14:48.226171+0000","last_undegraded":"2024-09-19T14:14:48.226171+0000","last_fullsized":"2024-09-19T14:14:48.226171+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'136","last_scrub_stamp":"2024-09-19T14:14:48.226013+0000","last_deep_scrub":"260'136","last_deep_scrub_stamp":"2024-09-19T14:14:48.226013+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.226013+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:06.268321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.245865+0000","last_change":"2024-09-19T14:14:45.245797+0000","last_active":"2024-09-19T14:14:45.245865+0000","last_peered":"2024-09-19T14:14:45.245865+0000","last_clean":"2024-09-19T14:14:45.245865+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:14:45.245865+0000","last_undegraded":"2024-09-19T14:14:45.245865+0000","last_fullsized":"2024-09-19T14:14:45.245865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.245715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.245715+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.245715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:20.002903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'84","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.995743+0000","last_change":"2024-09-19T14:15:01.995743+0000","last_active":"2024-09-19T14:15:01.995743+0000","last_peered":"2024-09-19T14:15:01.995743+0000","last_clean":"2024-09-19T14:15:01.995743+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:15:01.995743+0000","last_undegraded":"2024-09-19T14:15:01.995743+0000","last_fullsized":"2024-09-19T14:15:01.995743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-09-19T14:15:01.995660+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-09-19T14:15:01.995660+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.995660+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:33.369622+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'389","reported_seq":1831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.339492+0000","last_change":"2024-09-19T14:14:39.339428+0000","last_active":"2024-09-19T14:14:39.339492+0000","last_peered":"2024-09-19T14:14:39.339492+0000","last_clean":"2024-09-19T14:14:39.339492+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:14:39.339492+0000","last_undegraded":"2024-09-19T14:14:39.339492+0000","last_fullsized":"2024-09-19T14:14:39.339492+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.339324+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:46.745230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'201","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.141292+0000","last_change":"2024-09-19T14:14:23.141243+0000","last_active":"2024-09-19T14:14:23.141292+0000","last_peered":"2024-09-19T14:14:23.141292+0000","last_clean":"2024-09-19T14:14:23.141292+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:14:23.141292+0000","last_undegraded":"2024-09-19T14:14:23.141292+0000","last_fullsized":"2024-09-19T14:14:23.141292+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.141172+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:48:13.237318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":516,"num_read_kb":9219,"num_write":929,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.789205+0000","last_change":"2024-09-19T14:14:46.789120+0000","last_active":"2024-09-19T14:14:46.789205+0000","last_peered":"2024-09-19T14:14:46.789205+0000","last_clean":"2024-09-19T14:14:46.789205+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:14:46.789205+0000","last_undegraded":"2024-09-19T14:14:46.789205+0000","last_fullsized":"2024-09-19T14:14:46.789205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.789009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.789009+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.789009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:00.687915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'118","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.154803+0000","last_change":"2024-09-19T14:14:52.154803+0000","last_active":"2024-09-19T14:14:52.154803+0000","last_peered":"2024-09-19T14:14:52.154803+0000","last_clean":"2024-09-19T14:14:52.154803+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:14:52.154803+0000","last_undegraded":"2024-09-19T14:14:52.154803+0000","last_fullsized":"2024-09-19T14:14:52.154803+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-09-19T14:14:52.154713+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-09-19T14:14:52.154713+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.154713+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:53.703773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7954,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":214,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.779162+0000","last_change":"2024-09-19T14:14:55.779162+0000","last_active":"2024-09-19T14:14:55.779162+0000","last_peered":"2024-09-19T14:14:55.779162+0000","last_clean":"2024-09-19T14:14:55.779162+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:14:55.779162+0000","last_undegraded":"2024-09-19T14:14:55.779162+0000","last_fullsized":"2024-09-19T14:14:55.779162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.779074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.779074+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.779074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:00.069996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'168","reported_seq":1629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.329648+0000","last_change":"2024-09-19T14:14:57.329648+0000","last_active":"2024-09-19T14:14:57.329648+0000","last_peered":"2024-09-19T14:14:57.329648+0000","last_clean":"2024-09-19T14:14:57.329648+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:14:57.329648+0000","last_undegraded":"2024-09-19T14:14:57.329648+0000","last_fullsized":"2024-09-19T14:14:57.329648+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-09-19T14:14:57.329529+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-09-19T14:14:57.329529+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.329529+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:18.582411+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1273","reported_seq":2995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.694661+0000","last_change":"2024-09-19T14:14:34.694601+0000","last_active":"2024-09-19T14:14:34.694661+0000","last_peered":"2024-09-19T14:14:34.694661+0000","last_clean":"2024-09-19T14:14:34.694661+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:14:34.694661+0000","last_undegraded":"2024-09-19T14:14:34.694661+0000","last_fullsized":"2024-09-19T14:14:34.694661+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1273","last_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_deep_scrub":"260'1273","last_deep_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.694504+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:28.668229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'210","reported_seq":895,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.226451+0000","last_change":"2024-09-19T14:14:27.226451+0000","last_active":"2024-09-19T14:14:27.226451+0000","last_peered":"2024-09-19T14:14:27.226451+0000","last_clean":"2024-09-19T14:14:27.226451+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:14:27.226451+0000","last_undegraded":"2024-09-19T14:14:27.226451+0000","last_fullsized":"2024-09-19T14:14:27.226451+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.226323+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:19.006735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":101743,"num_write":1010,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.411709+0000","last_change":"2024-09-19T14:14:40.411618+0000","last_active":"2024-09-19T14:14:40.411709+0000","last_peered":"2024-09-19T14:14:40.411709+0000","last_clean":"2024-09-19T14:14:40.411709+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:14:40.411709+0000","last_undegraded":"2024-09-19T14:14:40.411709+0000","last_fullsized":"2024-09-19T14:14:40.411709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.411523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:59.159110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'164","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.788064+0000","last_change":"2024-09-19T14:14:48.788064+0000","last_active":"2024-09-19T14:14:48.788064+0000","last_peered":"2024-09-19T14:14:48.788064+0000","last_clean":"2024-09-19T14:14:48.788064+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:14:48.788064+0000","last_undegraded":"2024-09-19T14:14:48.788064+0000","last_fullsized":"2024-09-19T14:14:48.788064+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-19T14:14:48.787980+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-19T14:14:48.787980+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.787980+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:44.951134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9862,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":313,"num_write":122,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.204420+0000","last_change":"2024-09-19T14:14:55.204420+0000","last_active":"2024-09-19T14:14:55.204420+0000","last_peered":"2024-09-19T14:14:55.204420+0000","last_clean":"2024-09-19T14:14:55.204420+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:14:55.204420+0000","last_undegraded":"2024-09-19T14:14:55.204420+0000","last_fullsized":"2024-09-19T14:14:55.204420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.204309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.204309+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.204309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:17.732329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'160","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.769228+0000","last_change":"2024-09-19T14:14:57.769228+0000","last_active":"2024-09-19T14:14:57.769228+0000","last_peered":"2024-09-19T14:14:57.769228+0000","last_clean":"2024-09-19T14:14:57.769228+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:14:57.769228+0000","last_undegraded":"2024-09-19T14:14:57.769228+0000","last_fullsized":"2024-09-19T14:14:57.769228+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'160","last_scrub_stamp":"2024-09-19T14:14:57.769136+0000","last_deep_scrub":"260'160","last_deep_scrub_stamp":"2024-09-19T14:14:57.769136+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.769136+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:34.077896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'836","reported_seq":2521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.397461+0000","last_change":"2024-09-19T14:14:37.397395+0000","last_active":"2024-09-19T14:14:37.397461+0000","last_peered":"2024-09-19T14:14:37.397461+0000","last_clean":"2024-09-19T14:14:37.397461+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:14:37.397461+0000","last_undegraded":"2024-09-19T14:14:37.397461+0000","last_fullsized":"2024-09-19T14:14:37.397461+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'836","last_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_deep_scrub":"260'836","last_deep_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.397294+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:44.618601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'249","reported_seq":948,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.176212+0000","last_change":"2024-09-19T14:14:31.176212+0000","last_active":"2024-09-19T14:14:31.176212+0000","last_peered":"2024-09-19T14:14:31.176212+0000","last_clean":"2024-09-19T14:14:31.176212+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:14:31.176212+0000","last_undegraded":"2024-09-19T14:14:31.176212+0000","last_fullsized":"2024-09-19T14:14:31.176212+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'249","last_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_deep_scrub":"260'249","last_deep_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.176114+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:57.461970+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":888,"num_read_kb":7647,"num_write":1101,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.436557+0000","last_change":"2024-09-19T14:14:36.436486+0000","last_active":"2024-09-19T14:14:36.436557+0000","last_peered":"2024-09-19T14:14:36.436557+0000","last_clean":"2024-09-19T14:14:36.436557+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:14:36.436557+0000","last_undegraded":"2024-09-19T14:14:36.436557+0000","last_fullsized":"2024-09-19T14:14:36.436557+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'447","last_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_deep_scrub":"260'447","last_deep_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.436372+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:10.165233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'218","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.173076+0000","last_change":"2024-09-19T14:14:27.173076+0000","last_active":"2024-09-19T14:14:27.173076+0000","last_peered":"2024-09-19T14:14:27.173076+0000","last_clean":"2024-09-19T14:14:27.173076+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:14:27.173076+0000","last_undegraded":"2024-09-19T14:14:27.173076+0000","last_fullsized":"2024-09-19T14:14:27.173076+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.172984+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:42.410826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":577,"num_read_kb":9780,"num_write":1046,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'455","reported_seq":2089,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.752853+0000","last_change":"2024-09-19T14:14:39.752784+0000","last_active":"2024-09-19T14:14:39.752853+0000","last_peered":"2024-09-19T14:14:39.752853+0000","last_clean":"2024-09-19T14:14:39.752853+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:14:39.752853+0000","last_undegraded":"2024-09-19T14:14:39.752853+0000","last_fullsized":"2024-09-19T14:14:39.752853+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'455","last_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_deep_scrub":"260'455","last_deep_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.752704+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:34.065704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'211","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.759444+0000","last_change":"2024-09-19T14:14:29.759444+0000","last_active":"2024-09-19T14:14:29.759444+0000","last_peered":"2024-09-19T14:14:29.759444+0000","last_clean":"2024-09-19T14:14:29.759444+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:14:29.759444+0000","last_undegraded":"2024-09-19T14:14:29.759444+0000","last_fullsized":"2024-09-19T14:14:29.759444+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'211","last_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_deep_scrub":"260'211","last_deep_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.759339+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.186994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":691,"num_read_kb":41340,"num_write":997,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'838","reported_seq":2607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.446601+0000","last_change":"2024-09-19T14:14:35.446544+0000","last_active":"2024-09-19T14:14:35.446601+0000","last_peered":"2024-09-19T14:14:35.446601+0000","last_clean":"2024-09-19T14:14:35.446601+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:14:35.446601+0000","last_undegraded":"2024-09-19T14:14:35.446601+0000","last_fullsized":"2024-09-19T14:14:35.446601+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.446452+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:35.254669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'348","reported_seq":1037,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.265255+0000","last_change":"2024-09-19T14:14:28.265255+0000","last_active":"2024-09-19T14:14:28.265255+0000","last_peered":"2024-09-19T14:14:28.265255+0000","last_clean":"2024-09-19T14:14:28.265255+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:14:28.265255+0000","last_undegraded":"2024-09-19T14:14:28.265255+0000","last_fullsized":"2024-09-19T14:14:28.265255+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.265167+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:06.385286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":988,"num_read_kb":17821,"num_write":1252,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1315","reported_seq":2976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.329566+0000","last_change":"2024-09-19T14:14:41.329566+0000","last_active":"2024-09-19T14:14:41.329566+0000","last_peered":"2024-09-19T14:14:41.329566+0000","last_clean":"2024-09-19T14:14:41.329566+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:14:41.329566+0000","last_undegraded":"2024-09-19T14:14:41.329566+0000","last_fullsized":"2024-09-19T14:14:41.329566+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1315","last_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_deep_scrub":"260'1315","last_deep_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.329479+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:37.922023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'188","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.334937+0000","last_change":"2024-09-19T14:14:28.334879+0000","last_active":"2024-09-19T14:14:28.334937+0000","last_peered":"2024-09-19T14:14:28.334937+0000","last_clean":"2024-09-19T14:14:28.334937+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:14:28.334937+0000","last_undegraded":"2024-09-19T14:14:28.334937+0000","last_fullsized":"2024-09-19T14:14:28.334937+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.334791+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:30.887824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170303,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":35047,"num_write":889,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'461","reported_seq":2160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.731079+0000","last_change":"2024-09-19T14:14:37.731079+0000","last_active":"2024-09-19T14:14:37.731079+0000","last_peered":"2024-09-19T14:14:37.731079+0000","last_clean":"2024-09-19T14:14:37.731079+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:14:37.731079+0000","last_undegraded":"2024-09-19T14:14:37.731079+0000","last_fullsized":"2024-09-19T14:14:37.731079+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'461","last_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_deep_scrub":"260'461","last_deep_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.730982+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:25.634386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'263","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.273045+0000","last_change":"2024-09-19T14:14:27.272920+0000","last_active":"2024-09-19T14:14:27.273045+0000","last_peered":"2024-09-19T14:14:27.273045+0000","last_clean":"2024-09-19T14:14:27.273045+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:14:27.273045+0000","last_undegraded":"2024-09-19T14:14:27.273045+0000","last_fullsized":"2024-09-19T14:14:27.273045+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'263","last_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_deep_scrub":"260'263","last_deep_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.272800+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:17.008251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'506","reported_seq":2130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.307274+0000","last_change":"2024-09-19T14:14:40.307274+0000","last_active":"2024-09-19T14:14:40.307274+0000","last_peered":"2024-09-19T14:14:40.307274+0000","last_clean":"2024-09-19T14:14:40.307274+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:14:40.307274+0000","last_undegraded":"2024-09-19T14:14:40.307274+0000","last_fullsized":"2024-09-19T14:14:40.307274+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.307175+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:34.215410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'215","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.144872+0000","last_change":"2024-09-19T14:14:27.144807+0000","last_active":"2024-09-19T14:14:27.144872+0000","last_peered":"2024-09-19T14:14:27.144872+0000","last_clean":"2024-09-19T14:14:27.144872+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:14:27.144872+0000","last_undegraded":"2024-09-19T14:14:27.144872+0000","last_fullsized":"2024-09-19T14:14:27.144872+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.144709+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:35.772460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":13499,"num_write":1011,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'444","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.179317+0000","last_change":"2024-09-19T14:14:37.179317+0000","last_active":"2024-09-19T14:14:37.179317+0000","last_peered":"2024-09-19T14:14:37.179317+0000","last_clean":"2024-09-19T14:14:37.179317+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:14:37.179317+0000","last_undegraded":"2024-09-19T14:14:37.179317+0000","last_fullsized":"2024-09-19T14:14:37.179317+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'444","last_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_deep_scrub":"260'444","last_deep_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.179230+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:09.695208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'244","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.284298+0000","last_change":"2024-09-19T14:14:29.284232+0000","last_active":"2024-09-19T14:14:29.284298+0000","last_peered":"2024-09-19T14:14:29.284298+0000","last_clean":"2024-09-19T14:14:29.284298+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:14:29.284298+0000","last_undegraded":"2024-09-19T14:14:29.284298+0000","last_fullsized":"2024-09-19T14:14:29.284298+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.284150+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:03.574863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":662,"num_read_kb":12703,"num_write":1156,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'798","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.184755+0000","last_change":"2024-09-19T14:14:38.184755+0000","last_active":"2024-09-19T14:14:38.184755+0000","last_peered":"2024-09-19T14:14:38.184755+0000","last_clean":"2024-09-19T14:14:38.184755+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:14:38.184755+0000","last_undegraded":"2024-09-19T14:14:38.184755+0000","last_fullsized":"2024-09-19T14:14:38.184755+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.184639+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:45.021809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'200","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.783300+0000","last_change":"2024-09-19T14:14:32.783242+0000","last_active":"2024-09-19T14:14:32.783300+0000","last_peered":"2024-09-19T14:14:32.783300+0000","last_clean":"2024-09-19T14:14:32.783300+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:14:32.783300+0000","last_undegraded":"2024-09-19T14:14:32.783300+0000","last_fullsized":"2024-09-19T14:14:32.783300+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.783156+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.959321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":31175,"num_write":936,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'412","reported_seq":1863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.794667+0000","last_change":"2024-09-19T14:14:39.794667+0000","last_active":"2024-09-19T14:14:39.794667+0000","last_peered":"2024-09-19T14:14:39.794667+0000","last_clean":"2024-09-19T14:14:39.794667+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:14:39.794667+0000","last_undegraded":"2024-09-19T14:14:39.794667+0000","last_fullsized":"2024-09-19T14:14:39.794667+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'412","last_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_deep_scrub":"260'412","last_deep_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.794561+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:17.283150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'220","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.300531+0000","last_change":"2024-09-19T14:14:30.300531+0000","last_active":"2024-09-19T14:14:30.300531+0000","last_peered":"2024-09-19T14:14:30.300531+0000","last_clean":"2024-09-19T14:14:30.300531+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:14:30.300531+0000","last_undegraded":"2024-09-19T14:14:30.300531+0000","last_fullsized":"2024-09-19T14:14:30.300531+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.300443+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:44.686591+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":31236,"num_write":1023,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'417","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.201597+0000","last_change":"2024-09-19T14:14:28.201597+0000","last_active":"2024-09-19T14:14:28.201597+0000","last_peered":"2024-09-19T14:14:28.201597+0000","last_clean":"2024-09-19T14:14:28.201597+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:14:28.201597+0000","last_undegraded":"2024-09-19T14:14:28.201597+0000","last_fullsized":"2024-09-19T14:14:28.201597+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.201511+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:48.368700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'290","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.793178+0000","last_change":"2024-09-19T14:14:31.793178+0000","last_active":"2024-09-19T14:14:31.793178+0000","last_peered":"2024-09-19T14:14:31.793178+0000","last_clean":"2024-09-19T14:14:31.793178+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:14:31.793178+0000","last_undegraded":"2024-09-19T14:14:31.793178+0000","last_fullsized":"2024-09-19T14:14:31.793178+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.793101+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:55.675665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":11922,"num_write":1198,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'364","reported_seq":1810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.759457+0000","last_change":"2024-09-19T14:14:38.759457+0000","last_active":"2024-09-19T14:14:38.759457+0000","last_peered":"2024-09-19T14:14:38.759457+0000","last_clean":"2024-09-19T14:14:38.759457+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:14:38.759457+0000","last_undegraded":"2024-09-19T14:14:38.759457+0000","last_fullsized":"2024-09-19T14:14:38.759457+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.759372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:34.123627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'216","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.274839+0000","last_change":"2024-09-19T14:14:29.274839+0000","last_active":"2024-09-19T14:14:29.274839+0000","last_peered":"2024-09-19T14:14:29.274839+0000","last_clean":"2024-09-19T14:14:29.274839+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:14:29.274839+0000","last_undegraded":"2024-09-19T14:14:29.274839+0000","last_fullsized":"2024-09-19T14:14:29.274839+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.274732+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:54.840076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":593,"num_read_kb":98527,"num_write":1024,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'870","reported_seq":2506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.147163+0000","last_change":"2024-09-19T14:14:38.147163+0000","last_active":"2024-09-19T14:14:38.147163+0000","last_peered":"2024-09-19T14:14:38.147163+0000","last_clean":"2024-09-19T14:14:38.147163+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:14:38.147163+0000","last_undegraded":"2024-09-19T14:14:38.147163+0000","last_fullsized":"2024-09-19T14:14:38.147163+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'870","last_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_deep_scrub":"260'870","last_deep_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.147083+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:06:43.098776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'246","reported_seq":936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.136442+0000","last_change":"2024-09-19T14:14:29.136442+0000","last_active":"2024-09-19T14:14:29.136442+0000","last_peered":"2024-09-19T14:14:29.136442+0000","last_clean":"2024-09-19T14:14:29.136442+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:14:29.136442+0000","last_undegraded":"2024-09-19T14:14:29.136442+0000","last_fullsized":"2024-09-19T14:14:29.136442+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'246","last_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_deep_scrub":"260'246","last_deep_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.136336+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:58.288005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":868,"num_read_kb":9315,"num_write":1049,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3085,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.236512+0000","last_change":"2024-09-19T14:14:36.236512+0000","last_active":"2024-09-19T14:14:36.236512+0000","last_peered":"2024-09-19T14:14:36.236512+0000","last_clean":"2024-09-19T14:14:36.236512+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:14:36.236512+0000","last_undegraded":"2024-09-19T14:14:36.236512+0000","last_fullsized":"2024-09-19T14:14:36.236512+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1368","last_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_deep_scrub":"260'1368","last_deep_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.236418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:57.105756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'257","reported_seq":891,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.074777+0000","last_change":"2024-09-19T14:14:33.074714+0000","last_active":"2024-09-19T14:14:33.074777+0000","last_peered":"2024-09-19T14:14:33.074777+0000","last_clean":"2024-09-19T14:14:33.074777+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:14:33.074777+0000","last_undegraded":"2024-09-19T14:14:33.074777+0000","last_fullsized":"2024-09-19T14:14:33.074777+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'257","last_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_deep_scrub":"260'257","last_deep_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.074609+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:15.486564+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":13968,"num_write":1077,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'510","reported_seq":2135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.286931+0000","last_change":"2024-09-19T14:14:42.286931+0000","last_active":"2024-09-19T14:14:42.286931+0000","last_peered":"2024-09-19T14:14:42.286931+0000","last_clean":"2024-09-19T14:14:42.286931+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:14:42.286931+0000","last_undegraded":"2024-09-19T14:14:42.286931+0000","last_fullsized":"2024-09-19T14:14:42.286931+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'510","last_scrub_stamp":"2024-09-19T14:14:42.286833+0000","last_deep_scrub":"260'510","last_deep_scrub_stamp":"2024-09-19T14:14:42.286833+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.286833+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:27.122118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'223","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.140942+0000","last_change":"2024-09-19T14:14:25.140942+0000","last_active":"2024-09-19T14:14:25.140942+0000","last_peered":"2024-09-19T14:14:25.140942+0000","last_clean":"2024-09-19T14:14:25.140942+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:14:25.140942+0000","last_undegraded":"2024-09-19T14:14:25.140942+0000","last_fullsized":"2024-09-19T14:14:25.140942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'223","last_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_deep_scrub":"260'223","last_deep_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.140874+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:35.398581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":601,"num_read_kb":75622,"num_write":971,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'451","reported_seq":1956,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.168528+0000","last_change":"2024-09-19T14:14:39.168465+0000","last_active":"2024-09-19T14:14:39.168528+0000","last_peered":"2024-09-19T14:14:39.168528+0000","last_clean":"2024-09-19T14:14:39.168528+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:14:39.168528+0000","last_undegraded":"2024-09-19T14:14:39.168528+0000","last_fullsized":"2024-09-19T14:14:39.168528+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.168391+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:37.445191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'200","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.769229+0000","last_change":"2024-09-19T14:14:33.769229+0000","last_active":"2024-09-19T14:14:33.769229+0000","last_peered":"2024-09-19T14:14:33.769229+0000","last_clean":"2024-09-19T14:14:33.769229+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:14:33.769229+0000","last_undegraded":"2024-09-19T14:14:33.769229+0000","last_fullsized":"2024-09-19T14:14:33.769229+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.769142+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:16.153085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":10629,"num_write":1012,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'199","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.744446+0000","last_change":"2024-09-19T14:14:34.744446+0000","last_active":"2024-09-19T14:14:34.744446+0000","last_peered":"2024-09-19T14:14:34.744446+0000","last_clean":"2024-09-19T14:14:34.744446+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:14:34.744446+0000","last_undegraded":"2024-09-19T14:14:34.744446+0000","last_fullsized":"2024-09-19T14:14:34.744446+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'199","last_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_deep_scrub":"260'199","last_deep_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.744323+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:13.419758+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":6982,"num_write":950,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'989","reported_seq":2920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.211591+0000","last_change":"2024-09-19T14:14:39.211498+0000","last_active":"2024-09-19T14:14:39.211591+0000","last_peered":"2024-09-19T14:14:39.211591+0000","last_clean":"2024-09-19T14:14:39.211591+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:14:39.211591+0000","last_undegraded":"2024-09-19T14:14:39.211591+0000","last_fullsized":"2024-09-19T14:14:39.211591+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'989","last_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_deep_scrub":"260'989","last_deep_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.211398+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:47.763679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4337,"num_omap_keys":17,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'233","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.306234+0000","last_change":"2024-09-19T14:14:28.306234+0000","last_active":"2024-09-19T14:14:28.306234+0000","last_peered":"2024-09-19T14:14:28.306234+0000","last_clean":"2024-09-19T14:14:28.306234+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:14:28.306234+0000","last_undegraded":"2024-09-19T14:14:28.306234+0000","last_fullsized":"2024-09-19T14:14:28.306234+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'233","last_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_deep_scrub":"260'233","last_deep_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.306126+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.168938+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":54230,"num_write":1173,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'388","reported_seq":1934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.732752+0000","last_change":"2024-09-19T14:14:42.732692+0000","last_active":"2024-09-19T14:14:42.732752+0000","last_peered":"2024-09-19T14:14:42.732752+0000","last_clean":"2024-09-19T14:14:42.732752+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:14:42.732752+0000","last_undegraded":"2024-09-19T14:14:42.732752+0000","last_fullsized":"2024-09-19T14:14:42.732752+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-19T14:14:42.732611+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-19T14:14:42.732611+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.732611+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.549453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1669,"ondisk_log_size":1669,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":646,"ondisk_log_size":646,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314615,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7869,"num_read_kb":9932,"num_write":5261,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702536,"num_omap_keys":1622,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1988,"ondisk_log_size":1988,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2874,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35717,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40883929,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38761,"num_read_kb":2616727,"num_write":63893,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":81767858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4188,"ondisk_log_size":4188,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":176453,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":179418,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542621,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235860,"kb_used_data":15876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94135980,"statfs":{"total":96636764160,"available":96395243520,"internally_reserved":0,"allocated":16257024,"data_stored":14556338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542622,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230792,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94141048,"statfs":{"total":96636764160,"available":96400433152,"internally_reserved":0,"allocated":15327232,"data_stored":13795194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542622,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102852,"kb_used_data":13428,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94268988,"statfs":{"total":96636764160,"available":96531443712,"internally_reserved":0,"allocated":13750272,"data_stored":12053849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542625,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94804,"kb_used_data":19204,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94277036,"statfs":{"total":96636764160,"available":96539684864,"internally_reserved":0,"allocated":19664896,"data_stored":18070568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542623,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248784,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123056,"statfs":{"total":96636764160,"available":96382009344,"internally_reserved":0,"allocated":19529728,"data_stored":17906941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542623,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75700,"kb_used_data":8420,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296140,"statfs":{"total":96636764160,"available":96559247360,"internally_reserved":0,"allocated":8622080,"data_stored":7083388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542622,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128220,"kb_used_data":6860,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94243620,"statfs":{"total":96636764160,"available":96505466880,"internally_reserved":0,"allocated":7024640,"data_stored":5427412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542623,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242092,"kb_used_data":12380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94129748,"statfs":{"total":96636764160,"available":96388861952,"internally_reserved":0,"allocated":12677120,"data_stored":10986646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8458240,"data_stored":8279931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3432448,"data_stored":3312234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5058560,"data_stored":4967857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":15790141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":15955950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10084352,"data_stored":9935554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11751424,"data_stored":11680028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":11846163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:15:26.302 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:26.302 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:26.303 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:26.304 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:26.304 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:26.304 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:03:07.814600+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=14, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T14:15:26.308 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T14:15:46.309 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T14:15:46.644 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-19T14:15:46.656 INFO:teuthology.orchestra.run.smithi094.stderr:dumped all 2024-09-19T14:15:46.658 INFO:teuthology.orchestra.run.smithi094.stdout:{"pg_ready":true,"pg_map":{"version":1450,"stamp":"2024-09-19T14:15:45.745928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41806249,"num_objects":632,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":296329,"num_read_kb":3211329,"num_write":145619,"num_write_kb":2512533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":742080,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13974,"ondisk_log_size":13974,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1359104,"kb_used_data":110208,"kb_used_omap":12,"kb_used_meta":1248755,"kb_avail":753615616,"statfs":{"total":773094113280,"available":771702390784,"internally_reserved":0,"allocated":112852992,"data_stored":99880336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1278725680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005341"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.610354+0000","last_change":"2024-09-19T14:15:10.610266+0000","last_active":"2024-09-19T14:15:10.610354+0000","last_peered":"2024-09-19T14:15:10.610354+0000","last_clean":"2024-09-19T14:15:10.610354+0000","last_became_active":"2024-09-19T14:03:08.839031+0000","last_became_peered":"2024-09-19T14:03:08.839031+0000","last_unstale":"2024-09-19T14:15:10.610354+0000","last_undegraded":"2024-09-19T14:15:10.610354+0000","last_fullsized":"2024-09-19T14:15:10.610354+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:10.610172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:10.610172+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.610172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:57.446956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.611382+0000","last_change":"2024-09-19T14:15:07.611311+0000","last_active":"2024-09-19T14:15:07.611382+0000","last_peered":"2024-09-19T14:15:07.611382+0000","last_clean":"2024-09-19T14:15:07.611382+0000","last_became_active":"2024-09-19T13:52:51.581669+0000","last_became_peered":"2024-09-19T13:52:51.581669+0000","last_unstale":"2024-09-19T14:15:07.611382+0000","last_undegraded":"2024-09-19T14:15:07.611382+0000","last_fullsized":"2024-09-19T14:15:07.611382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:07.611193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:07.611193+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.611193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:24.619774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"257'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:13.919874+0000","last_change":"2024-09-19T14:15:13.919804+0000","last_active":"2024-09-19T14:15:13.919874+0000","last_peered":"2024-09-19T14:15:13.919874+0000","last_clean":"2024-09-19T14:15:13.919874+0000","last_became_active":"2024-09-19T13:52:48.556223+0000","last_became_peered":"2024-09-19T13:52:48.556223+0000","last_unstale":"2024-09-19T14:15:13.919874+0000","last_undegraded":"2024-09-19T14:15:13.919874+0000","last_fullsized":"2024-09-19T14:15:13.919874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:15:13.919706+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:15:13.919706+0000","last_clean_scrub_stamp":"2024-09-19T14:15:13.919706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:55.825932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.208161+0000","last_change":"2024-09-19T14:15:10.208161+0000","last_active":"2024-09-19T14:15:10.208161+0000","last_peered":"2024-09-19T14:15:10.208161+0000","last_clean":"2024-09-19T14:15:10.208161+0000","last_became_active":"2024-09-19T13:51:15.739492+0000","last_became_peered":"2024-09-19T13:51:15.739492+0000","last_unstale":"2024-09-19T14:15:10.208161+0000","last_undegraded":"2024-09-19T14:15:10.208161+0000","last_fullsized":"2024-09-19T14:15:10.208161+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-19T14:15:10.208073+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-19T14:15:10.208073+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.208073+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:03.900577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.846761+0000","last_change":"2024-09-19T14:14:51.846653+0000","last_active":"2024-09-19T14:14:51.846761+0000","last_peered":"2024-09-19T14:14:51.846761+0000","last_clean":"2024-09-19T14:14:51.846761+0000","last_became_active":"2024-09-19T14:03:08.835160+0000","last_became_peered":"2024-09-19T14:03:08.835160+0000","last_unstale":"2024-09-19T14:14:51.846761+0000","last_undegraded":"2024-09-19T14:14:51.846761+0000","last_fullsized":"2024-09-19T14:14:51.846761+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:51.846559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:51.846559+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.846559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:04.234531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.655141+0000","last_change":"2024-09-19T14:15:12.655077+0000","last_active":"2024-09-19T14:15:12.655141+0000","last_peered":"2024-09-19T14:15:12.655141+0000","last_clean":"2024-09-19T14:15:12.655141+0000","last_became_active":"2024-09-19T13:52:51.587575+0000","last_became_peered":"2024-09-19T13:52:51.587575+0000","last_unstale":"2024-09-19T14:15:12.655141+0000","last_undegraded":"2024-09-19T14:15:12.655141+0000","last_fullsized":"2024-09-19T14:15:12.655141+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:12.654986+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:12.654986+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.654986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:16.230105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.392895+0000","last_change":"2024-09-19T14:14:56.392837+0000","last_active":"2024-09-19T14:14:56.392895+0000","last_peered":"2024-09-19T14:14:56.392895+0000","last_clean":"2024-09-19T14:14:56.392895+0000","last_became_active":"2024-09-19T13:52:48.553436+0000","last_became_peered":"2024-09-19T13:52:48.553436+0000","last_unstale":"2024-09-19T14:14:56.392895+0000","last_undegraded":"2024-09-19T14:14:56.392895+0000","last_fullsized":"2024-09-19T14:14:56.392895+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:56.392758+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:56.392758+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.392758+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:53.408517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'21","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.009526+0000","last_change":"2024-09-19T14:14:44.009429+0000","last_active":"2024-09-19T14:14:44.009526+0000","last_peered":"2024-09-19T14:14:44.009526+0000","last_clean":"2024-09-19T14:14:44.009526+0000","last_became_active":"2024-09-19T13:51:15.745287+0000","last_became_peered":"2024-09-19T13:51:15.745287+0000","last_unstale":"2024-09-19T14:14:44.009526+0000","last_undegraded":"2024-09-19T14:14:44.009526+0000","last_fullsized":"2024-09-19T14:14:44.009526+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'21","last_scrub_stamp":"2024-09-19T14:14:44.009304+0000","last_deep_scrub":"260'21","last_deep_scrub_stamp":"2024-09-19T14:14:44.009304+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.009304+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":122,"num_write":52,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.426501+0000","last_change":"2024-09-19T14:15:02.426435+0000","last_active":"2024-09-19T14:15:02.426501+0000","last_peered":"2024-09-19T14:15:02.426501+0000","last_clean":"2024-09-19T14:15:02.426501+0000","last_became_active":"2024-09-19T14:03:08.837266+0000","last_became_peered":"2024-09-19T14:03:08.837266+0000","last_unstale":"2024-09-19T14:15:02.426501+0000","last_undegraded":"2024-09-19T14:15:02.426501+0000","last_fullsized":"2024-09-19T14:15:02.426501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:02.426354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:02.426354+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.426354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:54.564072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"257'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:17.233068+0000","last_change":"2024-09-19T14:15:17.233068+0000","last_active":"2024-09-19T14:15:17.233068+0000","last_peered":"2024-09-19T14:15:17.233068+0000","last_clean":"2024-09-19T14:15:17.233068+0000","last_became_active":"2024-09-19T13:52:51.586710+0000","last_became_peered":"2024-09-19T13:52:51.586710+0000","last_unstale":"2024-09-19T14:15:17.233068+0000","last_undegraded":"2024-09-19T14:15:17.233068+0000","last_fullsized":"2024-09-19T14:15:17.233068+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:17.232955+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:17.232955+0000","last_clean_scrub_stamp":"2024-09-19T14:15:17.232955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:12.618684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.953618+0000","last_change":"2024-09-19T14:14:47.953554+0000","last_active":"2024-09-19T14:14:47.953618+0000","last_peered":"2024-09-19T14:14:47.953618+0000","last_clean":"2024-09-19T14:14:47.953618+0000","last_became_active":"2024-09-19T13:52:48.554171+0000","last_became_peered":"2024-09-19T13:52:48.554171+0000","last_unstale":"2024-09-19T14:14:47.953618+0000","last_undegraded":"2024-09-19T14:14:47.953618+0000","last_fullsized":"2024-09-19T14:14:47.953618+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.953461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.953461+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.953461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:30:45.295224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.165251+0000","last_change":"2024-09-19T14:15:07.165251+0000","last_active":"2024-09-19T14:15:07.165251+0000","last_peered":"2024-09-19T14:15:07.165251+0000","last_clean":"2024-09-19T14:15:07.165251+0000","last_became_active":"2024-09-19T13:51:15.737066+0000","last_became_peered":"2024-09-19T13:51:15.737066+0000","last_unstale":"2024-09-19T14:15:07.165251+0000","last_undegraded":"2024-09-19T14:15:07.165251+0000","last_fullsized":"2024-09-19T14:15:07.165251+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-09-19T14:15:07.165163+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-09-19T14:15:07.165163+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.165163+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:21.641381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":127,"num_write":61,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:25.002734+0000","last_change":"2024-09-19T14:15:25.002734+0000","last_active":"2024-09-19T14:15:25.002734+0000","last_peered":"2024-09-19T14:15:25.002734+0000","last_clean":"2024-09-19T14:15:25.002734+0000","last_became_active":"2024-09-19T14:03:08.833637+0000","last_became_peered":"2024-09-19T14:03:08.833637+0000","last_unstale":"2024-09-19T14:15:25.002734+0000","last_undegraded":"2024-09-19T14:15:25.002734+0000","last_fullsized":"2024-09-19T14:15:25.002734+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:25.002637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:25.002637+0000","last_clean_scrub_stamp":"2024-09-19T14:15:25.002637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:28.249600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:20.991585+0000","last_change":"2024-09-19T14:15:20.991585+0000","last_active":"2024-09-19T14:15:20.991585+0000","last_peered":"2024-09-19T14:15:20.991585+0000","last_clean":"2024-09-19T14:15:20.991585+0000","last_became_active":"2024-09-19T13:52:51.581141+0000","last_became_peered":"2024-09-19T13:52:51.581141+0000","last_unstale":"2024-09-19T14:15:20.991585+0000","last_undegraded":"2024-09-19T14:15:20.991585+0000","last_fullsized":"2024-09-19T14:15:20.991585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:20.991495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:20.991495+0000","last_clean_scrub_stamp":"2024-09-19T14:15:20.991495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:33.097015+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"257'2","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.607376+0000","last_change":"2024-09-19T14:15:06.607376+0000","last_active":"2024-09-19T14:15:06.607376+0000","last_peered":"2024-09-19T14:15:06.607376+0000","last_clean":"2024-09-19T14:15:06.607376+0000","last_became_active":"2024-09-19T13:52:48.553580+0000","last_became_peered":"2024-09-19T13:52:48.553580+0000","last_unstale":"2024-09-19T14:15:06.607376+0000","last_undegraded":"2024-09-19T14:15:06.607376+0000","last_fullsized":"2024-09-19T14:15:06.607376+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:15:06.607277+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:15:06.607277+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.607277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:10.495395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'40","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.937491+0000","last_change":"2024-09-19T14:15:09.937491+0000","last_active":"2024-09-19T14:15:09.937491+0000","last_peered":"2024-09-19T14:15:09.937491+0000","last_clean":"2024-09-19T14:15:09.937491+0000","last_became_active":"2024-09-19T13:51:15.746317+0000","last_became_peered":"2024-09-19T13:51:15.746317+0000","last_unstale":"2024-09-19T14:15:09.937491+0000","last_undegraded":"2024-09-19T14:15:09.937491+0000","last_fullsized":"2024-09-19T14:15:09.937491+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'40","last_scrub_stamp":"2024-09-19T14:15:09.937408+0000","last_deep_scrub":"260'40","last_deep_scrub_stamp":"2024-09-19T14:15:09.937408+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.937408+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:32.921352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":204,"num_write":101,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:26.002516+0000","last_change":"2024-09-19T14:15:26.002516+0000","last_active":"2024-09-19T14:15:26.002516+0000","last_peered":"2024-09-19T14:15:26.002516+0000","last_clean":"2024-09-19T14:15:26.002516+0000","last_became_active":"2024-09-19T14:03:08.839411+0000","last_became_peered":"2024-09-19T14:03:08.839411+0000","last_unstale":"2024-09-19T14:15:26.002516+0000","last_undegraded":"2024-09-19T14:15:26.002516+0000","last_fullsized":"2024-09-19T14:15:26.002516+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:26.002436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:26.002436+0000","last_clean_scrub_stamp":"2024-09-19T14:15:26.002436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:12.442329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.622977+0000","last_change":"2024-09-19T14:15:06.622977+0000","last_active":"2024-09-19T14:15:06.622977+0000","last_peered":"2024-09-19T14:15:06.622977+0000","last_clean":"2024-09-19T14:15:06.622977+0000","last_became_active":"2024-09-19T13:53:44.845793+0000","last_became_peered":"2024-09-19T13:53:44.845793+0000","last_unstale":"2024-09-19T14:15:06.622977+0000","last_undegraded":"2024-09-19T14:15:06.622977+0000","last_fullsized":"2024-09-19T14:15:06.622977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:06.622900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:06.622900+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.622900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:16.104547+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'5","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:13.231976+0000","last_change":"2024-09-19T14:15:13.231976+0000","last_active":"2024-09-19T14:15:13.231976+0000","last_peered":"2024-09-19T14:15:13.231976+0000","last_clean":"2024-09-19T14:15:13.231976+0000","last_became_active":"2024-09-19T13:52:48.552604+0000","last_became_peered":"2024-09-19T13:52:48.552604+0000","last_unstale":"2024-09-19T14:15:13.231976+0000","last_undegraded":"2024-09-19T14:15:13.231976+0000","last_fullsized":"2024-09-19T14:15:13.231976+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-19T14:15:13.231875+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-19T14:15:13.231875+0000","last_clean_scrub_stamp":"2024-09-19T14:15:13.231875+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:27.673301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":5,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"260'31","reported_seq":135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.924637+0000","last_change":"2024-09-19T14:15:07.924637+0000","last_active":"2024-09-19T14:15:07.924637+0000","last_peered":"2024-09-19T14:15:07.924637+0000","last_clean":"2024-09-19T14:15:07.924637+0000","last_became_active":"2024-09-19T13:51:15.743690+0000","last_became_peered":"2024-09-19T13:51:15.743690+0000","last_unstale":"2024-09-19T14:15:07.924637+0000","last_undegraded":"2024-09-19T14:15:07.924637+0000","last_fullsized":"2024-09-19T14:15:07.924637+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'31","last_scrub_stamp":"2024-09-19T14:15:07.924548+0000","last_deep_scrub":"260'31","last_deep_scrub_stamp":"2024-09-19T14:15:07.924548+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.924548+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:36.819345+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":172,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.494720+0000","last_change":"2024-09-19T14:15:05.494663+0000","last_active":"2024-09-19T14:15:05.494720+0000","last_peered":"2024-09-19T14:15:05.494720+0000","last_clean":"2024-09-19T14:15:05.494720+0000","last_became_active":"2024-09-19T14:03:08.837209+0000","last_became_peered":"2024-09-19T14:03:08.837209+0000","last_unstale":"2024-09-19T14:15:05.494720+0000","last_undegraded":"2024-09-19T14:15:05.494720+0000","last_fullsized":"2024-09-19T14:15:05.494720+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:05.494574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:05.494574+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.494574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:39.245848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.466793+0000","last_change":"2024-09-19T14:15:00.466793+0000","last_active":"2024-09-19T14:15:00.466793+0000","last_peered":"2024-09-19T14:15:00.466793+0000","last_clean":"2024-09-19T14:15:00.466793+0000","last_became_active":"2024-09-19T13:52:51.576096+0000","last_became_peered":"2024-09-19T13:52:51.576096+0000","last_unstale":"2024-09-19T14:15:00.466793+0000","last_undegraded":"2024-09-19T14:15:00.466793+0000","last_fullsized":"2024-09-19T14:15:00.466793+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:15:00.466700+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:15:00.466700+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.466700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:36.437346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'3","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.655766+0000","last_change":"2024-09-19T14:15:08.655766+0000","last_active":"2024-09-19T14:15:08.655766+0000","last_peered":"2024-09-19T14:15:08.655766+0000","last_clean":"2024-09-19T14:15:08.655766+0000","last_became_active":"2024-09-19T13:52:48.552873+0000","last_became_peered":"2024-09-19T13:52:48.552873+0000","last_unstale":"2024-09-19T14:15:08.655766+0000","last_undegraded":"2024-09-19T14:15:08.655766+0000","last_fullsized":"2024-09-19T14:15:08.655766+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:08.655680+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:08.655680+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.655680+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:44.662906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'133","reported_seq":444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.457122+0000","last_change":"2024-09-19T14:14:54.457122+0000","last_active":"2024-09-19T14:14:54.457122+0000","last_peered":"2024-09-19T14:14:54.457122+0000","last_clean":"2024-09-19T14:14:54.457122+0000","last_became_active":"2024-09-19T13:51:15.746479+0000","last_became_peered":"2024-09-19T13:51:15.746479+0000","last_unstale":"2024-09-19T14:14:54.457122+0000","last_undegraded":"2024-09-19T14:14:54.457122+0000","last_fullsized":"2024-09-19T14:14:54.457122+0000","mapping_epoch":247,"log_start":"257'100","ondisk_log_start":"257'100","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-09-19T14:14:54.457032+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-09-19T14:14:54.457032+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.457032+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:45.706150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1244,"num_read_kb":967,"num_write":287,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:20.173230+0000","last_change":"2024-09-19T14:15:20.173171+0000","last_active":"2024-09-19T14:15:20.173230+0000","last_peered":"2024-09-19T14:15:20.173230+0000","last_clean":"2024-09-19T14:15:20.173230+0000","last_became_active":"2024-09-19T14:03:08.841894+0000","last_became_peered":"2024-09-19T14:03:08.841894+0000","last_unstale":"2024-09-19T14:15:20.173230+0000","last_undegraded":"2024-09-19T14:15:20.173230+0000","last_fullsized":"2024-09-19T14:15:20.173230+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:20.173085+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:20.173085+0000","last_clean_scrub_stamp":"2024-09-19T14:15:20.173085+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:50:52.365318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.439083+0000","last_change":"2024-09-19T14:14:59.439026+0000","last_active":"2024-09-19T14:14:59.439083+0000","last_peered":"2024-09-19T14:14:59.439083+0000","last_clean":"2024-09-19T14:14:59.439083+0000","last_became_active":"2024-09-19T13:52:51.577399+0000","last_became_peered":"2024-09-19T13:52:51.577399+0000","last_unstale":"2024-09-19T14:14:59.439083+0000","last_undegraded":"2024-09-19T14:14:59.439083+0000","last_fullsized":"2024-09-19T14:14:59.439083+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:59.438939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:59.438939+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.438939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:35.216484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.695573+0000","last_change":"2024-09-19T14:15:04.695515+0000","last_active":"2024-09-19T14:15:04.695573+0000","last_peered":"2024-09-19T14:15:04.695573+0000","last_clean":"2024-09-19T14:15:04.695573+0000","last_became_active":"2024-09-19T13:52:48.556044+0000","last_became_peered":"2024-09-19T13:52:48.556044+0000","last_unstale":"2024-09-19T14:15:04.695573+0000","last_undegraded":"2024-09-19T14:15:04.695573+0000","last_fullsized":"2024-09-19T14:15:04.695573+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:04.695427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:04.695427+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.695427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:44.629273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'22","reported_seq":112,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.148135+0000","last_change":"2024-09-19T14:15:06.148076+0000","last_active":"2024-09-19T14:15:06.148135+0000","last_peered":"2024-09-19T14:15:06.148135+0000","last_clean":"2024-09-19T14:15:06.148135+0000","last_became_active":"2024-09-19T13:51:15.738315+0000","last_became_peered":"2024-09-19T13:51:15.738315+0000","last_unstale":"2024-09-19T14:15:06.148135+0000","last_undegraded":"2024-09-19T14:15:06.148135+0000","last_fullsized":"2024-09-19T14:15:06.148135+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-19T14:15:06.148005+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-19T14:15:06.148005+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.148005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:35.685405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":113,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:21.137280+0000","last_change":"2024-09-19T14:15:21.137211+0000","last_active":"2024-09-19T14:15:21.137280+0000","last_peered":"2024-09-19T14:15:21.137280+0000","last_clean":"2024-09-19T14:15:21.137280+0000","last_became_active":"2024-09-19T14:03:08.844209+0000","last_became_peered":"2024-09-19T14:03:08.844209+0000","last_unstale":"2024-09-19T14:15:21.137280+0000","last_undegraded":"2024-09-19T14:15:21.137280+0000","last_fullsized":"2024-09-19T14:15:21.137280+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:21.137116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:21.137116+0000","last_clean_scrub_stamp":"2024-09-19T14:15:21.137116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:53.164623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'8","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:19.946212+0000","last_change":"2024-09-19T14:15:19.946140+0000","last_active":"2024-09-19T14:15:19.946212+0000","last_peered":"2024-09-19T14:15:19.946212+0000","last_clean":"2024-09-19T14:15:19.946212+0000","last_became_active":"2024-09-19T13:52:51.580691+0000","last_became_peered":"2024-09-19T13:52:51.580691+0000","last_unstale":"2024-09-19T14:15:19.946212+0000","last_undegraded":"2024-09-19T14:15:19.946212+0000","last_fullsized":"2024-09-19T14:15:19.946212+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:15:19.946035+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:15:19.946035+0000","last_clean_scrub_stamp":"2024-09-19T14:15:19.946035+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:57:26.937572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:14.260399+0000","last_change":"2024-09-19T14:15:14.260324+0000","last_active":"2024-09-19T14:15:14.260399+0000","last_peered":"2024-09-19T14:15:14.260399+0000","last_clean":"2024-09-19T14:15:14.260399+0000","last_became_active":"2024-09-19T13:52:48.559695+0000","last_became_peered":"2024-09-19T13:52:48.559695+0000","last_unstale":"2024-09-19T14:15:14.260399+0000","last_undegraded":"2024-09-19T14:15:14.260399+0000","last_fullsized":"2024-09-19T14:15:14.260399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:14.260225+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:14.260225+0000","last_clean_scrub_stamp":"2024-09-19T14:15:14.260225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:53:22.907945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'13","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.419383+0000","last_change":"2024-09-19T14:14:53.419264+0000","last_active":"2024-09-19T14:14:53.419383+0000","last_peered":"2024-09-19T14:14:53.419383+0000","last_clean":"2024-09-19T14:14:53.419383+0000","last_became_active":"2024-09-19T13:51:15.740189+0000","last_became_peered":"2024-09-19T13:51:15.740189+0000","last_unstale":"2024-09-19T14:14:53.419383+0000","last_undegraded":"2024-09-19T14:14:53.419383+0000","last_fullsized":"2024-09-19T14:14:53.419383+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'13","last_scrub_stamp":"2024-09-19T14:14:53.419168+0000","last_deep_scrub":"260'13","last_deep_scrub_stamp":"2024-09-19T14:14:53.419168+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.419168+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:32.991423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":64,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.496017+0000","last_change":"2024-09-19T14:15:04.496017+0000","last_active":"2024-09-19T14:15:04.496017+0000","last_peered":"2024-09-19T14:15:04.496017+0000","last_clean":"2024-09-19T14:15:04.496017+0000","last_became_active":"2024-09-19T14:03:08.839529+0000","last_became_peered":"2024-09-19T14:03:08.839529+0000","last_unstale":"2024-09-19T14:15:04.496017+0000","last_undegraded":"2024-09-19T14:15:04.496017+0000","last_fullsized":"2024-09-19T14:15:04.496017+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:04.495924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:04.495924+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.495924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:48.287933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'5","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:18.919134+0000","last_change":"2024-09-19T14:15:18.919134+0000","last_active":"2024-09-19T14:15:18.919134+0000","last_peered":"2024-09-19T14:15:18.919134+0000","last_clean":"2024-09-19T14:15:18.919134+0000","last_became_active":"2024-09-19T13:52:51.578955+0000","last_became_peered":"2024-09-19T13:52:51.578955+0000","last_unstale":"2024-09-19T14:15:18.919134+0000","last_undegraded":"2024-09-19T14:15:18.919134+0000","last_fullsized":"2024-09-19T14:15:18.919134+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-19T14:15:18.919023+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-19T14:15:18.919023+0000","last_clean_scrub_stamp":"2024-09-19T14:15:18.919023+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:06.522877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.598551+0000","last_change":"2024-09-19T14:15:05.598551+0000","last_active":"2024-09-19T14:15:05.598551+0000","last_peered":"2024-09-19T14:15:05.598551+0000","last_clean":"2024-09-19T14:15:05.598551+0000","last_became_active":"2024-09-19T13:52:48.554415+0000","last_became_peered":"2024-09-19T13:52:48.554415+0000","last_unstale":"2024-09-19T14:15:05.598551+0000","last_undegraded":"2024-09-19T14:15:05.598551+0000","last_fullsized":"2024-09-19T14:15:05.598551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-19T14:15:05.598433+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-19T14:15:05.598433+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.598433+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:51.185214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'39","reported_seq":158,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.193918+0000","last_change":"2024-09-19T14:15:05.193858+0000","last_active":"2024-09-19T14:15:05.193918+0000","last_peered":"2024-09-19T14:15:05.193918+0000","last_clean":"2024-09-19T14:15:05.193918+0000","last_became_active":"2024-09-19T13:51:15.738792+0000","last_became_peered":"2024-09-19T13:51:15.738792+0000","last_unstale":"2024-09-19T14:15:05.193918+0000","last_undegraded":"2024-09-19T14:15:05.193918+0000","last_fullsized":"2024-09-19T14:15:05.193918+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'39","last_scrub_stamp":"2024-09-19T14:15:05.193755+0000","last_deep_scrub":"260'39","last_deep_scrub_stamp":"2024-09-19T14:15:05.193755+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.193755+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:54.011214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":299,"num_read_kb":201,"num_write":98,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.881471+0000","last_change":"2024-09-19T14:14:49.881409+0000","last_active":"2024-09-19T14:14:49.881471+0000","last_peered":"2024-09-19T14:14:49.881471+0000","last_clean":"2024-09-19T14:14:49.881471+0000","last_became_active":"2024-09-19T14:03:08.840970+0000","last_became_peered":"2024-09-19T14:03:08.840970+0000","last_unstale":"2024-09-19T14:14:49.881471+0000","last_undegraded":"2024-09-19T14:14:49.881471+0000","last_fullsized":"2024-09-19T14:14:49.881471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:49.881313+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:49.881313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.881313+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:14.081295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:16.932519+0000","last_change":"2024-09-19T14:15:16.932519+0000","last_active":"2024-09-19T14:15:16.932519+0000","last_peered":"2024-09-19T14:15:16.932519+0000","last_clean":"2024-09-19T14:15:16.932519+0000","last_became_active":"2024-09-19T13:52:51.578486+0000","last_became_peered":"2024-09-19T13:52:51.578486+0000","last_unstale":"2024-09-19T14:15:16.932519+0000","last_undegraded":"2024-09-19T14:15:16.932519+0000","last_fullsized":"2024-09-19T14:15:16.932519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:16.932422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:16.932422+0000","last_clean_scrub_stamp":"2024-09-19T14:15:16.932422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:09.242445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.370849+0000","last_change":"2024-09-19T14:15:09.370849+0000","last_active":"2024-09-19T14:15:09.370849+0000","last_peered":"2024-09-19T14:15:09.370849+0000","last_clean":"2024-09-19T14:15:09.370849+0000","last_became_active":"2024-09-19T13:52:48.554201+0000","last_became_peered":"2024-09-19T13:52:48.554201+0000","last_unstale":"2024-09-19T14:15:09.370849+0000","last_undegraded":"2024-09-19T14:15:09.370849+0000","last_fullsized":"2024-09-19T14:15:09.370849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:09.370741+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:09.370741+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.370741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:34.311632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'41","reported_seq":162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.958954+0000","last_change":"2024-09-19T14:15:06.958885+0000","last_active":"2024-09-19T14:15:06.958954+0000","last_peered":"2024-09-19T14:15:06.958954+0000","last_clean":"2024-09-19T14:15:06.958954+0000","last_became_active":"2024-09-19T13:51:15.743559+0000","last_became_peered":"2024-09-19T13:51:15.743559+0000","last_unstale":"2024-09-19T14:15:06.958954+0000","last_undegraded":"2024-09-19T14:15:06.958954+0000","last_fullsized":"2024-09-19T14:15:06.958954+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'41","last_scrub_stamp":"2024-09-19T14:15:06.958806+0000","last_deep_scrub":"260'41","last_deep_scrub_stamp":"2024-09-19T14:15:06.958806+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.958806+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:41.977158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":313,"num_read_kb":195,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:19.189389+0000","last_change":"2024-09-19T14:15:19.189389+0000","last_active":"2024-09-19T14:15:19.189389+0000","last_peered":"2024-09-19T14:15:19.189389+0000","last_clean":"2024-09-19T14:15:19.189389+0000","last_became_active":"2024-09-19T14:03:08.840449+0000","last_became_peered":"2024-09-19T14:03:08.840449+0000","last_unstale":"2024-09-19T14:15:19.189389+0000","last_undegraded":"2024-09-19T14:15:19.189389+0000","last_fullsized":"2024-09-19T14:15:19.189389+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:19.189298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:19.189298+0000","last_clean_scrub_stamp":"2024-09-19T14:15:19.189298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:35.706672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:17.901460+0000","last_change":"2024-09-19T14:15:17.901460+0000","last_active":"2024-09-19T14:15:17.901460+0000","last_peered":"2024-09-19T14:15:17.901460+0000","last_clean":"2024-09-19T14:15:17.901460+0000","last_became_active":"2024-09-19T13:52:51.576366+0000","last_became_peered":"2024-09-19T13:52:51.576366+0000","last_unstale":"2024-09-19T14:15:17.901460+0000","last_undegraded":"2024-09-19T14:15:17.901460+0000","last_fullsized":"2024-09-19T14:15:17.901460+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:17.901370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:17.901370+0000","last_clean_scrub_stamp":"2024-09-19T14:15:17.901370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:43.649938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.926906+0000","last_change":"2024-09-19T14:14:46.926906+0000","last_active":"2024-09-19T14:14:46.926906+0000","last_peered":"2024-09-19T14:14:46.926906+0000","last_clean":"2024-09-19T14:14:46.926906+0000","last_became_active":"2024-09-19T13:52:48.557825+0000","last_became_peered":"2024-09-19T13:52:48.557825+0000","last_unstale":"2024-09-19T14:14:46.926906+0000","last_undegraded":"2024-09-19T14:14:46.926906+0000","last_fullsized":"2024-09-19T14:14:46.926906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:46.926822+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:46.926822+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.926822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:46.808770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'17","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.994674+0000","last_change":"2024-09-19T14:14:42.994603+0000","last_active":"2024-09-19T14:14:42.994674+0000","last_peered":"2024-09-19T14:14:42.994674+0000","last_clean":"2024-09-19T14:14:42.994674+0000","last_became_active":"2024-09-19T13:51:15.738941+0000","last_became_peered":"2024-09-19T13:51:15.738941+0000","last_unstale":"2024-09-19T14:14:42.994674+0000","last_undegraded":"2024-09-19T14:14:42.994674+0000","last_fullsized":"2024-09-19T14:14:42.994674+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'17","last_scrub_stamp":"2024-09-19T14:14:42.994517+0000","last_deep_scrub":"260'17","last_deep_scrub_stamp":"2024-09-19T14:14:42.994517+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.994517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:21.285051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":61,"num_write":47,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.611737+0000","last_change":"2024-09-19T14:15:11.611737+0000","last_active":"2024-09-19T14:15:11.611737+0000","last_peered":"2024-09-19T14:15:11.611737+0000","last_clean":"2024-09-19T14:15:11.611737+0000","last_became_active":"2024-09-19T14:03:08.838533+0000","last_became_peered":"2024-09-19T14:03:08.838533+0000","last_unstale":"2024-09-19T14:15:11.611737+0000","last_undegraded":"2024-09-19T14:15:11.611737+0000","last_fullsized":"2024-09-19T14:15:11.611737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.611643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.611643+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.611643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:35:12.597118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.621036+0000","last_change":"2024-09-19T14:15:10.621036+0000","last_active":"2024-09-19T14:15:10.621036+0000","last_peered":"2024-09-19T14:15:10.621036+0000","last_clean":"2024-09-19T14:15:10.621036+0000","last_became_active":"2024-09-19T13:52:51.583645+0000","last_became_peered":"2024-09-19T13:52:51.583645+0000","last_unstale":"2024-09-19T14:15:10.621036+0000","last_undegraded":"2024-09-19T14:15:10.621036+0000","last_fullsized":"2024-09-19T14:15:10.621036+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:10.620953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:10.620953+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.620953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:37.295128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'8","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.248053+0000","last_change":"2024-09-19T14:15:12.248053+0000","last_active":"2024-09-19T14:15:12.248053+0000","last_peered":"2024-09-19T14:15:12.248053+0000","last_clean":"2024-09-19T14:15:12.248053+0000","last_became_active":"2024-09-19T13:52:48.555440+0000","last_became_peered":"2024-09-19T13:52:48.555440+0000","last_unstale":"2024-09-19T14:15:12.248053+0000","last_undegraded":"2024-09-19T14:15:12.248053+0000","last_fullsized":"2024-09-19T14:15:12.248053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:15:12.247922+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:15:12.247922+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.247922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:00:47.210429+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'38","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.398926+0000","last_change":"2024-09-19T14:15:02.398926+0000","last_active":"2024-09-19T14:15:02.398926+0000","last_peered":"2024-09-19T14:15:02.398926+0000","last_clean":"2024-09-19T14:15:02.398926+0000","last_became_active":"2024-09-19T13:51:15.742525+0000","last_became_peered":"2024-09-19T13:51:15.742525+0000","last_unstale":"2024-09-19T14:15:02.398926+0000","last_undegraded":"2024-09-19T14:15:02.398926+0000","last_fullsized":"2024-09-19T14:15:02.398926+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'38","last_scrub_stamp":"2024-09-19T14:15:02.398844+0000","last_deep_scrub":"260'38","last_deep_scrub_stamp":"2024-09-19T14:15:02.398844+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.398844+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:46.346823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":177,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:24.024059+0000","last_change":"2024-09-19T14:15:24.024059+0000","last_active":"2024-09-19T14:15:24.024059+0000","last_peered":"2024-09-19T14:15:24.024059+0000","last_clean":"2024-09-19T14:15:24.024059+0000","last_became_active":"2024-09-19T14:03:08.838584+0000","last_became_peered":"2024-09-19T14:03:08.838584+0000","last_unstale":"2024-09-19T14:15:24.024059+0000","last_undegraded":"2024-09-19T14:15:24.024059+0000","last_fullsized":"2024-09-19T14:15:24.024059+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:24.023961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:24.023961+0000","last_clean_scrub_stamp":"2024-09-19T14:15:24.023961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:07.125244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"260'14","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.459253+0000","last_change":"2024-09-19T14:15:02.459253+0000","last_active":"2024-09-19T14:15:02.459253+0000","last_peered":"2024-09-19T14:15:02.459253+0000","last_clean":"2024-09-19T14:15:02.459253+0000","last_became_active":"2024-09-19T13:52:51.584567+0000","last_became_peered":"2024-09-19T13:52:51.584567+0000","last_unstale":"2024-09-19T14:15:02.459253+0000","last_undegraded":"2024-09-19T14:15:02.459253+0000","last_fullsized":"2024-09-19T14:15:02.459253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-19T14:15:02.459165+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-19T14:15:02.459165+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.459165+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:49.616451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":11793,"num_write":34,"num_write_kb":16913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.740275+0000","last_change":"2024-09-19T14:15:02.740275+0000","last_active":"2024-09-19T14:15:02.740275+0000","last_peered":"2024-09-19T14:15:02.740275+0000","last_clean":"2024-09-19T14:15:02.740275+0000","last_became_active":"2024-09-19T13:52:48.557946+0000","last_became_peered":"2024-09-19T13:52:48.557946+0000","last_unstale":"2024-09-19T14:15:02.740275+0000","last_undegraded":"2024-09-19T14:15:02.740275+0000","last_fullsized":"2024-09-19T14:15:02.740275+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:02.740161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:02.740161+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.740161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:24.678974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'19","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.403295+0000","last_change":"2024-09-19T14:15:04.403295+0000","last_active":"2024-09-19T14:15:04.403295+0000","last_peered":"2024-09-19T14:15:04.403295+0000","last_clean":"2024-09-19T14:15:04.403295+0000","last_became_active":"2024-09-19T13:51:15.742691+0000","last_became_peered":"2024-09-19T13:51:15.742691+0000","last_unstale":"2024-09-19T14:15:04.403295+0000","last_undegraded":"2024-09-19T14:15:04.403295+0000","last_fullsized":"2024-09-19T14:15:04.403295+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-19T14:15:04.403195+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-19T14:15:04.403195+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.403195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:11.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":97,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:21.319472+0000","last_change":"2024-09-19T14:15:21.319472+0000","last_active":"2024-09-19T14:15:21.319472+0000","last_peered":"2024-09-19T14:15:21.319472+0000","last_clean":"2024-09-19T14:15:21.319472+0000","last_became_active":"2024-09-19T14:03:08.841776+0000","last_became_peered":"2024-09-19T14:03:08.841776+0000","last_unstale":"2024-09-19T14:15:21.319472+0000","last_undegraded":"2024-09-19T14:15:21.319472+0000","last_fullsized":"2024-09-19T14:15:21.319472+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:21.319373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:21.319373+0000","last_clean_scrub_stamp":"2024-09-19T14:15:21.319373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:41.729827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.458805+0000","last_change":"2024-09-19T14:15:01.458805+0000","last_active":"2024-09-19T14:15:01.458805+0000","last_peered":"2024-09-19T14:15:01.458805+0000","last_clean":"2024-09-19T14:15:01.458805+0000","last_became_active":"2024-09-19T13:52:51.582095+0000","last_became_peered":"2024-09-19T13:52:51.582095+0000","last_unstale":"2024-09-19T14:15:01.458805+0000","last_undegraded":"2024-09-19T14:15:01.458805+0000","last_fullsized":"2024-09-19T14:15:01.458805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:01.458718+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:01.458718+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.458718+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:20.975760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.933103+0000","last_change":"2024-09-19T14:15:10.933103+0000","last_active":"2024-09-19T14:15:10.933103+0000","last_peered":"2024-09-19T14:15:10.933103+0000","last_clean":"2024-09-19T14:15:10.933103+0000","last_became_active":"2024-09-19T13:52:48.557544+0000","last_became_peered":"2024-09-19T13:52:48.557544+0000","last_unstale":"2024-09-19T14:15:10.933103+0000","last_undegraded":"2024-09-19T14:15:10.933103+0000","last_fullsized":"2024-09-19T14:15:10.933103+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:10.933001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:10.933001+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.933001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:10:36.311311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'11","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.181180+0000","last_change":"2024-09-19T14:15:04.181180+0000","last_active":"2024-09-19T14:15:04.181180+0000","last_peered":"2024-09-19T14:15:04.181180+0000","last_clean":"2024-09-19T14:15:04.181180+0000","last_became_active":"2024-09-19T13:51:15.738916+0000","last_became_peered":"2024-09-19T13:51:15.738916+0000","last_unstale":"2024-09-19T14:15:04.181180+0000","last_undegraded":"2024-09-19T14:15:04.181180+0000","last_fullsized":"2024-09-19T14:15:04.181180+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'11","last_scrub_stamp":"2024-09-19T14:15:04.181090+0000","last_deep_scrub":"260'11","last_deep_scrub_stamp":"2024-09-19T14:15:04.181090+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.181090+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:09.746349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":35,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:22.314071+0000","last_change":"2024-09-19T14:15:22.314071+0000","last_active":"2024-09-19T14:15:22.314071+0000","last_peered":"2024-09-19T14:15:22.314071+0000","last_clean":"2024-09-19T14:15:22.314071+0000","last_became_active":"2024-09-19T14:03:08.837261+0000","last_became_peered":"2024-09-19T14:03:08.837261+0000","last_unstale":"2024-09-19T14:15:22.314071+0000","last_undegraded":"2024-09-19T14:15:22.314071+0000","last_fullsized":"2024-09-19T14:15:22.314071+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:22.313985+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:22.313985+0000","last_clean_scrub_stamp":"2024-09-19T14:15:22.313985+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:46:37.657770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:15.920753+0000","last_change":"2024-09-19T14:15:15.920753+0000","last_active":"2024-09-19T14:15:15.920753+0000","last_peered":"2024-09-19T14:15:15.920753+0000","last_clean":"2024-09-19T14:15:15.920753+0000","last_became_active":"2024-09-19T13:52:51.579979+0000","last_became_peered":"2024-09-19T13:52:51.579979+0000","last_unstale":"2024-09-19T14:15:15.920753+0000","last_undegraded":"2024-09-19T14:15:15.920753+0000","last_fullsized":"2024-09-19T14:15:15.920753+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:15.920655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:15.920655+0000","last_clean_scrub_stamp":"2024-09-19T14:15:15.920655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:57.968812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"257'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.437176+0000","last_change":"2024-09-19T14:14:57.437176+0000","last_active":"2024-09-19T14:14:57.437176+0000","last_peered":"2024-09-19T14:14:57.437176+0000","last_clean":"2024-09-19T14:14:57.437176+0000","last_became_active":"2024-09-19T13:52:48.547543+0000","last_became_peered":"2024-09-19T13:52:48.547543+0000","last_unstale":"2024-09-19T14:14:57.437176+0000","last_undegraded":"2024-09-19T14:14:57.437176+0000","last_fullsized":"2024-09-19T14:14:57.437176+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:14:57.437055+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:14:57.437055+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.437055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.642438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'60","reported_seq":223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.735800+0000","last_change":"2024-09-19T14:15:03.735800+0000","last_active":"2024-09-19T14:15:03.735800+0000","last_peered":"2024-09-19T14:15:03.735800+0000","last_clean":"2024-09-19T14:15:03.735800+0000","last_became_active":"2024-09-19T13:51:15.735844+0000","last_became_peered":"2024-09-19T13:51:15.735844+0000","last_unstale":"2024-09-19T14:15:03.735800+0000","last_undegraded":"2024-09-19T14:15:03.735800+0000","last_fullsized":"2024-09-19T14:15:03.735800+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'60","last_scrub_stamp":"2024-09-19T14:15:03.735712+0000","last_deep_scrub":"260'60","last_deep_scrub_stamp":"2024-09-19T14:15:03.735712+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.735712+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:00.243992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":498,"num_read_kb":326,"num_write":149,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:23.012240+0000","last_change":"2024-09-19T14:15:23.012240+0000","last_active":"2024-09-19T14:15:23.012240+0000","last_peered":"2024-09-19T14:15:23.012240+0000","last_clean":"2024-09-19T14:15:23.012240+0000","last_became_active":"2024-09-19T14:03:08.837391+0000","last_became_peered":"2024-09-19T14:03:08.837391+0000","last_unstale":"2024-09-19T14:15:23.012240+0000","last_undegraded":"2024-09-19T14:15:23.012240+0000","last_fullsized":"2024-09-19T14:15:23.012240+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:23.012152+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:23.012152+0000","last_clean_scrub_stamp":"2024-09-19T14:15:23.012152+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:04.884048+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.472398+0000","last_change":"2024-09-19T14:14:58.472398+0000","last_active":"2024-09-19T14:14:58.472398+0000","last_peered":"2024-09-19T14:14:58.472398+0000","last_clean":"2024-09-19T14:14:58.472398+0000","last_became_active":"2024-09-19T13:52:51.585579+0000","last_became_peered":"2024-09-19T13:52:51.585579+0000","last_unstale":"2024-09-19T14:14:58.472398+0000","last_undegraded":"2024-09-19T14:14:58.472398+0000","last_fullsized":"2024-09-19T14:14:58.472398+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:14:58.472281+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:14:58.472281+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.472281+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:14.088006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'10","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.597665+0000","last_change":"2024-09-19T14:15:03.597665+0000","last_active":"2024-09-19T14:15:03.597665+0000","last_peered":"2024-09-19T14:15:03.597665+0000","last_clean":"2024-09-19T14:15:03.597665+0000","last_became_active":"2024-09-19T13:52:48.546897+0000","last_became_peered":"2024-09-19T13:52:48.546897+0000","last_unstale":"2024-09-19T14:15:03.597665+0000","last_undegraded":"2024-09-19T14:15:03.597665+0000","last_fullsized":"2024-09-19T14:15:03.597665+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-19T14:15:03.597576+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-19T14:15:03.597576+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.597576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:12.886619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26674,"num_write":10,"num_write_kb":11312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'42","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.948840+0000","last_change":"2024-09-19T14:15:08.948840+0000","last_active":"2024-09-19T14:15:08.948840+0000","last_peered":"2024-09-19T14:15:08.948840+0000","last_clean":"2024-09-19T14:15:08.948840+0000","last_became_active":"2024-09-19T13:51:15.745001+0000","last_became_peered":"2024-09-19T13:51:15.745001+0000","last_unstale":"2024-09-19T14:15:08.948840+0000","last_undegraded":"2024-09-19T14:15:08.948840+0000","last_fullsized":"2024-09-19T14:15:08.948840+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-09-19T14:15:08.948731+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-09-19T14:15:08.948731+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.948731+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:03.316574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":198,"num_write":107,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.907232+0000","last_change":"2024-09-19T14:14:48.907232+0000","last_active":"2024-09-19T14:14:48.907232+0000","last_peered":"2024-09-19T14:14:48.907232+0000","last_clean":"2024-09-19T14:14:48.907232+0000","last_became_active":"2024-09-19T14:03:08.839297+0000","last_became_peered":"2024-09-19T14:03:08.839297+0000","last_unstale":"2024-09-19T14:14:48.907232+0000","last_undegraded":"2024-09-19T14:14:48.907232+0000","last_fullsized":"2024-09-19T14:14:48.907232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:48.907148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:48.907148+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.907148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:32.974297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'7","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.909915+0000","last_change":"2024-09-19T14:15:12.909858+0000","last_active":"2024-09-19T14:15:12.909915+0000","last_peered":"2024-09-19T14:15:12.909915+0000","last_clean":"2024-09-19T14:15:12.909915+0000","last_became_active":"2024-09-19T13:52:51.577791+0000","last_became_peered":"2024-09-19T13:52:51.577791+0000","last_unstale":"2024-09-19T14:15:12.909915+0000","last_undegraded":"2024-09-19T14:15:12.909915+0000","last_fullsized":"2024-09-19T14:15:12.909915+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-19T14:15:12.909772+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-19T14:15:12.909772+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.909772+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:49:24.602438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.366281+0000","last_change":"2024-09-19T14:15:08.366219+0000","last_active":"2024-09-19T14:15:08.366281+0000","last_peered":"2024-09-19T14:15:08.366281+0000","last_clean":"2024-09-19T14:15:08.366281+0000","last_became_active":"2024-09-19T13:52:48.557836+0000","last_became_peered":"2024-09-19T13:52:48.557836+0000","last_unstale":"2024-09-19T14:15:08.366281+0000","last_undegraded":"2024-09-19T14:15:08.366281+0000","last_fullsized":"2024-09-19T14:15:08.366281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:08.366090+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:08.366090+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.366090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:27.241621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'14","reported_seq":89,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.911897+0000","last_change":"2024-09-19T14:15:05.911897+0000","last_active":"2024-09-19T14:15:05.911897+0000","last_peered":"2024-09-19T14:15:05.911897+0000","last_clean":"2024-09-19T14:15:05.911897+0000","last_became_active":"2024-09-19T13:51:15.742764+0000","last_became_peered":"2024-09-19T13:51:15.742764+0000","last_unstale":"2024-09-19T14:15:05.911897+0000","last_undegraded":"2024-09-19T14:15:05.911897+0000","last_fullsized":"2024-09-19T14:15:05.911897+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-19T14:15:05.911821+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-19T14:15:05.911821+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.911821+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:26.933947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:16.280073+0000","last_change":"2024-09-19T14:15:16.280073+0000","last_active":"2024-09-19T14:15:16.280073+0000","last_peered":"2024-09-19T14:15:16.280073+0000","last_clean":"2024-09-19T14:15:16.280073+0000","last_became_active":"2024-09-19T14:03:08.841168+0000","last_became_peered":"2024-09-19T14:03:08.841168+0000","last_unstale":"2024-09-19T14:15:16.280073+0000","last_undegraded":"2024-09-19T14:15:16.280073+0000","last_fullsized":"2024-09-19T14:15:16.280073+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:16.279982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:16.279982+0000","last_clean_scrub_stamp":"2024-09-19T14:15:16.279982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:17:20.725265+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.955019+0000","last_change":"2024-09-19T14:15:11.954950+0000","last_active":"2024-09-19T14:15:11.955019+0000","last_peered":"2024-09-19T14:15:11.955019+0000","last_clean":"2024-09-19T14:15:11.955019+0000","last_became_active":"2024-09-19T13:52:51.585406+0000","last_became_peered":"2024-09-19T13:52:51.585406+0000","last_unstale":"2024-09-19T14:15:11.955019+0000","last_undegraded":"2024-09-19T14:15:11.955019+0000","last_fullsized":"2024-09-19T14:15:11.955019+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.954861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.954861+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.954861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:44.561504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'6","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.944278+0000","last_change":"2024-09-19T14:14:45.944218+0000","last_active":"2024-09-19T14:14:45.944278+0000","last_peered":"2024-09-19T14:14:45.944278+0000","last_clean":"2024-09-19T14:14:45.944278+0000","last_became_active":"2024-09-19T13:52:48.558233+0000","last_became_peered":"2024-09-19T13:52:48.558233+0000","last_unstale":"2024-09-19T14:14:45.944278+0000","last_undegraded":"2024-09-19T14:14:45.944278+0000","last_fullsized":"2024-09-19T14:14:45.944278+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:14:45.944144+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:14:45.944144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.944144+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:16.135652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'64","reported_seq":233,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.589575+0000","last_change":"2024-09-19T14:15:01.589575+0000","last_active":"2024-09-19T14:15:01.589575+0000","last_peered":"2024-09-19T14:15:01.589575+0000","last_clean":"2024-09-19T14:15:01.589575+0000","last_became_active":"2024-09-19T13:51:15.746858+0000","last_became_peered":"2024-09-19T13:51:15.746858+0000","last_unstale":"2024-09-19T14:15:01.589575+0000","last_undegraded":"2024-09-19T14:15:01.589575+0000","last_fullsized":"2024-09-19T14:15:01.589575+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'64","last_scrub_stamp":"2024-09-19T14:15:01.589492+0000","last_deep_scrub":"260'64","last_deep_scrub_stamp":"2024-09-19T14:15:01.589492+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.589492+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:19:29.776594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":369,"num_write":152,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.446730+0000","last_change":"2024-09-19T14:15:01.446730+0000","last_active":"2024-09-19T14:15:01.446730+0000","last_peered":"2024-09-19T14:15:01.446730+0000","last_clean":"2024-09-19T14:15:01.446730+0000","last_became_active":"2024-09-19T14:03:08.836907+0000","last_became_peered":"2024-09-19T14:03:08.836907+0000","last_unstale":"2024-09-19T14:15:01.446730+0000","last_undegraded":"2024-09-19T14:15:01.446730+0000","last_fullsized":"2024-09-19T14:15:01.446730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:01.446614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:01.446614+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.446614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:06.181987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"257'5","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.460332+0000","last_change":"2024-09-19T14:15:00.460227+0000","last_active":"2024-09-19T14:15:00.460332+0000","last_peered":"2024-09-19T14:15:00.460332+0000","last_clean":"2024-09-19T14:15:00.460332+0000","last_became_active":"2024-09-19T13:52:51.585863+0000","last_became_peered":"2024-09-19T13:52:51.585863+0000","last_unstale":"2024-09-19T14:15:00.460332+0000","last_undegraded":"2024-09-19T14:15:00.460332+0000","last_fullsized":"2024-09-19T14:15:00.460332+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:00.460130+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:00.460130+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.460130+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:48.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.214774+0000","last_change":"2024-09-19T14:15:11.214707+0000","last_active":"2024-09-19T14:15:11.214774+0000","last_peered":"2024-09-19T14:15:11.214774+0000","last_clean":"2024-09-19T14:15:11.214774+0000","last_became_active":"2024-09-19T13:52:48.554109+0000","last_became_peered":"2024-09-19T13:52:48.554109+0000","last_unstale":"2024-09-19T14:15:11.214774+0000","last_undegraded":"2024-09-19T14:15:11.214774+0000","last_fullsized":"2024-09-19T14:15:11.214774+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.214616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.214616+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.214616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:01:07.590123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'30","reported_seq":135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.444451+0000","last_change":"2024-09-19T14:14:53.444451+0000","last_active":"2024-09-19T14:14:53.444451+0000","last_peered":"2024-09-19T14:14:53.444451+0000","last_clean":"2024-09-19T14:14:53.444451+0000","last_became_active":"2024-09-19T13:51:15.746975+0000","last_became_peered":"2024-09-19T13:51:15.746975+0000","last_unstale":"2024-09-19T14:14:53.444451+0000","last_undegraded":"2024-09-19T14:14:53.444451+0000","last_fullsized":"2024-09-19T14:14:53.444451+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-19T14:14:53.444377+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-19T14:14:53.444377+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.444377+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:45.326578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":149,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:17.244684+0000","last_change":"2024-09-19T14:15:17.244684+0000","last_active":"2024-09-19T14:15:17.244684+0000","last_peered":"2024-09-19T14:15:17.244684+0000","last_clean":"2024-09-19T14:15:17.244684+0000","last_became_active":"2024-09-19T14:03:08.841594+0000","last_became_peered":"2024-09-19T14:03:08.841594+0000","last_unstale":"2024-09-19T14:15:17.244684+0000","last_undegraded":"2024-09-19T14:15:17.244684+0000","last_fullsized":"2024-09-19T14:15:17.244684+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:17.244573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:17.244573+0000","last_clean_scrub_stamp":"2024-09-19T14:15:17.244573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:55.999582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:14.950032+0000","last_change":"2024-09-19T14:15:14.949928+0000","last_active":"2024-09-19T14:15:14.950032+0000","last_peered":"2024-09-19T14:15:14.950032+0000","last_clean":"2024-09-19T14:15:14.950032+0000","last_became_active":"2024-09-19T13:52:51.581891+0000","last_became_peered":"2024-09-19T13:52:51.581891+0000","last_unstale":"2024-09-19T14:15:14.950032+0000","last_undegraded":"2024-09-19T14:15:14.950032+0000","last_fullsized":"2024-09-19T14:15:14.950032+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:14.949833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:14.949833+0000","last_clean_scrub_stamp":"2024-09-19T14:15:14.949833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:40.450631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'8","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.392574+0000","last_change":"2024-09-19T14:14:54.392508+0000","last_active":"2024-09-19T14:14:54.392574+0000","last_peered":"2024-09-19T14:14:54.392574+0000","last_clean":"2024-09-19T14:14:54.392574+0000","last_became_active":"2024-09-19T13:52:48.546752+0000","last_became_peered":"2024-09-19T13:52:48.546752+0000","last_unstale":"2024-09-19T14:14:54.392574+0000","last_undegraded":"2024-09-19T14:14:54.392574+0000","last_fullsized":"2024-09-19T14:14:54.392574+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-19T14:14:54.392427+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-19T14:14:54.392427+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.392427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:25.291069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'33","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.959800+0000","last_change":"2024-09-19T14:14:41.959800+0000","last_active":"2024-09-19T14:14:41.959800+0000","last_peered":"2024-09-19T14:14:41.959800+0000","last_clean":"2024-09-19T14:14:41.959800+0000","last_became_active":"2024-09-19T13:51:15.740076+0000","last_became_peered":"2024-09-19T13:51:15.740076+0000","last_unstale":"2024-09-19T14:14:41.959800+0000","last_undegraded":"2024-09-19T14:14:41.959800+0000","last_fullsized":"2024-09-19T14:14:41.959800+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'33","last_scrub_stamp":"2024-09-19T14:14:41.959718+0000","last_deep_scrub":"260'33","last_deep_scrub_stamp":"2024-09-19T14:14:41.959718+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.959718+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:54.621103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":185,"num_write":80,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:21.980214+0000","last_change":"2024-09-19T14:15:21.980214+0000","last_active":"2024-09-19T14:15:21.980214+0000","last_peered":"2024-09-19T14:15:21.980214+0000","last_clean":"2024-09-19T14:15:21.980214+0000","last_became_active":"2024-09-19T14:03:08.838599+0000","last_became_peered":"2024-09-19T14:03:08.838599+0000","last_unstale":"2024-09-19T14:15:21.980214+0000","last_undegraded":"2024-09-19T14:15:21.980214+0000","last_fullsized":"2024-09-19T14:15:21.980214+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:21.980115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:21.980115+0000","last_clean_scrub_stamp":"2024-09-19T14:15:21.980115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:59.161602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'5","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.631826+0000","last_change":"2024-09-19T14:15:09.631826+0000","last_active":"2024-09-19T14:15:09.631826+0000","last_peered":"2024-09-19T14:15:09.631826+0000","last_clean":"2024-09-19T14:15:09.631826+0000","last_became_active":"2024-09-19T13:52:51.583802+0000","last_became_peered":"2024-09-19T13:52:51.583802+0000","last_unstale":"2024-09-19T14:15:09.631826+0000","last_undegraded":"2024-09-19T14:15:09.631826+0000","last_fullsized":"2024-09-19T14:15:09.631826+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-19T14:15:09.631702+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-19T14:15:09.631702+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.631702+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:46.447470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.127297+0000","last_change":"2024-09-19T14:15:08.127297+0000","last_active":"2024-09-19T14:15:08.127297+0000","last_peered":"2024-09-19T14:15:08.127297+0000","last_clean":"2024-09-19T14:15:08.127297+0000","last_became_active":"2024-09-19T13:52:48.555036+0000","last_became_peered":"2024-09-19T13:52:48.555036+0000","last_unstale":"2024-09-19T14:15:08.127297+0000","last_undegraded":"2024-09-19T14:15:08.127297+0000","last_fullsized":"2024-09-19T14:15:08.127297+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:08.127203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:08.127203+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.127203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:45.450270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'18","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.204017+0000","last_change":"2024-09-19T14:15:02.204017+0000","last_active":"2024-09-19T14:15:02.204017+0000","last_peered":"2024-09-19T14:15:02.204017+0000","last_clean":"2024-09-19T14:15:02.204017+0000","last_became_active":"2024-09-19T13:51:15.741854+0000","last_became_peered":"2024-09-19T13:51:15.741854+0000","last_unstale":"2024-09-19T14:15:02.204017+0000","last_undegraded":"2024-09-19T14:15:02.204017+0000","last_fullsized":"2024-09-19T14:15:02.204017+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'18","last_scrub_stamp":"2024-09-19T14:15:02.203930+0000","last_deep_scrub":"260'18","last_deep_scrub_stamp":"2024-09-19T14:15:02.203930+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.203930+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:22:26.895274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":91,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:18.231865+0000","last_change":"2024-09-19T14:15:18.231865+0000","last_active":"2024-09-19T14:15:18.231865+0000","last_peered":"2024-09-19T14:15:18.231865+0000","last_clean":"2024-09-19T14:15:18.231865+0000","last_became_active":"2024-09-19T14:03:08.843101+0000","last_became_peered":"2024-09-19T14:03:08.843101+0000","last_unstale":"2024-09-19T14:15:18.231865+0000","last_undegraded":"2024-09-19T14:15:18.231865+0000","last_fullsized":"2024-09-19T14:15:18.231865+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:18.231758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:18.231758+0000","last_clean_scrub_stamp":"2024-09-19T14:15:18.231758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:37.573477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.422999+0000","last_change":"2024-09-19T14:15:11.422999+0000","last_active":"2024-09-19T14:15:11.422999+0000","last_peered":"2024-09-19T14:15:11.422999+0000","last_clean":"2024-09-19T14:15:11.422999+0000","last_became_active":"2024-09-19T13:52:51.586009+0000","last_became_peered":"2024-09-19T13:52:51.586009+0000","last_unstale":"2024-09-19T14:15:11.422999+0000","last_undegraded":"2024-09-19T14:15:11.422999+0000","last_fullsized":"2024-09-19T14:15:11.422999+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.422879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.422879+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.422879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:32.738045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.343218+0000","last_change":"2024-09-19T14:14:55.343218+0000","last_active":"2024-09-19T14:14:55.343218+0000","last_peered":"2024-09-19T14:14:55.343218+0000","last_clean":"2024-09-19T14:14:55.343218+0000","last_became_active":"2024-09-19T13:52:48.545919+0000","last_became_peered":"2024-09-19T13:52:48.545919+0000","last_unstale":"2024-09-19T14:14:55.343218+0000","last_undegraded":"2024-09-19T14:14:55.343218+0000","last_fullsized":"2024-09-19T14:14:55.343218+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:55.343135+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:55.343135+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.343135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:13.998712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'58","reported_seq":214,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.356650+0000","last_change":"2024-09-19T14:15:01.356578+0000","last_active":"2024-09-19T14:15:01.356650+0000","last_peered":"2024-09-19T14:15:01.356650+0000","last_clean":"2024-09-19T14:15:01.356650+0000","last_became_active":"2024-09-19T13:51:15.742959+0000","last_became_peered":"2024-09-19T13:51:15.742959+0000","last_unstale":"2024-09-19T14:15:01.356650+0000","last_undegraded":"2024-09-19T14:15:01.356650+0000","last_fullsized":"2024-09-19T14:15:01.356650+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'58","last_scrub_stamp":"2024-09-19T14:15:01.356496+0000","last_deep_scrub":"260'58","last_deep_scrub_stamp":"2024-09-19T14:15:01.356496+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.356496+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:40.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":334,"num_write":151,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:15.304799+0000","last_change":"2024-09-19T14:15:15.304799+0000","last_active":"2024-09-19T14:15:15.304799+0000","last_peered":"2024-09-19T14:15:15.304799+0000","last_clean":"2024-09-19T14:15:15.304799+0000","last_became_active":"2024-09-19T14:03:08.841424+0000","last_became_peered":"2024-09-19T14:03:08.841424+0000","last_unstale":"2024-09-19T14:15:15.304799+0000","last_undegraded":"2024-09-19T14:15:15.304799+0000","last_fullsized":"2024-09-19T14:15:15.304799+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:15.304711+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:15.304711+0000","last_clean_scrub_stamp":"2024-09-19T14:15:15.304711+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.210111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.437000+0000","last_change":"2024-09-19T14:14:59.436917+0000","last_active":"2024-09-19T14:14:59.437000+0000","last_peered":"2024-09-19T14:14:59.437000+0000","last_clean":"2024-09-19T14:14:59.437000+0000","last_became_active":"2024-09-19T13:52:51.582972+0000","last_became_peered":"2024-09-19T13:52:51.582972+0000","last_unstale":"2024-09-19T14:14:59.437000+0000","last_undegraded":"2024-09-19T14:14:59.437000+0000","last_fullsized":"2024-09-19T14:14:59.437000+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:59.436823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:59.436823+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.436823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:55.959030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'4","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.171002+0000","last_change":"2024-09-19T14:15:09.171002+0000","last_active":"2024-09-19T14:15:09.171002+0000","last_peered":"2024-09-19T14:15:09.171002+0000","last_clean":"2024-09-19T14:15:09.171002+0000","last_became_active":"2024-09-19T13:52:48.557372+0000","last_became_peered":"2024-09-19T13:52:48.557372+0000","last_unstale":"2024-09-19T14:15:09.171002+0000","last_undegraded":"2024-09-19T14:15:09.171002+0000","last_fullsized":"2024-09-19T14:15:09.171002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:15:09.170874+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:15:09.170874+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.170874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:35.329268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'35","reported_seq":147,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.916782+0000","last_change":"2024-09-19T14:15:04.916726+0000","last_active":"2024-09-19T14:15:04.916782+0000","last_peered":"2024-09-19T14:15:04.916782+0000","last_clean":"2024-09-19T14:15:04.916782+0000","last_became_active":"2024-09-19T13:51:15.741285+0000","last_became_peered":"2024-09-19T13:51:15.741285+0000","last_unstale":"2024-09-19T14:15:04.916782+0000","last_undegraded":"2024-09-19T14:15:04.916782+0000","last_fullsized":"2024-09-19T14:15:04.916782+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-19T14:15:04.916642+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-19T14:15:04.916642+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.916642+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:47.438969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":186,"num_write":89,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:20.283087+0000","last_change":"2024-09-19T14:15:20.283087+0000","last_active":"2024-09-19T14:15:20.283087+0000","last_peered":"2024-09-19T14:15:20.283087+0000","last_clean":"2024-09-19T14:15:20.283087+0000","last_became_active":"2024-09-19T14:03:08.836235+0000","last_became_peered":"2024-09-19T14:03:08.836235+0000","last_unstale":"2024-09-19T14:15:20.283087+0000","last_undegraded":"2024-09-19T14:15:20.283087+0000","last_fullsized":"2024-09-19T14:15:20.283087+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:20.282982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:20.282982+0000","last_clean_scrub_stamp":"2024-09-19T14:15:20.282982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:47.271552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:12.409271+0000","last_change":"2024-09-19T14:15:12.409271+0000","last_active":"2024-09-19T14:15:12.409271+0000","last_peered":"2024-09-19T14:15:12.409271+0000","last_clean":"2024-09-19T14:15:12.409271+0000","last_became_active":"2024-09-19T13:52:51.586556+0000","last_became_peered":"2024-09-19T13:52:51.586556+0000","last_unstale":"2024-09-19T14:15:12.409271+0000","last_undegraded":"2024-09-19T14:15:12.409271+0000","last_fullsized":"2024-09-19T14:15:12.409271+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:12.409180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:12.409180+0000","last_clean_scrub_stamp":"2024-09-19T14:15:12.409180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:03.371193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.739455+0000","last_change":"2024-09-19T14:15:01.739365+0000","last_active":"2024-09-19T14:15:01.739455+0000","last_peered":"2024-09-19T14:15:01.739455+0000","last_clean":"2024-09-19T14:15:01.739455+0000","last_became_active":"2024-09-19T13:52:48.556086+0000","last_became_peered":"2024-09-19T13:52:48.556086+0000","last_unstale":"2024-09-19T14:15:01.739455+0000","last_undegraded":"2024-09-19T14:15:01.739455+0000","last_fullsized":"2024-09-19T14:15:01.739455+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:15:01.739263+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:15:01.739263+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.739263+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:49.014949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"257'31","reported_seq":142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.406840+0000","last_change":"2024-09-19T14:14:52.406743+0000","last_active":"2024-09-19T14:14:52.406840+0000","last_peered":"2024-09-19T14:14:52.406840+0000","last_clean":"2024-09-19T14:14:52.406840+0000","last_became_active":"2024-09-19T13:51:15.744414+0000","last_became_peered":"2024-09-19T13:51:15.744414+0000","last_unstale":"2024-09-19T14:14:52.406840+0000","last_undegraded":"2024-09-19T14:14:52.406840+0000","last_fullsized":"2024-09-19T14:14:52.406840+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'31","last_scrub_stamp":"2024-09-19T14:14:52.406622+0000","last_deep_scrub":"257'31","last_deep_scrub_stamp":"2024-09-19T14:14:52.406622+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.406622+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:01.251978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":177,"num_write":74,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:13.360747+0000","last_change":"2024-09-19T14:15:13.360672+0000","last_active":"2024-09-19T14:15:13.360747+0000","last_peered":"2024-09-19T14:15:13.360747+0000","last_clean":"2024-09-19T14:15:13.360747+0000","last_became_active":"2024-09-19T14:03:08.843124+0000","last_became_peered":"2024-09-19T14:03:08.843124+0000","last_unstale":"2024-09-19T14:15:13.360747+0000","last_undegraded":"2024-09-19T14:15:13.360747+0000","last_fullsized":"2024-09-19T14:15:13.360747+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:13.360586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:13.360586+0000","last_clean_scrub_stamp":"2024-09-19T14:15:13.360586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:16.259340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:15.227967+0000","last_change":"2024-09-19T14:15:15.227967+0000","last_active":"2024-09-19T14:15:15.227967+0000","last_peered":"2024-09-19T14:15:15.227967+0000","last_clean":"2024-09-19T14:15:15.227967+0000","last_became_active":"2024-09-19T13:52:51.585724+0000","last_became_peered":"2024-09-19T13:52:51.585724+0000","last_unstale":"2024-09-19T14:15:15.227967+0000","last_undegraded":"2024-09-19T14:15:15.227967+0000","last_fullsized":"2024-09-19T14:15:15.227967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-19T14:15:15.227877+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-19T14:15:15.227877+0000","last_clean_scrub_stamp":"2024-09-19T14:15:15.227877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:22:54.364408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:06.405371+0000","last_change":"2024-09-19T14:15:06.405371+0000","last_active":"2024-09-19T14:15:06.405371+0000","last_peered":"2024-09-19T14:15:06.405371+0000","last_clean":"2024-09-19T14:15:06.405371+0000","last_became_active":"2024-09-19T13:52:48.554121+0000","last_became_peered":"2024-09-19T13:52:48.554121+0000","last_unstale":"2024-09-19T14:15:06.405371+0000","last_undegraded":"2024-09-19T14:15:06.405371+0000","last_fullsized":"2024-09-19T14:15:06.405371+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:06.405281+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:06.405281+0000","last_clean_scrub_stamp":"2024-09-19T14:15:06.405281+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:57.593072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'13","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.163847+0000","last_change":"2024-09-19T14:15:03.163754+0000","last_active":"2024-09-19T14:15:03.163847+0000","last_peered":"2024-09-19T14:15:03.163847+0000","last_clean":"2024-09-19T14:15:03.163847+0000","last_became_active":"2024-09-19T13:51:15.740225+0000","last_became_peered":"2024-09-19T13:51:15.740225+0000","last_unstale":"2024-09-19T14:15:03.163847+0000","last_undegraded":"2024-09-19T14:15:03.163847+0000","last_fullsized":"2024-09-19T14:15:03.163847+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'13","last_scrub_stamp":"2024-09-19T14:15:03.163638+0000","last_deep_scrub":"260'13","last_deep_scrub_stamp":"2024-09-19T14:15:03.163638+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.163638+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:07.807861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:09.642636+0000","last_change":"2024-09-19T14:15:09.642582+0000","last_active":"2024-09-19T14:15:09.642636+0000","last_peered":"2024-09-19T14:15:09.642636+0000","last_clean":"2024-09-19T14:15:09.642636+0000","last_became_active":"2024-09-19T14:03:08.839873+0000","last_became_peered":"2024-09-19T14:03:08.839873+0000","last_unstale":"2024-09-19T14:15:09.642636+0000","last_undegraded":"2024-09-19T14:15:09.642636+0000","last_fullsized":"2024-09-19T14:15:09.642636+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:09.642501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:09.642501+0000","last_clean_scrub_stamp":"2024-09-19T14:15:09.642501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:17.722038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"257'2","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:16.217390+0000","last_change":"2024-09-19T14:15:16.217390+0000","last_active":"2024-09-19T14:15:16.217390+0000","last_peered":"2024-09-19T14:15:16.217390+0000","last_clean":"2024-09-19T14:15:16.217390+0000","last_became_active":"2024-09-19T13:52:51.587276+0000","last_became_peered":"2024-09-19T13:52:51.587276+0000","last_unstale":"2024-09-19T14:15:16.217390+0000","last_undegraded":"2024-09-19T14:15:16.217390+0000","last_fullsized":"2024-09-19T14:15:16.217390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-19T14:15:16.217272+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-19T14:15:16.217272+0000","last_clean_scrub_stamp":"2024-09-19T14:15:16.217272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.508090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.973143+0000","last_change":"2024-09-19T14:14:44.973143+0000","last_active":"2024-09-19T14:14:44.973143+0000","last_peered":"2024-09-19T14:14:44.973143+0000","last_clean":"2024-09-19T14:14:44.973143+0000","last_became_active":"2024-09-19T13:52:48.558205+0000","last_became_peered":"2024-09-19T13:52:48.558205+0000","last_unstale":"2024-09-19T14:14:44.973143+0000","last_undegraded":"2024-09-19T14:14:44.973143+0000","last_fullsized":"2024-09-19T14:14:44.973143+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.973056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.973056+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.973056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:59:37.180506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'34","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.356498+0000","last_change":"2024-09-19T14:14:51.356443+0000","last_active":"2024-09-19T14:14:51.356498+0000","last_peered":"2024-09-19T14:14:51.356498+0000","last_clean":"2024-09-19T14:14:51.356498+0000","last_became_active":"2024-09-19T13:51:15.744305+0000","last_became_peered":"2024-09-19T13:51:15.744305+0000","last_unstale":"2024-09-19T14:14:51.356498+0000","last_undegraded":"2024-09-19T14:14:51.356498+0000","last_fullsized":"2024-09-19T14:14:51.356498+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'34","last_scrub_stamp":"2024-09-19T14:14:51.356359+0000","last_deep_scrub":"260'34","last_deep_scrub_stamp":"2024-09-19T14:14:51.356359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.356359+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:37.031352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":93,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.507056+0000","last_change":"2024-09-19T14:15:03.506948+0000","last_active":"2024-09-19T14:15:03.507056+0000","last_peered":"2024-09-19T14:15:03.507056+0000","last_clean":"2024-09-19T14:15:03.507056+0000","last_became_active":"2024-09-19T14:03:08.834133+0000","last_became_peered":"2024-09-19T14:03:08.834133+0000","last_unstale":"2024-09-19T14:15:03.507056+0000","last_undegraded":"2024-09-19T14:15:03.507056+0000","last_fullsized":"2024-09-19T14:15:03.507056+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:03.506858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:03.506858+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.506858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:15.332807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'3","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:10.421362+0000","last_change":"2024-09-19T14:15:10.421362+0000","last_active":"2024-09-19T14:15:10.421362+0000","last_peered":"2024-09-19T14:15:10.421362+0000","last_clean":"2024-09-19T14:15:10.421362+0000","last_became_active":"2024-09-19T13:52:51.587019+0000","last_became_peered":"2024-09-19T13:52:51.587019+0000","last_unstale":"2024-09-19T14:15:10.421362+0000","last_undegraded":"2024-09-19T14:15:10.421362+0000","last_fullsized":"2024-09-19T14:15:10.421362+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:15:10.421271+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:15:10.421271+0000","last_clean_scrub_stamp":"2024-09-19T14:15:10.421271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:00.557794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:04.626625+0000","last_change":"2024-09-19T14:15:04.626625+0000","last_active":"2024-09-19T14:15:04.626625+0000","last_peered":"2024-09-19T14:15:04.626625+0000","last_clean":"2024-09-19T14:15:04.626625+0000","last_became_active":"2024-09-19T13:52:48.552712+0000","last_became_peered":"2024-09-19T13:52:48.552712+0000","last_unstale":"2024-09-19T14:15:04.626625+0000","last_undegraded":"2024-09-19T14:15:04.626625+0000","last_fullsized":"2024-09-19T14:15:04.626625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:04.626541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:04.626541+0000","last_clean_scrub_stamp":"2024-09-19T14:15:04.626541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.358881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"260'37","reported_seq":153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.301644+0000","last_change":"2024-09-19T14:14:59.301644+0000","last_active":"2024-09-19T14:14:59.301644+0000","last_peered":"2024-09-19T14:14:59.301644+0000","last_clean":"2024-09-19T14:14:59.301644+0000","last_became_active":"2024-09-19T13:51:15.744430+0000","last_became_peered":"2024-09-19T13:51:15.744430+0000","last_unstale":"2024-09-19T14:14:59.301644+0000","last_undegraded":"2024-09-19T14:14:59.301644+0000","last_fullsized":"2024-09-19T14:14:59.301644+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'37","last_scrub_stamp":"2024-09-19T14:14:59.301562+0000","last_deep_scrub":"260'37","last_deep_scrub_stamp":"2024-09-19T14:14:59.301562+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.301562+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:22.479580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":189,"num_write":93,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:11.630660+0000","last_change":"2024-09-19T14:15:11.630607+0000","last_active":"2024-09-19T14:15:11.630660+0000","last_peered":"2024-09-19T14:15:11.630660+0000","last_clean":"2024-09-19T14:15:11.630660+0000","last_became_active":"2024-09-19T14:03:08.839050+0000","last_became_peered":"2024-09-19T14:03:08.839050+0000","last_unstale":"2024-09-19T14:15:11.630660+0000","last_undegraded":"2024-09-19T14:15:11.630660+0000","last_fullsized":"2024-09-19T14:15:11.630660+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:11.630525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:11.630525+0000","last_clean_scrub_stamp":"2024-09-19T14:15:11.630525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:14.164058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.646918+0000","last_change":"2024-09-19T14:15:05.646918+0000","last_active":"2024-09-19T14:15:05.646918+0000","last_peered":"2024-09-19T14:15:05.646918+0000","last_clean":"2024-09-19T14:15:05.646918+0000","last_became_active":"2024-09-19T13:52:51.582609+0000","last_became_peered":"2024-09-19T13:52:51.582609+0000","last_unstale":"2024-09-19T14:15:05.646918+0000","last_undegraded":"2024-09-19T14:15:05.646918+0000","last_fullsized":"2024-09-19T14:15:05.646918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:05.646786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:05.646786+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.646786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:40.605145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.368409+0000","last_change":"2024-09-19T14:15:07.368409+0000","last_active":"2024-09-19T14:15:07.368409+0000","last_peered":"2024-09-19T14:15:07.368409+0000","last_clean":"2024-09-19T14:15:07.368409+0000","last_became_active":"2024-09-19T13:52:48.557858+0000","last_became_peered":"2024-09-19T13:52:48.557858+0000","last_unstale":"2024-09-19T14:15:07.368409+0000","last_undegraded":"2024-09-19T14:15:07.368409+0000","last_fullsized":"2024-09-19T14:15:07.368409+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:15:07.368311+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:15:07.368311+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.368311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:38.449295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"257'248","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.445795+0000","last_change":"2024-09-19T14:14:51.445795+0000","last_active":"2024-09-19T14:14:51.445795+0000","last_peered":"2024-09-19T14:14:51.445795+0000","last_clean":"2024-09-19T14:14:51.445795+0000","last_became_active":"2024-09-19T13:51:15.746368+0000","last_became_peered":"2024-09-19T13:51:15.746368+0000","last_unstale":"2024-09-19T14:14:51.445795+0000","last_undegraded":"2024-09-19T14:14:51.445795+0000","last_fullsized":"2024-09-19T14:14:51.445795+0000","mapping_epoch":247,"log_start":"257'200","ondisk_log_start":"257'200","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'248","last_scrub_stamp":"2024-09-19T14:14:51.445710+0000","last_deep_scrub":"257'248","last_deep_scrub_stamp":"2024-09-19T14:14:51.445710+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.445710+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:23.572561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2380,"num_read_kb":2986,"num_write":489,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.883369+0000","last_change":"2024-09-19T14:14:50.883369+0000","last_active":"2024-09-19T14:14:50.883369+0000","last_peered":"2024-09-19T14:14:50.883369+0000","last_clean":"2024-09-19T14:14:50.883369+0000","last_became_active":"2024-09-19T14:03:08.835725+0000","last_became_peered":"2024-09-19T14:03:08.835725+0000","last_unstale":"2024-09-19T14:14:50.883369+0000","last_undegraded":"2024-09-19T14:14:50.883369+0000","last_fullsized":"2024-09-19T14:14:50.883369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:50.883275+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:50.883275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.883275+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:11.827780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"257'5","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.401357+0000","last_change":"2024-09-19T14:14:58.401357+0000","last_active":"2024-09-19T14:14:58.401357+0000","last_peered":"2024-09-19T14:14:58.401357+0000","last_clean":"2024-09-19T14:14:58.401357+0000","last_became_active":"2024-09-19T13:52:51.582398+0000","last_became_peered":"2024-09-19T13:52:51.582398+0000","last_unstale":"2024-09-19T14:14:58.401357+0000","last_undegraded":"2024-09-19T14:14:58.401357+0000","last_fullsized":"2024-09-19T14:14:58.401357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:14:58.401253+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:14:58.401253+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.401253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:22.910974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.374717+0000","last_change":"2024-09-19T14:15:03.374717+0000","last_active":"2024-09-19T14:15:03.374717+0000","last_peered":"2024-09-19T14:15:03.374717+0000","last_clean":"2024-09-19T14:15:03.374717+0000","last_became_active":"2024-09-19T13:52:48.556503+0000","last_became_peered":"2024-09-19T13:52:48.556503+0000","last_unstale":"2024-09-19T14:15:03.374717+0000","last_undegraded":"2024-09-19T14:15:03.374717+0000","last_fullsized":"2024-09-19T14:15:03.374717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:03.374621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:03.374621+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.374621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:38.238150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'10","reported_seq":81,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.575272+0000","last_change":"2024-09-19T14:15:02.575272+0000","last_active":"2024-09-19T14:15:02.575272+0000","last_peered":"2024-09-19T14:15:02.575272+0000","last_clean":"2024-09-19T14:15:02.575272+0000","last_became_active":"2024-09-19T13:51:15.742369+0000","last_became_peered":"2024-09-19T13:51:15.742369+0000","last_unstale":"2024-09-19T14:15:02.575272+0000","last_undegraded":"2024-09-19T14:15:02.575272+0000","last_fullsized":"2024-09-19T14:15:02.575272+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-19T14:15:02.575187+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-19T14:15:02.575187+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.575187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:21.697759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":48,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:18.264814+0000","last_change":"2024-09-19T14:15:18.264814+0000","last_active":"2024-09-19T14:15:18.264814+0000","last_peered":"2024-09-19T14:15:18.264814+0000","last_clean":"2024-09-19T14:15:18.264814+0000","last_became_active":"2024-09-19T14:03:08.837218+0000","last_became_peered":"2024-09-19T14:03:08.837218+0000","last_unstale":"2024-09-19T14:15:18.264814+0000","last_undegraded":"2024-09-19T14:15:18.264814+0000","last_fullsized":"2024-09-19T14:15:18.264814+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:18.264690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:18.264690+0000","last_clean_scrub_stamp":"2024-09-19T14:15:18.264690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:43.470646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:08.653353+0000","last_change":"2024-09-19T14:15:08.653353+0000","last_active":"2024-09-19T14:15:08.653353+0000","last_peered":"2024-09-19T14:15:08.653353+0000","last_clean":"2024-09-19T14:15:08.653353+0000","last_became_active":"2024-09-19T13:52:51.582198+0000","last_became_peered":"2024-09-19T13:52:51.582198+0000","last_unstale":"2024-09-19T14:15:08.653353+0000","last_undegraded":"2024-09-19T14:15:08.653353+0000","last_fullsized":"2024-09-19T14:15:08.653353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:08.653265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:08.653265+0000","last_clean_scrub_stamp":"2024-09-19T14:15:08.653265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:02.246708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"257'5","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:05.402996+0000","last_change":"2024-09-19T14:15:05.402996+0000","last_active":"2024-09-19T14:15:05.402996+0000","last_peered":"2024-09-19T14:15:05.402996+0000","last_clean":"2024-09-19T14:15:05.402996+0000","last_became_active":"2024-09-19T13:52:48.557932+0000","last_became_peered":"2024-09-19T13:52:48.557932+0000","last_unstale":"2024-09-19T14:15:05.402996+0000","last_undegraded":"2024-09-19T14:15:05.402996+0000","last_fullsized":"2024-09-19T14:15:05.402996+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-19T14:15:05.402901+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-19T14:15:05.402901+0000","last_clean_scrub_stamp":"2024-09-19T14:15:05.402901+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:20.756508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'15","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.716000+0000","last_change":"2024-09-19T14:15:00.716000+0000","last_active":"2024-09-19T14:15:00.716000+0000","last_peered":"2024-09-19T14:15:00.716000+0000","last_clean":"2024-09-19T14:15:00.716000+0000","last_became_active":"2024-09-19T13:51:15.739186+0000","last_became_peered":"2024-09-19T13:51:15.739186+0000","last_unstale":"2024-09-19T14:15:00.716000+0000","last_undegraded":"2024-09-19T14:15:00.716000+0000","last_fullsized":"2024-09-19T14:15:00.716000+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-19T14:15:00.715916+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-19T14:15:00.715916+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.715916+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:55.850827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":79,"num_write":37,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:19.249906+0000","last_change":"2024-09-19T14:15:19.249836+0000","last_active":"2024-09-19T14:15:19.249906+0000","last_peered":"2024-09-19T14:15:19.249906+0000","last_clean":"2024-09-19T14:15:19.249906+0000","last_became_active":"2024-09-19T14:03:08.843352+0000","last_became_peered":"2024-09-19T14:03:08.843352+0000","last_unstale":"2024-09-19T14:15:19.249906+0000","last_undegraded":"2024-09-19T14:15:19.249906+0000","last_fullsized":"2024-09-19T14:15:19.249906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:19.249748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:19.249748+0000","last_clean_scrub_stamp":"2024-09-19T14:15:19.249748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:59.123358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'7","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.474343+0000","last_change":"2024-09-19T14:14:56.474343+0000","last_active":"2024-09-19T14:14:56.474343+0000","last_peered":"2024-09-19T14:14:56.474343+0000","last_clean":"2024-09-19T14:14:56.474343+0000","last_became_active":"2024-09-19T13:52:51.584774+0000","last_became_peered":"2024-09-19T13:52:51.584774+0000","last_unstale":"2024-09-19T14:14:56.474343+0000","last_undegraded":"2024-09-19T14:14:56.474343+0000","last_fullsized":"2024-09-19T14:14:56.474343+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-19T14:14:56.474264+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-19T14:14:56.474264+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.474264+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:19.206700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21053,"num_write":12,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.419389+0000","last_change":"2024-09-19T14:14:57.419389+0000","last_active":"2024-09-19T14:14:57.419389+0000","last_peered":"2024-09-19T14:14:57.419389+0000","last_clean":"2024-09-19T14:14:57.419389+0000","last_became_active":"2024-09-19T13:52:48.554728+0000","last_became_peered":"2024-09-19T13:52:48.554728+0000","last_unstale":"2024-09-19T14:14:57.419389+0000","last_undegraded":"2024-09-19T14:14:57.419389+0000","last_fullsized":"2024-09-19T14:14:57.419389+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:14:57.419144+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:14:57.419144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.419144+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:50.391968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'65","reported_seq":235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.319252+0000","last_change":"2024-09-19T14:14:50.319252+0000","last_active":"2024-09-19T14:14:50.319252+0000","last_peered":"2024-09-19T14:14:50.319252+0000","last_clean":"2024-09-19T14:14:50.319252+0000","last_became_active":"2024-09-19T13:51:15.746045+0000","last_became_peered":"2024-09-19T13:51:15.746045+0000","last_unstale":"2024-09-19T14:14:50.319252+0000","last_undegraded":"2024-09-19T14:14:50.319252+0000","last_fullsized":"2024-09-19T14:14:50.319252+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'65","last_scrub_stamp":"2024-09-19T14:14:50.319141+0000","last_deep_scrub":"260'65","last_deep_scrub_stamp":"2024-09-19T14:14:50.319141+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.319141+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:00.287119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":541,"num_read_kb":373,"num_write":159,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:14.350456+0000","last_change":"2024-09-19T14:15:14.350456+0000","last_active":"2024-09-19T14:15:14.350456+0000","last_peered":"2024-09-19T14:15:14.350456+0000","last_clean":"2024-09-19T14:15:14.350456+0000","last_became_active":"2024-09-19T14:03:08.842321+0000","last_became_peered":"2024-09-19T14:03:08.842321+0000","last_unstale":"2024-09-19T14:15:14.350456+0000","last_undegraded":"2024-09-19T14:15:14.350456+0000","last_fullsized":"2024-09-19T14:15:14.350456+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:15:14.350357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:15:14.350357+0000","last_clean_scrub_stamp":"2024-09-19T14:15:14.350357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:05.785545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:07.652585+0000","last_change":"2024-09-19T14:15:07.652585+0000","last_active":"2024-09-19T14:15:07.652585+0000","last_peered":"2024-09-19T14:15:07.652585+0000","last_clean":"2024-09-19T14:15:07.652585+0000","last_became_active":"2024-09-19T13:52:51.581626+0000","last_became_peered":"2024-09-19T13:52:51.581626+0000","last_unstale":"2024-09-19T14:15:07.652585+0000","last_undegraded":"2024-09-19T14:15:07.652585+0000","last_fullsized":"2024-09-19T14:15:07.652585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:15:07.652502+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:15:07.652502+0000","last_clean_scrub_stamp":"2024-09-19T14:15:07.652502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:47.010354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":214,"num_write":4,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.431200+0000","last_change":"2024-09-19T14:14:55.431200+0000","last_active":"2024-09-19T14:14:55.431200+0000","last_peered":"2024-09-19T14:14:55.431200+0000","last_clean":"2024-09-19T14:14:55.431200+0000","last_became_active":"2024-09-19T13:52:48.546658+0000","last_became_peered":"2024-09-19T13:52:48.546658+0000","last_unstale":"2024-09-19T14:14:55.431200+0000","last_undegraded":"2024-09-19T14:14:55.431200+0000","last_fullsized":"2024-09-19T14:14:55.431200+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-19T14:14:55.431115+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-19T14:14:55.431115+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.431115+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:38:01.164802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"260'26","reported_seq":124,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.313755+0000","last_change":"2024-09-19T14:14:58.313688+0000","last_active":"2024-09-19T14:14:58.313755+0000","last_peered":"2024-09-19T14:14:58.313755+0000","last_clean":"2024-09-19T14:14:58.313755+0000","last_became_active":"2024-09-19T13:51:15.745209+0000","last_became_peered":"2024-09-19T13:51:15.745209+0000","last_unstale":"2024-09-19T14:14:58.313755+0000","last_undegraded":"2024-09-19T14:14:58.313755+0000","last_fullsized":"2024-09-19T14:14:58.313755+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'26","last_scrub_stamp":"2024-09-19T14:14:58.313601+0000","last_deep_scrub":"260'26","last_deep_scrub_stamp":"2024-09-19T14:14:58.313601+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.313601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:54.752333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":124,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'198","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.123580+0000","last_change":"2024-09-19T14:14:37.123580+0000","last_active":"2024-09-19T14:14:37.123580+0000","last_peered":"2024-09-19T14:14:37.123580+0000","last_clean":"2024-09-19T14:14:37.123580+0000","last_became_active":"2024-09-19T13:36:07.808664+0000","last_became_peered":"2024-09-19T13:36:07.808664+0000","last_unstale":"2024-09-19T14:14:37.123580+0000","last_undegraded":"2024-09-19T14:14:37.123580+0000","last_fullsized":"2024-09-19T14:14:37.123580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:37.123480+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.123480+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:59.204973+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":531,"num_read_kb":14767,"num_write":959,"num_write_kb":27475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'809","reported_seq":2392,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.739943+0000","last_change":"2024-09-19T14:14:41.739943+0000","last_active":"2024-09-19T14:14:41.739943+0000","last_peered":"2024-09-19T14:14:41.739943+0000","last_clean":"2024-09-19T14:14:41.739943+0000","last_became_active":"2024-09-19T13:36:09.334096+0000","last_became_peered":"2024-09-19T13:36:09.334096+0000","last_unstale":"2024-09-19T14:14:41.739943+0000","last_undegraded":"2024-09-19T14:14:41.739943+0000","last_fullsized":"2024-09-19T14:14:41.739943+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'809","last_scrub_stamp":"2024-09-19T14:14:41.739846+0000","last_deep_scrub":"260'809","last_deep_scrub_stamp":"2024-09-19T14:14:41.739846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.739846+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:08:36.451126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3868,"num_read_kb":3490,"num_write":1066,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'195","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.326367+0000","last_change":"2024-09-19T14:14:29.326367+0000","last_active":"2024-09-19T14:14:29.326367+0000","last_peered":"2024-09-19T14:14:29.326367+0000","last_clean":"2024-09-19T14:14:29.326367+0000","last_became_active":"2024-09-19T13:36:07.810002+0000","last_became_peered":"2024-09-19T13:36:07.810002+0000","last_unstale":"2024-09-19T14:14:29.326367+0000","last_undegraded":"2024-09-19T14:14:29.326367+0000","last_fullsized":"2024-09-19T14:14:29.326367+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:29.326239+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.326239+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:00.504896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":434,"num_read_kb":5759,"num_write":878,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'702","reported_seq":2398,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.246546+0000","last_change":"2024-09-19T14:14:41.246546+0000","last_active":"2024-09-19T14:14:41.246546+0000","last_peered":"2024-09-19T14:14:41.246546+0000","last_clean":"2024-09-19T14:14:41.246546+0000","last_became_active":"2024-09-19T13:36:09.340803+0000","last_became_peered":"2024-09-19T13:36:09.340803+0000","last_unstale":"2024-09-19T14:14:41.246546+0000","last_undegraded":"2024-09-19T14:14:41.246546+0000","last_fullsized":"2024-09-19T14:14:41.246546+0000","mapping_epoch":24,"log_start":"260'600","ondisk_log_start":"260'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'702","last_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_deep_scrub":"260'702","last_deep_scrub_stamp":"2024-09-19T14:14:41.246453+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.246453+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:35.785088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3681,"num_read_kb":3333,"num_write":958,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'225","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.292915+0000","last_change":"2024-09-19T14:14:32.292915+0000","last_active":"2024-09-19T14:14:32.292915+0000","last_peered":"2024-09-19T14:14:32.292915+0000","last_clean":"2024-09-19T14:14:32.292915+0000","last_became_active":"2024-09-19T13:36:07.800313+0000","last_became_peered":"2024-09-19T13:36:07.800313+0000","last_unstale":"2024-09-19T14:14:32.292915+0000","last_undegraded":"2024-09-19T14:14:32.292915+0000","last_fullsized":"2024-09-19T14:14:32.292915+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:32.292807+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.292807+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:56.116597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":564,"num_read_kb":12221,"num_write":1127,"num_write_kb":22023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'390","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.745712+0000","last_change":"2024-09-19T14:14:42.745712+0000","last_active":"2024-09-19T14:14:42.745712+0000","last_peered":"2024-09-19T14:14:42.745712+0000","last_clean":"2024-09-19T14:14:42.745712+0000","last_became_active":"2024-09-19T13:36:09.331561+0000","last_became_peered":"2024-09-19T13:36:09.331561+0000","last_unstale":"2024-09-19T14:14:42.745712+0000","last_undegraded":"2024-09-19T14:14:42.745712+0000","last_fullsized":"2024-09-19T14:14:42.745712+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-19T14:14:42.745623+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-19T14:14:42.745623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.745623+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.098393+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2254,"num_read_kb":2140,"num_write":455,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'225","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.804464+0000","last_change":"2024-09-19T14:14:36.804464+0000","last_active":"2024-09-19T14:14:36.804464+0000","last_peered":"2024-09-19T14:14:36.804464+0000","last_clean":"2024-09-19T14:14:36.804464+0000","last_became_active":"2024-09-19T13:36:07.812607+0000","last_became_peered":"2024-09-19T13:36:07.812607+0000","last_unstale":"2024-09-19T14:14:36.804464+0000","last_undegraded":"2024-09-19T14:14:36.804464+0000","last_fullsized":"2024-09-19T14:14:36.804464+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:36.804346+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.804346+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:50.761130+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311660,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":9100,"num_write":1128,"num_write_kb":20356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'994","reported_seq":2647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.190516+0000","last_change":"2024-09-19T14:14:40.190516+0000","last_active":"2024-09-19T14:14:40.190516+0000","last_peered":"2024-09-19T14:14:40.190516+0000","last_clean":"2024-09-19T14:14:40.190516+0000","last_became_active":"2024-09-19T13:36:44.400009+0000","last_became_peered":"2024-09-19T13:36:44.400009+0000","last_unstale":"2024-09-19T14:14:40.190516+0000","last_undegraded":"2024-09-19T14:14:40.190516+0000","last_fullsized":"2024-09-19T14:14:40.190516+0000","mapping_epoch":35,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'994","last_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_deep_scrub":"260'994","last_deep_scrub_stamp":"2024-09-19T14:14:40.190428+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.190428+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":900,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:54.056506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4660,"num_read_kb":4119,"num_write":1354,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'203","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.089410+0000","last_change":"2024-09-19T14:14:36.089410+0000","last_active":"2024-09-19T14:14:36.089410+0000","last_peered":"2024-09-19T14:14:36.089410+0000","last_clean":"2024-09-19T14:14:36.089410+0000","last_became_active":"2024-09-19T13:36:07.807794+0000","last_became_peered":"2024-09-19T13:36:07.807794+0000","last_unstale":"2024-09-19T14:14:36.089410+0000","last_undegraded":"2024-09-19T14:14:36.089410+0000","last_fullsized":"2024-09-19T14:14:36.089410+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-09-19T14:14:36.089313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.089313+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:07.911503+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":762,"num_read_kb":134002,"num_write":945,"num_write_kb":58064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'559","reported_seq":2312,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.131013+0000","last_change":"2024-09-19T14:14:36.131013+0000","last_active":"2024-09-19T14:14:36.131013+0000","last_peered":"2024-09-19T14:14:36.131013+0000","last_clean":"2024-09-19T14:14:36.131013+0000","last_became_active":"2024-09-19T13:36:09.334181+0000","last_became_peered":"2024-09-19T13:36:09.334181+0000","last_unstale":"2024-09-19T14:14:36.131013+0000","last_undegraded":"2024-09-19T14:14:36.131013+0000","last_fullsized":"2024-09-19T14:14:36.131013+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:36.130918+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.130918+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.095702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2985,"num_read_kb":2800,"num_write":665,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'193","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.782781+0000","last_change":"2024-09-19T14:14:35.782781+0000","last_active":"2024-09-19T14:14:35.782781+0000","last_peered":"2024-09-19T14:14:35.782781+0000","last_clean":"2024-09-19T14:14:35.782781+0000","last_became_active":"2024-09-19T13:36:07.815990+0000","last_became_peered":"2024-09-19T13:36:07.815990+0000","last_unstale":"2024-09-19T14:14:35.782781+0000","last_undegraded":"2024-09-19T14:14:35.782781+0000","last_fullsized":"2024-09-19T14:14:35.782781+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:35.782688+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.782688+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.990734+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":442,"num_read_kb":377,"num_write":871,"num_write_kb":27678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'838","reported_seq":2453,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.796490+0000","last_change":"2024-09-19T14:14:43.796490+0000","last_active":"2024-09-19T14:14:43.796490+0000","last_peered":"2024-09-19T14:14:43.796490+0000","last_clean":"2024-09-19T14:14:43.796490+0000","last_became_active":"2024-09-19T13:36:09.332813+0000","last_became_peered":"2024-09-19T13:36:09.332813+0000","last_unstale":"2024-09-19T14:14:43.796490+0000","last_undegraded":"2024-09-19T14:14:43.796490+0000","last_fullsized":"2024-09-19T14:14:43.796490+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:43.796410+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:43.796410+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.796410+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:49:51.893820+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3995,"num_read_kb":3603,"num_write":1099,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'192","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.091489+0000","last_change":"2024-09-19T14:14:35.091489+0000","last_active":"2024-09-19T14:14:35.091489+0000","last_peered":"2024-09-19T14:14:35.091489+0000","last_clean":"2024-09-19T14:14:35.091489+0000","last_became_active":"2024-09-19T13:36:07.816293+0000","last_became_peered":"2024-09-19T13:36:07.816293+0000","last_unstale":"2024-09-19T14:14:35.091489+0000","last_undegraded":"2024-09-19T14:14:35.091489+0000","last_fullsized":"2024-09-19T14:14:35.091489+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'192","last_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_deep_scrub":"260'192","last_deep_scrub_stamp":"2024-09-19T14:14:35.091359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.091359+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:04.394433+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":7782,"num_write":893,"num_write_kb":22142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'506","reported_seq":2295,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.741302+0000","last_change":"2024-09-19T14:14:43.741302+0000","last_active":"2024-09-19T14:14:43.741302+0000","last_peered":"2024-09-19T14:14:43.741302+0000","last_clean":"2024-09-19T14:14:43.741302+0000","last_became_active":"2024-09-19T13:36:09.343197+0000","last_became_peered":"2024-09-19T13:36:09.343197+0000","last_unstale":"2024-09-19T14:14:43.741302+0000","last_undegraded":"2024-09-19T14:14:43.741302+0000","last_fullsized":"2024-09-19T14:14:43.741302+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:43.741200+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:43.741200+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.741200+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:02.439155+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3151,"num_read_kb":2974,"num_write":616,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'196","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.298383+0000","last_change":"2024-09-19T14:14:32.298383+0000","last_active":"2024-09-19T14:14:32.298383+0000","last_peered":"2024-09-19T14:14:32.298383+0000","last_clean":"2024-09-19T14:14:32.298383+0000","last_became_active":"2024-09-19T13:36:07.807055+0000","last_became_peered":"2024-09-19T13:36:07.807055+0000","last_unstale":"2024-09-19T14:14:32.298383+0000","last_undegraded":"2024-09-19T14:14:32.298383+0000","last_fullsized":"2024-09-19T14:14:32.298383+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-19T14:14:32.298282+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.298282+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:53:47.257623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1090,"num_read_kb":38780,"num_write":956,"num_write_kb":39180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'844","reported_seq":2355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.151176+0000","last_change":"2024-09-19T14:14:32.151176+0000","last_active":"2024-09-19T14:14:32.151176+0000","last_peered":"2024-09-19T14:14:32.151176+0000","last_clean":"2024-09-19T14:14:32.151176+0000","last_became_active":"2024-09-19T13:36:09.343167+0000","last_became_peered":"2024-09-19T13:36:09.343167+0000","last_unstale":"2024-09-19T14:14:32.151176+0000","last_undegraded":"2024-09-19T14:14:32.151176+0000","last_fullsized":"2024-09-19T14:14:32.151176+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-19T14:14:32.151071+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.151071+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:53:10.742546+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4025,"num_read_kb":3579,"num_write":1157,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'554","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.736290+0000","last_change":"2024-09-19T14:14:41.736290+0000","last_active":"2024-09-19T14:14:41.736290+0000","last_peered":"2024-09-19T14:14:41.736290+0000","last_clean":"2024-09-19T14:14:41.736290+0000","last_became_active":"2024-09-19T13:36:09.331276+0000","last_became_peered":"2024-09-19T13:36:09.331276+0000","last_unstale":"2024-09-19T14:14:41.736290+0000","last_undegraded":"2024-09-19T14:14:41.736290+0000","last_fullsized":"2024-09-19T14:14:41.736290+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'554","last_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_deep_scrub":"260'554","last_deep_scrub_stamp":"2024-09-19T14:14:41.736205+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.736205+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:08:58.060707+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2966,"num_read_kb":2758,"num_write":661,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'193","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.105180+0000","last_change":"2024-09-19T14:14:34.105113+0000","last_active":"2024-09-19T14:14:34.105180+0000","last_peered":"2024-09-19T14:14:34.105180+0000","last_clean":"2024-09-19T14:14:34.105180+0000","last_became_active":"2024-09-19T13:36:07.811963+0000","last_became_peered":"2024-09-19T13:36:07.811963+0000","last_unstale":"2024-09-19T14:14:34.105180+0000","last_undegraded":"2024-09-19T14:14:34.105180+0000","last_fullsized":"2024-09-19T14:14:34.105180+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:34.105025+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.105025+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:38.487293+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":485,"num_read_kb":11511,"num_write":896,"num_write_kb":24966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'383","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.214409+0000","last_change":"2024-09-19T14:14:40.214409+0000","last_active":"2024-09-19T14:14:40.214409+0000","last_peered":"2024-09-19T14:14:40.214409+0000","last_clean":"2024-09-19T14:14:40.214409+0000","last_became_active":"2024-09-19T13:36:09.340926+0000","last_became_peered":"2024-09-19T13:36:09.340926+0000","last_unstale":"2024-09-19T14:14:40.214409+0000","last_undegraded":"2024-09-19T14:14:40.214409+0000","last_fullsized":"2024-09-19T14:14:40.214409+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-19T14:14:40.214311+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.214311+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:37:14.302323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2216,"num_read_kb":2101,"num_write":424,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'197","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.132706+0000","last_change":"2024-09-19T14:14:32.132624+0000","last_active":"2024-09-19T14:14:32.132706+0000","last_peered":"2024-09-19T14:14:32.132706+0000","last_clean":"2024-09-19T14:14:32.132706+0000","last_became_active":"2024-09-19T13:36:07.811632+0000","last_became_peered":"2024-09-19T13:36:07.811632+0000","last_unstale":"2024-09-19T14:14:32.132706+0000","last_undegraded":"2024-09-19T14:14:32.132706+0000","last_fullsized":"2024-09-19T14:14:32.132706+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:32.132498+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.132498+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:29.891589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":26719,"num_write":915,"num_write_kb":27391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'559","reported_seq":2190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.704483+0000","last_change":"2024-09-19T14:14:40.704483+0000","last_active":"2024-09-19T14:14:40.704483+0000","last_peered":"2024-09-19T14:14:40.704483+0000","last_clean":"2024-09-19T14:14:40.704483+0000","last_became_active":"2024-09-19T13:36:09.335306+0000","last_became_peered":"2024-09-19T13:36:09.335306+0000","last_unstale":"2024-09-19T14:14:40.704483+0000","last_undegraded":"2024-09-19T14:14:40.704483+0000","last_fullsized":"2024-09-19T14:14:40.704483+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'559","last_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_deep_scrub":"260'559","last_deep_scrub_stamp":"2024-09-19T14:14:40.704381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.704381+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:12.312285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2973,"num_read_kb":2760,"num_write":734,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'227","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.161781+0000","last_change":"2024-09-19T14:14:30.161690+0000","last_active":"2024-09-19T14:14:30.161781+0000","last_peered":"2024-09-19T14:14:30.161781+0000","last_clean":"2024-09-19T14:14:30.161781+0000","last_became_active":"2024-09-19T13:36:44.401093+0000","last_became_peered":"2024-09-19T13:36:44.401093+0000","last_unstale":"2024-09-19T14:14:30.161781+0000","last_undegraded":"2024-09-19T14:14:30.161781+0000","last_fullsized":"2024-09-19T14:14:30.161781+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'227","last_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_deep_scrub":"260'227","last_deep_scrub_stamp":"2024-09-19T14:14:30.161577+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.161577+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:19.848076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":629,"num_read_kb":31855,"num_write":1145,"num_write_kb":32449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'379","reported_seq":1919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.163114+0000","last_change":"2024-09-19T14:14:30.163058+0000","last_active":"2024-09-19T14:14:30.163114+0000","last_peered":"2024-09-19T14:14:30.163114+0000","last_clean":"2024-09-19T14:14:30.163114+0000","last_became_active":"2024-09-19T13:36:09.336759+0000","last_became_peered":"2024-09-19T13:36:09.336759+0000","last_unstale":"2024-09-19T14:14:30.163114+0000","last_undegraded":"2024-09-19T14:14:30.163114+0000","last_fullsized":"2024-09-19T14:14:30.163114+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-19T14:14:30.162974+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.162974+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:37.556799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2098,"num_read_kb":2022,"num_write":428,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'206","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.663752+0000","last_change":"2024-09-19T14:14:27.663692+0000","last_active":"2024-09-19T14:14:27.663752+0000","last_peered":"2024-09-19T14:14:27.663752+0000","last_clean":"2024-09-19T14:14:27.663752+0000","last_became_active":"2024-09-19T13:36:07.806577+0000","last_became_peered":"2024-09-19T13:36:07.806577+0000","last_unstale":"2024-09-19T14:14:27.663752+0000","last_undegraded":"2024-09-19T14:14:27.663752+0000","last_fullsized":"2024-09-19T14:14:27.663752+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:27.663598+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.663598+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:54:59.757452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":49502,"num_write":988,"num_write_kb":42182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"260'394","reported_seq":2008,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.172308+0000","last_change":"2024-09-19T14:14:31.172225+0000","last_active":"2024-09-19T14:14:31.172308+0000","last_peered":"2024-09-19T14:14:31.172308+0000","last_clean":"2024-09-19T14:14:31.172308+0000","last_became_active":"2024-09-19T13:36:09.324284+0000","last_became_peered":"2024-09-19T13:36:09.324284+0000","last_unstale":"2024-09-19T14:14:31.172308+0000","last_undegraded":"2024-09-19T14:14:31.172308+0000","last_fullsized":"2024-09-19T14:14:31.172308+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'394","last_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_deep_scrub":"260'394","last_deep_scrub_stamp":"2024-09-19T14:14:31.172124+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.172124+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:59.034171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2275,"num_read_kb":2190,"num_write":423,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'195","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.310130+0000","last_change":"2024-09-19T14:14:31.310078+0000","last_active":"2024-09-19T14:14:31.310130+0000","last_peered":"2024-09-19T14:14:31.310130+0000","last_clean":"2024-09-19T14:14:31.310130+0000","last_became_active":"2024-09-19T13:36:07.806803+0000","last_became_peered":"2024-09-19T13:36:07.806803+0000","last_unstale":"2024-09-19T14:14:31.310130+0000","last_undegraded":"2024-09-19T14:14:31.310130+0000","last_fullsized":"2024-09-19T14:14:31.310130+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:31.309994+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.309994+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:02.549578+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145924,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":176003,"num_write":888,"num_write_kb":56959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'910","reported_seq":2615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.755134+0000","last_change":"2024-09-19T14:14:40.755059+0000","last_active":"2024-09-19T14:14:40.755134+0000","last_peered":"2024-09-19T14:14:40.755134+0000","last_clean":"2024-09-19T14:14:40.755134+0000","last_became_active":"2024-09-19T13:36:09.330816+0000","last_became_peered":"2024-09-19T13:36:09.330816+0000","last_unstale":"2024-09-19T14:14:40.755134+0000","last_undegraded":"2024-09-19T14:14:40.755134+0000","last_fullsized":"2024-09-19T14:14:40.755134+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'910","last_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_deep_scrub":"260'910","last_deep_scrub_stamp":"2024-09-19T14:14:40.754973+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.754973+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:03.252154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4376,"num_read_kb":3925,"num_write":1184,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.263121+0000","last_change":"2024-09-19T14:14:30.263121+0000","last_active":"2024-09-19T14:14:30.263121+0000","last_peered":"2024-09-19T14:14:30.263121+0000","last_clean":"2024-09-19T14:14:30.263121+0000","last_became_active":"2024-09-19T13:36:07.811034+0000","last_became_peered":"2024-09-19T13:36:07.811034+0000","last_unstale":"2024-09-19T14:14:30.263121+0000","last_undegraded":"2024-09-19T14:14:30.263121+0000","last_fullsized":"2024-09-19T14:14:30.263121+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-19T14:14:30.263019+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.263019+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:26.635817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":112164,"num_write":1137,"num_write_kb":85285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'139","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.770168+0000","last_change":"2024-09-19T14:14:58.770168+0000","last_active":"2024-09-19T14:14:58.770168+0000","last_peered":"2024-09-19T14:14:58.770168+0000","last_clean":"2024-09-19T14:14:58.770168+0000","last_became_active":"2024-09-19T13:36:17.363380+0000","last_became_peered":"2024-09-19T13:36:17.363380+0000","last_unstale":"2024-09-19T14:14:58.770168+0000","last_undegraded":"2024-09-19T14:14:58.770168+0000","last_fullsized":"2024-09-19T14:14:58.770168+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-19T14:14:58.770082+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-19T14:14:58.770082+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.770082+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:36:45.776897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":259,"num_read_kb":238,"num_write":324,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'819","reported_seq":2323,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.328941+0000","last_change":"2024-09-19T14:14:36.328941+0000","last_active":"2024-09-19T14:14:36.328941+0000","last_peered":"2024-09-19T14:14:36.328941+0000","last_clean":"2024-09-19T14:14:36.328941+0000","last_became_active":"2024-09-19T13:36:09.344003+0000","last_became_peered":"2024-09-19T13:36:09.344003+0000","last_unstale":"2024-09-19T14:14:36.328941+0000","last_undegraded":"2024-09-19T14:14:36.328941+0000","last_fullsized":"2024-09-19T14:14:36.328941+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'819","last_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_deep_scrub":"260'819","last_deep_scrub_stamp":"2024-09-19T14:14:36.328841+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.328841+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:46.293758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3878,"num_read_kb":3464,"num_write":1074,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'177","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.117409+0000","last_change":"2024-09-19T14:14:31.117409+0000","last_active":"2024-09-19T14:14:31.117409+0000","last_peered":"2024-09-19T14:14:31.117409+0000","last_clean":"2024-09-19T14:14:31.117409+0000","last_became_active":"2024-09-19T13:36:07.807853+0000","last_became_peered":"2024-09-19T13:36:07.807853+0000","last_unstale":"2024-09-19T14:14:31.117409+0000","last_undegraded":"2024-09-19T14:14:31.117409+0000","last_fullsized":"2024-09-19T14:14:31.117409+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-09-19T14:14:31.117313+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.117313+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:40.698859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":47147,"num_write":844,"num_write_kb":32754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.702330+0000","last_change":"2024-09-19T14:14:46.702269+0000","last_active":"2024-09-19T14:14:46.702330+0000","last_peered":"2024-09-19T14:14:46.702330+0000","last_clean":"2024-09-19T14:14:46.702330+0000","last_became_active":"2024-09-19T13:36:11.340212+0000","last_became_peered":"2024-09-19T13:36:11.340212+0000","last_unstale":"2024-09-19T14:14:46.702330+0000","last_undegraded":"2024-09-19T14:14:46.702330+0000","last_fullsized":"2024-09-19T14:14:46.702330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.702178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.702178+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.702178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:28.252054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'197","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.213989+0000","last_change":"2024-09-19T14:14:47.213911+0000","last_active":"2024-09-19T14:14:47.213989+0000","last_peered":"2024-09-19T14:14:47.213989+0000","last_clean":"2024-09-19T14:14:47.213989+0000","last_became_active":"2024-09-19T13:36:13.345897+0000","last_became_peered":"2024-09-19T13:36:13.345897+0000","last_unstale":"2024-09-19T14:14:47.213989+0000","last_undegraded":"2024-09-19T14:14:47.213989+0000","last_fullsized":"2024-09-19T14:14:47.213989+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:14:47.213829+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:14:47.213829+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.213829+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:52.269122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14027,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":262,"num_read_kb":375,"num_write":156,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.239283+0000","last_change":"2024-09-19T14:14:55.239180+0000","last_active":"2024-09-19T14:14:55.239283+0000","last_peered":"2024-09-19T14:14:55.239283+0000","last_clean":"2024-09-19T14:14:55.239283+0000","last_became_active":"2024-09-19T13:36:15.352746+0000","last_became_peered":"2024-09-19T13:36:15.352746+0000","last_unstale":"2024-09-19T14:14:55.239283+0000","last_undegraded":"2024-09-19T14:14:55.239283+0000","last_fullsized":"2024-09-19T14:14:55.239283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.239075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.239075+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.239075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:55.212000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2507","reported_seq":4328,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.590514+0000","last_change":"2024-09-19T14:14:59.590448+0000","last_active":"2024-09-19T14:14:59.590514+0000","last_peered":"2024-09-19T14:14:59.590514+0000","last_clean":"2024-09-19T14:14:59.590514+0000","last_became_active":"2024-09-19T13:36:17.361156+0000","last_became_peered":"2024-09-19T13:36:17.361156+0000","last_unstale":"2024-09-19T14:14:59.590514+0000","last_undegraded":"2024-09-19T14:14:59.590514+0000","last_fullsized":"2024-09-19T14:14:59.590514+0000","mapping_epoch":32,"log_start":"260'2400","ondisk_log_start":"260'2400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2507","last_scrub_stamp":"2024-09-19T14:14:59.590365+0000","last_deep_scrub":"260'2507","last_deep_scrub_stamp":"2024-09-19T14:14:59.590365+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.590365+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":2400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:38.558628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6224,"num_read_kb":6226,"num_write":5062,"num_write_kb":1854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'479","reported_seq":2129,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.773886+0000","last_change":"2024-09-19T14:14:37.773810+0000","last_active":"2024-09-19T14:14:37.773886+0000","last_peered":"2024-09-19T14:14:37.773886+0000","last_clean":"2024-09-19T14:14:37.773886+0000","last_became_active":"2024-09-19T13:36:09.335540+0000","last_became_peered":"2024-09-19T13:36:09.335540+0000","last_unstale":"2024-09-19T14:14:37.773886+0000","last_undegraded":"2024-09-19T14:14:37.773886+0000","last_fullsized":"2024-09-19T14:14:37.773886+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'479","last_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_deep_scrub":"260'479","last_deep_scrub_stamp":"2024-09-19T14:14:37.773706+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.773706+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:04.083276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2596,"num_read_kb":2450,"num_write":554,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":251,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'172","reported_seq":757,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.319675+0000","last_change":"2024-09-19T14:14:24.319675+0000","last_active":"2024-09-19T14:14:24.319675+0000","last_peered":"2024-09-19T14:14:24.319675+0000","last_clean":"2024-09-19T14:14:24.319675+0000","last_became_active":"2024-09-19T13:36:07.810907+0000","last_became_peered":"2024-09-19T13:36:07.810907+0000","last_unstale":"2024-09-19T14:14:24.319675+0000","last_undegraded":"2024-09-19T14:14:24.319675+0000","last_fullsized":"2024-09-19T14:14:24.319675+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'172","last_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_deep_scrub":"260'172","last_deep_scrub_stamp":"2024-09-19T14:14:24.319605+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.319605+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:56.937149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":371,"num_read_kb":36151,"num_write":775,"num_write_kb":44972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.252761+0000","last_change":"2024-09-19T14:14:44.252761+0000","last_active":"2024-09-19T14:14:44.252761+0000","last_peered":"2024-09-19T14:14:44.252761+0000","last_clean":"2024-09-19T14:14:44.252761+0000","last_became_active":"2024-09-19T13:36:11.336063+0000","last_became_peered":"2024-09-19T13:36:11.336063+0000","last_unstale":"2024-09-19T14:14:44.252761+0000","last_undegraded":"2024-09-19T14:14:44.252761+0000","last_fullsized":"2024-09-19T14:14:44.252761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.252671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.252671+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.252671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:08.431300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'81","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.794184+0000","last_change":"2024-09-19T14:14:49.794123+0000","last_active":"2024-09-19T14:14:49.794184+0000","last_peered":"2024-09-19T14:14:49.794184+0000","last_clean":"2024-09-19T14:14:49.794184+0000","last_became_active":"2024-09-19T13:36:13.337390+0000","last_became_peered":"2024-09-19T13:36:13.337390+0000","last_unstale":"2024-09-19T14:14:49.794184+0000","last_undegraded":"2024-09-19T14:14:49.794184+0000","last_fullsized":"2024-09-19T14:14:49.794184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'81","last_scrub_stamp":"2024-09-19T14:14:49.794031+0000","last_deep_scrub":"260'81","last_deep_scrub_stamp":"2024-09-19T14:14:49.794031+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.794031+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:53.073294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":78,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.818300+0000","last_change":"2024-09-19T14:14:54.818226+0000","last_active":"2024-09-19T14:14:54.818300+0000","last_peered":"2024-09-19T14:14:54.818300+0000","last_clean":"2024-09-19T14:14:54.818300+0000","last_became_active":"2024-09-19T13:36:15.349075+0000","last_became_peered":"2024-09-19T13:36:15.349075+0000","last_unstale":"2024-09-19T14:14:54.818300+0000","last_undegraded":"2024-09-19T14:14:54.818300+0000","last_fullsized":"2024-09-19T14:14:54.818300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.818118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.818118+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.818118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:11.651936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'138","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.169897+0000","last_change":"2024-09-19T14:14:58.169897+0000","last_active":"2024-09-19T14:14:58.169897+0000","last_peered":"2024-09-19T14:14:58.169897+0000","last_clean":"2024-09-19T14:14:58.169897+0000","last_became_active":"2024-09-19T13:36:17.360138+0000","last_became_peered":"2024-09-19T13:36:17.360138+0000","last_unstale":"2024-09-19T14:14:58.169897+0000","last_undegraded":"2024-09-19T14:14:58.169897+0000","last_fullsized":"2024-09-19T14:14:58.169897+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'138","last_scrub_stamp":"2024-09-19T14:14:58.169814+0000","last_deep_scrub":"260'138","last_deep_scrub_stamp":"2024-09-19T14:14:58.169814+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.169814+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:59.894371+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":174,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'837","reported_seq":2520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.219917+0000","last_change":"2024-09-19T14:14:35.219848+0000","last_active":"2024-09-19T14:14:35.219917+0000","last_peered":"2024-09-19T14:14:35.219917+0000","last_clean":"2024-09-19T14:14:35.219917+0000","last_became_active":"2024-09-19T13:36:09.337929+0000","last_became_peered":"2024-09-19T13:36:09.337929+0000","last_unstale":"2024-09-19T14:14:35.219917+0000","last_undegraded":"2024-09-19T14:14:35.219917+0000","last_fullsized":"2024-09-19T14:14:35.219917+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'837","last_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_deep_scrub":"260'837","last_deep_scrub_stamp":"2024-09-19T14:14:35.219760+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.219760+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:28.048778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3655,"num_write":1098,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'169","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.152624+0000","last_change":"2024-09-19T14:14:29.152624+0000","last_active":"2024-09-19T14:14:29.152624+0000","last_peered":"2024-09-19T14:14:29.152624+0000","last_clean":"2024-09-19T14:14:29.152624+0000","last_became_active":"2024-09-19T13:36:07.805714+0000","last_became_peered":"2024-09-19T13:36:07.805714+0000","last_unstale":"2024-09-19T14:14:29.152624+0000","last_undegraded":"2024-09-19T14:14:29.152624+0000","last_fullsized":"2024-09-19T14:14:29.152624+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'169","last_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_deep_scrub":"260'169","last_deep_scrub_stamp":"2024-09-19T14:14:29.152542+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.152542+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:24.812263+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":63998,"num_write":820,"num_write_kb":45562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.221945+0000","last_change":"2024-09-19T14:14:46.221891+0000","last_active":"2024-09-19T14:14:46.221945+0000","last_peered":"2024-09-19T14:14:46.221945+0000","last_clean":"2024-09-19T14:14:46.221945+0000","last_became_active":"2024-09-19T13:36:11.336859+0000","last_became_peered":"2024-09-19T13:36:11.336859+0000","last_unstale":"2024-09-19T14:14:46.221945+0000","last_undegraded":"2024-09-19T14:14:46.221945+0000","last_fullsized":"2024-09-19T14:14:46.221945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.221818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.221818+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.221818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:33.565654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'109","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.063068+0000","last_change":"2024-09-19T14:14:38.063068+0000","last_active":"2024-09-19T14:14:38.063068+0000","last_peered":"2024-09-19T14:14:38.063068+0000","last_clean":"2024-09-19T14:14:38.063068+0000","last_became_active":"2024-09-19T13:36:13.341827+0000","last_became_peered":"2024-09-19T13:36:13.341827+0000","last_unstale":"2024-09-19T14:14:38.063068+0000","last_undegraded":"2024-09-19T14:14:38.063068+0000","last_fullsized":"2024-09-19T14:14:38.063068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-19T14:14:38.062968+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.062968+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:05.291095+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'764","reported_seq":2075,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.219729+0000","last_change":"2024-09-19T14:14:54.219640+0000","last_active":"2024-09-19T14:14:54.219729+0000","last_peered":"2024-09-19T14:14:54.219729+0000","last_clean":"2024-09-19T14:14:54.219729+0000","last_became_active":"2024-09-19T13:36:15.353423+0000","last_became_peered":"2024-09-19T13:36:15.353423+0000","last_unstale":"2024-09-19T14:14:54.219729+0000","last_undegraded":"2024-09-19T14:14:54.219729+0000","last_fullsized":"2024-09-19T14:14:54.219729+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'764","last_scrub_stamp":"2024-09-19T14:14:54.219557+0000","last_deep_scrub":"260'764","last_deep_scrub_stamp":"2024-09-19T14:14:54.219557+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.219557+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:45.057117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'278","reported_seq":1116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.743148+0000","last_change":"2024-09-19T14:14:59.743148+0000","last_active":"2024-09-19T14:14:59.743148+0000","last_peered":"2024-09-19T14:14:59.743148+0000","last_clean":"2024-09-19T14:14:59.743148+0000","last_became_active":"2024-09-19T13:36:17.361525+0000","last_became_peered":"2024-09-19T13:36:17.361525+0000","last_unstale":"2024-09-19T14:14:59.743148+0000","last_undegraded":"2024-09-19T14:14:59.743148+0000","last_fullsized":"2024-09-19T14:14:59.743148+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-09-19T14:14:59.743054+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-09-19T14:14:59.743054+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.743054+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:04.825781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":731,"num_write":568,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'432","reported_seq":1989,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.369856+0000","last_change":"2024-09-19T14:14:37.369783+0000","last_active":"2024-09-19T14:14:37.369856+0000","last_peered":"2024-09-19T14:14:37.369856+0000","last_clean":"2024-09-19T14:14:37.369856+0000","last_became_active":"2024-09-19T13:36:09.335790+0000","last_became_peered":"2024-09-19T13:36:09.335790+0000","last_unstale":"2024-09-19T14:14:37.369856+0000","last_undegraded":"2024-09-19T14:14:37.369856+0000","last_fullsized":"2024-09-19T14:14:37.369856+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-19T14:14:37.369664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.369664+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:53.882937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2501,"num_read_kb":2362,"num_write":507,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'185","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.095470+0000","last_change":"2024-09-19T14:14:26.095470+0000","last_active":"2024-09-19T14:14:26.095470+0000","last_peered":"2024-09-19T14:14:26.095470+0000","last_clean":"2024-09-19T14:14:26.095470+0000","last_became_active":"2024-09-19T13:36:07.816349+0000","last_became_peered":"2024-09-19T13:36:07.816349+0000","last_unstale":"2024-09-19T14:14:26.095470+0000","last_undegraded":"2024-09-19T14:14:26.095470+0000","last_fullsized":"2024-09-19T14:14:26.095470+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'185","last_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_deep_scrub":"260'185","last_deep_scrub_stamp":"2024-09-19T14:14:26.095355+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.095355+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:16.399362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":449,"num_read_kb":22529,"num_write":874,"num_write_kb":24056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.665020+0000","last_change":"2024-09-19T14:14:47.664954+0000","last_active":"2024-09-19T14:14:47.665020+0000","last_peered":"2024-09-19T14:14:47.665020+0000","last_clean":"2024-09-19T14:14:47.665020+0000","last_became_active":"2024-09-19T13:36:11.335649+0000","last_became_peered":"2024-09-19T13:36:11.335649+0000","last_unstale":"2024-09-19T14:14:47.665020+0000","last_undegraded":"2024-09-19T14:14:47.665020+0000","last_fullsized":"2024-09-19T14:14:47.665020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.664850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.664850+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.664850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:57.538937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'119","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.240368+0000","last_change":"2024-09-19T14:14:50.240296+0000","last_active":"2024-09-19T14:14:50.240368+0000","last_peered":"2024-09-19T14:14:50.240368+0000","last_clean":"2024-09-19T14:14:50.240368+0000","last_became_active":"2024-09-19T13:36:13.678375+0000","last_became_peered":"2024-09-19T13:36:13.678375+0000","last_unstale":"2024-09-19T14:14:50.240368+0000","last_undegraded":"2024-09-19T14:14:50.240368+0000","last_fullsized":"2024-09-19T14:14:50.240368+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-09-19T14:14:50.240208+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-09-19T14:14:50.240208+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.240208+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:02.074101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":261,"num_write":92,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'796","reported_seq":2175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.064370+0000","last_change":"2024-09-19T14:14:58.064370+0000","last_active":"2024-09-19T14:14:58.064370+0000","last_peered":"2024-09-19T14:14:58.064370+0000","last_clean":"2024-09-19T14:14:58.064370+0000","last_became_active":"2024-09-19T13:36:15.346780+0000","last_became_peered":"2024-09-19T13:36:15.346780+0000","last_unstale":"2024-09-19T14:14:58.064370+0000","last_undegraded":"2024-09-19T14:14:58.064370+0000","last_fullsized":"2024-09-19T14:14:58.064370+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'796","last_scrub_stamp":"2024-09-19T14:14:58.064253+0000","last_deep_scrub":"260'796","last_deep_scrub_stamp":"2024-09-19T14:14:58.064253+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.064253+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:36.368112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'452","reported_seq":2033,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.750257+0000","last_change":"2024-09-19T14:14:38.750189+0000","last_active":"2024-09-19T14:14:38.750257+0000","last_peered":"2024-09-19T14:14:38.750257+0000","last_clean":"2024-09-19T14:14:38.750257+0000","last_became_active":"2024-09-19T13:36:09.333663+0000","last_became_peered":"2024-09-19T13:36:09.333663+0000","last_unstale":"2024-09-19T14:14:38.750257+0000","last_undegraded":"2024-09-19T14:14:38.750257+0000","last_fullsized":"2024-09-19T14:14:38.750257+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'452","last_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_deep_scrub":"260'452","last_deep_scrub_stamp":"2024-09-19T14:14:38.750102+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.750102+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:49.925244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2452,"num_read_kb":2310,"num_write":534,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'243","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.150348+0000","last_change":"2024-09-19T14:14:28.150279+0000","last_active":"2024-09-19T14:14:28.150348+0000","last_peered":"2024-09-19T14:14:28.150348+0000","last_clean":"2024-09-19T14:14:28.150348+0000","last_became_active":"2024-09-19T13:36:07.809267+0000","last_became_peered":"2024-09-19T13:36:07.809267+0000","last_unstale":"2024-09-19T14:14:28.150348+0000","last_undegraded":"2024-09-19T14:14:28.150348+0000","last_fullsized":"2024-09-19T14:14:28.150348+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'243","last_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_deep_scrub":"260'243","last_deep_scrub_stamp":"2024-09-19T14:14:28.150184+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.150184+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:23.391140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":46832,"num_write":1033,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.263893+0000","last_change":"2024-09-19T14:14:43.263839+0000","last_active":"2024-09-19T14:14:43.263893+0000","last_peered":"2024-09-19T14:14:43.263893+0000","last_clean":"2024-09-19T14:14:43.263893+0000","last_became_active":"2024-09-19T13:36:11.332480+0000","last_became_peered":"2024-09-19T13:36:11.332480+0000","last_unstale":"2024-09-19T14:14:43.263893+0000","last_undegraded":"2024-09-19T14:14:43.263893+0000","last_fullsized":"2024-09-19T14:14:43.263893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.263742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.263742+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.263742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:03.888213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'198","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.740221+0000","last_change":"2024-09-19T14:14:50.740161+0000","last_active":"2024-09-19T14:14:50.740221+0000","last_peered":"2024-09-19T14:14:50.740221+0000","last_clean":"2024-09-19T14:14:50.740221+0000","last_became_active":"2024-09-19T13:36:13.679529+0000","last_became_peered":"2024-09-19T13:36:13.679529+0000","last_unstale":"2024-09-19T14:14:50.740221+0000","last_undegraded":"2024-09-19T14:14:50.740221+0000","last_fullsized":"2024-09-19T14:14:50.740221+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'198","last_scrub_stamp":"2024-09-19T14:14:50.740052+0000","last_deep_scrub":"260'198","last_deep_scrub_stamp":"2024-09-19T14:14:50.740052+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.740052+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:48.730209+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":253,"num_read_kb":317,"num_write":142,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.465022+0000","last_change":"2024-09-19T14:14:45.465022+0000","last_active":"2024-09-19T14:14:45.465022+0000","last_peered":"2024-09-19T14:14:45.465022+0000","last_clean":"2024-09-19T14:14:45.465022+0000","last_became_active":"2024-09-19T13:36:15.350780+0000","last_became_peered":"2024-09-19T13:36:15.350780+0000","last_unstale":"2024-09-19T14:14:45.465022+0000","last_undegraded":"2024-09-19T14:14:45.465022+0000","last_fullsized":"2024-09-19T14:14:45.465022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.464942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.464942+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.464942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:20.634984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'542","reported_seq":1364,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.614789+0000","last_change":"2024-09-19T14:14:55.614789+0000","last_active":"2024-09-19T14:14:55.614789+0000","last_peered":"2024-09-19T14:14:55.614789+0000","last_clean":"2024-09-19T14:14:55.614789+0000","last_became_active":"2024-09-19T13:36:17.360452+0000","last_became_peered":"2024-09-19T13:36:17.360452+0000","last_unstale":"2024-09-19T14:14:55.614789+0000","last_undegraded":"2024-09-19T14:14:55.614789+0000","last_fullsized":"2024-09-19T14:14:55.614789+0000","mapping_epoch":32,"log_start":"260'500","ondisk_log_start":"260'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'542","last_scrub_stamp":"2024-09-19T14:14:55.614697+0000","last_deep_scrub":"260'542","last_deep_scrub_stamp":"2024-09-19T14:14:55.614697+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.614697+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:51.676971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":1350,"num_write":1128,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'477","reported_seq":2067,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.703369+0000","last_change":"2024-09-19T14:14:29.703272+0000","last_active":"2024-09-19T14:14:29.703369+0000","last_peered":"2024-09-19T14:14:29.703369+0000","last_clean":"2024-09-19T14:14:29.703369+0000","last_became_active":"2024-09-19T13:36:09.332121+0000","last_became_peered":"2024-09-19T13:36:09.332121+0000","last_unstale":"2024-09-19T14:14:29.703369+0000","last_undegraded":"2024-09-19T14:14:29.703369+0000","last_fullsized":"2024-09-19T14:14:29.703369+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'477","last_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_deep_scrub":"260'477","last_deep_scrub_stamp":"2024-09-19T14:14:29.703144+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.703144+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:43.741727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":2318,"num_write":551,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'207","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.084574+0000","last_change":"2024-09-19T14:14:26.084488+0000","last_active":"2024-09-19T14:14:26.084574+0000","last_peered":"2024-09-19T14:14:26.084574+0000","last_clean":"2024-09-19T14:14:26.084574+0000","last_became_active":"2024-09-19T13:36:07.805724+0000","last_became_peered":"2024-09-19T13:36:07.805724+0000","last_unstale":"2024-09-19T14:14:26.084574+0000","last_undegraded":"2024-09-19T14:14:26.084574+0000","last_fullsized":"2024-09-19T14:14:26.084574+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'207","last_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_deep_scrub":"260'207","last_deep_scrub_stamp":"2024-09-19T14:14:26.084345+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.084345+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:14.683841+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":31454,"num_write":896,"num_write_kb":15886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"260'4","reported_seq":984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.082679+0000","last_change":"2024-09-19T14:14:34.082578+0000","last_active":"2024-09-19T14:14:34.082679+0000","last_peered":"2024-09-19T14:14:34.082679+0000","last_clean":"2024-09-19T14:14:34.082679+0000","last_became_active":"2024-09-19T13:36:11.333142+0000","last_became_peered":"2024-09-19T13:36:11.333142+0000","last_unstale":"2024-09-19T14:14:34.082679+0000","last_undegraded":"2024-09-19T14:14:34.082679+0000","last_fullsized":"2024-09-19T14:14:34.082679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-19T14:14:34.082477+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.082477+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:29.861443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'129","reported_seq":695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.207940+0000","last_change":"2024-09-19T14:14:48.207940+0000","last_active":"2024-09-19T14:14:48.207940+0000","last_peered":"2024-09-19T14:14:48.207940+0000","last_clean":"2024-09-19T14:14:48.207940+0000","last_became_active":"2024-09-19T13:36:13.346112+0000","last_became_peered":"2024-09-19T13:36:13.346112+0000","last_unstale":"2024-09-19T14:14:48.207940+0000","last_undegraded":"2024-09-19T14:14:48.207940+0000","last_fullsized":"2024-09-19T14:14:48.207940+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:48.207855+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:48.207855+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.207855+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:56.958935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10667,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.019083+0000","last_change":"2024-09-19T14:14:56.018990+0000","last_active":"2024-09-19T14:14:56.019083+0000","last_peered":"2024-09-19T14:14:56.019083+0000","last_clean":"2024-09-19T14:14:56.019083+0000","last_became_active":"2024-09-19T13:36:15.346082+0000","last_became_peered":"2024-09-19T13:36:15.346082+0000","last_unstale":"2024-09-19T14:14:56.019083+0000","last_undegraded":"2024-09-19T14:14:56.019083+0000","last_fullsized":"2024-09-19T14:14:56.019083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:56.018901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:56.018901+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.018901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:32.913138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'175","reported_seq":668,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.292890+0000","last_change":"2024-09-19T14:14:47.292890+0000","last_active":"2024-09-19T14:14:47.292890+0000","last_peered":"2024-09-19T14:14:47.292890+0000","last_clean":"2024-09-19T14:14:47.292890+0000","last_became_active":"2024-09-19T13:36:17.360688+0000","last_became_peered":"2024-09-19T13:36:17.360688+0000","last_unstale":"2024-09-19T14:14:47.292890+0000","last_undegraded":"2024-09-19T14:14:47.292890+0000","last_fullsized":"2024-09-19T14:14:47.292890+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-09-19T14:14:47.292772+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-09-19T14:14:47.292772+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.292772+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:16.886494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":145,"num_read_kb":142,"num_write":398,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'344","reported_seq":1852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.128389+0000","last_change":"2024-09-19T14:14:34.128335+0000","last_active":"2024-09-19T14:14:34.128389+0000","last_peered":"2024-09-19T14:14:34.128389+0000","last_clean":"2024-09-19T14:14:34.128389+0000","last_became_active":"2024-09-19T13:36:44.477712+0000","last_became_peered":"2024-09-19T13:36:44.477712+0000","last_unstale":"2024-09-19T14:14:34.128389+0000","last_undegraded":"2024-09-19T14:14:34.128389+0000","last_fullsized":"2024-09-19T14:14:34.128389+0000","mapping_epoch":35,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'344","last_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_deep_scrub":"260'344","last_deep_scrub_stamp":"2024-09-19T14:14:34.128247+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.128247+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:06.144660+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1953,"num_read_kb":1897,"num_write":369,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'241","reported_seq":1073,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.069250+0000","last_change":"2024-09-19T14:14:32.069250+0000","last_active":"2024-09-19T14:14:32.069250+0000","last_peered":"2024-09-19T14:14:32.069250+0000","last_clean":"2024-09-19T14:14:32.069250+0000","last_became_active":"2024-09-19T13:36:07.811941+0000","last_became_peered":"2024-09-19T13:36:07.811941+0000","last_unstale":"2024-09-19T14:14:32.069250+0000","last_undegraded":"2024-09-19T14:14:32.069250+0000","last_fullsized":"2024-09-19T14:14:32.069250+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:32.069155+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.069155+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:39.354526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":168929,"num_write":1052,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.087218+0000","last_change":"2024-09-19T14:14:36.087218+0000","last_active":"2024-09-19T14:14:36.087218+0000","last_peered":"2024-09-19T14:14:36.087218+0000","last_clean":"2024-09-19T14:14:36.087218+0000","last_became_active":"2024-09-19T13:36:11.333327+0000","last_became_peered":"2024-09-19T13:36:11.333327+0000","last_unstale":"2024-09-19T14:14:36.087218+0000","last_undegraded":"2024-09-19T14:14:36.087218+0000","last_fullsized":"2024-09-19T14:14:36.087218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:36.087119+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.087119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:15.398847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'168","reported_seq":746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.150173+0000","last_change":"2024-09-19T14:14:46.150114+0000","last_active":"2024-09-19T14:14:46.150173+0000","last_peered":"2024-09-19T14:14:46.150173+0000","last_clean":"2024-09-19T14:14:46.150173+0000","last_became_active":"2024-09-19T13:36:13.347973+0000","last_became_peered":"2024-09-19T13:36:13.347973+0000","last_unstale":"2024-09-19T14:14:46.150173+0000","last_undegraded":"2024-09-19T14:14:46.150173+0000","last_fullsized":"2024-09-19T14:14:46.150173+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-09-19T14:14:46.150015+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-09-19T14:14:46.150015+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.150015+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:14.578493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5306,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":189,"num_read_kb":233,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'805","reported_seq":2368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.216679+0000","last_change":"2024-09-19T14:14:51.216602+0000","last_active":"2024-09-19T14:14:51.216679+0000","last_peered":"2024-09-19T14:14:51.216679+0000","last_clean":"2024-09-19T14:14:51.216679+0000","last_became_active":"2024-09-19T13:36:15.347371+0000","last_became_peered":"2024-09-19T13:36:15.347371+0000","last_unstale":"2024-09-19T14:14:51.216679+0000","last_undegraded":"2024-09-19T14:14:51.216679+0000","last_fullsized":"2024-09-19T14:14:51.216679+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-19T14:14:51.216522+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-19T14:14:51.216522+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.216522+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:17.663430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'141","reported_seq":628,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.188797+0000","last_change":"2024-09-19T14:14:56.188724+0000","last_active":"2024-09-19T14:14:56.188797+0000","last_peered":"2024-09-19T14:14:56.188797+0000","last_clean":"2024-09-19T14:14:56.188797+0000","last_became_active":"2024-09-19T13:36:17.360419+0000","last_became_peered":"2024-09-19T13:36:17.360419+0000","last_unstale":"2024-09-19T14:14:56.188797+0000","last_undegraded":"2024-09-19T14:14:56.188797+0000","last_fullsized":"2024-09-19T14:14:56.188797+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-09-19T14:14:56.188636+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-09-19T14:14:56.188636+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.188636+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:38.609689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'429","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.275001+0000","last_change":"2024-09-19T14:14:33.275001+0000","last_active":"2024-09-19T14:14:33.275001+0000","last_peered":"2024-09-19T14:14:33.275001+0000","last_clean":"2024-09-19T14:14:33.275001+0000","last_became_active":"2024-09-19T13:36:09.341668+0000","last_became_peered":"2024-09-19T13:36:09.341668+0000","last_unstale":"2024-09-19T14:14:33.275001+0000","last_undegraded":"2024-09-19T14:14:33.275001+0000","last_fullsized":"2024-09-19T14:14:33.275001+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'429","last_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_deep_scrub":"260'429","last_deep_scrub_stamp":"2024-09-19T14:14:33.274911+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.274911+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:04.889403+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2249,"num_read_kb":2124,"num_write":479,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'206","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.809045+0000","last_change":"2024-09-19T14:14:26.809045+0000","last_active":"2024-09-19T14:14:26.809045+0000","last_peered":"2024-09-19T14:14:26.809045+0000","last_clean":"2024-09-19T14:14:26.809045+0000","last_became_active":"2024-09-19T13:36:07.809082+0000","last_became_peered":"2024-09-19T13:36:07.809082+0000","last_unstale":"2024-09-19T14:14:26.809045+0000","last_undegraded":"2024-09-19T14:14:26.809045+0000","last_fullsized":"2024-09-19T14:14:26.809045+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:26.808956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.808956+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:42.176771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":543,"num_read_kb":50665,"num_write":1025,"num_write_kb":45500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.119360+0000","last_change":"2024-09-19T14:14:35.119264+0000","last_active":"2024-09-19T14:14:35.119360+0000","last_peered":"2024-09-19T14:14:35.119360+0000","last_clean":"2024-09-19T14:14:35.119360+0000","last_became_active":"2024-09-19T13:36:11.328022+0000","last_became_peered":"2024-09-19T13:36:11.328022+0000","last_unstale":"2024-09-19T14:14:35.119360+0000","last_undegraded":"2024-09-19T14:14:35.119360+0000","last_fullsized":"2024-09-19T14:14:35.119360+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:35.119157+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.119157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:35:11.867701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'193","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.199619+0000","last_change":"2024-09-19T14:14:45.199552+0000","last_active":"2024-09-19T14:14:45.199619+0000","last_peered":"2024-09-19T14:14:45.199619+0000","last_clean":"2024-09-19T14:14:45.199619+0000","last_became_active":"2024-09-19T13:36:13.345872+0000","last_became_peered":"2024-09-19T13:36:13.345872+0000","last_unstale":"2024-09-19T14:14:45.199619+0000","last_undegraded":"2024-09-19T14:14:45.199619+0000","last_fullsized":"2024-09-19T14:14:45.199619+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-09-19T14:14:45.199463+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-09-19T14:14:45.199463+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.199463+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:27.643129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20793,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":267,"num_read_kb":404,"num_write":130,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.985454+0000","last_change":"2024-09-19T14:14:39.985385+0000","last_active":"2024-09-19T14:14:39.985454+0000","last_peered":"2024-09-19T14:14:39.985454+0000","last_clean":"2024-09-19T14:14:39.985454+0000","last_became_active":"2024-09-19T13:36:15.353622+0000","last_became_peered":"2024-09-19T13:36:15.353622+0000","last_unstale":"2024-09-19T14:14:39.985454+0000","last_undegraded":"2024-09-19T14:14:39.985454+0000","last_fullsized":"2024-09-19T14:14:39.985454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.985275+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.985275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:14.242432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'171","reported_seq":694,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.418240+0000","last_change":"2024-09-19T14:14:50.418181+0000","last_active":"2024-09-19T14:14:50.418240+0000","last_peered":"2024-09-19T14:14:50.418240+0000","last_clean":"2024-09-19T14:14:50.418240+0000","last_became_active":"2024-09-19T13:36:17.362215+0000","last_became_peered":"2024-09-19T13:36:17.362215+0000","last_unstale":"2024-09-19T14:14:50.418240+0000","last_undegraded":"2024-09-19T14:14:50.418240+0000","last_fullsized":"2024-09-19T14:14:50.418240+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'171","last_scrub_stamp":"2024-09-19T14:14:50.418094+0000","last_deep_scrub":"260'171","last_deep_scrub_stamp":"2024-09-19T14:14:50.418094+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.418094+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:41.041552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":265,"num_read_kb":249,"num_write":410,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'1299","reported_seq":3081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.665018+0000","last_change":"2024-09-19T14:14:30.665018+0000","last_active":"2024-09-19T14:14:30.665018+0000","last_peered":"2024-09-19T14:14:30.665018+0000","last_clean":"2024-09-19T14:14:30.665018+0000","last_became_active":"2024-09-19T13:36:09.334081+0000","last_became_peered":"2024-09-19T13:36:09.334081+0000","last_unstale":"2024-09-19T14:14:30.665018+0000","last_undegraded":"2024-09-19T14:14:30.665018+0000","last_fullsized":"2024-09-19T14:14:30.665018+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1299","last_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_deep_scrub":"260'1299","last_deep_scrub_stamp":"2024-09-19T14:14:30.664940+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.664940+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":1200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:04.360372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6004,"num_read_kb":5317,"num_write":1782,"num_write_kb":724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'194","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.386580+0000","last_change":"2024-09-19T14:14:27.386580+0000","last_active":"2024-09-19T14:14:27.386580+0000","last_peered":"2024-09-19T14:14:27.386580+0000","last_clean":"2024-09-19T14:14:27.386580+0000","last_became_active":"2024-09-19T13:36:07.799549+0000","last_became_peered":"2024-09-19T13:36:07.799549+0000","last_unstale":"2024-09-19T14:14:27.386580+0000","last_undegraded":"2024-09-19T14:14:27.386580+0000","last_fullsized":"2024-09-19T14:14:27.386580+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-09-19T14:14:27.386475+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.386475+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:11.179031+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":2025,"num_write":905,"num_write_kb":37651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.084095+0000","last_change":"2024-09-19T14:14:37.084095+0000","last_active":"2024-09-19T14:14:37.084095+0000","last_peered":"2024-09-19T14:14:37.084095+0000","last_clean":"2024-09-19T14:14:37.084095+0000","last_became_active":"2024-09-19T13:36:11.338493+0000","last_became_peered":"2024-09-19T13:36:11.338493+0000","last_unstale":"2024-09-19T14:14:37.084095+0000","last_undegraded":"2024-09-19T14:14:37.084095+0000","last_fullsized":"2024-09-19T14:14:37.084095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:37.084002+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.084002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:24.084032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'152","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.803330+0000","last_change":"2024-09-19T14:14:50.803330+0000","last_active":"2024-09-19T14:14:50.803330+0000","last_peered":"2024-09-19T14:14:50.803330+0000","last_clean":"2024-09-19T14:14:50.803330+0000","last_became_active":"2024-09-19T13:36:13.344081+0000","last_became_peered":"2024-09-19T13:36:13.344081+0000","last_unstale":"2024-09-19T14:14:50.803330+0000","last_undegraded":"2024-09-19T14:14:50.803330+0000","last_fullsized":"2024-09-19T14:14:50.803330+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:50.803244+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:50.803244+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.803244+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:55.132678+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":203,"num_read_kb":278,"num_write":160,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.204653+0000","last_change":"2024-09-19T14:14:52.204653+0000","last_active":"2024-09-19T14:14:52.204653+0000","last_peered":"2024-09-19T14:14:52.204653+0000","last_clean":"2024-09-19T14:14:52.204653+0000","last_became_active":"2024-09-19T13:36:15.348137+0000","last_became_peered":"2024-09-19T13:36:15.348137+0000","last_unstale":"2024-09-19T14:14:52.204653+0000","last_undegraded":"2024-09-19T14:14:52.204653+0000","last_fullsized":"2024-09-19T14:14:52.204653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:52.204570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:52.204570+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.204570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:02.183773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'121","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.055536+0000","last_change":"2024-09-19T14:14:59.055536+0000","last_active":"2024-09-19T14:14:59.055536+0000","last_peered":"2024-09-19T14:14:59.055536+0000","last_clean":"2024-09-19T14:14:59.055536+0000","last_became_active":"2024-09-19T13:36:17.364041+0000","last_became_peered":"2024-09-19T13:36:17.364041+0000","last_unstale":"2024-09-19T14:14:59.055536+0000","last_undegraded":"2024-09-19T14:14:59.055536+0000","last_fullsized":"2024-09-19T14:14:59.055536+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'121","last_scrub_stamp":"2024-09-19T14:14:59.055434+0000","last_deep_scrub":"260'121","last_deep_scrub_stamp":"2024-09-19T14:14:59.055434+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.055434+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:34.842983+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":163,"num_write":291,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'471","reported_seq":2101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.635975+0000","last_change":"2024-09-19T14:14:31.635975+0000","last_active":"2024-09-19T14:14:31.635975+0000","last_peered":"2024-09-19T14:14:31.635975+0000","last_clean":"2024-09-19T14:14:31.635975+0000","last_became_active":"2024-09-19T13:36:09.329479+0000","last_became_peered":"2024-09-19T13:36:09.329479+0000","last_unstale":"2024-09-19T14:14:31.635975+0000","last_undegraded":"2024-09-19T14:14:31.635975+0000","last_fullsized":"2024-09-19T14:14:31.635975+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'471","last_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_deep_scrub":"260'471","last_deep_scrub_stamp":"2024-09-19T14:14:31.635871+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.635871+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:59.000822+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2491,"num_read_kb":2354,"num_write":534,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'218","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.108020+0000","last_change":"2024-09-19T14:14:28.107934+0000","last_active":"2024-09-19T14:14:28.108020+0000","last_peered":"2024-09-19T14:14:28.108020+0000","last_clean":"2024-09-19T14:14:28.108020+0000","last_became_active":"2024-09-19T13:36:07.814270+0000","last_became_peered":"2024-09-19T13:36:07.814270+0000","last_unstale":"2024-09-19T14:14:28.108020+0000","last_undegraded":"2024-09-19T14:14:28.108020+0000","last_fullsized":"2024-09-19T14:14:28.108020+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:28.107813+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.107813+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:55:25.599144+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":527,"num_read_kb":62927,"num_write":1024,"num_write_kb":47256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.387905+0000","last_change":"2024-09-19T14:14:38.387905+0000","last_active":"2024-09-19T14:14:38.387905+0000","last_peered":"2024-09-19T14:14:38.387905+0000","last_clean":"2024-09-19T14:14:38.387905+0000","last_became_active":"2024-09-19T13:36:11.335981+0000","last_became_peered":"2024-09-19T13:36:11.335981+0000","last_unstale":"2024-09-19T14:14:38.387905+0000","last_undegraded":"2024-09-19T14:14:38.387905+0000","last_fullsized":"2024-09-19T14:14:38.387905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.387808+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.387808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:10.915092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'152","reported_seq":732,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.019987+0000","last_change":"2024-09-19T14:14:39.019987+0000","last_active":"2024-09-19T14:14:39.019987+0000","last_peered":"2024-09-19T14:14:39.019987+0000","last_clean":"2024-09-19T14:14:39.019987+0000","last_became_active":"2024-09-19T13:36:13.343360+0000","last_became_peered":"2024-09-19T13:36:13.343360+0000","last_unstale":"2024-09-19T14:14:39.019987+0000","last_undegraded":"2024-09-19T14:14:39.019987+0000","last_fullsized":"2024-09-19T14:14:39.019987+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-09-19T14:14:39.019863+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.019863+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:04.873037+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":180,"num_read_kb":188,"num_write":94,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'736","reported_seq":2209,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.008665+0000","last_change":"2024-09-19T14:14:41.008665+0000","last_active":"2024-09-19T14:14:41.008665+0000","last_peered":"2024-09-19T14:14:41.008665+0000","last_clean":"2024-09-19T14:14:41.008665+0000","last_became_active":"2024-09-19T13:36:15.349605+0000","last_became_peered":"2024-09-19T13:36:15.349605+0000","last_unstale":"2024-09-19T14:14:41.008665+0000","last_undegraded":"2024-09-19T14:14:41.008665+0000","last_fullsized":"2024-09-19T14:14:41.008665+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'736","last_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_deep_scrub":"260'736","last_deep_scrub_stamp":"2024-09-19T14:14:41.008532+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.008532+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:52.770410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'123","reported_seq":642,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.413838+0000","last_change":"2024-09-19T14:14:48.413838+0000","last_active":"2024-09-19T14:14:48.413838+0000","last_peered":"2024-09-19T14:14:48.413838+0000","last_clean":"2024-09-19T14:14:48.413838+0000","last_became_active":"2024-09-19T13:36:17.355204+0000","last_became_peered":"2024-09-19T13:36:17.355204+0000","last_unstale":"2024-09-19T14:14:48.413838+0000","last_undegraded":"2024-09-19T14:14:48.413838+0000","last_fullsized":"2024-09-19T14:14:48.413838+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'123","last_scrub_stamp":"2024-09-19T14:14:48.413746+0000","last_deep_scrub":"260'123","last_deep_scrub_stamp":"2024-09-19T14:14:48.413746+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.413746+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.347352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1275,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":243,"num_read_kb":216,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'1577","reported_seq":3205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.622853+0000","last_change":"2024-09-19T14:14:32.622853+0000","last_active":"2024-09-19T14:14:32.622853+0000","last_peered":"2024-09-19T14:14:32.622853+0000","last_clean":"2024-09-19T14:14:32.622853+0000","last_became_active":"2024-09-19T13:36:09.332613+0000","last_became_peered":"2024-09-19T13:36:09.332613+0000","last_unstale":"2024-09-19T14:14:32.622853+0000","last_undegraded":"2024-09-19T14:14:32.622853+0000","last_fullsized":"2024-09-19T14:14:32.622853+0000","mapping_epoch":24,"log_start":"260'1500","ondisk_log_start":"260'1500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1577","last_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_deep_scrub":"260'1577","last_deep_scrub_stamp":"2024-09-19T14:14:32.622730+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.622730+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":1500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:37.492268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6999,"num_read_kb":6110,"num_write":2225,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'202","reported_seq":828,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.599843+0000","last_change":"2024-09-19T14:14:24.599775+0000","last_active":"2024-09-19T14:14:24.599843+0000","last_peered":"2024-09-19T14:14:24.599843+0000","last_clean":"2024-09-19T14:14:24.599843+0000","last_became_active":"2024-09-19T13:36:07.800575+0000","last_became_peered":"2024-09-19T13:36:07.800575+0000","last_unstale":"2024-09-19T14:14:24.599843+0000","last_undegraded":"2024-09-19T14:14:24.599843+0000","last_fullsized":"2024-09-19T14:14:24.599843+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-09-19T14:14:24.599680+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.599680+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.795340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":467,"num_read_kb":26305,"num_write":903,"num_write_kb":49998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"260'9","reported_seq":1934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.736639+0000","last_change":"2024-09-19T14:14:45.736639+0000","last_active":"2024-09-19T14:14:45.736639+0000","last_peered":"2024-09-19T14:14:45.736639+0000","last_clean":"2024-09-19T14:14:45.736639+0000","last_became_active":"2024-09-19T13:36:11.338615+0000","last_became_peered":"2024-09-19T13:36:11.338615+0000","last_unstale":"2024-09-19T14:14:45.736639+0000","last_undegraded":"2024-09-19T14:14:45.736639+0000","last_fullsized":"2024-09-19T14:14:45.736639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-19T14:14:45.736528+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-19T14:14:45.736528+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.736528+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:03.389967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1231,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1680,"num_read_kb":2149,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'80","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.214532+0000","last_change":"2024-09-19T14:14:49.214532+0000","last_active":"2024-09-19T14:14:49.214532+0000","last_peered":"2024-09-19T14:14:49.214532+0000","last_clean":"2024-09-19T14:14:49.214532+0000","last_became_active":"2024-09-19T13:36:13.678117+0000","last_became_peered":"2024-09-19T13:36:13.678117+0000","last_unstale":"2024-09-19T14:14:49.214532+0000","last_undegraded":"2024-09-19T14:14:49.214532+0000","last_fullsized":"2024-09-19T14:14:49.214532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'80","last_scrub_stamp":"2024-09-19T14:14:49.214444+0000","last_deep_scrub":"260'80","last_deep_scrub_stamp":"2024-09-19T14:14:49.214444+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.214444+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:00.195139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'779","reported_seq":4746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.272223+0000","last_change":"2024-09-19T14:14:43.272223+0000","last_active":"2024-09-19T14:14:43.272223+0000","last_peered":"2024-09-19T14:14:43.272223+0000","last_clean":"2024-09-19T14:14:43.272223+0000","last_became_active":"2024-09-19T13:36:15.352021+0000","last_became_peered":"2024-09-19T13:36:15.352021+0000","last_unstale":"2024-09-19T14:14:43.272223+0000","last_undegraded":"2024-09-19T14:14:43.272223+0000","last_fullsized":"2024-09-19T14:14:43.272223+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'779","last_scrub_stamp":"2024-09-19T14:14:43.272137+0000","last_deep_scrub":"260'779","last_deep_scrub_stamp":"2024-09-19T14:14:43.272137+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.272137+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:40.042664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'129","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.801351+0000","last_change":"2024-09-19T14:14:56.801351+0000","last_active":"2024-09-19T14:14:56.801351+0000","last_peered":"2024-09-19T14:14:56.801351+0000","last_clean":"2024-09-19T14:14:56.801351+0000","last_became_active":"2024-09-19T13:36:17.359957+0000","last_became_peered":"2024-09-19T13:36:17.359957+0000","last_unstale":"2024-09-19T14:14:56.801351+0000","last_undegraded":"2024-09-19T14:14:56.801351+0000","last_fullsized":"2024-09-19T14:14:56.801351+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:56.801262+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:56.801262+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.801262+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:57.529161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":143,"num_read_kb":141,"num_write":282,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'913","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.399491+0000","last_change":"2024-09-19T14:14:34.399491+0000","last_active":"2024-09-19T14:14:34.399491+0000","last_peered":"2024-09-19T14:14:34.399491+0000","last_clean":"2024-09-19T14:14:34.399491+0000","last_became_active":"2024-09-19T13:36:09.345208+0000","last_became_peered":"2024-09-19T13:36:09.345208+0000","last_unstale":"2024-09-19T14:14:34.399491+0000","last_undegraded":"2024-09-19T14:14:34.399491+0000","last_fullsized":"2024-09-19T14:14:34.399491+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-19T14:14:34.399381+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.399381+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:04.254432+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4543,"num_read_kb":4052,"num_write":1236,"num_write_kb":483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'181","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.387161+0000","last_change":"2024-09-19T14:14:24.387106+0000","last_active":"2024-09-19T14:14:24.387161+0000","last_peered":"2024-09-19T14:14:24.387161+0000","last_clean":"2024-09-19T14:14:24.387161+0000","last_became_active":"2024-09-19T13:36:07.802912+0000","last_became_peered":"2024-09-19T13:36:07.802912+0000","last_unstale":"2024-09-19T14:14:24.387161+0000","last_undegraded":"2024-09-19T14:14:24.387161+0000","last_fullsized":"2024-09-19T14:14:24.387161+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'181","last_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_deep_scrub":"260'181","last_deep_scrub_stamp":"2024-09-19T14:14:24.387035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.387035+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:58.069276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":394,"num_write":879,"num_write_kb":11607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.789131+0000","last_change":"2024-09-19T14:14:45.789131+0000","last_active":"2024-09-19T14:14:45.789131+0000","last_peered":"2024-09-19T14:14:45.789131+0000","last_clean":"2024-09-19T14:14:45.789131+0000","last_became_active":"2024-09-19T13:36:11.333797+0000","last_became_peered":"2024-09-19T13:36:11.333797+0000","last_unstale":"2024-09-19T14:14:45.789131+0000","last_undegraded":"2024-09-19T14:14:45.789131+0000","last_fullsized":"2024-09-19T14:14:45.789131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.789031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.789031+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.789031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:15.046433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'204","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.703399+0000","last_change":"2024-09-19T14:14:51.703399+0000","last_active":"2024-09-19T14:14:51.703399+0000","last_peered":"2024-09-19T14:14:51.703399+0000","last_clean":"2024-09-19T14:14:51.703399+0000","last_became_active":"2024-09-19T13:36:13.346419+0000","last_became_peered":"2024-09-19T13:36:13.346419+0000","last_unstale":"2024-09-19T14:14:51.703399+0000","last_undegraded":"2024-09-19T14:14:51.703399+0000","last_fullsized":"2024-09-19T14:14:51.703399+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'204","last_scrub_stamp":"2024-09-19T14:14:51.703300+0000","last_deep_scrub":"260'204","last_deep_scrub_stamp":"2024-09-19T14:14:51.703300+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.703300+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:45.051594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":866,"num_read_kb":913,"num_write":1382,"num_write_kb":1260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516348,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.214279+0000","last_change":"2024-09-19T14:14:39.214279+0000","last_active":"2024-09-19T14:14:39.214279+0000","last_peered":"2024-09-19T14:14:39.214279+0000","last_clean":"2024-09-19T14:14:39.214279+0000","last_became_active":"2024-09-19T13:36:15.349143+0000","last_became_peered":"2024-09-19T13:36:15.349143+0000","last_unstale":"2024-09-19T14:14:39.214279+0000","last_undegraded":"2024-09-19T14:14:39.214279+0000","last_fullsized":"2024-09-19T14:14:39.214279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.214191+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.214191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:32.459392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.449989+0000","last_change":"2024-09-19T14:14:49.449989+0000","last_active":"2024-09-19T14:14:49.449989+0000","last_peered":"2024-09-19T14:14:49.449989+0000","last_clean":"2024-09-19T14:14:49.449989+0000","last_became_active":"2024-09-19T13:36:17.353903+0000","last_became_peered":"2024-09-19T13:36:17.353903+0000","last_unstale":"2024-09-19T14:14:49.449989+0000","last_undegraded":"2024-09-19T14:14:49.449989+0000","last_fullsized":"2024-09-19T14:14:49.449989+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-09-19T14:14:49.449885+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-09-19T14:14:49.449885+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.449885+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:16.393490+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":138,"num_write":267,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'535","reported_seq":2185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.142395+0000","last_change":"2024-09-19T14:14:33.142395+0000","last_active":"2024-09-19T14:14:33.142395+0000","last_peered":"2024-09-19T14:14:33.142395+0000","last_clean":"2024-09-19T14:14:33.142395+0000","last_became_active":"2024-09-19T13:36:09.335067+0000","last_became_peered":"2024-09-19T13:36:09.335067+0000","last_unstale":"2024-09-19T14:14:33.142395+0000","last_undegraded":"2024-09-19T14:14:33.142395+0000","last_fullsized":"2024-09-19T14:14:33.142395+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-19T14:14:33.142301+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.142301+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:53:23.111973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2775,"num_read_kb":2591,"num_write":642,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.090762+0000","last_change":"2024-09-19T14:14:25.090762+0000","last_active":"2024-09-19T14:14:25.090762+0000","last_peered":"2024-09-19T14:14:25.090762+0000","last_clean":"2024-09-19T14:14:25.090762+0000","last_became_active":"2024-09-19T13:35:53.208115+0000","last_became_peered":"2024-09-19T13:35:53.208115+0000","last_unstale":"2024-09-19T14:14:25.090762+0000","last_undegraded":"2024-09-19T14:14:25.090762+0000","last_fullsized":"2024-09-19T14:14:25.090762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-19T14:14:25.090660+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.090660+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:42.554407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.846131+0000","last_change":"2024-09-19T14:14:24.846077+0000","last_active":"2024-09-19T14:14:24.846131+0000","last_peered":"2024-09-19T14:14:24.846131+0000","last_clean":"2024-09-19T14:14:24.846131+0000","last_became_active":"2024-09-19T13:35:58.757682+0000","last_became_peered":"2024-09-19T13:35:58.757682+0000","last_unstale":"2024-09-19T14:14:24.846131+0000","last_undegraded":"2024-09-19T14:14:24.846131+0000","last_fullsized":"2024-09-19T14:14:24.846131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:24.845991+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.845991+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:12.158112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051593199999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"260'234","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.365639+0000","last_change":"2024-09-19T14:14:23.365639+0000","last_active":"2024-09-19T14:14:23.365639+0000","last_peered":"2024-09-19T14:14:23.365639+0000","last_clean":"2024-09-19T14:14:23.365639+0000","last_became_active":"2024-09-19T13:36:07.812591+0000","last_became_peered":"2024-09-19T13:36:07.812591+0000","last_unstale":"2024-09-19T14:14:23.365639+0000","last_undegraded":"2024-09-19T14:14:23.365639+0000","last_fullsized":"2024-09-19T14:14:23.365639+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'234","last_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_deep_scrub":"260'234","last_deep_scrub_stamp":"2024-09-19T14:14:23.365567+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.365567+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:40:16.918810+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":4147,"num_write":1074,"num_write_kb":25755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.276710+0000","last_change":"2024-09-19T14:14:42.276710+0000","last_active":"2024-09-19T14:14:42.276710+0000","last_peered":"2024-09-19T14:14:42.276710+0000","last_clean":"2024-09-19T14:14:42.276710+0000","last_became_active":"2024-09-19T13:36:11.335652+0000","last_became_peered":"2024-09-19T13:36:11.335652+0000","last_unstale":"2024-09-19T14:14:42.276710+0000","last_undegraded":"2024-09-19T14:14:42.276710+0000","last_fullsized":"2024-09-19T14:14:42.276710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.276595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.276595+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.276595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:58:08.758004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'341","reported_seq":1036,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.731198+0000","last_change":"2024-09-19T14:14:49.731106+0000","last_active":"2024-09-19T14:14:49.731198+0000","last_peered":"2024-09-19T14:14:49.731198+0000","last_clean":"2024-09-19T14:14:49.731198+0000","last_became_active":"2024-09-19T13:36:13.347682+0000","last_became_peered":"2024-09-19T13:36:13.347682+0000","last_unstale":"2024-09-19T14:14:49.731198+0000","last_undegraded":"2024-09-19T14:14:49.731198+0000","last_fullsized":"2024-09-19T14:14:49.731198+0000","mapping_epoch":28,"log_start":"260'300","ondisk_log_start":"260'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-19T14:14:49.730990+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-19T14:14:49.730990+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.730990+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:57.630554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":592,"num_read_kb":939,"num_write":532,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107642,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.185727+0000","last_change":"2024-09-19T14:14:50.185647+0000","last_active":"2024-09-19T14:14:50.185727+0000","last_peered":"2024-09-19T14:14:50.185727+0000","last_clean":"2024-09-19T14:14:50.185727+0000","last_became_active":"2024-09-19T13:36:15.353020+0000","last_became_peered":"2024-09-19T13:36:15.353020+0000","last_unstale":"2024-09-19T14:14:50.185727+0000","last_undegraded":"2024-09-19T14:14:50.185727+0000","last_fullsized":"2024-09-19T14:14:50.185727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:50.185520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:50.185520+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.185520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:59.119852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'191","reported_seq":890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.336293+0000","last_change":"2024-09-19T14:14:48.336239+0000","last_active":"2024-09-19T14:14:48.336293+0000","last_peered":"2024-09-19T14:14:48.336293+0000","last_clean":"2024-09-19T14:14:48.336293+0000","last_became_active":"2024-09-19T13:36:17.356689+0000","last_became_peered":"2024-09-19T13:36:17.356689+0000","last_unstale":"2024-09-19T14:14:48.336293+0000","last_undegraded":"2024-09-19T14:14:48.336293+0000","last_fullsized":"2024-09-19T14:14:48.336293+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-09-19T14:14:48.336158+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-09-19T14:14:48.336158+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.336158+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:21.500227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":461,"num_read_kb":460,"num_write":407,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"260'976","reported_seq":2588,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.255176+0000","last_change":"2024-09-19T14:14:34.255104+0000","last_active":"2024-09-19T14:14:34.255176+0000","last_peered":"2024-09-19T14:14:34.255176+0000","last_clean":"2024-09-19T14:14:34.255176+0000","last_became_active":"2024-09-19T13:36:09.343599+0000","last_became_peered":"2024-09-19T13:36:09.343599+0000","last_unstale":"2024-09-19T14:14:34.255176+0000","last_undegraded":"2024-09-19T14:14:34.255176+0000","last_fullsized":"2024-09-19T14:14:34.255176+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'976","last_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_deep_scrub":"260'976","last_deep_scrub_stamp":"2024-09-19T14:14:34.255007+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.255007+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:17.054045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4808,"num_read_kb":4384,"num_write":1423,"num_write_kb":580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.122612+0000","last_change":"2024-09-19T14:14:27.122612+0000","last_active":"2024-09-19T14:14:27.122612+0000","last_peered":"2024-09-19T14:14:27.122612+0000","last_clean":"2024-09-19T14:14:27.122612+0000","last_became_active":"2024-09-19T13:35:58.758234+0000","last_became_peered":"2024-09-19T13:35:58.758234+0000","last_unstale":"2024-09-19T14:14:27.122612+0000","last_undegraded":"2024-09-19T14:14:27.122612+0000","last_fullsized":"2024-09-19T14:14:27.122612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:27.122523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.122523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:34.702946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000372617,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'215","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.355899+0000","last_change":"2024-09-19T14:14:23.355899+0000","last_active":"2024-09-19T14:14:23.355899+0000","last_peered":"2024-09-19T14:14:23.355899+0000","last_clean":"2024-09-19T14:14:23.355899+0000","last_became_active":"2024-09-19T13:36:07.801927+0000","last_became_peered":"2024-09-19T13:36:07.801927+0000","last_unstale":"2024-09-19T14:14:23.355899+0000","last_undegraded":"2024-09-19T14:14:23.355899+0000","last_fullsized":"2024-09-19T14:14:23.355899+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:23.355816+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.355816+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:31.085121+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":574,"num_read_kb":42960,"num_write":983,"num_write_kb":27097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.727911+0000","last_change":"2024-09-19T14:14:44.727854+0000","last_active":"2024-09-19T14:14:44.727911+0000","last_peered":"2024-09-19T14:14:44.727911+0000","last_clean":"2024-09-19T14:14:44.727911+0000","last_became_active":"2024-09-19T13:36:11.336929+0000","last_became_peered":"2024-09-19T13:36:11.336929+0000","last_unstale":"2024-09-19T14:14:44.727911+0000","last_undegraded":"2024-09-19T14:14:44.727911+0000","last_fullsized":"2024-09-19T14:14:44.727911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.727726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.727726+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.727726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:09.947880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'830","reported_seq":2218,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.397591+0000","last_change":"2024-09-19T14:14:43.397591+0000","last_active":"2024-09-19T14:14:43.397591+0000","last_peered":"2024-09-19T14:14:43.397591+0000","last_clean":"2024-09-19T14:14:43.397591+0000","last_became_active":"2024-09-19T13:36:13.344151+0000","last_became_peered":"2024-09-19T13:36:13.344151+0000","last_unstale":"2024-09-19T14:14:43.397591+0000","last_undegraded":"2024-09-19T14:14:43.397591+0000","last_fullsized":"2024-09-19T14:14:43.397591+0000","mapping_epoch":28,"log_start":"260'800","ondisk_log_start":"260'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'830","last_scrub_stamp":"2024-09-19T14:14:43.397471+0000","last_deep_scrub":"260'830","last_deep_scrub_stamp":"2024-09-19T14:14:43.397471+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.397471+0000","objects_scrubbed":11,"log_size":30,"log_dups_size":800,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:58:39.866036+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1143,"num_read_kb":1321,"num_write":246,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.220809+0000","last_change":"2024-09-19T14:14:52.220809+0000","last_active":"2024-09-19T14:14:52.220809+0000","last_peered":"2024-09-19T14:14:52.220809+0000","last_clean":"2024-09-19T14:14:52.220809+0000","last_became_active":"2024-09-19T13:36:15.354894+0000","last_became_peered":"2024-09-19T13:36:15.354894+0000","last_unstale":"2024-09-19T14:14:52.220809+0000","last_undegraded":"2024-09-19T14:14:52.220809+0000","last_fullsized":"2024-09-19T14:14:52.220809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:52.220717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:52.220717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.220717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:57.489976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'129","reported_seq":637,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.427909+0000","last_change":"2024-09-19T14:14:52.427846+0000","last_active":"2024-09-19T14:14:52.427909+0000","last_peered":"2024-09-19T14:14:52.427909+0000","last_clean":"2024-09-19T14:14:52.427909+0000","last_became_active":"2024-09-19T13:36:17.352751+0000","last_became_peered":"2024-09-19T13:36:17.352751+0000","last_unstale":"2024-09-19T14:14:52.427909+0000","last_undegraded":"2024-09-19T14:14:52.427909+0000","last_fullsized":"2024-09-19T14:14:52.427909+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-19T14:14:52.427757+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-19T14:14:52.427757+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.427757+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:50.156910+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":186,"num_write":336,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"260'772","reported_seq":2376,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.370974+0000","last_change":"2024-09-19T14:14:32.370868+0000","last_active":"2024-09-19T14:14:32.370974+0000","last_peered":"2024-09-19T14:14:32.370974+0000","last_clean":"2024-09-19T14:14:32.370974+0000","last_became_active":"2024-09-19T13:36:09.334870+0000","last_became_peered":"2024-09-19T13:36:09.334870+0000","last_unstale":"2024-09-19T14:14:32.370974+0000","last_undegraded":"2024-09-19T14:14:32.370974+0000","last_fullsized":"2024-09-19T14:14:32.370974+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'772","last_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_deep_scrub":"260'772","last_deep_scrub_stamp":"2024-09-19T14:14:32.370749+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.370749+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:44.543791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3723,"num_read_kb":3377,"num_write":1002,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.186533+0000","last_change":"2024-09-19T14:14:24.186455+0000","last_active":"2024-09-19T14:14:24.186533+0000","last_peered":"2024-09-19T14:14:24.186533+0000","last_clean":"2024-09-19T14:14:24.186533+0000","last_became_active":"2024-09-19T13:35:58.754750+0000","last_became_peered":"2024-09-19T13:35:58.754750+0000","last_unstale":"2024-09-19T14:14:24.186533+0000","last_undegraded":"2024-09-19T14:14:24.186533+0000","last_fullsized":"2024-09-19T14:14:24.186533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:24.186357+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.186357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:33.573366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076413499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"260'184","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:24.246955+0000","last_change":"2024-09-19T14:14:24.246955+0000","last_active":"2024-09-19T14:14:24.246955+0000","last_peered":"2024-09-19T14:14:24.246955+0000","last_clean":"2024-09-19T14:14:24.246955+0000","last_became_active":"2024-09-19T13:36:07.803169+0000","last_became_peered":"2024-09-19T13:36:07.803169+0000","last_unstale":"2024-09-19T14:14:24.246955+0000","last_undegraded":"2024-09-19T14:14:24.246955+0000","last_fullsized":"2024-09-19T14:14:24.246955+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-09-19T14:14:24.246846+0000","last_clean_scrub_stamp":"2024-09-19T14:14:24.246846+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:34.062372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":6136,"num_write":878,"num_write_kb":35030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.120781+0000","last_change":"2024-09-19T14:14:33.120713+0000","last_active":"2024-09-19T14:14:33.120781+0000","last_peered":"2024-09-19T14:14:33.120781+0000","last_clean":"2024-09-19T14:14:33.120781+0000","last_became_active":"2024-09-19T13:36:11.334668+0000","last_became_peered":"2024-09-19T13:36:11.334668+0000","last_unstale":"2024-09-19T14:14:33.120781+0000","last_undegraded":"2024-09-19T14:14:33.120781+0000","last_fullsized":"2024-09-19T14:14:33.120781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:33.120629+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.120629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:47.158421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'210","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.171630+0000","last_change":"2024-09-19T14:14:48.171630+0000","last_active":"2024-09-19T14:14:48.171630+0000","last_peered":"2024-09-19T14:14:48.171630+0000","last_clean":"2024-09-19T14:14:48.171630+0000","last_became_active":"2024-09-19T13:36:13.677984+0000","last_became_peered":"2024-09-19T13:36:13.677984+0000","last_unstale":"2024-09-19T14:14:48.171630+0000","last_undegraded":"2024-09-19T14:14:48.171630+0000","last_fullsized":"2024-09-19T14:14:48.171630+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:48.171510+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:48.171510+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.171510+0000","objects_scrubbed":9,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:18.235764+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":150,"num_read_kb":142,"num_write":115,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5278,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.218523+0000","last_change":"2024-09-19T14:14:49.218523+0000","last_active":"2024-09-19T14:14:49.218523+0000","last_peered":"2024-09-19T14:14:49.218523+0000","last_clean":"2024-09-19T14:14:49.218523+0000","last_became_active":"2024-09-19T13:36:15.350147+0000","last_became_peered":"2024-09-19T13:36:15.350147+0000","last_unstale":"2024-09-19T14:14:49.218523+0000","last_undegraded":"2024-09-19T14:14:49.218523+0000","last_fullsized":"2024-09-19T14:14:49.218523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:49.218432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:49.218432+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.218432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:13.814133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'244","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.032600+0000","last_change":"2024-09-19T14:15:00.032600+0000","last_active":"2024-09-19T14:15:00.032600+0000","last_peered":"2024-09-19T14:15:00.032600+0000","last_clean":"2024-09-19T14:15:00.032600+0000","last_became_active":"2024-09-19T13:36:17.363378+0000","last_became_peered":"2024-09-19T13:36:17.363378+0000","last_unstale":"2024-09-19T14:15:00.032600+0000","last_undegraded":"2024-09-19T14:15:00.032600+0000","last_fullsized":"2024-09-19T14:15:00.032600+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:15:00.032503+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:15:00.032503+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.032503+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:07.050608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":531,"num_read_kb":549,"num_write":541,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"260'352","reported_seq":1880,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.371001+0000","last_change":"2024-09-19T14:14:30.371001+0000","last_active":"2024-09-19T14:14:30.371001+0000","last_peered":"2024-09-19T14:14:30.371001+0000","last_clean":"2024-09-19T14:14:30.371001+0000","last_became_active":"2024-09-19T13:36:09.326567+0000","last_became_peered":"2024-09-19T13:36:09.326567+0000","last_unstale":"2024-09-19T14:14:30.371001+0000","last_undegraded":"2024-09-19T14:14:30.371001+0000","last_fullsized":"2024-09-19T14:14:30.371001+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-19T14:14:30.370905+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.370905+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:22.516405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2051,"num_read_kb":1982,"num_write":391,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.799153+0000","last_change":"2024-09-19T14:14:23.799062+0000","last_active":"2024-09-19T14:14:23.799153+0000","last_peered":"2024-09-19T14:14:23.799153+0000","last_clean":"2024-09-19T14:14:23.799153+0000","last_became_active":"2024-09-19T13:35:58.757784+0000","last_became_peered":"2024-09-19T13:35:58.757784+0000","last_unstale":"2024-09-19T14:14:23.799153+0000","last_undegraded":"2024-09-19T14:14:23.799153+0000","last_fullsized":"2024-09-19T14:14:23.799153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-19T14:14:23.798956+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.798956+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:54.613030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001031524,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'228","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.574659+0000","last_change":"2024-09-19T14:14:23.574659+0000","last_active":"2024-09-19T14:14:23.574659+0000","last_peered":"2024-09-19T14:14:23.574659+0000","last_clean":"2024-09-19T14:14:23.574659+0000","last_became_active":"2024-09-19T13:36:07.800218+0000","last_became_peered":"2024-09-19T13:36:07.800218+0000","last_unstale":"2024-09-19T14:14:23.574659+0000","last_undegraded":"2024-09-19T14:14:23.574659+0000","last_fullsized":"2024-09-19T14:14:23.574659+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'228","last_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_deep_scrub":"260'228","last_deep_scrub_stamp":"2024-09-19T14:14:23.574564+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.574564+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:46.444524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":5696,"num_write":1072,"num_write_kb":28094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.179926+0000","last_change":"2024-09-19T14:14:43.179926+0000","last_active":"2024-09-19T14:14:43.179926+0000","last_peered":"2024-09-19T14:14:43.179926+0000","last_clean":"2024-09-19T14:14:43.179926+0000","last_became_active":"2024-09-19T13:36:11.336323+0000","last_became_peered":"2024-09-19T13:36:11.336323+0000","last_unstale":"2024-09-19T14:14:43.179926+0000","last_undegraded":"2024-09-19T14:14:43.179926+0000","last_fullsized":"2024-09-19T14:14:43.179926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.179836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.179836+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.179836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:12.637353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'113","reported_seq":648,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.244263+0000","last_change":"2024-09-19T14:14:47.244204+0000","last_active":"2024-09-19T14:14:47.244263+0000","last_peered":"2024-09-19T14:14:47.244263+0000","last_clean":"2024-09-19T14:14:47.244263+0000","last_became_active":"2024-09-19T13:36:13.341348+0000","last_became_peered":"2024-09-19T13:36:13.341348+0000","last_unstale":"2024-09-19T14:14:47.244263+0000","last_undegraded":"2024-09-19T14:14:47.244263+0000","last_fullsized":"2024-09-19T14:14:47.244263+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'113","last_scrub_stamp":"2024-09-19T14:14:47.244112+0000","last_deep_scrub":"260'113","last_deep_scrub_stamp":"2024-09-19T14:14:47.244112+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.244112+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:45.237429+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":88,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.225037+0000","last_change":"2024-09-19T14:14:41.224975+0000","last_active":"2024-09-19T14:14:41.225037+0000","last_peered":"2024-09-19T14:14:41.225037+0000","last_clean":"2024-09-19T14:14:41.225037+0000","last_became_active":"2024-09-19T13:36:15.348002+0000","last_became_peered":"2024-09-19T13:36:15.348002+0000","last_unstale":"2024-09-19T14:14:41.225037+0000","last_undegraded":"2024-09-19T14:14:41.225037+0000","last_fullsized":"2024-09-19T14:14:41.225037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.224899+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.224899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:53.063511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'107","reported_seq":650,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.579290+0000","last_change":"2024-09-19T14:14:56.579227+0000","last_active":"2024-09-19T14:14:56.579290+0000","last_peered":"2024-09-19T14:14:56.579290+0000","last_clean":"2024-09-19T14:14:56.579290+0000","last_became_active":"2024-09-19T13:36:17.362391+0000","last_became_peered":"2024-09-19T13:36:17.362391+0000","last_unstale":"2024-09-19T14:14:56.579290+0000","last_undegraded":"2024-09-19T14:14:56.579290+0000","last_fullsized":"2024-09-19T14:14:56.579290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'107","last_scrub_stamp":"2024-09-19T14:14:56.579142+0000","last_deep_scrub":"260'107","last_deep_scrub_stamp":"2024-09-19T14:14:56.579142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.579142+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:09.076208+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":239,"num_read_kb":235,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"260'601","reported_seq":2326,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.333499+0000","last_change":"2024-09-19T14:14:31.333499+0000","last_active":"2024-09-19T14:14:31.333499+0000","last_peered":"2024-09-19T14:14:31.333499+0000","last_clean":"2024-09-19T14:14:31.333499+0000","last_became_active":"2024-09-19T13:36:09.338384+0000","last_became_peered":"2024-09-19T13:36:09.338384+0000","last_unstale":"2024-09-19T14:14:31.333499+0000","last_undegraded":"2024-09-19T14:14:31.333499+0000","last_fullsized":"2024-09-19T14:14:31.333499+0000","mapping_epoch":24,"log_start":"260'500","ondisk_log_start":"260'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'601","last_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_deep_scrub":"260'601","last_deep_scrub_stamp":"2024-09-19T14:14:31.333408+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.333408+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:33.805427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3282,"num_read_kb":3030,"num_write":806,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'206","reported_seq":853,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.807429+0000","last_change":"2024-09-19T14:14:25.807429+0000","last_active":"2024-09-19T14:14:25.807429+0000","last_peered":"2024-09-19T14:14:25.807429+0000","last_clean":"2024-09-19T14:14:25.807429+0000","last_became_active":"2024-09-19T13:36:07.809095+0000","last_became_peered":"2024-09-19T13:36:07.809095+0000","last_unstale":"2024-09-19T14:14:25.807429+0000","last_undegraded":"2024-09-19T14:14:25.807429+0000","last_fullsized":"2024-09-19T14:14:25.807429+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:25.807326+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.807326+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:54.324076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":574,"num_read_kb":24801,"num_write":998,"num_write_kb":29754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.271963+0000","last_change":"2024-09-19T14:14:22.271878+0000","last_active":"2024-09-19T14:14:22.271963+0000","last_peered":"2024-09-19T14:14:22.271963+0000","last_clean":"2024-09-19T14:14:22.271963+0000","last_became_active":"2024-09-19T13:35:58.767850+0000","last_became_peered":"2024-09-19T13:35:58.767850+0000","last_unstale":"2024-09-19T14:14:22.271963+0000","last_undegraded":"2024-09-19T14:14:22.271963+0000","last_fullsized":"2024-09-19T14:14:22.271963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:22.271798+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.271798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:15.460044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053996399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.211839+0000","last_change":"2024-09-19T14:14:41.211839+0000","last_active":"2024-09-19T14:14:41.211839+0000","last_peered":"2024-09-19T14:14:41.211839+0000","last_clean":"2024-09-19T14:14:41.211839+0000","last_became_active":"2024-09-19T13:36:11.333031+0000","last_became_peered":"2024-09-19T13:36:11.333031+0000","last_unstale":"2024-09-19T14:14:41.211839+0000","last_undegraded":"2024-09-19T14:14:41.211839+0000","last_fullsized":"2024-09-19T14:14:41.211839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.211717+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.211717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:50.720540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'272","reported_seq":926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.229777+0000","last_change":"2024-09-19T14:14:44.229777+0000","last_active":"2024-09-19T14:14:44.229777+0000","last_peered":"2024-09-19T14:14:44.229777+0000","last_clean":"2024-09-19T14:14:44.229777+0000","last_became_active":"2024-09-19T13:36:13.343790+0000","last_became_peered":"2024-09-19T13:36:13.343790+0000","last_unstale":"2024-09-19T14:14:44.229777+0000","last_undegraded":"2024-09-19T14:14:44.229777+0000","last_fullsized":"2024-09-19T14:14:44.229777+0000","mapping_epoch":28,"log_start":"260'200","ondisk_log_start":"260'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'272","last_scrub_stamp":"2024-09-19T14:14:44.229683+0000","last_deep_scrub":"260'272","last_deep_scrub_stamp":"2024-09-19T14:14:44.229683+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.229683+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:29.728099+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12301,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":381,"num_read_kb":528,"num_write":240,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.787040+0000","last_change":"2024-09-19T14:14:53.787040+0000","last_active":"2024-09-19T14:14:53.787040+0000","last_peered":"2024-09-19T14:14:53.787040+0000","last_clean":"2024-09-19T14:14:53.787040+0000","last_became_active":"2024-09-19T13:36:15.346916+0000","last_became_peered":"2024-09-19T13:36:15.346916+0000","last_unstale":"2024-09-19T14:14:53.787040+0000","last_undegraded":"2024-09-19T14:14:53.787040+0000","last_fullsized":"2024-09-19T14:14:53.787040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.786945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.786945+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.786945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:21.722947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'130","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.233247+0000","last_change":"2024-09-19T14:15:00.233247+0000","last_active":"2024-09-19T14:15:00.233247+0000","last_peered":"2024-09-19T14:15:00.233247+0000","last_clean":"2024-09-19T14:15:00.233247+0000","last_became_active":"2024-09-19T13:36:17.358397+0000","last_became_peered":"2024-09-19T13:36:17.358397+0000","last_unstale":"2024-09-19T14:15:00.233247+0000","last_undegraded":"2024-09-19T14:15:00.233247+0000","last_fullsized":"2024-09-19T14:15:00.233247+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-09-19T14:15:00.233162+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-09-19T14:15:00.233162+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.233162+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:07.109767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":282,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'1173","reported_seq":2702,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.253870+0000","last_change":"2024-09-19T14:14:31.253870+0000","last_active":"2024-09-19T14:14:31.253870+0000","last_peered":"2024-09-19T14:14:31.253870+0000","last_clean":"2024-09-19T14:14:31.253870+0000","last_became_active":"2024-09-19T13:36:09.338416+0000","last_became_peered":"2024-09-19T13:36:09.338416+0000","last_unstale":"2024-09-19T14:14:31.253870+0000","last_undegraded":"2024-09-19T14:14:31.253870+0000","last_fullsized":"2024-09-19T14:14:31.253870+0000","mapping_epoch":24,"log_start":"260'1100","ondisk_log_start":"260'1100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1173","last_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_deep_scrub":"260'1173","last_deep_scrub_stamp":"2024-09-19T14:14:31.253789+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.253789+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":1100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:19.605470+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5306,"num_read_kb":4668,"num_write":1611,"num_write_kb":664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'241","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.269778+0000","last_change":"2024-09-19T14:14:25.269778+0000","last_active":"2024-09-19T14:14:25.269778+0000","last_peered":"2024-09-19T14:14:25.269778+0000","last_clean":"2024-09-19T14:14:25.269778+0000","last_became_active":"2024-09-19T13:36:07.803934+0000","last_became_peered":"2024-09-19T13:36:07.803934+0000","last_unstale":"2024-09-19T14:14:25.269778+0000","last_undegraded":"2024-09-19T14:14:25.269778+0000","last_fullsized":"2024-09-19T14:14:25.269778+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:25.269708+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.269708+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:59.804876+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":611,"num_read_kb":113129,"num_write":1047,"num_write_kb":44674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.132997+0000","last_change":"2024-09-19T14:14:30.132997+0000","last_active":"2024-09-19T14:14:30.132997+0000","last_peered":"2024-09-19T14:14:30.132997+0000","last_clean":"2024-09-19T14:14:30.132997+0000","last_became_active":"2024-09-19T13:35:58.767904+0000","last_became_peered":"2024-09-19T13:35:58.767904+0000","last_unstale":"2024-09-19T14:14:30.132997+0000","last_undegraded":"2024-09-19T14:14:30.132997+0000","last_fullsized":"2024-09-19T14:14:30.132997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:30.132909+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.132909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:09:35.776106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039548600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.210314+0000","last_change":"2024-09-19T14:14:38.210314+0000","last_active":"2024-09-19T14:14:38.210314+0000","last_peered":"2024-09-19T14:14:38.210314+0000","last_clean":"2024-09-19T14:14:38.210314+0000","last_became_active":"2024-09-19T13:36:11.336495+0000","last_became_peered":"2024-09-19T13:36:11.336495+0000","last_unstale":"2024-09-19T14:14:38.210314+0000","last_undegraded":"2024-09-19T14:14:38.210314+0000","last_fullsized":"2024-09-19T14:14:38.210314+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:38.210233+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.210233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:40.582675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'153","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.431223+0000","last_change":"2024-09-19T14:14:42.431223+0000","last_active":"2024-09-19T14:14:42.431223+0000","last_peered":"2024-09-19T14:14:42.431223+0000","last_clean":"2024-09-19T14:14:42.431223+0000","last_became_active":"2024-09-19T13:36:13.678123+0000","last_became_peered":"2024-09-19T13:36:13.678123+0000","last_unstale":"2024-09-19T14:14:42.431223+0000","last_undegraded":"2024-09-19T14:14:42.431223+0000","last_fullsized":"2024-09-19T14:14:42.431223+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-09-19T14:14:42.431130+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-09-19T14:14:42.431130+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.431130+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:19.187356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":179,"num_read_kb":170,"num_write":122,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'789","reported_seq":2507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.655888+0000","last_change":"2024-09-19T14:14:53.655888+0000","last_active":"2024-09-19T14:14:53.655888+0000","last_peered":"2024-09-19T14:14:53.655888+0000","last_clean":"2024-09-19T14:14:53.655888+0000","last_became_active":"2024-09-19T13:36:15.348546+0000","last_became_peered":"2024-09-19T13:36:15.348546+0000","last_unstale":"2024-09-19T14:14:53.655888+0000","last_undegraded":"2024-09-19T14:14:53.655888+0000","last_fullsized":"2024-09-19T14:14:53.655888+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-19T14:14:53.655783+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-19T14:14:53.655783+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.655783+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:57.878586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'141","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.000825+0000","last_change":"2024-09-19T14:15:01.000825+0000","last_active":"2024-09-19T14:15:01.000825+0000","last_peered":"2024-09-19T14:15:01.000825+0000","last_clean":"2024-09-19T14:15:01.000825+0000","last_became_active":"2024-09-19T13:36:17.363005+0000","last_became_peered":"2024-09-19T13:36:17.363005+0000","last_unstale":"2024-09-19T14:15:01.000825+0000","last_undegraded":"2024-09-19T14:15:01.000825+0000","last_fullsized":"2024-09-19T14:15:01.000825+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-09-19T14:15:01.000739+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-09-19T14:15:01.000739+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.000739+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:43.347659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":271,"num_read_kb":245,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"260'349","reported_seq":1773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.313938+0000","last_change":"2024-09-19T14:14:34.313938+0000","last_active":"2024-09-19T14:14:34.313938+0000","last_peered":"2024-09-19T14:14:34.313938+0000","last_clean":"2024-09-19T14:14:34.313938+0000","last_became_active":"2024-09-19T13:36:09.334468+0000","last_became_peered":"2024-09-19T13:36:09.334468+0000","last_unstale":"2024-09-19T14:14:34.313938+0000","last_undegraded":"2024-09-19T14:14:34.313938+0000","last_fullsized":"2024-09-19T14:14:34.313938+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'349","last_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_deep_scrub":"260'349","last_deep_scrub_stamp":"2024-09-19T14:14:34.313853+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.313853+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:03.281146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1863,"num_read_kb":1792,"num_write":387,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'210","reported_seq":836,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.389595+0000","last_change":"2024-09-19T14:14:25.389550+0000","last_active":"2024-09-19T14:14:25.389595+0000","last_peered":"2024-09-19T14:14:25.389595+0000","last_clean":"2024-09-19T14:14:25.389595+0000","last_became_active":"2024-09-19T13:36:07.808774+0000","last_became_peered":"2024-09-19T13:36:07.808774+0000","last_unstale":"2024-09-19T14:14:25.389595+0000","last_undegraded":"2024-09-19T14:14:25.389595+0000","last_fullsized":"2024-09-19T14:14:25.389595+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:25.389494+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.389494+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:57.196831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":8334,"num_write":1024,"num_write_kb":35913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.254812+0000","last_change":"2024-09-19T14:14:23.254724+0000","last_active":"2024-09-19T14:14:23.254812+0000","last_peered":"2024-09-19T14:14:23.254812+0000","last_clean":"2024-09-19T14:14:23.254812+0000","last_became_active":"2024-09-19T13:35:58.757618+0000","last_became_peered":"2024-09-19T13:35:58.757618+0000","last_unstale":"2024-09-19T14:14:23.254812+0000","last_undegraded":"2024-09-19T14:14:23.254812+0000","last_fullsized":"2024-09-19T14:14:23.254812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:23.254647+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.254647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:57.792058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00059875300000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.814330+0000","last_change":"2024-09-19T14:14:44.814330+0000","last_active":"2024-09-19T14:14:44.814330+0000","last_peered":"2024-09-19T14:14:44.814330+0000","last_clean":"2024-09-19T14:14:44.814330+0000","last_became_active":"2024-09-19T13:36:11.329560+0000","last_became_peered":"2024-09-19T13:36:11.329560+0000","last_unstale":"2024-09-19T14:14:44.814330+0000","last_undegraded":"2024-09-19T14:14:44.814330+0000","last_fullsized":"2024-09-19T14:14:44.814330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.814245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.814245+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.814245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:05.603181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":624,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.799856+0000","last_change":"2024-09-19T14:14:47.799856+0000","last_active":"2024-09-19T14:14:47.799856+0000","last_peered":"2024-09-19T14:14:47.799856+0000","last_clean":"2024-09-19T14:14:47.799856+0000","last_became_active":"2024-09-19T13:36:13.343422+0000","last_became_peered":"2024-09-19T13:36:13.343422+0000","last_unstale":"2024-09-19T14:14:47.799856+0000","last_undegraded":"2024-09-19T14:14:47.799856+0000","last_fullsized":"2024-09-19T14:14:47.799856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'92","last_scrub_stamp":"2024-09-19T14:14:47.799733+0000","last_deep_scrub":"260'92","last_deep_scrub_stamp":"2024-09-19T14:14:47.799733+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.799733+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:15.665895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":99,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'798","reported_seq":2387,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.067387+0000","last_change":"2024-09-19T14:14:55.067387+0000","last_active":"2024-09-19T14:14:55.067387+0000","last_peered":"2024-09-19T14:14:55.067387+0000","last_clean":"2024-09-19T14:14:55.067387+0000","last_became_active":"2024-09-19T13:36:15.349911+0000","last_became_peered":"2024-09-19T13:36:15.349911+0000","last_unstale":"2024-09-19T14:14:55.067387+0000","last_undegraded":"2024-09-19T14:14:55.067387+0000","last_fullsized":"2024-09-19T14:14:55.067387+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:55.067292+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:55.067292+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.067292+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:51.523534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'295","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.199741+0000","last_change":"2024-09-19T14:14:57.199741+0000","last_active":"2024-09-19T14:14:57.199741+0000","last_peered":"2024-09-19T14:14:57.199741+0000","last_clean":"2024-09-19T14:14:57.199741+0000","last_became_active":"2024-09-19T13:36:17.361982+0000","last_became_peered":"2024-09-19T13:36:17.361982+0000","last_unstale":"2024-09-19T14:14:57.199741+0000","last_undegraded":"2024-09-19T14:14:57.199741+0000","last_fullsized":"2024-09-19T14:14:57.199741+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'295","last_scrub_stamp":"2024-09-19T14:14:57.199654+0000","last_deep_scrub":"260'295","last_deep_scrub_stamp":"2024-09-19T14:14:57.199654+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.199654+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:54:15.911982+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":401,"num_read_kb":396,"num_write":638,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"260'725","reported_seq":2605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.675073+0000","last_change":"2024-09-19T14:14:28.675073+0000","last_active":"2024-09-19T14:14:28.675073+0000","last_peered":"2024-09-19T14:14:28.675073+0000","last_clean":"2024-09-19T14:14:28.675073+0000","last_became_active":"2024-09-19T13:36:09.334375+0000","last_became_peered":"2024-09-19T13:36:09.334375+0000","last_unstale":"2024-09-19T14:14:28.675073+0000","last_undegraded":"2024-09-19T14:14:28.675073+0000","last_fullsized":"2024-09-19T14:14:28.675073+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'725","last_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_deep_scrub":"260'725","last_deep_scrub_stamp":"2024-09-19T14:14:28.674989+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.674989+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.706637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3988,"num_read_kb":3644,"num_write":1006,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3080,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'226","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:22.315006+0000","last_change":"2024-09-19T14:14:22.314956+0000","last_active":"2024-09-19T14:14:22.315006+0000","last_peered":"2024-09-19T14:14:22.315006+0000","last_clean":"2024-09-19T14:14:22.315006+0000","last_became_active":"2024-09-19T13:36:07.810784+0000","last_became_peered":"2024-09-19T13:36:07.810784+0000","last_unstale":"2024-09-19T14:14:22.315006+0000","last_undegraded":"2024-09-19T14:14:22.315006+0000","last_fullsized":"2024-09-19T14:14:22.315006+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-09-19T14:14:22.314854+0000","last_clean_scrub_stamp":"2024-09-19T14:14:22.314854+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:16.077018+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":41557,"num_write":1060,"num_write_kb":45854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.131236+0000","last_change":"2024-09-19T14:14:25.131186+0000","last_active":"2024-09-19T14:14:25.131236+0000","last_peered":"2024-09-19T14:14:25.131236+0000","last_clean":"2024-09-19T14:14:25.131236+0000","last_became_active":"2024-09-19T13:35:58.757332+0000","last_became_peered":"2024-09-19T13:35:58.757332+0000","last_unstale":"2024-09-19T14:14:25.131236+0000","last_undegraded":"2024-09-19T14:14:25.131236+0000","last_fullsized":"2024-09-19T14:14:25.131236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:25.131106+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.131106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:59.433032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046214200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:43.280601+0000","last_change":"2024-09-19T14:14:43.280601+0000","last_active":"2024-09-19T14:14:43.280601+0000","last_peered":"2024-09-19T14:14:43.280601+0000","last_clean":"2024-09-19T14:14:43.280601+0000","last_became_active":"2024-09-19T13:36:11.334328+0000","last_became_peered":"2024-09-19T13:36:11.334328+0000","last_unstale":"2024-09-19T14:14:43.280601+0000","last_undegraded":"2024-09-19T14:14:43.280601+0000","last_fullsized":"2024-09-19T14:14:43.280601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:43.280506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:43.280506+0000","last_clean_scrub_stamp":"2024-09-19T14:14:43.280506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:33.983298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'309","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.193778+0000","last_change":"2024-09-19T14:14:47.193778+0000","last_active":"2024-09-19T14:14:47.193778+0000","last_peered":"2024-09-19T14:14:47.193778+0000","last_clean":"2024-09-19T14:14:47.193778+0000","last_became_active":"2024-09-19T13:36:13.678105+0000","last_became_peered":"2024-09-19T13:36:13.678105+0000","last_unstale":"2024-09-19T14:14:47.193778+0000","last_undegraded":"2024-09-19T14:14:47.193778+0000","last_fullsized":"2024-09-19T14:14:47.193778+0000","mapping_epoch":28,"log_start":"257'200","ondisk_log_start":"257'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'309","last_scrub_stamp":"2024-09-19T14:14:47.193662+0000","last_deep_scrub":"260'309","last_deep_scrub_stamp":"2024-09-19T14:14:47.193662+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.193662+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:33.116186+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16920,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":432,"num_read_kb":558,"num_write":210,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.075533+0000","last_change":"2024-09-19T14:14:54.075533+0000","last_active":"2024-09-19T14:14:54.075533+0000","last_peered":"2024-09-19T14:14:54.075533+0000","last_clean":"2024-09-19T14:14:54.075533+0000","last_became_active":"2024-09-19T13:36:15.348170+0000","last_became_peered":"2024-09-19T13:36:15.348170+0000","last_unstale":"2024-09-19T14:14:54.075533+0000","last_undegraded":"2024-09-19T14:14:54.075533+0000","last_fullsized":"2024-09-19T14:14:54.075533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.075442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.075442+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.075442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:42.751459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'163","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.603741+0000","last_change":"2024-09-19T14:14:57.603741+0000","last_active":"2024-09-19T14:14:57.603741+0000","last_peered":"2024-09-19T14:14:57.603741+0000","last_clean":"2024-09-19T14:14:57.603741+0000","last_became_active":"2024-09-19T13:36:17.358596+0000","last_became_peered":"2024-09-19T13:36:17.358596+0000","last_unstale":"2024-09-19T14:14:57.603741+0000","last_undegraded":"2024-09-19T14:14:57.603741+0000","last_fullsized":"2024-09-19T14:14:57.603741+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-09-19T14:14:57.603637+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-09-19T14:14:57.603637+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.603637+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:31.917350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":227,"num_write":394,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"260'146","reported_seq":717,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.192822+0000","last_change":"2024-09-19T14:15:01.192822+0000","last_active":"2024-09-19T14:15:01.192822+0000","last_peered":"2024-09-19T14:15:01.192822+0000","last_clean":"2024-09-19T14:15:01.192822+0000","last_became_active":"2024-09-19T13:36:17.360978+0000","last_became_peered":"2024-09-19T13:36:17.360978+0000","last_unstale":"2024-09-19T14:15:01.192822+0000","last_undegraded":"2024-09-19T14:15:01.192822+0000","last_fullsized":"2024-09-19T14:15:01.192822+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-09-19T14:15:01.192741+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-09-19T14:15:01.192741+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.192741+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:32.255912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":326,"num_read_kb":305,"num_write":337,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'780","reported_seq":2484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.645115+0000","last_change":"2024-09-19T14:14:33.645115+0000","last_active":"2024-09-19T14:14:33.645115+0000","last_peered":"2024-09-19T14:14:33.645115+0000","last_clean":"2024-09-19T14:14:33.645115+0000","last_became_active":"2024-09-19T13:36:09.330222+0000","last_became_peered":"2024-09-19T13:36:09.330222+0000","last_unstale":"2024-09-19T14:14:33.645115+0000","last_undegraded":"2024-09-19T14:14:33.645115+0000","last_fullsized":"2024-09-19T14:14:33.645115+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'780","last_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_deep_scrub":"260'780","last_deep_scrub_stamp":"2024-09-19T14:14:33.645030+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.645030+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:38.455079+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3985,"num_read_kb":3627,"num_write":1014,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'201","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.669948+0000","last_change":"2024-09-19T14:14:26.669948+0000","last_active":"2024-09-19T14:14:26.669948+0000","last_peered":"2024-09-19T14:14:26.669948+0000","last_clean":"2024-09-19T14:14:26.669948+0000","last_became_active":"2024-09-19T13:36:07.807188+0000","last_became_peered":"2024-09-19T13:36:07.807188+0000","last_unstale":"2024-09-19T14:14:26.669948+0000","last_undegraded":"2024-09-19T14:14:26.669948+0000","last_fullsized":"2024-09-19T14:14:26.669948+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:26.669848+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.669848+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.636524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":235834,"num_write":982,"num_write_kb":39682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.369204+0000","last_change":"2024-09-19T14:14:39.369204+0000","last_active":"2024-09-19T14:14:39.369204+0000","last_peered":"2024-09-19T14:14:39.369204+0000","last_clean":"2024-09-19T14:14:39.369204+0000","last_became_active":"2024-09-19T13:36:11.335704+0000","last_became_peered":"2024-09-19T13:36:11.335704+0000","last_unstale":"2024-09-19T14:14:39.369204+0000","last_undegraded":"2024-09-19T14:14:39.369204+0000","last_fullsized":"2024-09-19T14:14:39.369204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:39.369113+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.369113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:47.710446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'145","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:50.226227+0000","last_change":"2024-09-19T14:14:50.226227+0000","last_active":"2024-09-19T14:14:50.226227+0000","last_peered":"2024-09-19T14:14:50.226227+0000","last_clean":"2024-09-19T14:14:50.226227+0000","last_became_active":"2024-09-19T13:36:13.342076+0000","last_became_peered":"2024-09-19T13:36:13.342076+0000","last_unstale":"2024-09-19T14:14:50.226227+0000","last_undegraded":"2024-09-19T14:14:50.226227+0000","last_fullsized":"2024-09-19T14:14:50.226227+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-09-19T14:14:50.226133+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-09-19T14:14:50.226133+0000","last_clean_scrub_stamp":"2024-09-19T14:14:50.226133+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:40.245409+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":264,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.018323+0000","last_change":"2024-09-19T14:14:57.018323+0000","last_active":"2024-09-19T14:14:57.018323+0000","last_peered":"2024-09-19T14:14:57.018323+0000","last_clean":"2024-09-19T14:14:57.018323+0000","last_became_active":"2024-09-19T13:36:15.346897+0000","last_became_peered":"2024-09-19T13:36:15.346897+0000","last_unstale":"2024-09-19T14:14:57.018323+0000","last_undegraded":"2024-09-19T14:14:57.018323+0000","last_fullsized":"2024-09-19T14:14:57.018323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:57.018222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:57.018222+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.018222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:27.098198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'127","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:03.921729+0000","last_change":"2024-09-19T14:15:03.921729+0000","last_active":"2024-09-19T14:15:03.921729+0000","last_peered":"2024-09-19T14:15:03.921729+0000","last_clean":"2024-09-19T14:15:03.921729+0000","last_became_active":"2024-09-19T13:36:17.361617+0000","last_became_peered":"2024-09-19T13:36:17.361617+0000","last_unstale":"2024-09-19T14:15:03.921729+0000","last_undegraded":"2024-09-19T14:15:03.921729+0000","last_fullsized":"2024-09-19T14:15:03.921729+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-19T14:15:03.921646+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-19T14:15:03.921646+0000","last_clean_scrub_stamp":"2024-09-19T14:15:03.921646+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:32.648247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":151,"num_read_kb":146,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'451","reported_seq":2142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.385125+0000","last_change":"2024-09-19T14:14:33.385125+0000","last_active":"2024-09-19T14:14:33.385125+0000","last_peered":"2024-09-19T14:14:33.385125+0000","last_clean":"2024-09-19T14:14:33.385125+0000","last_became_active":"2024-09-19T13:36:09.341105+0000","last_became_peered":"2024-09-19T13:36:09.341105+0000","last_unstale":"2024-09-19T14:14:33.385125+0000","last_undegraded":"2024-09-19T14:14:33.385125+0000","last_fullsized":"2024-09-19T14:14:33.385125+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:33.385044+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.385044+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:40.641199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2648,"num_read_kb":2520,"num_write":522,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'206","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.184308+0000","last_change":"2024-09-19T14:14:29.184238+0000","last_active":"2024-09-19T14:14:29.184308+0000","last_peered":"2024-09-19T14:14:29.184308+0000","last_clean":"2024-09-19T14:14:29.184308+0000","last_became_active":"2024-09-19T13:36:44.399959+0000","last_became_peered":"2024-09-19T13:36:44.399959+0000","last_unstale":"2024-09-19T14:14:29.184308+0000","last_undegraded":"2024-09-19T14:14:29.184308+0000","last_fullsized":"2024-09-19T14:14:29.184308+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-09-19T14:14:29.184140+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.184140+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:52.173970+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":26124,"num_write":1061,"num_write_kb":21506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.262863+0000","last_change":"2024-09-19T14:14:45.262863+0000","last_active":"2024-09-19T14:14:45.262863+0000","last_peered":"2024-09-19T14:14:45.262863+0000","last_clean":"2024-09-19T14:14:45.262863+0000","last_became_active":"2024-09-19T13:36:11.337117+0000","last_became_peered":"2024-09-19T13:36:11.337117+0000","last_unstale":"2024-09-19T14:14:45.262863+0000","last_undegraded":"2024-09-19T14:14:45.262863+0000","last_fullsized":"2024-09-19T14:14:45.262863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.262794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.262794+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.262794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:11.511930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'51","reported_seq":549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.167410+0000","last_change":"2024-09-19T14:14:46.167410+0000","last_active":"2024-09-19T14:14:46.167410+0000","last_peered":"2024-09-19T14:14:46.167410+0000","last_clean":"2024-09-19T14:14:46.167410+0000","last_became_active":"2024-09-19T13:36:13.343121+0000","last_became_peered":"2024-09-19T13:36:13.343121+0000","last_unstale":"2024-09-19T14:14:46.167410+0000","last_undegraded":"2024-09-19T14:14:46.167410+0000","last_fullsized":"2024-09-19T14:14:46.167410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'51","last_scrub_stamp":"2024-09-19T14:14:46.167332+0000","last_deep_scrub":"260'51","last_deep_scrub_stamp":"2024-09-19T14:14:46.167332+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.167332+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:27.825629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.229878+0000","last_change":"2024-09-19T14:14:53.229878+0000","last_active":"2024-09-19T14:14:53.229878+0000","last_peered":"2024-09-19T14:14:53.229878+0000","last_clean":"2024-09-19T14:14:53.229878+0000","last_became_active":"2024-09-19T13:36:15.352755+0000","last_became_peered":"2024-09-19T13:36:15.352755+0000","last_unstale":"2024-09-19T14:14:53.229878+0000","last_undegraded":"2024-09-19T14:14:53.229878+0000","last_fullsized":"2024-09-19T14:14:53.229878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.229785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.229785+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.229785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:19.760091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'217","reported_seq":731,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:59.200730+0000","last_change":"2024-09-19T14:14:59.200730+0000","last_active":"2024-09-19T14:14:59.200730+0000","last_peered":"2024-09-19T14:14:59.200730+0000","last_clean":"2024-09-19T14:14:59.200730+0000","last_became_active":"2024-09-19T13:36:17.356206+0000","last_became_peered":"2024-09-19T13:36:17.356206+0000","last_unstale":"2024-09-19T14:14:59.200730+0000","last_undegraded":"2024-09-19T14:14:59.200730+0000","last_fullsized":"2024-09-19T14:14:59.200730+0000","mapping_epoch":32,"log_start":"260'200","ondisk_log_start":"260'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'217","last_scrub_stamp":"2024-09-19T14:14:59.200634+0000","last_deep_scrub":"260'217","last_deep_scrub_stamp":"2024-09-19T14:14:59.200634+0000","last_clean_scrub_stamp":"2024-09-19T14:14:59.200634+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:57.519787+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":341,"num_read_kb":339,"num_write":493,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'398","reported_seq":1849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.336463+0000","last_change":"2024-09-19T14:14:35.336463+0000","last_active":"2024-09-19T14:14:35.336463+0000","last_peered":"2024-09-19T14:14:35.336463+0000","last_clean":"2024-09-19T14:14:35.336463+0000","last_became_active":"2024-09-19T13:36:09.334544+0000","last_became_peered":"2024-09-19T13:36:09.334544+0000","last_unstale":"2024-09-19T14:14:35.336463+0000","last_undegraded":"2024-09-19T14:14:35.336463+0000","last_fullsized":"2024-09-19T14:14:35.336463+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'398","last_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_deep_scrub":"260'398","last_deep_scrub_stamp":"2024-09-19T14:14:35.336359+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.336359+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:33.204997+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2152,"num_read_kb":2028,"num_write":468,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'215","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.823196+0000","last_change":"2024-09-19T14:14:27.823104+0000","last_active":"2024-09-19T14:14:27.823196+0000","last_peered":"2024-09-19T14:14:27.823196+0000","last_clean":"2024-09-19T14:14:27.823196+0000","last_became_active":"2024-09-19T13:36:07.810303+0000","last_became_peered":"2024-09-19T13:36:07.810303+0000","last_unstale":"2024-09-19T14:14:27.823196+0000","last_undegraded":"2024-09-19T14:14:27.823196+0000","last_fullsized":"2024-09-19T14:14:27.823196+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.822984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.822984+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:08.778750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":16519,"num_write":1037,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.215103+0000","last_change":"2024-09-19T14:14:44.215103+0000","last_active":"2024-09-19T14:14:44.215103+0000","last_peered":"2024-09-19T14:14:44.215103+0000","last_clean":"2024-09-19T14:14:44.215103+0000","last_became_active":"2024-09-19T13:36:11.335753+0000","last_became_peered":"2024-09-19T13:36:11.335753+0000","last_unstale":"2024-09-19T14:14:44.215103+0000","last_undegraded":"2024-09-19T14:14:44.215103+0000","last_fullsized":"2024-09-19T14:14:44.215103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.215012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.215012+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.215012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:26.236101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'149","reported_seq":734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.188758+0000","last_change":"2024-09-19T14:14:51.188758+0000","last_active":"2024-09-19T14:14:51.188758+0000","last_peered":"2024-09-19T14:14:51.188758+0000","last_clean":"2024-09-19T14:14:51.188758+0000","last_became_active":"2024-09-19T13:36:13.342227+0000","last_became_peered":"2024-09-19T13:36:13.342227+0000","last_unstale":"2024-09-19T14:14:51.188758+0000","last_undegraded":"2024-09-19T14:14:51.188758+0000","last_fullsized":"2024-09-19T14:14:51.188758+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-09-19T14:14:51.188664+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-09-19T14:14:51.188664+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.188664+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:49.379920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":198,"num_write":100,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.230017+0000","last_change":"2024-09-19T14:14:44.230017+0000","last_active":"2024-09-19T14:14:44.230017+0000","last_peered":"2024-09-19T14:14:44.230017+0000","last_clean":"2024-09-19T14:14:44.230017+0000","last_became_active":"2024-09-19T13:36:15.348983+0000","last_became_peered":"2024-09-19T13:36:15.348983+0000","last_unstale":"2024-09-19T14:14:44.230017+0000","last_undegraded":"2024-09-19T14:14:44.230017+0000","last_fullsized":"2024-09-19T14:14:44.230017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:44.229930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:44.229930+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.229930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:01:59.977901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'182","reported_seq":747,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.639043+0000","last_change":"2024-09-19T14:15:00.639043+0000","last_active":"2024-09-19T14:15:00.639043+0000","last_peered":"2024-09-19T14:15:00.639043+0000","last_clean":"2024-09-19T14:15:00.639043+0000","last_became_active":"2024-09-19T13:36:17.358491+0000","last_became_peered":"2024-09-19T13:36:17.358491+0000","last_unstale":"2024-09-19T14:15:00.639043+0000","last_undegraded":"2024-09-19T14:15:00.639043+0000","last_fullsized":"2024-09-19T14:15:00.639043+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'182","last_scrub_stamp":"2024-09-19T14:15:00.638945+0000","last_deep_scrub":"260'182","last_deep_scrub_stamp":"2024-09-19T14:15:00.638945+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.638945+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.573733+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":492,"num_read_kb":430,"num_write":451,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'410","reported_seq":1901,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.343318+0000","last_change":"2024-09-19T14:14:33.343318+0000","last_active":"2024-09-19T14:14:33.343318+0000","last_peered":"2024-09-19T14:14:33.343318+0000","last_clean":"2024-09-19T14:14:33.343318+0000","last_became_active":"2024-09-19T13:36:09.347469+0000","last_became_peered":"2024-09-19T13:36:09.347469+0000","last_unstale":"2024-09-19T14:14:33.343318+0000","last_undegraded":"2024-09-19T14:14:33.343318+0000","last_fullsized":"2024-09-19T14:14:33.343318+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'410","last_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_deep_scrub":"260'410","last_deep_scrub_stamp":"2024-09-19T14:14:33.343234+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.343234+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:26.919333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2395,"num_read_kb":2250,"num_write":505,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3249,"num_omap_keys":13,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'225","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.302152+0000","last_change":"2024-09-19T14:14:25.302102+0000","last_active":"2024-09-19T14:14:25.302152+0000","last_peered":"2024-09-19T14:14:25.302152+0000","last_clean":"2024-09-19T14:14:25.302152+0000","last_became_active":"2024-09-19T13:36:07.809960+0000","last_became_peered":"2024-09-19T13:36:07.809960+0000","last_unstale":"2024-09-19T14:14:25.302152+0000","last_undegraded":"2024-09-19T14:14:25.302152+0000","last_fullsized":"2024-09-19T14:14:25.302152+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'225","last_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_deep_scrub":"260'225","last_deep_scrub_stamp":"2024-09-19T14:14:25.302035+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.302035+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:39.521325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":697,"num_read_kb":42518,"num_write":1086,"num_write_kb":17539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.200192+0000","last_change":"2024-09-19T14:14:40.200192+0000","last_active":"2024-09-19T14:14:40.200192+0000","last_peered":"2024-09-19T14:14:40.200192+0000","last_clean":"2024-09-19T14:14:40.200192+0000","last_became_active":"2024-09-19T13:36:11.338212+0000","last_became_peered":"2024-09-19T13:36:11.338212+0000","last_unstale":"2024-09-19T14:14:40.200192+0000","last_undegraded":"2024-09-19T14:14:40.200192+0000","last_fullsized":"2024-09-19T14:14:40.200192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:40.200107+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.200107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:09.154313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'133","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.217377+0000","last_change":"2024-09-19T14:14:49.217377+0000","last_active":"2024-09-19T14:14:49.217377+0000","last_peered":"2024-09-19T14:14:49.217377+0000","last_clean":"2024-09-19T14:14:49.217377+0000","last_became_active":"2024-09-19T13:36:13.347904+0000","last_became_peered":"2024-09-19T13:36:13.347904+0000","last_unstale":"2024-09-19T14:14:49.217377+0000","last_undegraded":"2024-09-19T14:14:49.217377+0000","last_fullsized":"2024-09-19T14:14:49.217377+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-09-19T14:14:49.217265+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-09-19T14:14:49.217265+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.217265+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:25.483828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":236,"num_write":84,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.186875+0000","last_change":"2024-09-19T14:14:53.186875+0000","last_active":"2024-09-19T14:14:53.186875+0000","last_peered":"2024-09-19T14:14:53.186875+0000","last_clean":"2024-09-19T14:14:53.186875+0000","last_became_active":"2024-09-19T13:36:15.352969+0000","last_became_peered":"2024-09-19T13:36:15.352969+0000","last_unstale":"2024-09-19T14:14:53.186875+0000","last_undegraded":"2024-09-19T14:14:53.186875+0000","last_fullsized":"2024-09-19T14:14:53.186875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:53.186792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:53.186792+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.186792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:13.861721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'843","reported_seq":2334,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.153572+0000","last_change":"2024-09-19T14:14:35.153572+0000","last_active":"2024-09-19T14:14:35.153572+0000","last_peered":"2024-09-19T14:14:35.153572+0000","last_clean":"2024-09-19T14:14:35.153572+0000","last_became_active":"2024-09-19T13:36:09.338582+0000","last_became_peered":"2024-09-19T13:36:09.338582+0000","last_unstale":"2024-09-19T14:14:35.153572+0000","last_undegraded":"2024-09-19T14:14:35.153572+0000","last_fullsized":"2024-09-19T14:14:35.153572+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'843","last_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_deep_scrub":"260'843","last_deep_scrub_stamp":"2024-09-19T14:14:35.153464+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.153464+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:33.436497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3526,"num_write":1144,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'213","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.383864+0000","last_change":"2024-09-19T14:14:26.383816+0000","last_active":"2024-09-19T14:14:26.383864+0000","last_peered":"2024-09-19T14:14:26.383864+0000","last_clean":"2024-09-19T14:14:26.383864+0000","last_became_active":"2024-09-19T13:36:07.800702+0000","last_became_peered":"2024-09-19T13:36:07.800702+0000","last_unstale":"2024-09-19T14:14:26.383864+0000","last_undegraded":"2024-09-19T14:14:26.383864+0000","last_fullsized":"2024-09-19T14:14:26.383864+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-19T14:14:26.383747+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.383747+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:29.585612+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":34256,"num_write":1036,"num_write_kb":35589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.228558+0000","last_change":"2024-09-19T14:14:42.228558+0000","last_active":"2024-09-19T14:14:42.228558+0000","last_peered":"2024-09-19T14:14:42.228558+0000","last_clean":"2024-09-19T14:14:42.228558+0000","last_became_active":"2024-09-19T13:36:11.339142+0000","last_became_peered":"2024-09-19T13:36:11.339142+0000","last_unstale":"2024-09-19T14:14:42.228558+0000","last_undegraded":"2024-09-19T14:14:42.228558+0000","last_fullsized":"2024-09-19T14:14:42.228558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.228473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.228473+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.228473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:59:51.937204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'190","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:44.429807+0000","last_change":"2024-09-19T14:14:44.429807+0000","last_active":"2024-09-19T14:14:44.429807+0000","last_peered":"2024-09-19T14:14:44.429807+0000","last_clean":"2024-09-19T14:14:44.429807+0000","last_became_active":"2024-09-19T13:36:13.344206+0000","last_became_peered":"2024-09-19T13:36:13.344206+0000","last_unstale":"2024-09-19T14:14:44.429807+0000","last_undegraded":"2024-09-19T14:14:44.429807+0000","last_fullsized":"2024-09-19T14:14:44.429807+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'190","last_scrub_stamp":"2024-09-19T14:14:44.429692+0000","last_deep_scrub":"260'190","last_deep_scrub_stamp":"2024-09-19T14:14:44.429692+0000","last_clean_scrub_stamp":"2024-09-19T14:14:44.429692+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:03.688402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11489,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":293,"num_read_kb":440,"num_write":180,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.609408+0000","last_change":"2024-09-19T14:14:54.609408+0000","last_active":"2024-09-19T14:14:54.609408+0000","last_peered":"2024-09-19T14:14:54.609408+0000","last_clean":"2024-09-19T14:14:54.609408+0000","last_became_active":"2024-09-19T13:36:15.354148+0000","last_became_peered":"2024-09-19T13:36:15.354148+0000","last_unstale":"2024-09-19T14:14:54.609408+0000","last_undegraded":"2024-09-19T14:14:54.609408+0000","last_fullsized":"2024-09-19T14:14:54.609408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.609322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.609322+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.609322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:03.584374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'197","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:02.965648+0000","last_change":"2024-09-19T14:15:02.965648+0000","last_active":"2024-09-19T14:15:02.965648+0000","last_peered":"2024-09-19T14:15:02.965648+0000","last_clean":"2024-09-19T14:15:02.965648+0000","last_became_active":"2024-09-19T13:36:17.362176+0000","last_became_peered":"2024-09-19T13:36:17.362176+0000","last_unstale":"2024-09-19T14:15:02.965648+0000","last_undegraded":"2024-09-19T14:15:02.965648+0000","last_fullsized":"2024-09-19T14:15:02.965648+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-09-19T14:15:02.965563+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-09-19T14:15:02.965563+0000","last_clean_scrub_stamp":"2024-09-19T14:15:02.965563+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:53.492217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":294,"num_write":449,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'885","reported_seq":2491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.197145+0000","last_change":"2024-09-19T14:14:37.197145+0000","last_active":"2024-09-19T14:14:37.197145+0000","last_peered":"2024-09-19T14:14:37.197145+0000","last_clean":"2024-09-19T14:14:37.197145+0000","last_became_active":"2024-09-19T13:36:09.333955+0000","last_became_peered":"2024-09-19T13:36:09.333955+0000","last_unstale":"2024-09-19T14:14:37.197145+0000","last_undegraded":"2024-09-19T14:14:37.197145+0000","last_fullsized":"2024-09-19T14:14:37.197145+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-19T14:14:37.197060+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.197060+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:29:42.296752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4328,"num_read_kb":3878,"num_write":1256,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'195","reported_seq":940,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.278558+0000","last_change":"2024-09-19T14:14:26.278507+0000","last_active":"2024-09-19T14:14:26.278558+0000","last_peered":"2024-09-19T14:14:26.278558+0000","last_clean":"2024-09-19T14:14:26.278558+0000","last_became_active":"2024-09-19T13:36:07.807988+0000","last_became_peered":"2024-09-19T13:36:07.807988+0000","last_unstale":"2024-09-19T14:14:26.278558+0000","last_undegraded":"2024-09-19T14:14:26.278558+0000","last_fullsized":"2024-09-19T14:14:26.278558+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-09-19T14:14:26.278417+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.278417+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:45.039194+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":906,"num_read_kb":49787,"num_write":936,"num_write_kb":35087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.244914+0000","last_change":"2024-09-19T14:14:42.244914+0000","last_active":"2024-09-19T14:14:42.244914+0000","last_peered":"2024-09-19T14:14:42.244914+0000","last_clean":"2024-09-19T14:14:42.244914+0000","last_became_active":"2024-09-19T13:36:11.338794+0000","last_became_peered":"2024-09-19T13:36:11.338794+0000","last_unstale":"2024-09-19T14:14:42.244914+0000","last_undegraded":"2024-09-19T14:14:42.244914+0000","last_fullsized":"2024-09-19T14:14:42.244914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:42.244809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:42.244809+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.244809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:20.570407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'139","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.206362+0000","last_change":"2024-09-19T14:14:51.206362+0000","last_active":"2024-09-19T14:14:51.206362+0000","last_peered":"2024-09-19T14:14:51.206362+0000","last_clean":"2024-09-19T14:14:51.206362+0000","last_became_active":"2024-09-19T13:36:13.351421+0000","last_became_peered":"2024-09-19T13:36:13.351421+0000","last_unstale":"2024-09-19T14:14:51.206362+0000","last_undegraded":"2024-09-19T14:14:51.206362+0000","last_fullsized":"2024-09-19T14:14:51.206362+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-19T14:14:51.206266+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-19T14:14:51.206266+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.206266+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:30.621888+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":183,"num_read_kb":180,"num_write":112,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.449794+0000","last_change":"2024-09-19T14:14:46.449794+0000","last_active":"2024-09-19T14:14:46.449794+0000","last_peered":"2024-09-19T14:14:46.449794+0000","last_clean":"2024-09-19T14:14:46.449794+0000","last_became_active":"2024-09-19T13:36:15.351896+0000","last_became_peered":"2024-09-19T13:36:15.351896+0000","last_unstale":"2024-09-19T14:14:46.449794+0000","last_undegraded":"2024-09-19T14:14:46.449794+0000","last_fullsized":"2024-09-19T14:14:46.449794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.449716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.449716+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.449716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.451294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'159","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:49.346944+0000","last_change":"2024-09-19T14:14:49.346944+0000","last_active":"2024-09-19T14:14:49.346944+0000","last_peered":"2024-09-19T14:14:49.346944+0000","last_clean":"2024-09-19T14:14:49.346944+0000","last_became_active":"2024-09-19T13:36:17.361493+0000","last_became_peered":"2024-09-19T13:36:17.361493+0000","last_unstale":"2024-09-19T14:14:49.346944+0000","last_undegraded":"2024-09-19T14:14:49.346944+0000","last_fullsized":"2024-09-19T14:14:49.346944+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'159","last_scrub_stamp":"2024-09-19T14:14:49.346845+0000","last_deep_scrub":"260'159","last_deep_scrub_stamp":"2024-09-19T14:14:49.346845+0000","last_clean_scrub_stamp":"2024-09-19T14:14:49.346845+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:54.114382+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":210,"num_write":445,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'365","reported_seq":1770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.344661+0000","last_change":"2024-09-19T14:14:38.344661+0000","last_active":"2024-09-19T14:14:38.344661+0000","last_peered":"2024-09-19T14:14:38.344661+0000","last_clean":"2024-09-19T14:14:38.344661+0000","last_became_active":"2024-09-19T13:36:09.347445+0000","last_became_peered":"2024-09-19T13:36:09.347445+0000","last_unstale":"2024-09-19T14:14:38.344661+0000","last_undegraded":"2024-09-19T14:14:38.344661+0000","last_fullsized":"2024-09-19T14:14:38.344661+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'365","last_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_deep_scrub":"260'365","last_deep_scrub_stamp":"2024-09-19T14:14:38.344573+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.344573+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:24.841460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2005,"num_read_kb":1894,"num_write":425,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'205","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.620062+0000","last_change":"2024-09-19T14:14:25.620062+0000","last_active":"2024-09-19T14:14:25.620062+0000","last_peered":"2024-09-19T14:14:25.620062+0000","last_clean":"2024-09-19T14:14:25.620062+0000","last_became_active":"2024-09-19T13:36:07.803684+0000","last_became_peered":"2024-09-19T13:36:07.803684+0000","last_unstale":"2024-09-19T14:14:25.620062+0000","last_undegraded":"2024-09-19T14:14:25.620062+0000","last_fullsized":"2024-09-19T14:14:25.620062+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-09-19T14:14:25.619965+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.619965+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:40.388409+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":98647,"num_write":933,"num_write_kb":44739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:51.822035+0000","last_change":"2024-09-19T14:14:51.822035+0000","last_active":"2024-09-19T14:14:51.822035+0000","last_peered":"2024-09-19T14:14:51.822035+0000","last_clean":"2024-09-19T14:14:51.822035+0000","last_became_active":"2024-09-19T13:36:11.336148+0000","last_became_peered":"2024-09-19T13:36:11.336148+0000","last_unstale":"2024-09-19T14:14:51.822035+0000","last_undegraded":"2024-09-19T14:14:51.822035+0000","last_fullsized":"2024-09-19T14:14:51.822035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:51.821944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:51.821944+0000","last_clean_scrub_stamp":"2024-09-19T14:14:51.821944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:29.667562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'128","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:53.118261+0000","last_change":"2024-09-19T14:14:53.118261+0000","last_active":"2024-09-19T14:14:53.118261+0000","last_peered":"2024-09-19T14:14:53.118261+0000","last_clean":"2024-09-19T14:14:53.118261+0000","last_became_active":"2024-09-19T13:36:13.679466+0000","last_became_peered":"2024-09-19T13:36:13.679466+0000","last_unstale":"2024-09-19T14:14:53.118261+0000","last_undegraded":"2024-09-19T14:14:53.118261+0000","last_fullsized":"2024-09-19T14:14:53.118261+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'128","last_scrub_stamp":"2024-09-19T14:14:53.118178+0000","last_deep_scrub":"260'128","last_deep_scrub_stamp":"2024-09-19T14:14:53.118178+0000","last_clean_scrub_stamp":"2024-09-19T14:14:53.118178+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:45.968519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7162,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":222,"num_write":82,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:47.407146+0000","last_change":"2024-09-19T14:14:47.407146+0000","last_active":"2024-09-19T14:14:47.407146+0000","last_peered":"2024-09-19T14:14:47.407146+0000","last_clean":"2024-09-19T14:14:47.407146+0000","last_became_active":"2024-09-19T13:36:15.346067+0000","last_became_peered":"2024-09-19T13:36:15.346067+0000","last_unstale":"2024-09-19T14:14:47.407146+0000","last_undegraded":"2024-09-19T14:14:47.407146+0000","last_fullsized":"2024-09-19T14:14:47.407146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:47.407057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:47.407057+0000","last_clean_scrub_stamp":"2024-09-19T14:14:47.407057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:58.345273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'115","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:58.610611+0000","last_change":"2024-09-19T14:14:58.610611+0000","last_active":"2024-09-19T14:14:58.610611+0000","last_peered":"2024-09-19T14:14:58.610611+0000","last_clean":"2024-09-19T14:14:58.610611+0000","last_became_active":"2024-09-19T13:36:17.358568+0000","last_became_peered":"2024-09-19T13:36:17.358568+0000","last_unstale":"2024-09-19T14:14:58.610611+0000","last_undegraded":"2024-09-19T14:14:58.610611+0000","last_fullsized":"2024-09-19T14:14:58.610611+0000","mapping_epoch":32,"log_start":"260'101","ondisk_log_start":"260'101","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'115","last_scrub_stamp":"2024-09-19T14:14:58.610517+0000","last_deep_scrub":"260'115","last_deep_scrub_stamp":"2024-09-19T14:14:58.610517+0000","last_clean_scrub_stamp":"2024-09-19T14:14:58.610517+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:48.477399+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1222,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'868","reported_seq":2584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.153740+0000","last_change":"2024-09-19T14:14:26.153740+0000","last_active":"2024-09-19T14:14:26.153740+0000","last_peered":"2024-09-19T14:14:26.153740+0000","last_clean":"2024-09-19T14:14:26.153740+0000","last_became_active":"2024-09-19T13:36:09.327597+0000","last_became_peered":"2024-09-19T13:36:09.327597+0000","last_unstale":"2024-09-19T14:14:26.153740+0000","last_undegraded":"2024-09-19T14:14:26.153740+0000","last_fullsized":"2024-09-19T14:14:26.153740+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'868","last_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_deep_scrub":"260'868","last_deep_scrub_stamp":"2024-09-19T14:14:26.153669+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.153669+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:07.343986+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4336,"num_read_kb":3925,"num_write":1142,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2999,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'241","reported_seq":860,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:26.275883+0000","last_change":"2024-09-19T14:14:26.275883+0000","last_active":"2024-09-19T14:14:26.275883+0000","last_peered":"2024-09-19T14:14:26.275883+0000","last_clean":"2024-09-19T14:14:26.275883+0000","last_became_active":"2024-09-19T13:36:07.809882+0000","last_became_peered":"2024-09-19T13:36:07.809882+0000","last_unstale":"2024-09-19T14:14:26.275883+0000","last_undegraded":"2024-09-19T14:14:26.275883+0000","last_fullsized":"2024-09-19T14:14:26.275883+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'241","last_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_deep_scrub":"260'241","last_deep_scrub_stamp":"2024-09-19T14:14:26.275769+0000","last_clean_scrub_stamp":"2024-09-19T14:14:26.275769+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:42.512214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":578,"num_read_kb":17644,"num_write":972,"num_write_kb":47737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.450775+0000","last_change":"2024-09-19T14:14:41.450775+0000","last_active":"2024-09-19T14:14:41.450775+0000","last_peered":"2024-09-19T14:14:41.450775+0000","last_clean":"2024-09-19T14:14:41.450775+0000","last_became_active":"2024-09-19T13:36:11.341208+0000","last_became_peered":"2024-09-19T13:36:11.341208+0000","last_unstale":"2024-09-19T14:14:41.450775+0000","last_undegraded":"2024-09-19T14:14:41.450775+0000","last_fullsized":"2024-09-19T14:14:41.450775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:41.450684+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.450684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:23:36.944231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.824859+0000","last_change":"2024-09-19T14:14:52.824859+0000","last_active":"2024-09-19T14:14:52.824859+0000","last_peered":"2024-09-19T14:14:52.824859+0000","last_clean":"2024-09-19T14:14:52.824859+0000","last_became_active":"2024-09-19T13:36:13.678179+0000","last_became_peered":"2024-09-19T13:36:13.678179+0000","last_unstale":"2024-09-19T14:14:52.824859+0000","last_undegraded":"2024-09-19T14:14:52.824859+0000","last_fullsized":"2024-09-19T14:14:52.824859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'79","last_scrub_stamp":"2024-09-19T14:14:52.824746+0000","last_deep_scrub":"260'79","last_deep_scrub_stamp":"2024-09-19T14:14:52.824746+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.824746+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:43.682521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":61,"num_write":52,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'779","reported_seq":4117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.275263+0000","last_change":"2024-09-19T14:14:46.275263+0000","last_active":"2024-09-19T14:14:46.275263+0000","last_peered":"2024-09-19T14:14:46.275263+0000","last_clean":"2024-09-19T14:14:46.275263+0000","last_became_active":"2024-09-19T13:36:15.349768+0000","last_became_peered":"2024-09-19T13:36:15.349768+0000","last_unstale":"2024-09-19T14:14:46.275263+0000","last_undegraded":"2024-09-19T14:14:46.275263+0000","last_fullsized":"2024-09-19T14:14:46.275263+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'779","last_scrub_stamp":"2024-09-19T14:14:46.275174+0000","last_deep_scrub":"260'779","last_deep_scrub_stamp":"2024-09-19T14:14:46.275174+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.275174+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:16.885230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'117","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:56.283773+0000","last_change":"2024-09-19T14:14:56.283773+0000","last_active":"2024-09-19T14:14:56.283773+0000","last_peered":"2024-09-19T14:14:56.283773+0000","last_clean":"2024-09-19T14:14:56.283773+0000","last_became_active":"2024-09-19T13:36:17.363381+0000","last_became_peered":"2024-09-19T13:36:17.363381+0000","last_unstale":"2024-09-19T14:14:56.283773+0000","last_undegraded":"2024-09-19T14:14:56.283773+0000","last_fullsized":"2024-09-19T14:14:56.283773+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-09-19T14:14:56.283687+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-09-19T14:14:56.283687+0000","last_clean_scrub_stamp":"2024-09-19T14:14:56.283687+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:49.798497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":151,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'838","reported_seq":2313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.704717+0000","last_change":"2024-09-19T14:14:36.704717+0000","last_active":"2024-09-19T14:14:36.704717+0000","last_peered":"2024-09-19T14:14:36.704717+0000","last_clean":"2024-09-19T14:14:36.704717+0000","last_became_active":"2024-09-19T13:36:09.338540+0000","last_became_peered":"2024-09-19T13:36:09.338540+0000","last_unstale":"2024-09-19T14:14:36.704717+0000","last_undegraded":"2024-09-19T14:14:36.704717+0000","last_fullsized":"2024-09-19T14:14:36.704717+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:36.704635+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.704635+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:10.522393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3972,"num_read_kb":3527,"num_write":1130,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'179","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.802969+0000","last_change":"2024-09-19T14:14:28.802969+0000","last_active":"2024-09-19T14:14:28.802969+0000","last_peered":"2024-09-19T14:14:28.802969+0000","last_clean":"2024-09-19T14:14:28.802969+0000","last_became_active":"2024-09-19T13:36:07.814666+0000","last_became_peered":"2024-09-19T13:36:07.814666+0000","last_unstale":"2024-09-19T14:14:28.802969+0000","last_undegraded":"2024-09-19T14:14:28.802969+0000","last_fullsized":"2024-09-19T14:14:28.802969+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'179","last_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_deep_scrub":"260'179","last_deep_scrub_stamp":"2024-09-19T14:14:28.802887+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.802887+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:55.372480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":403,"num_read_kb":5488,"num_write":868,"num_write_kb":34166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.182462+0000","last_change":"2024-09-19T14:14:45.182462+0000","last_active":"2024-09-19T14:14:45.182462+0000","last_peered":"2024-09-19T14:14:45.182462+0000","last_clean":"2024-09-19T14:14:45.182462+0000","last_became_active":"2024-09-19T13:36:11.338326+0000","last_became_peered":"2024-09-19T13:36:11.338326+0000","last_unstale":"2024-09-19T14:14:45.182462+0000","last_undegraded":"2024-09-19T14:14:45.182462+0000","last_fullsized":"2024-09-19T14:14:45.182462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.182364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.182364+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.182364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:28.117734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'154","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.693486+0000","last_change":"2024-09-19T14:14:52.693429+0000","last_active":"2024-09-19T14:14:52.693486+0000","last_peered":"2024-09-19T14:14:52.693486+0000","last_clean":"2024-09-19T14:14:52.693486+0000","last_became_active":"2024-09-19T13:36:13.344589+0000","last_became_peered":"2024-09-19T13:36:13.344589+0000","last_unstale":"2024-09-19T14:14:52.693486+0000","last_undegraded":"2024-09-19T14:14:52.693486+0000","last_fullsized":"2024-09-19T14:14:52.693486+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'154","last_scrub_stamp":"2024-09-19T14:14:52.693341+0000","last_deep_scrub":"260'154","last_deep_scrub_stamp":"2024-09-19T14:14:52.693341+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.693341+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:38.128913+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7396,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":188,"num_read_kb":254,"num_write":102,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:54.208002+0000","last_change":"2024-09-19T14:14:54.207936+0000","last_active":"2024-09-19T14:14:54.208002+0000","last_peered":"2024-09-19T14:14:54.208002+0000","last_clean":"2024-09-19T14:14:54.208002+0000","last_became_active":"2024-09-19T13:36:15.348522+0000","last_became_peered":"2024-09-19T13:36:15.348522+0000","last_unstale":"2024-09-19T14:14:54.208002+0000","last_undegraded":"2024-09-19T14:14:54.208002+0000","last_fullsized":"2024-09-19T14:14:54.208002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:54.207851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:54.207851+0000","last_clean_scrub_stamp":"2024-09-19T14:14:54.207851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:34.430680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'116","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:00.332277+0000","last_change":"2024-09-19T14:15:00.332277+0000","last_active":"2024-09-19T14:15:00.332277+0000","last_peered":"2024-09-19T14:15:00.332277+0000","last_clean":"2024-09-19T14:15:00.332277+0000","last_became_active":"2024-09-19T13:36:17.357508+0000","last_became_peered":"2024-09-19T13:36:17.357508+0000","last_unstale":"2024-09-19T14:15:00.332277+0000","last_undegraded":"2024-09-19T14:15:00.332277+0000","last_fullsized":"2024-09-19T14:15:00.332277+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-09-19T14:15:00.332193+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-09-19T14:15:00.332193+0000","last_clean_scrub_stamp":"2024-09-19T14:15:00.332193+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:08.555607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":145,"num_read_kb":139,"num_write":268,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'888","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.694724+0000","last_change":"2024-09-19T14:14:35.694724+0000","last_active":"2024-09-19T14:14:35.694724+0000","last_peered":"2024-09-19T14:14:35.694724+0000","last_clean":"2024-09-19T14:14:35.694724+0000","last_became_active":"2024-09-19T13:36:09.338877+0000","last_became_peered":"2024-09-19T13:36:09.338877+0000","last_unstale":"2024-09-19T14:14:35.694724+0000","last_undegraded":"2024-09-19T14:14:35.694724+0000","last_fullsized":"2024-09-19T14:14:35.694724+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'888","last_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_deep_scrub":"260'888","last_deep_scrub_stamp":"2024-09-19T14:14:35.694623+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.694623+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:15:14.199274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4425,"num_read_kb":3987,"num_write":1194,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'245","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.794846+0000","last_change":"2024-09-19T14:14:30.794846+0000","last_active":"2024-09-19T14:14:30.794846+0000","last_peered":"2024-09-19T14:14:30.794846+0000","last_clean":"2024-09-19T14:14:30.794846+0000","last_became_active":"2024-09-19T13:36:07.814062+0000","last_became_peered":"2024-09-19T13:36:07.814062+0000","last_unstale":"2024-09-19T14:14:30.794846+0000","last_undegraded":"2024-09-19T14:14:30.794846+0000","last_fullsized":"2024-09-19T14:14:30.794846+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'245","last_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_deep_scrub":"260'245","last_deep_scrub_stamp":"2024-09-19T14:14:30.794729+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.794729+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:31.629348+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655873,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":59575,"num_write":1084,"num_write_kb":37006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.692404+0000","last_change":"2024-09-19T14:14:48.692404+0000","last_active":"2024-09-19T14:14:48.692404+0000","last_peered":"2024-09-19T14:14:48.692404+0000","last_clean":"2024-09-19T14:14:48.692404+0000","last_became_active":"2024-09-19T13:36:11.336359+0000","last_became_peered":"2024-09-19T13:36:11.336359+0000","last_unstale":"2024-09-19T14:14:48.692404+0000","last_undegraded":"2024-09-19T14:14:48.692404+0000","last_fullsized":"2024-09-19T14:14:48.692404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:48.692312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:48.692312+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.692312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:23.065865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'136","reported_seq":698,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.226171+0000","last_change":"2024-09-19T14:14:48.226112+0000","last_active":"2024-09-19T14:14:48.226171+0000","last_peered":"2024-09-19T14:14:48.226171+0000","last_clean":"2024-09-19T14:14:48.226171+0000","last_became_active":"2024-09-19T13:36:13.344678+0000","last_became_peered":"2024-09-19T13:36:13.344678+0000","last_unstale":"2024-09-19T14:14:48.226171+0000","last_undegraded":"2024-09-19T14:14:48.226171+0000","last_fullsized":"2024-09-19T14:14:48.226171+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'136","last_scrub_stamp":"2024-09-19T14:14:48.226013+0000","last_deep_scrub":"260'136","last_deep_scrub_stamp":"2024-09-19T14:14:48.226013+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.226013+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:06.268321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7442,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":153,"num_read_kb":207,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:45.245865+0000","last_change":"2024-09-19T14:14:45.245797+0000","last_active":"2024-09-19T14:14:45.245865+0000","last_peered":"2024-09-19T14:14:45.245865+0000","last_clean":"2024-09-19T14:14:45.245865+0000","last_became_active":"2024-09-19T13:36:15.352968+0000","last_became_peered":"2024-09-19T13:36:15.352968+0000","last_unstale":"2024-09-19T14:14:45.245865+0000","last_undegraded":"2024-09-19T14:14:45.245865+0000","last_fullsized":"2024-09-19T14:14:45.245865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:45.245715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:45.245715+0000","last_clean_scrub_stamp":"2024-09-19T14:14:45.245715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:20.002903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'84","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:15:01.995743+0000","last_change":"2024-09-19T14:15:01.995743+0000","last_active":"2024-09-19T14:15:01.995743+0000","last_peered":"2024-09-19T14:15:01.995743+0000","last_clean":"2024-09-19T14:15:01.995743+0000","last_became_active":"2024-09-19T13:36:17.361578+0000","last_became_peered":"2024-09-19T13:36:17.361578+0000","last_unstale":"2024-09-19T14:15:01.995743+0000","last_undegraded":"2024-09-19T14:15:01.995743+0000","last_fullsized":"2024-09-19T14:15:01.995743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-09-19T14:15:01.995660+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-09-19T14:15:01.995660+0000","last_clean_scrub_stamp":"2024-09-19T14:15:01.995660+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:33.369622+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":741,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":167,"num_write":188,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'389","reported_seq":1831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.339492+0000","last_change":"2024-09-19T14:14:39.339428+0000","last_active":"2024-09-19T14:14:39.339492+0000","last_peered":"2024-09-19T14:14:39.339492+0000","last_clean":"2024-09-19T14:14:39.339492+0000","last_became_active":"2024-09-19T13:36:09.341234+0000","last_became_peered":"2024-09-19T13:36:09.341234+0000","last_unstale":"2024-09-19T14:14:39.339492+0000","last_undegraded":"2024-09-19T14:14:39.339492+0000","last_fullsized":"2024-09-19T14:14:39.339492+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-19T14:14:39.339324+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.339324+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:46.745230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2061,"num_read_kb":1953,"num_write":440,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'201","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:23.141292+0000","last_change":"2024-09-19T14:14:23.141243+0000","last_active":"2024-09-19T14:14:23.141292+0000","last_peered":"2024-09-19T14:14:23.141292+0000","last_clean":"2024-09-19T14:14:23.141292+0000","last_became_active":"2024-09-19T13:36:44.400190+0000","last_became_peered":"2024-09-19T13:36:44.400190+0000","last_unstale":"2024-09-19T14:14:23.141292+0000","last_undegraded":"2024-09-19T14:14:23.141292+0000","last_fullsized":"2024-09-19T14:14:23.141292+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'201","last_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_deep_scrub":"260'201","last_deep_scrub_stamp":"2024-09-19T14:14:23.141172+0000","last_clean_scrub_stamp":"2024-09-19T14:14:23.141172+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:48:13.237318+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":516,"num_read_kb":9219,"num_write":929,"num_write_kb":48718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:46.789205+0000","last_change":"2024-09-19T14:14:46.789120+0000","last_active":"2024-09-19T14:14:46.789205+0000","last_peered":"2024-09-19T14:14:46.789205+0000","last_clean":"2024-09-19T14:14:46.789205+0000","last_became_active":"2024-09-19T13:36:11.333969+0000","last_became_peered":"2024-09-19T13:36:11.333969+0000","last_unstale":"2024-09-19T14:14:46.789205+0000","last_undegraded":"2024-09-19T14:14:46.789205+0000","last_fullsized":"2024-09-19T14:14:46.789205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:46.789009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:46.789009+0000","last_clean_scrub_stamp":"2024-09-19T14:14:46.789009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:00.687915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'118","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:52.154803+0000","last_change":"2024-09-19T14:14:52.154803+0000","last_active":"2024-09-19T14:14:52.154803+0000","last_peered":"2024-09-19T14:14:52.154803+0000","last_clean":"2024-09-19T14:14:52.154803+0000","last_became_active":"2024-09-19T13:36:13.345971+0000","last_became_peered":"2024-09-19T13:36:13.345971+0000","last_unstale":"2024-09-19T14:14:52.154803+0000","last_undegraded":"2024-09-19T14:14:52.154803+0000","last_fullsized":"2024-09-19T14:14:52.154803+0000","mapping_epoch":28,"log_start":"260'100","ondisk_log_start":"260'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-09-19T14:14:52.154713+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-09-19T14:14:52.154713+0000","last_clean_scrub_stamp":"2024-09-19T14:14:52.154713+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:53.703773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7954,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":214,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.779162+0000","last_change":"2024-09-19T14:14:55.779162+0000","last_active":"2024-09-19T14:14:55.779162+0000","last_peered":"2024-09-19T14:14:55.779162+0000","last_clean":"2024-09-19T14:14:55.779162+0000","last_became_active":"2024-09-19T13:36:15.348425+0000","last_became_peered":"2024-09-19T13:36:15.348425+0000","last_unstale":"2024-09-19T14:14:55.779162+0000","last_undegraded":"2024-09-19T14:14:55.779162+0000","last_fullsized":"2024-09-19T14:14:55.779162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.779074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.779074+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.779074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:22:00.069996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'168","reported_seq":1629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.329648+0000","last_change":"2024-09-19T14:14:57.329648+0000","last_active":"2024-09-19T14:14:57.329648+0000","last_peered":"2024-09-19T14:14:57.329648+0000","last_clean":"2024-09-19T14:14:57.329648+0000","last_became_active":"2024-09-19T13:36:17.359332+0000","last_became_peered":"2024-09-19T13:36:17.359332+0000","last_unstale":"2024-09-19T14:14:57.329648+0000","last_undegraded":"2024-09-19T14:14:57.329648+0000","last_fullsized":"2024-09-19T14:14:57.329648+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-09-19T14:14:57.329529+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-09-19T14:14:57.329529+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.329529+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:18.582411+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1092,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1190,"num_read_kb":1188,"num_write":363,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'1273","reported_seq":2995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.694661+0000","last_change":"2024-09-19T14:14:34.694601+0000","last_active":"2024-09-19T14:14:34.694661+0000","last_peered":"2024-09-19T14:14:34.694661+0000","last_clean":"2024-09-19T14:14:34.694661+0000","last_became_active":"2024-09-19T13:36:09.337966+0000","last_became_peered":"2024-09-19T13:36:09.337966+0000","last_unstale":"2024-09-19T14:14:34.694661+0000","last_undegraded":"2024-09-19T14:14:34.694661+0000","last_fullsized":"2024-09-19T14:14:34.694661+0000","mapping_epoch":24,"log_start":"260'1200","ondisk_log_start":"260'1200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1273","last_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_deep_scrub":"260'1273","last_deep_scrub_stamp":"2024-09-19T14:14:34.694504+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.694504+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:28.668229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5775,"num_read_kb":5105,"num_write":1719,"num_write_kb":689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'210","reported_seq":895,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.226451+0000","last_change":"2024-09-19T14:14:27.226451+0000","last_active":"2024-09-19T14:14:27.226451+0000","last_peered":"2024-09-19T14:14:27.226451+0000","last_clean":"2024-09-19T14:14:27.226451+0000","last_became_active":"2024-09-19T13:36:07.812837+0000","last_became_peered":"2024-09-19T13:36:07.812837+0000","last_unstale":"2024-09-19T14:14:27.226451+0000","last_undegraded":"2024-09-19T14:14:27.226451+0000","last_fullsized":"2024-09-19T14:14:27.226451+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'210","last_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_deep_scrub":"260'210","last_deep_scrub_stamp":"2024-09-19T14:14:27.226323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.226323+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:19.006735+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":101743,"num_write":1010,"num_write_kb":36590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.411709+0000","last_change":"2024-09-19T14:14:40.411618+0000","last_active":"2024-09-19T14:14:40.411709+0000","last_peered":"2024-09-19T14:14:40.411709+0000","last_clean":"2024-09-19T14:14:40.411709+0000","last_became_active":"2024-09-19T13:36:11.337872+0000","last_became_peered":"2024-09-19T13:36:11.337872+0000","last_unstale":"2024-09-19T14:14:40.411709+0000","last_undegraded":"2024-09-19T14:14:40.411709+0000","last_fullsized":"2024-09-19T14:14:40.411709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-19T14:14:40.411523+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.411523+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:59.159110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'164","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:48.788064+0000","last_change":"2024-09-19T14:14:48.788064+0000","last_active":"2024-09-19T14:14:48.788064+0000","last_peered":"2024-09-19T14:14:48.788064+0000","last_clean":"2024-09-19T14:14:48.788064+0000","last_became_active":"2024-09-19T13:36:13.345111+0000","last_became_peered":"2024-09-19T13:36:13.345111+0000","last_unstale":"2024-09-19T14:14:48.788064+0000","last_undegraded":"2024-09-19T14:14:48.788064+0000","last_fullsized":"2024-09-19T14:14:48.788064+0000","mapping_epoch":28,"log_start":"257'100","ondisk_log_start":"257'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-19T14:14:48.787980+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-19T14:14:48.787980+0000","last_clean_scrub_stamp":"2024-09-19T14:14:48.787980+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:44.951134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9862,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":313,"num_write":122,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:55.204420+0000","last_change":"2024-09-19T14:14:55.204420+0000","last_active":"2024-09-19T14:14:55.204420+0000","last_peered":"2024-09-19T14:14:55.204420+0000","last_clean":"2024-09-19T14:14:55.204420+0000","last_became_active":"2024-09-19T13:36:15.349358+0000","last_became_peered":"2024-09-19T13:36:15.349358+0000","last_unstale":"2024-09-19T14:14:55.204420+0000","last_undegraded":"2024-09-19T14:14:55.204420+0000","last_fullsized":"2024-09-19T14:14:55.204420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:14:55.204309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:14:55.204309+0000","last_clean_scrub_stamp":"2024-09-19T14:14:55.204309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:17.732329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'160","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:57.769228+0000","last_change":"2024-09-19T14:14:57.769228+0000","last_active":"2024-09-19T14:14:57.769228+0000","last_peered":"2024-09-19T14:14:57.769228+0000","last_clean":"2024-09-19T14:14:57.769228+0000","last_became_active":"2024-09-19T13:36:17.360074+0000","last_became_peered":"2024-09-19T13:36:17.360074+0000","last_unstale":"2024-09-19T14:14:57.769228+0000","last_undegraded":"2024-09-19T14:14:57.769228+0000","last_fullsized":"2024-09-19T14:14:57.769228+0000","mapping_epoch":32,"log_start":"260'100","ondisk_log_start":"260'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'160","last_scrub_stamp":"2024-09-19T14:14:57.769136+0000","last_deep_scrub":"260'160","last_deep_scrub_stamp":"2024-09-19T14:14:57.769136+0000","last_clean_scrub_stamp":"2024-09-19T14:14:57.769136+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:34.077896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":207,"num_read_kb":195,"num_write":374,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'836","reported_seq":2521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.397461+0000","last_change":"2024-09-19T14:14:37.397395+0000","last_active":"2024-09-19T14:14:37.397461+0000","last_peered":"2024-09-19T14:14:37.397461+0000","last_clean":"2024-09-19T14:14:37.397461+0000","last_became_active":"2024-09-19T13:36:09.338912+0000","last_became_peered":"2024-09-19T13:36:09.338912+0000","last_unstale":"2024-09-19T14:14:37.397461+0000","last_undegraded":"2024-09-19T14:14:37.397461+0000","last_fullsized":"2024-09-19T14:14:37.397461+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'836","last_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_deep_scrub":"260'836","last_deep_scrub_stamp":"2024-09-19T14:14:37.397294+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.397294+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:44.618601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4105,"num_read_kb":3721,"num_write":1098,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'249","reported_seq":948,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.176212+0000","last_change":"2024-09-19T14:14:31.176212+0000","last_active":"2024-09-19T14:14:31.176212+0000","last_peered":"2024-09-19T14:14:31.176212+0000","last_clean":"2024-09-19T14:14:31.176212+0000","last_became_active":"2024-09-19T13:36:07.815855+0000","last_became_peered":"2024-09-19T13:36:07.815855+0000","last_unstale":"2024-09-19T14:14:31.176212+0000","last_undegraded":"2024-09-19T14:14:31.176212+0000","last_fullsized":"2024-09-19T14:14:31.176212+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'249","last_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_deep_scrub":"260'249","last_deep_scrub_stamp":"2024-09-19T14:14:31.176114+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.176114+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:57.461970+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":888,"num_read_kb":7647,"num_write":1101,"num_write_kb":19551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'447","reported_seq":1967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.436557+0000","last_change":"2024-09-19T14:14:36.436486+0000","last_active":"2024-09-19T14:14:36.436557+0000","last_peered":"2024-09-19T14:14:36.436557+0000","last_clean":"2024-09-19T14:14:36.436557+0000","last_became_active":"2024-09-19T13:36:09.327270+0000","last_became_peered":"2024-09-19T13:36:09.327270+0000","last_unstale":"2024-09-19T14:14:36.436557+0000","last_undegraded":"2024-09-19T14:14:36.436557+0000","last_fullsized":"2024-09-19T14:14:36.436557+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'447","last_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_deep_scrub":"260'447","last_deep_scrub_stamp":"2024-09-19T14:14:36.436372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.436372+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:10.165233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2163,"num_write":522,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'218","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.173076+0000","last_change":"2024-09-19T14:14:27.173076+0000","last_active":"2024-09-19T14:14:27.173076+0000","last_peered":"2024-09-19T14:14:27.173076+0000","last_clean":"2024-09-19T14:14:27.173076+0000","last_became_active":"2024-09-19T13:36:44.476693+0000","last_became_peered":"2024-09-19T13:36:44.476693+0000","last_unstale":"2024-09-19T14:14:27.173076+0000","last_undegraded":"2024-09-19T14:14:27.173076+0000","last_fullsized":"2024-09-19T14:14:27.173076+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-09-19T14:14:27.172984+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.172984+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:42.410826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":577,"num_read_kb":9780,"num_write":1046,"num_write_kb":28443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'455","reported_seq":2089,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.752853+0000","last_change":"2024-09-19T14:14:39.752784+0000","last_active":"2024-09-19T14:14:39.752853+0000","last_peered":"2024-09-19T14:14:39.752853+0000","last_clean":"2024-09-19T14:14:39.752853+0000","last_became_active":"2024-09-19T13:36:09.335795+0000","last_became_peered":"2024-09-19T13:36:09.335795+0000","last_unstale":"2024-09-19T14:14:39.752853+0000","last_undegraded":"2024-09-19T14:14:39.752853+0000","last_fullsized":"2024-09-19T14:14:39.752853+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'455","last_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_deep_scrub":"260'455","last_deep_scrub_stamp":"2024-09-19T14:14:39.752704+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.752704+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:34.065704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2565,"num_read_kb":2440,"num_write":511,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'211","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.759444+0000","last_change":"2024-09-19T14:14:29.759444+0000","last_active":"2024-09-19T14:14:29.759444+0000","last_peered":"2024-09-19T14:14:29.759444+0000","last_clean":"2024-09-19T14:14:29.759444+0000","last_became_active":"2024-09-19T13:36:07.812809+0000","last_became_peered":"2024-09-19T13:36:07.812809+0000","last_unstale":"2024-09-19T14:14:29.759444+0000","last_undegraded":"2024-09-19T14:14:29.759444+0000","last_fullsized":"2024-09-19T14:14:29.759444+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'211","last_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_deep_scrub":"260'211","last_deep_scrub_stamp":"2024-09-19T14:14:29.759339+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.759339+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.186994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":691,"num_read_kb":41340,"num_write":997,"num_write_kb":31724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'838","reported_seq":2607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:35.446601+0000","last_change":"2024-09-19T14:14:35.446544+0000","last_active":"2024-09-19T14:14:35.446601+0000","last_peered":"2024-09-19T14:14:35.446601+0000","last_clean":"2024-09-19T14:14:35.446601+0000","last_became_active":"2024-09-19T13:36:09.336861+0000","last_became_peered":"2024-09-19T13:36:09.336861+0000","last_unstale":"2024-09-19T14:14:35.446601+0000","last_undegraded":"2024-09-19T14:14:35.446601+0000","last_fullsized":"2024-09-19T14:14:35.446601+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'838","last_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_deep_scrub":"260'838","last_deep_scrub_stamp":"2024-09-19T14:14:35.446452+0000","last_clean_scrub_stamp":"2024-09-19T14:14:35.446452+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:35.254669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4201,"num_read_kb":3825,"num_write":1094,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'348","reported_seq":1037,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.265255+0000","last_change":"2024-09-19T14:14:28.265255+0000","last_active":"2024-09-19T14:14:28.265255+0000","last_peered":"2024-09-19T14:14:28.265255+0000","last_clean":"2024-09-19T14:14:28.265255+0000","last_became_active":"2024-09-19T13:36:07.799415+0000","last_became_peered":"2024-09-19T13:36:07.799415+0000","last_unstale":"2024-09-19T14:14:28.265255+0000","last_undegraded":"2024-09-19T14:14:28.265255+0000","last_fullsized":"2024-09-19T14:14:28.265255+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-19T14:14:28.265167+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.265167+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:06.385286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":988,"num_read_kb":17821,"num_write":1252,"num_write_kb":48689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'1315","reported_seq":2976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:41.329566+0000","last_change":"2024-09-19T14:14:41.329566+0000","last_active":"2024-09-19T14:14:41.329566+0000","last_peered":"2024-09-19T14:14:41.329566+0000","last_clean":"2024-09-19T14:14:41.329566+0000","last_became_active":"2024-09-19T13:36:09.336833+0000","last_became_peered":"2024-09-19T13:36:09.336833+0000","last_unstale":"2024-09-19T14:14:41.329566+0000","last_undegraded":"2024-09-19T14:14:41.329566+0000","last_fullsized":"2024-09-19T14:14:41.329566+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1315","last_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_deep_scrub":"260'1315","last_deep_scrub_stamp":"2024-09-19T14:14:41.329479+0000","last_clean_scrub_stamp":"2024-09-19T14:14:41.329479+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:37.922023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":5314,"num_write":1883,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'188","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.334937+0000","last_change":"2024-09-19T14:14:28.334879+0000","last_active":"2024-09-19T14:14:28.334937+0000","last_peered":"2024-09-19T14:14:28.334937+0000","last_clean":"2024-09-19T14:14:28.334937+0000","last_became_active":"2024-09-19T13:36:07.798730+0000","last_became_peered":"2024-09-19T13:36:07.798730+0000","last_unstale":"2024-09-19T14:14:28.334937+0000","last_undegraded":"2024-09-19T14:14:28.334937+0000","last_fullsized":"2024-09-19T14:14:28.334937+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-09-19T14:14:28.334791+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.334791+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:03:30.887824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170303,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":35047,"num_write":889,"num_write_kb":50540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'461","reported_seq":2160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.731079+0000","last_change":"2024-09-19T14:14:37.731079+0000","last_active":"2024-09-19T14:14:37.731079+0000","last_peered":"2024-09-19T14:14:37.731079+0000","last_clean":"2024-09-19T14:14:37.731079+0000","last_became_active":"2024-09-19T13:36:09.337087+0000","last_became_peered":"2024-09-19T13:36:09.337087+0000","last_unstale":"2024-09-19T14:14:37.731079+0000","last_undegraded":"2024-09-19T14:14:37.731079+0000","last_fullsized":"2024-09-19T14:14:37.731079+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'461","last_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_deep_scrub":"260'461","last_deep_scrub_stamp":"2024-09-19T14:14:37.730982+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.730982+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:47:25.634386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2777,"num_read_kb":2639,"num_write":542,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'263","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.273045+0000","last_change":"2024-09-19T14:14:27.272920+0000","last_active":"2024-09-19T14:14:27.273045+0000","last_peered":"2024-09-19T14:14:27.273045+0000","last_clean":"2024-09-19T14:14:27.273045+0000","last_became_active":"2024-09-19T13:36:07.807180+0000","last_became_peered":"2024-09-19T13:36:07.807180+0000","last_unstale":"2024-09-19T14:14:27.273045+0000","last_undegraded":"2024-09-19T14:14:27.273045+0000","last_fullsized":"2024-09-19T14:14:27.273045+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'263","last_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_deep_scrub":"260'263","last_deep_scrub_stamp":"2024-09-19T14:14:27.272800+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.272800+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:17.008251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":789,"num_read_kb":1272,"num_write":1202,"num_write_kb":28876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'506","reported_seq":2130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:40.307274+0000","last_change":"2024-09-19T14:14:40.307274+0000","last_active":"2024-09-19T14:14:40.307274+0000","last_peered":"2024-09-19T14:14:40.307274+0000","last_clean":"2024-09-19T14:14:40.307274+0000","last_became_active":"2024-09-19T13:36:09.344923+0000","last_became_peered":"2024-09-19T13:36:09.344923+0000","last_unstale":"2024-09-19T14:14:40.307274+0000","last_undegraded":"2024-09-19T14:14:40.307274+0000","last_fullsized":"2024-09-19T14:14:40.307274+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'506","last_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_deep_scrub":"260'506","last_deep_scrub_stamp":"2024-09-19T14:14:40.307175+0000","last_clean_scrub_stamp":"2024-09-19T14:14:40.307175+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:34.215410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2612,"num_read_kb":2444,"num_write":592,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'215","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:27.144872+0000","last_change":"2024-09-19T14:14:27.144807+0000","last_active":"2024-09-19T14:14:27.144872+0000","last_peered":"2024-09-19T14:14:27.144872+0000","last_clean":"2024-09-19T14:14:27.144872+0000","last_became_active":"2024-09-19T13:36:07.806877+0000","last_became_peered":"2024-09-19T13:36:07.806877+0000","last_unstale":"2024-09-19T14:14:27.144872+0000","last_undegraded":"2024-09-19T14:14:27.144872+0000","last_fullsized":"2024-09-19T14:14:27.144872+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'215","last_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_deep_scrub":"260'215","last_deep_scrub_stamp":"2024-09-19T14:14:27.144709+0000","last_clean_scrub_stamp":"2024-09-19T14:14:27.144709+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:35.772460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":13499,"num_write":1011,"num_write_kb":26561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'444","reported_seq":1923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:37.179317+0000","last_change":"2024-09-19T14:14:37.179317+0000","last_active":"2024-09-19T14:14:37.179317+0000","last_peered":"2024-09-19T14:14:37.179317+0000","last_clean":"2024-09-19T14:14:37.179317+0000","last_became_active":"2024-09-19T13:36:09.339383+0000","last_became_peered":"2024-09-19T13:36:09.339383+0000","last_unstale":"2024-09-19T14:14:37.179317+0000","last_undegraded":"2024-09-19T14:14:37.179317+0000","last_fullsized":"2024-09-19T14:14:37.179317+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'444","last_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_deep_scrub":"260'444","last_deep_scrub_stamp":"2024-09-19T14:14:37.179230+0000","last_clean_scrub_stamp":"2024-09-19T14:14:37.179230+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:09.695208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2470,"num_read_kb":2309,"num_write":565,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'244","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.284298+0000","last_change":"2024-09-19T14:14:29.284232+0000","last_active":"2024-09-19T14:14:29.284298+0000","last_peered":"2024-09-19T14:14:29.284298+0000","last_clean":"2024-09-19T14:14:29.284298+0000","last_became_active":"2024-09-19T13:36:07.798710+0000","last_became_peered":"2024-09-19T13:36:07.798710+0000","last_unstale":"2024-09-19T14:14:29.284298+0000","last_undegraded":"2024-09-19T14:14:29.284298+0000","last_fullsized":"2024-09-19T14:14:29.284298+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'244","last_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_deep_scrub":"260'244","last_deep_scrub_stamp":"2024-09-19T14:14:29.284150+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.284150+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:03.574863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":662,"num_read_kb":12703,"num_write":1156,"num_write_kb":29501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'798","reported_seq":2316,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.184755+0000","last_change":"2024-09-19T14:14:38.184755+0000","last_active":"2024-09-19T14:14:38.184755+0000","last_peered":"2024-09-19T14:14:38.184755+0000","last_clean":"2024-09-19T14:14:38.184755+0000","last_became_active":"2024-09-19T13:36:09.334401+0000","last_became_peered":"2024-09-19T13:36:09.334401+0000","last_unstale":"2024-09-19T14:14:38.184755+0000","last_undegraded":"2024-09-19T14:14:38.184755+0000","last_fullsized":"2024-09-19T14:14:38.184755+0000","mapping_epoch":24,"log_start":"260'700","ondisk_log_start":"260'700","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'798","last_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_deep_scrub":"260'798","last_deep_scrub_stamp":"2024-09-19T14:14:38.184639+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.184639+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:45.021809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3845,"num_read_kb":3451,"num_write":1078,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'200","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:32.783300+0000","last_change":"2024-09-19T14:14:32.783242+0000","last_active":"2024-09-19T14:14:32.783300+0000","last_peered":"2024-09-19T14:14:32.783300+0000","last_clean":"2024-09-19T14:14:32.783300+0000","last_became_active":"2024-09-19T13:36:07.809970+0000","last_became_peered":"2024-09-19T13:36:07.809970+0000","last_unstale":"2024-09-19T14:14:32.783300+0000","last_undegraded":"2024-09-19T14:14:32.783300+0000","last_fullsized":"2024-09-19T14:14:32.783300+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:32.783156+0000","last_clean_scrub_stamp":"2024-09-19T14:14:32.783156+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.959321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":31175,"num_write":936,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'412","reported_seq":1863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.794667+0000","last_change":"2024-09-19T14:14:39.794667+0000","last_active":"2024-09-19T14:14:39.794667+0000","last_peered":"2024-09-19T14:14:39.794667+0000","last_clean":"2024-09-19T14:14:39.794667+0000","last_became_active":"2024-09-19T13:36:09.330042+0000","last_became_peered":"2024-09-19T13:36:09.330042+0000","last_unstale":"2024-09-19T14:14:39.794667+0000","last_undegraded":"2024-09-19T14:14:39.794667+0000","last_fullsized":"2024-09-19T14:14:39.794667+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'412","last_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_deep_scrub":"260'412","last_deep_scrub_stamp":"2024-09-19T14:14:39.794561+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.794561+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:17.283150+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2125,"num_read_kb":2001,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'220","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:30.300531+0000","last_change":"2024-09-19T14:14:30.300531+0000","last_active":"2024-09-19T14:14:30.300531+0000","last_peered":"2024-09-19T14:14:30.300531+0000","last_clean":"2024-09-19T14:14:30.300531+0000","last_became_active":"2024-09-19T13:36:07.797974+0000","last_became_peered":"2024-09-19T13:36:07.797974+0000","last_unstale":"2024-09-19T14:14:30.300531+0000","last_undegraded":"2024-09-19T14:14:30.300531+0000","last_fullsized":"2024-09-19T14:14:30.300531+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-09-19T14:14:30.300443+0000","last_clean_scrub_stamp":"2024-09-19T14:14:30.300443+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:44.686591+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":616,"num_read_kb":31236,"num_write":1023,"num_write_kb":31132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"260'417","reported_seq":1928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.201597+0000","last_change":"2024-09-19T14:14:28.201597+0000","last_active":"2024-09-19T14:14:28.201597+0000","last_peered":"2024-09-19T14:14:28.201597+0000","last_clean":"2024-09-19T14:14:28.201597+0000","last_became_active":"2024-09-19T13:36:09.335295+0000","last_became_peered":"2024-09-19T13:36:09.335295+0000","last_unstale":"2024-09-19T14:14:28.201597+0000","last_undegraded":"2024-09-19T14:14:28.201597+0000","last_fullsized":"2024-09-19T14:14:28.201597+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-19T14:14:28.201511+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.201511+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:48.368700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2093,"num_write":470,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'290","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:31.793178+0000","last_change":"2024-09-19T14:14:31.793178+0000","last_active":"2024-09-19T14:14:31.793178+0000","last_peered":"2024-09-19T14:14:31.793178+0000","last_clean":"2024-09-19T14:14:31.793178+0000","last_became_active":"2024-09-19T13:36:07.810359+0000","last_became_peered":"2024-09-19T13:36:07.810359+0000","last_unstale":"2024-09-19T14:14:31.793178+0000","last_undegraded":"2024-09-19T14:14:31.793178+0000","last_fullsized":"2024-09-19T14:14:31.793178+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-19T14:14:31.793101+0000","last_clean_scrub_stamp":"2024-09-19T14:14:31.793101+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:55.675665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":727,"num_read_kb":11922,"num_write":1198,"num_write_kb":26323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'364","reported_seq":1810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.759457+0000","last_change":"2024-09-19T14:14:38.759457+0000","last_active":"2024-09-19T14:14:38.759457+0000","last_peered":"2024-09-19T14:14:38.759457+0000","last_clean":"2024-09-19T14:14:38.759457+0000","last_became_active":"2024-09-19T13:36:09.336745+0000","last_became_peered":"2024-09-19T13:36:09.336745+0000","last_unstale":"2024-09-19T14:14:38.759457+0000","last_undegraded":"2024-09-19T14:14:38.759457+0000","last_fullsized":"2024-09-19T14:14:38.759457+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-19T14:14:38.759372+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.759372+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:34.123627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1976,"num_read_kb":1888,"num_write":409,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'216","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.274839+0000","last_change":"2024-09-19T14:14:29.274839+0000","last_active":"2024-09-19T14:14:29.274839+0000","last_peered":"2024-09-19T14:14:29.274839+0000","last_clean":"2024-09-19T14:14:29.274839+0000","last_became_active":"2024-09-19T13:36:07.813916+0000","last_became_peered":"2024-09-19T13:36:07.813916+0000","last_unstale":"2024-09-19T14:14:29.274839+0000","last_undegraded":"2024-09-19T14:14:29.274839+0000","last_fullsized":"2024-09-19T14:14:29.274839+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-09-19T14:14:29.274732+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.274732+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:54.840076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":593,"num_read_kb":98527,"num_write":1024,"num_write_kb":17579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'870","reported_seq":2506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:38.147163+0000","last_change":"2024-09-19T14:14:38.147163+0000","last_active":"2024-09-19T14:14:38.147163+0000","last_peered":"2024-09-19T14:14:38.147163+0000","last_clean":"2024-09-19T14:14:38.147163+0000","last_became_active":"2024-09-19T13:36:09.337770+0000","last_became_peered":"2024-09-19T13:36:09.337770+0000","last_unstale":"2024-09-19T14:14:38.147163+0000","last_undegraded":"2024-09-19T14:14:38.147163+0000","last_fullsized":"2024-09-19T14:14:38.147163+0000","mapping_epoch":24,"log_start":"260'800","ondisk_log_start":"260'800","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'870","last_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_deep_scrub":"260'870","last_deep_scrub_stamp":"2024-09-19T14:14:38.147083+0000","last_clean_scrub_stamp":"2024-09-19T14:14:38.147083+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:06:43.098776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4223,"num_read_kb":3806,"num_write":1179,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'246","reported_seq":936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:29.136442+0000","last_change":"2024-09-19T14:14:29.136442+0000","last_active":"2024-09-19T14:14:29.136442+0000","last_peered":"2024-09-19T14:14:29.136442+0000","last_clean":"2024-09-19T14:14:29.136442+0000","last_became_active":"2024-09-19T13:36:07.814123+0000","last_became_peered":"2024-09-19T13:36:07.814123+0000","last_unstale":"2024-09-19T14:14:29.136442+0000","last_undegraded":"2024-09-19T14:14:29.136442+0000","last_fullsized":"2024-09-19T14:14:29.136442+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'246","last_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_deep_scrub":"260'246","last_deep_scrub_stamp":"2024-09-19T14:14:29.136336+0000","last_clean_scrub_stamp":"2024-09-19T14:14:29.136336+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:58.288005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":868,"num_read_kb":9315,"num_write":1049,"num_write_kb":26695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"260'1368","reported_seq":3085,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:36.236512+0000","last_change":"2024-09-19T14:14:36.236512+0000","last_active":"2024-09-19T14:14:36.236512+0000","last_peered":"2024-09-19T14:14:36.236512+0000","last_clean":"2024-09-19T14:14:36.236512+0000","last_became_active":"2024-09-19T13:36:09.340944+0000","last_became_peered":"2024-09-19T13:36:09.340944+0000","last_unstale":"2024-09-19T14:14:36.236512+0000","last_undegraded":"2024-09-19T14:14:36.236512+0000","last_fullsized":"2024-09-19T14:14:36.236512+0000","mapping_epoch":24,"log_start":"260'1300","ondisk_log_start":"260'1300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1368","last_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_deep_scrub":"260'1368","last_deep_scrub_stamp":"2024-09-19T14:14:36.236418+0000","last_clean_scrub_stamp":"2024-09-19T14:14:36.236418+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:57.105756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8287,"num_read_kb":7567,"num_write":2115,"num_write_kb":897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'257","reported_seq":891,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.074777+0000","last_change":"2024-09-19T14:14:33.074714+0000","last_active":"2024-09-19T14:14:33.074777+0000","last_peered":"2024-09-19T14:14:33.074777+0000","last_clean":"2024-09-19T14:14:33.074777+0000","last_became_active":"2024-09-19T13:36:07.806625+0000","last_became_peered":"2024-09-19T13:36:07.806625+0000","last_unstale":"2024-09-19T14:14:33.074777+0000","last_undegraded":"2024-09-19T14:14:33.074777+0000","last_fullsized":"2024-09-19T14:14:33.074777+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'257","last_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_deep_scrub":"260'257","last_deep_scrub_stamp":"2024-09-19T14:14:33.074609+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.074609+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:15.486564+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":638,"num_read_kb":13968,"num_write":1077,"num_write_kb":38347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'510","reported_seq":2135,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.286931+0000","last_change":"2024-09-19T14:14:42.286931+0000","last_active":"2024-09-19T14:14:42.286931+0000","last_peered":"2024-09-19T14:14:42.286931+0000","last_clean":"2024-09-19T14:14:42.286931+0000","last_became_active":"2024-09-19T13:36:09.335897+0000","last_became_peered":"2024-09-19T13:36:09.335897+0000","last_unstale":"2024-09-19T14:14:42.286931+0000","last_undegraded":"2024-09-19T14:14:42.286931+0000","last_fullsized":"2024-09-19T14:14:42.286931+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'510","last_scrub_stamp":"2024-09-19T14:14:42.286833+0000","last_deep_scrub":"260'510","last_deep_scrub_stamp":"2024-09-19T14:14:42.286833+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.286833+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:27.122118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2801,"num_read_kb":2617,"num_write":621,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'223","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:25.140942+0000","last_change":"2024-09-19T14:14:25.140942+0000","last_active":"2024-09-19T14:14:25.140942+0000","last_peered":"2024-09-19T14:14:25.140942+0000","last_clean":"2024-09-19T14:14:25.140942+0000","last_became_active":"2024-09-19T13:36:07.807902+0000","last_became_peered":"2024-09-19T13:36:07.807902+0000","last_unstale":"2024-09-19T14:14:25.140942+0000","last_undegraded":"2024-09-19T14:14:25.140942+0000","last_fullsized":"2024-09-19T14:14:25.140942+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'223","last_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_deep_scrub":"260'223","last_deep_scrub_stamp":"2024-09-19T14:14:25.140874+0000","last_clean_scrub_stamp":"2024-09-19T14:14:25.140874+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:35.398581+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":601,"num_read_kb":75622,"num_write":971,"num_write_kb":29118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'451","reported_seq":1956,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.168528+0000","last_change":"2024-09-19T14:14:39.168465+0000","last_active":"2024-09-19T14:14:39.168528+0000","last_peered":"2024-09-19T14:14:39.168528+0000","last_clean":"2024-09-19T14:14:39.168528+0000","last_became_active":"2024-09-19T13:36:09.337663+0000","last_became_peered":"2024-09-19T13:36:09.337663+0000","last_unstale":"2024-09-19T14:14:39.168528+0000","last_undegraded":"2024-09-19T14:14:39.168528+0000","last_fullsized":"2024-09-19T14:14:39.168528+0000","mapping_epoch":24,"log_start":"260'400","ondisk_log_start":"260'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'451","last_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_deep_scrub":"260'451","last_deep_scrub_stamp":"2024-09-19T14:14:39.168391+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.168391+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:37.445191+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2343,"num_read_kb":2192,"num_write":526,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'200","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:33.769229+0000","last_change":"2024-09-19T14:14:33.769229+0000","last_active":"2024-09-19T14:14:33.769229+0000","last_peered":"2024-09-19T14:14:33.769229+0000","last_clean":"2024-09-19T14:14:33.769229+0000","last_became_active":"2024-09-19T13:36:07.810417+0000","last_became_peered":"2024-09-19T13:36:07.810417+0000","last_unstale":"2024-09-19T14:14:33.769229+0000","last_undegraded":"2024-09-19T14:14:33.769229+0000","last_fullsized":"2024-09-19T14:14:33.769229+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'200","last_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_deep_scrub":"260'200","last_deep_scrub_stamp":"2024-09-19T14:14:33.769142+0000","last_clean_scrub_stamp":"2024-09-19T14:14:33.769142+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:09:16.153085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":544,"num_read_kb":10629,"num_write":1012,"num_write_kb":18229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'199","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:34.744446+0000","last_change":"2024-09-19T14:14:34.744446+0000","last_active":"2024-09-19T14:14:34.744446+0000","last_peered":"2024-09-19T14:14:34.744446+0000","last_clean":"2024-09-19T14:14:34.744446+0000","last_became_active":"2024-09-19T13:36:07.816458+0000","last_became_peered":"2024-09-19T13:36:07.816458+0000","last_unstale":"2024-09-19T14:14:34.744446+0000","last_undegraded":"2024-09-19T14:14:34.744446+0000","last_fullsized":"2024-09-19T14:14:34.744446+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'199","last_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_deep_scrub":"260'199","last_deep_scrub_stamp":"2024-09-19T14:14:34.744323+0000","last_clean_scrub_stamp":"2024-09-19T14:14:34.744323+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:13.419758+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":6982,"num_write":950,"num_write_kb":19942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'989","reported_seq":2920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:39.211591+0000","last_change":"2024-09-19T14:14:39.211498+0000","last_active":"2024-09-19T14:14:39.211591+0000","last_peered":"2024-09-19T14:14:39.211591+0000","last_clean":"2024-09-19T14:14:39.211591+0000","last_became_active":"2024-09-19T13:36:09.340079+0000","last_became_peered":"2024-09-19T13:36:09.340079+0000","last_unstale":"2024-09-19T14:14:39.211591+0000","last_undegraded":"2024-09-19T14:14:39.211591+0000","last_fullsized":"2024-09-19T14:14:39.211591+0000","mapping_epoch":24,"log_start":"260'900","ondisk_log_start":"260'900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'989","last_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_deep_scrub":"260'989","last_deep_scrub_stamp":"2024-09-19T14:14:39.211398+0000","last_clean_scrub_stamp":"2024-09-19T14:14:39.211398+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":900,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:47.763679+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5154,"num_read_kb":4657,"num_write":1326,"num_write_kb":545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4337,"num_omap_keys":17,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'233","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:28.306234+0000","last_change":"2024-09-19T14:14:28.306234+0000","last_active":"2024-09-19T14:14:28.306234+0000","last_peered":"2024-09-19T14:14:28.306234+0000","last_clean":"2024-09-19T14:14:28.306234+0000","last_became_active":"2024-09-19T13:36:07.805609+0000","last_became_peered":"2024-09-19T13:36:07.805609+0000","last_unstale":"2024-09-19T14:14:28.306234+0000","last_undegraded":"2024-09-19T14:14:28.306234+0000","last_fullsized":"2024-09-19T14:14:28.306234+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'233","last_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_deep_scrub":"260'233","last_deep_scrub_stamp":"2024-09-19T14:14:28.306126+0000","last_clean_scrub_stamp":"2024-09-19T14:14:28.306126+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.168938+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":722,"num_read_kb":54230,"num_write":1173,"num_write_kb":29860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'388","reported_seq":1934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-19T14:14:42.732752+0000","last_change":"2024-09-19T14:14:42.732692+0000","last_active":"2024-09-19T14:14:42.732752+0000","last_peered":"2024-09-19T14:14:42.732752+0000","last_clean":"2024-09-19T14:14:42.732752+0000","last_became_active":"2024-09-19T13:36:09.336068+0000","last_became_peered":"2024-09-19T13:36:09.336068+0000","last_unstale":"2024-09-19T14:14:42.732752+0000","last_undegraded":"2024-09-19T14:14:42.732752+0000","last_fullsized":"2024-09-19T14:14:42.732752+0000","mapping_epoch":24,"log_start":"260'300","ondisk_log_start":"260'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-19T14:14:42.732611+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-19T14:14:42.732611+0000","last_clean_scrub_stamp":"2024-09-19T14:14:42.732611+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.549453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2129,"num_read_kb":2046,"num_write":428,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10842,"num_read_kb":8743,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":997,"ondisk_log_size":997,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":16358,"num_read_kb":16047,"num_write":17076,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1669,"ondisk_log_size":1669,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":646,"ondisk_log_size":646,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":314615,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":7869,"num_read_kb":9932,"num_write":5261,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702536,"num_omap_keys":1622,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1988,"ondisk_log_size":1988,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2407,"num_read_kb":2874,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219746,"num_read_kb":201068,"num_write":55823,"num_write_kb":19037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35717,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40883929,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38761,"num_read_kb":2616727,"num_write":63893,"num_write_kb":2249332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82804736,"data_stored":81767858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4188,"ondisk_log_size":4188,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":176453,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":179418,"num_write":154,"num_write_kb":116946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542625,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":235860,"kb_used_data":15876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94135980,"statfs":{"total":96636764160,"available":96395243520,"internally_reserved":0,"allocated":16257024,"data_stored":14556338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225245642},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542626,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230792,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94141048,"statfs":{"total":96636764160,"available":96400433152,"internally_reserved":0,"allocated":15327232,"data_stored":13795194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542626,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102852,"kb_used_data":13428,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94268988,"statfs":{"total":96636764160,"available":96531443712,"internally_reserved":0,"allocated":13750272,"data_stored":12053849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542629,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94804,"kb_used_data":19204,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94277036,"statfs":{"total":96636764160,"available":96539684864,"internally_reserved":0,"allocated":19664896,"data_stored":18070568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542627,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248784,"kb_used_data":19072,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94123056,"statfs":{"total":96636764160,"available":96382009344,"internally_reserved":0,"allocated":19529728,"data_stored":17906941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542627,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75700,"kb_used_data":8420,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296140,"statfs":{"total":96636764160,"available":96559247360,"internally_reserved":0,"allocated":8622080,"data_stored":7083388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542626,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128220,"kb_used_data":6860,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94243620,"statfs":{"total":96636764160,"available":96505466880,"internally_reserved":0,"allocated":7024640,"data_stored":5427412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542627,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242092,"kb_used_data":12380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94129748,"statfs":{"total":96636764160,"available":96388861952,"internally_reserved":0,"allocated":12677120,"data_stored":10986646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8458240,"data_stored":8279931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3432448,"data_stored":3312234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5058560,"data_stored":4967857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15912960,"data_stored":15790141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16105472,"data_stored":15955950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10084352,"data_stored":9935554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11751424,"data_stored":11680028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12001280,"data_stored":11846163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T14:15:46.679 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T14:15:47.009 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T14:15:47.009 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T14:15:47.009 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T14:15:47.010 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.054 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T14:15:47.054 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T14:15:47.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.101 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T14:15:47.101 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T14:15:47.101 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.143 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T14:15:47.144 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T14:15:47.144 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.190 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T14:15:47.191 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T14:15:47.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.232 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T14:15:47.233 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T14:15:47.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.310 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T14:15:47.310 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T14:15:47.311 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.392 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T14:15:47.393 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T14:15:47.393 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.442 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T14:15:47.443 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T14:15:47.443 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T14:15:47.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.468 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T14:15:47.469 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T14:15:47.469 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.500 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T14:15:47.500 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T14:15:47.500 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T14:15:47.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.523 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T14:15:47.523 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T14:15:47.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.576 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T14:15:47.576 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T14:15:47.577 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T14:15:47.589 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T14:15:47.589 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T14:15:47.592 DEBUG:teuthology.orchestra.run.smithi094:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-19T14:15:47.657 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T14:15:47.657 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T14:15:47.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T14:15:47.886 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T14:15:48.003 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T14:15:48.003 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T14:15:48.083 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T14:15:48.083 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T14:15:48.192 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T14:15:48.193 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T14:15:48.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T14:15:48.426 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T14:15:48.526 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T14:15:48.526 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T14:15:48.597 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T14:15:48.598 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T14:15:48.664 INFO:tasks.ceph:Archiving mon data... 2024-09-19T14:15:48.665 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/data/mon.a.tgz 2024-09-19T14:15:48.665 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-19T14:15:48.695 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.NN80u0Fjlt 2024-09-19T14:15:48.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NN80u0Fjlt 2024-09-19T14:15:48.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.NN80u0Fjlt 2024-09-19T14:15:48.996 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.NN80u0Fjlt is 463KB 2024-09-19T14:15:49.092 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.NN80u0Fjlt 2024-09-19T14:15:49.121 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/data/mon.c.tgz 2024-09-19T14:15:49.122 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-19T14:15:49.189 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.nx825mL3h3 2024-09-19T14:15:49.189 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.nx825mL3h3 2024-09-19T14:15:49.372 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.nx825mL3h3 2024-09-19T14:15:49.483 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.nx825mL3h3 is 471KB 2024-09-19T14:15:49.566 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.nx825mL3h3 2024-09-19T14:15:49.594 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/data/mon.b.tgz 2024-09-19T14:15:49.594 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-19T14:15:49.630 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.d0MvJL7Y33 2024-09-19T14:15:49.630 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.d0MvJL7Y33 2024-09-19T14:15:49.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.d0MvJL7Y33 2024-09-19T14:15:49.934 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.d0MvJL7Y33 is 471KB 2024-09-19T14:15:50.035 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.d0MvJL7Y33 2024-09-19T14:15:50.063 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T14:15:50.064 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T14:15:50.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T14:15:50.174 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T14:15:50.211 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T14:15:50.211 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T14:15:50.213 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/remote/smithi094/crash 2024-09-19T14:15:50.213 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T14:15:50.252 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/remote/smithi149/crash 2024-09-19T14:15:50.253 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T14:15:50.291 INFO:tasks.ceph:Compressing logs... 2024-09-19T14:15:50.291 DEBUG:teuthology.orchestra.run.smithi094:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T14:15:50.296 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T14:15:50.331 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105553.log 2024-09-19T14:15:50.331 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T14:15:50.388 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33221.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33221.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33221.log.gz 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33045.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33265.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33001.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33265.log.gz 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33133.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33089.log 2024-09-19T14:15:50.389 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33001.log.gz 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33133.log.gz 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33177.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33089.log: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33089.log.gz 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.33177.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33177.log.gz --verbose 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr: -- /var/log/ceph/ceph-osd.5.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33309.log 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.33309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33309.log.gz 2024-09-19T14:15:50.390 INFO:teuthology.orchestra.run.smithi149.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T14:15:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190577.log 2024-09-19T14:15:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.105553.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153868.log 2024-09-19T14:15:50.440 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105553.log.gz 2024-09-19T14:15:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190577.log.gz 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.153868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55361.log 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55950.log 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.55361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191221.log 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.55361.log.gz 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.55950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190945.log 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.55950.log.gz 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153868.log.gz -5 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.81993.log 2024-09-19T14:15:50.441 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191221.log.gz 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39449.log 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190945.log.gz 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.81993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149743.log 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81993.log.gz 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129114.log 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39449.log.gz 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.149743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40225.log 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149743.log.gz/var/log/ceph/ceph-client.admin.129114.log: 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94362.log 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40225.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129114.log.gzgzip 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.182050.log 2024-09-19T14:15:50.442 INFO:teuthology.orchestra.run.smithi094.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40225.log.gz 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.94362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94362.log.gz 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.182050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165192.log 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.182050.log.gz 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100841.log 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.165192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178396.log 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.100841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117923.log 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.165192.log.gz 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100841.log.gz 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.178396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80815.log 2024-09-19T14:15:50.443 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.178396.log.gz 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.117923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48810.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.80815.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.117923.log.gz -- 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.110855.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67014.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48810.log.gz 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80815.log.gz 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.110855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110855.log.gz 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.67014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130881.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.130881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43288.log 2024-09-19T14:15:50.444 INFO:teuthology.orchestra.run.smithi094.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.130881.log.gz 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163966.log 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164603.log 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.43288.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43288.log.gz 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.163966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109088.log 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.67014.log.gz 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.163966.log.gz 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160369.log 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164603.log: /var/log/ceph/ceph-client.admin.109088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131470.log 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr: 90.1% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.164603.log.gz -- replaced with /var/log/ceph/ceph-client.admin.109088.log.gz 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.160369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59580.log 2024-09-19T14:15:50.445 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.131470.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160369.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104964.log 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131470.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186276.log 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.59580.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.104964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114389.log 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.186276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83171.log 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104964.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.114389.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.186276.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170037.log 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.114389.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.83171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84938.log 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.83171.log.gz 2024-09-19T14:15:50.446 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.170037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38742.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.84938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42082.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170037.log.gz 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.84938.log.gz 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127347.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38742.log.gz 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.42082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52416.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42082.log.gz 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.127347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152688.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.52416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142072.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.52416.log.gz 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.152688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60758.log 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.152688.log.gz 2024-09-19T14:15:50.447 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104375.log 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.142072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72488.log 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60758.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.127347.log.gz 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.104375.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.60758.log.gz 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143250.log 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.104375.log.gz 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.72488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190991.log 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.72488.log.gz 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.143250.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.142072.log.gz 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110266.log 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190991.log.gz 2024-09-19T14:15:50.448 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.143250.log.gz 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77594.log 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.110266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107320.log 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.77594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110266.log.gz 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159780.log 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.0.77594.log.gz 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189623.log 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.107320.log: /var/log/ceph/ceph-client.admin.159780.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107320.log.gz 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.189623.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.159780.log.gz 2024-09-19T14:15:50.449 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190899.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162740.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57765.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190899.log.gz 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106142.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162740.log.gz 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127936.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.189623.log.gz 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57765.log: /var/log/ceph/ceph-client.admin.106142.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.57765.log.gz 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106142.log.gz 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188234.log 2024-09-19T14:15:50.450 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.127936.log: /var/log/ceph/ceph-client.admin.48786.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127936.log.gz 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91417.log 0.0% 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177178.log 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.91417.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.188234.log.gz 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164555.log 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.91417.log.gz 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.177178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111444.log 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1%gzip -- replaced with /var/log/ceph/ceph-client.0.177178.log.gz -5 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.170645.log 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164555.log.gz 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.111444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167875.log 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.170645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90239.log 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111444.log.gz 2024-09-19T14:15:50.451 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.167875.log: gzip -5 --verbose -- 92.2% /var/log/ceph/ceph-client.admin.124402.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170645.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99074.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.90239.log: /var/log/ceph/ceph-client.admin.124402.log: gzip -5 --verbose 90.3% -- replaced with /var/log/ceph/ceph-client.admin.167875.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: -- /var/log/ceph/ceph-client.admin.38617.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.124402.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.99074.log: gzip 82.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.99074.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.191083.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.38617.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.147386.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38617.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38374.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.90239.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191083.log.gz 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.147386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171253.log 2024-09-19T14:15:50.452 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.147386.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38374.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134415.log 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.171253.log: /var/log/ceph/ceph-client.admin.46430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38071.log 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171253.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.134415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168483.log 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.134415.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.38071.log: --verbose -- /var/log/ceph/ceph-client.admin.39313.log 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38071.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.168483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76219.log 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168483.log.gz 2024-09-19T14:15:50.453 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39313.log.gz 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188137.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38950.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.76219.log: /var/log/ceph/ceph-client.admin.188137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188137.log.gz 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140305.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.76219.log.gz 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122635.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38950.log.gz 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.140305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173224.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.122635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76985.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140305.log.gz 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122635.log.gz 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.173224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183268.log 2024-09-19T14:15:50.454 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132648.log 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.76985.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173224.log.gz 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.183268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58943.log 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.183268.log.gz 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.132648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119101.log 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132648.log.gz 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.58943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174711.log 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.119101.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.58943.log.gz 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.119101.log.gz -5 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37877.log 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.174711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92595.log 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37877.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37877.log.gz 2024-09-19T14:15:50.455 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47608.log 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.92595.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.76985.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38376.log 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92595.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47608.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.174711.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.47608.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58354.log 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38376.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116745.log 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.58354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66394.log 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.116745.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.58354.log.gz 2024-09-19T14:15:50.456 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119690.log 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116745.log.gz 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.66394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96718.log 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190439.log 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.119690.log: /var/log/ceph/ceph-client.admin.96718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176567.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119690.log.gz 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96718.log.gz 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190439.log.gz 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73669.log 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.0.176567.log: --verbose -- /var/log/ceph/ceph-client.admin.62566.log 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.73669.log: 80.0% -- replaced with /var/log/ceph/ceph-client.0.176567.log.gz 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62502.log 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62566.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.73669.log.gz 2024-09-19T14:15:50.457 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39608.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62566.log.gz 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.62502.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.155635.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.62502.log.gz 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.39608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.155635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190255.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.155635.log.gz/var/log/ceph/ceph-client.admin.44920.log: 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.39608.log.gz 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190347.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190301.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190255.log.gz 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75610.log 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190347.log.gz 2024-09-19T14:15:50.458 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190301.log.gz 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38377.log 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66394.log.gz 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.75610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84349.log 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38377.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.75610.log.gz 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38377.log.gz -5 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48197.log 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.84349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162788.log 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.84349.log.gz 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.48197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59532.log 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.48197.log.gz 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73077.log 2024-09-19T14:15:50.459 INFO:teuthology.orchestra.run.smithi094.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.162788.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90828.log 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59532.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79048.log 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.73077.log: /var/log/ceph/ceph-client.admin.90828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190669.log 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.73077.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90828.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.79048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113800.log 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190669.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.79048.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190669.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179614.log 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159759.log 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.113800.log: /var/log/ceph/ceph-client.0.179614.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113800.log.gz 2024-09-19T14:15:50.460 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40870.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.179614.log.gz 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.159759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63916.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159759.log.gz 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.40870.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63916.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.40870.log.gz 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62063.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133826.log 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62063.log.gz 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130292.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.133826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56539.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.130292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57176.log 2024-09-19T14:15:50.461 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.130292.log.gz 2024-09-19T14:15:50.462 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.56539.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.56539.log.gz 2024-09-19T14:15:50.462 INFO:teuthology.orchestra.run.smithi094.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.133826.log.gz 2024-09-19T14:15:50.462 INFO:teuthology.orchestra.run.smithi094.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T14:15:50.462 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65154.log 2024-09-19T14:15:50.462 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57176.log: -- /var/log/ceph/ceph-client.admin.190807.log 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.65154.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.57176.log.gz 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151510.log 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190807.log.gz 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162136.log 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.151510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156813.log 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.151510.log.gz 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135004.log 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.156813.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162136.log.gz 2024-09-19T14:15:50.464 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87294.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.156813.log.gz 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.135004.log: -- /var/log/ceph/ceph-client.admin.93773.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.87294.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.135004.log.gz 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54183.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.87294.log.gz 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.93773.log: gzip -5 --verbose -- 81.3% -- replaced with /var/log/ceph/ceph-client.admin.93773.log.gz 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.112033.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.54183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67633.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.54183.log.gz 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.112033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191175.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112033.log.gz 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169429.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.67633.log: /var/log/ceph/ceph-client.admin.191175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135593.log 2024-09-19T14:15:50.465 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191175.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.169429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190853.log 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.135593.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135593.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: 93.7% 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65154.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.169429.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62434.log 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67633.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95540.log 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190853.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79637.log 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.95540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191267.log 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0%/var/log/ceph/ceph-client.admin.79637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83760.log 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95540.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79637.log.gz 2024-09-19T14:15:50.466 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191267.log.gz 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.83760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69490.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr: 89.9%/var/log/ceph/ops-log-ceph-client.admin.log: -- replaced with /var/log/ceph/ceph-client.admin.83760.log.gz 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161547.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41479.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.69490.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.63916.log.gz 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.161547.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.161547.log.gz 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187525.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.41479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71395.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.41479.log.gz 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.187525.log.gz 2024-09-19T14:15:50.467 INFO:teuthology.orchestra.run.smithi094.stderr: 88.4%/var/log/ceph/ceph-client.admin.71395.log: -- replaced with /var/log/ceph/ceph-client.admin.69490.log.gzgzip 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.179005.log 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.71395.log.gz 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163377.log 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.179005.log: gzip 84.2% -- replaced with /var/log/ceph/ceph-client.0.179005.log.gz 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54772.log 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:gzip/var/log/ceph/ceph-client.admin.163377.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.140894.log 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: 94.3%/var/log/ceph/ceph-client.admin.54772.log: -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 86.7% -- replaced with /var/log/ceph/ceph-client.admin.163377.log.gz 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191360.log 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.54772.log.gz 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.140894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63327.log 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.140894.log.gz 2024-09-19T14:15:50.468 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182659.log 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191360.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5/var/log/ceph/ceph-client.admin.63327.log: --verbose -- /var/log/ceph/ceph-client.admin.190715.log 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.182659.log: 83.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61933.log 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63327.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.182659.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149154.log 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190715.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39539.log 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.61933.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.149154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87883.log 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.149154.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152099.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39539.log.gz 2024-09-19T14:15:50.469 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.87883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190531.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.87883.log.gz 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.152099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59556.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190531.log.gz 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190485.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.59556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59556.log.gz 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164579.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.152099.log.gz 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190485.log.gz 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.164579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128525.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164579.log.gz 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37966.log 2024-09-19T14:15:50.470 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.128525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101430.log 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.128525.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37966.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70109.log 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37966.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.101430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184486.log 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101430.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183877.log 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.70109.log: /var/log/ceph/ceph-client.0.184486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63147.log 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.184486.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.183877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180223.log 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62434.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63147.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.183877.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70109.log.gz 2024-09-19T14:15:50.471 INFO:teuthology.orchestra.run.smithi094.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.63147.log.gz 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57128.log 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.180223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51214.log 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.180223.log.gz 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144441.log 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57128.log.gz 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38992.log 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51214.log.gz 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.144441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85527.log 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.144441.log.gz 2024-09-19T14:15:50.472 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38992.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188185.log 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.85527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99663.log 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.85527.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120868.log 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188185.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80226.log 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.99663.log: /var/log/ceph/ceph-client.admin.120868.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.99663.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75441.log 82.0% -- replaced with /var/log/ceph/ceph-client.admin.120868.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.80226.log: gzip -5 --verbose -- 80.7% -- replaced with /var/log/ceph/ceph-client.admin.80226.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr: /var/log/ceph/ceph-client.admin.50012.log 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.75441.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.75441.log.gz 2024-09-19T14:15:50.473 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64535.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68871.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.50012.log: /var/log/ceph/ceph-client.admin.64535.log: 85.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38373.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.68871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136182.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.64535.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156224.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38373.log: /var/log/ceph/ceph-client.admin.136182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38373.log.gz 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.136182.log.gz/var/log/ceph/ceph-client.admin.156224.log: 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115567.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.156224.log.gz 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103197.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.115567.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.68871.log.gz 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51190.log 2024-09-19T14:15:50.474 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.103197.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.115567.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86116.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr: 89.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103197.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.86116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114978.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.47019.log: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38117.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86116.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94951.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.114978.log: /var/log/ceph/ceph-client.admin.38117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157402.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38117.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.94951.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114978.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157991.log 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94951.log.gz 2024-09-19T14:15:50.475 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.157402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147976.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157402.log.gz 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81404.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.157991.log: /var/log/ceph/ceph-client.admin.147976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39145.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.157991.log.gz 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.81404.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.147976.log.gz 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.81404.log.gz 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39145.log: -- /var/log/ceph/ceph-client.admin.190623.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39145.log.gz 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137360.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190623.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165781.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186865.log 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.137360.log: /var/log/ceph/ceph-client.admin.165781.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.137360.log.gz 2024-09-19T14:15:50.476 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.165781.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51238.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.186865.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.186865.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120279.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108499.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.51238.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.120279.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120279.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141483.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74850.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.108499.log: /var/log/ceph/ceph-client.admin.141483.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108499.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.141483.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106731.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38369.log 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.74850.log: /var/log/ceph/ceph-client.admin.106731.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.74850.log.gz 2024-09-19T14:15:50.477 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42685.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38369.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82582.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.42685.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.106731.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42685.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102019.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97307.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.82582.log: /var/log/ceph/ceph-client.admin.102019.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82582.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr: 82.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103786.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102019.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.97307.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97307.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88472.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.103786.log: /var/log/ceph/ceph-mgr.y.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103786.log.gz 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62289.log 2024-09-19T14:15:50.478 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.88472.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88472.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38745.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62289.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62289.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60169.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38745.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38993.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.60169.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.60169.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138538.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38993.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191313.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.138538.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138538.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98485.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191313.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.98485.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98485.log.gz 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154457.log 2024-09-19T14:15:50.479 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T14:15:50.537 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86705.log 2024-09-19T14:15:50.537 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.154457.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.154457.log.gz 2024-09-19T14:15:50.537 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39097.log 2024-09-19T14:15:50.537 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.86705.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86705.log.gz 2024-09-19T14:15:50.537 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162764.log 2024-09-19T14:15:50.537 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39097.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33121.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.162764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162764.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139716.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.33121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33121.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102608.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.139716.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139716.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177787.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.102608.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102608.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136771.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.177787.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.177787.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173832.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.136771.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.136771.log.gz 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70731.log 2024-09-19T14:15:50.538 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.173832.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173832.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175958.log 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.70731.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.70731.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153279.log 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74259.log 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.175958.log: /var/log/ceph/ceph-client.admin.153279.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.175958.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.153279.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188929.log 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.74259.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.74259.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146208.log 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.188929.log: /var/log/ceph/ceph-client.admin.53005.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.188929.log.gz 2024-09-19T14:15:50.539 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142661.log 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.146208.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.146208.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123813.log 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191404.log 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.142661.log: /var/log/ceph/ceph-client.admin.123813.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.142661.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.123813.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121457.log 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150332.log 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191404.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.121457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129703.log 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.150332.log: 94.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121457.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.150332.log.gz 2024-09-19T14:15:50.540 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97896.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.129703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125580.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.129703.log.gz 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.97896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39405.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97896.log.gz 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65773.log/var/log/ceph/ceph-client.admin.125580.log: 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39405.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38367.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39405.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125580.log.gz 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50601.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.65773.log: /var/log/ceph/ceph-client.admin.38367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123224.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.50601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155046.log 2024-09-19T14:15:50.541 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50601.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.123224.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.123224.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118512.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.155046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145030.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.118512.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.155046.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.118512.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148565.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.145030.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145030.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191037.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.148565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159169.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191037.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.148565.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191037.log.gz 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38025.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.159169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45515.log 2024-09-19T14:15:50.542 INFO:teuthology.orchestra.run.smithi094.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.159169.log.gz/var/log/ceph/ceph-client.admin.38025.log: 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38025.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62370.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.45515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146797.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.65773.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.62370.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.45515.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62370.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175319.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.146797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76929.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.146797.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.175319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92006.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150921.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.76929.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175319.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr: 50.7% -- replaced with /var/log/ceph/ceph-client.admin.76929.log.gz 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.92006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2024-09-19T14:15:50.543 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92006.log.gz 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122046.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.150921.log: /var/log/ceph/ceph-client.admin.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57152.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.150921.log.gz 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.122046.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.57152.log: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188210.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.122046.log.gz 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57152.log.gz 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188115.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188210.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89061.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188210.log.gz 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181441.log 2024-09-19T14:15:50.544 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.89061.log: /var/log/ceph/ceph-client.admin.188115.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.188115.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89061.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49423.log 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38741.log 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.181441.log: /var/log/ceph/ceph-client.admin.49423.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.181441.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.49423.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89650.log 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38741.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.51827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32783.log 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.89650.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.89650.log.gz 2024-09-19T14:15:50.545 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143852.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.32783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109677.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32783.log.gz 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.143852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124991.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.109677.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.109677.log.gz 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.143852.log.gz 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160958.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.124991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116156.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.124991.log.gz 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.160958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187455.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.116156.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.160958.log.gz 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.116156.log.gz 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100252.log 2024-09-19T14:15:50.546 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39585.log 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.100252.log: /var/log/ceph/ceph-client.admin.187455.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.187455.log.gz 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39495.log 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100252.log.gz 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167226.log 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39585.log.gz 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39495.log.gz 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180832.log 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.167226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158580.log 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.167226.log.gz 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.0.180832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185095.log 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.158580.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.180832.log.gz 2024-09-19T14:15:50.547 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158580.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37941.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.185095.log: -- /var/log/ceph/ceph.tmp-client.admin.26691.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.185095.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.37941.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190393.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37941.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191129.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph.tmp-client.admin.26691.log: /var/log/ceph/ceph-client.admin.190393.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26691.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190393.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38163.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.191129.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139127.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191129.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187501.log 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38163.log.gz 2024-09-19T14:15:50.548 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.139127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113211.log 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139127.log.gz 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187501.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.187501.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.107909.log 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187477.log 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.113211.log: /var/log/ceph/ceph-client.admin.107909.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.107909.log.gz 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38739.log 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.187477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187477.log.gz 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96129.log 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38739.log.gz 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113211.log.gz 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68252.log 2024-09-19T14:15:50.549 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.96129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132059.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96129.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.68252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.132059.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.132059.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63213.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.53594.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172616.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.63213.log: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.63213.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78459.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.172616.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172616.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137949.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.78459.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.78459.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145619.log 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.137949.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.137949.log.gz 2024-09-19T14:15:50.550 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38624.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.145619.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.145619.log.gz 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126758.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38624.log.gz 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117334.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.126758.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126758.log.gz 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172008.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.117334.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117334.log.gz 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.172008.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172008.log.gz 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39133.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93184.log 2024-09-19T14:15:50.551 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39133.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68252.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112622.log 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.93184.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.93184.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39067.log 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.112622.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112622.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61656.log 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.39067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39067.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126169.log 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.61656.log: 59.9% -- replaced with /var/log/ceph/ceph-client.admin.61656.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38625.log 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.126169.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126169.log.gz 2024-09-19T14:15:50.552 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190761.log 2024-09-19T14:15:50.553 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.38625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38625.log.gz 2024-09-19T14:15:50.553 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188161.log 2024-09-19T14:15:50.553 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.190761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190761.log.gz 2024-09-19T14:15:50.553 INFO:teuthology.orchestra.run.smithi094.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133237.log 2024-09-19T14:15:50.553 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.188161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188161.log.gz 2024-09-19T14:15:50.553 INFO:teuthology.orchestra.run.smithi094.stderr:/var/log/ceph/ceph-client.admin.133237.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.133237.log.gz 2024-09-19T14:15:50.779 INFO:teuthology.orchestra.run.smithi149.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T14:15:50.995 INFO:teuthology.orchestra.run.smithi094.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T14:15:51.353 INFO:teuthology.orchestra.run.smithi149.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T14:15:52.489 INFO:teuthology.orchestra.run.smithi094.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T14:15:53.893 INFO:teuthology.orchestra.run.smithi094.stderr: 93.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-19T14:15:56.741 INFO:teuthology.orchestra.run.smithi094.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T14:15:58.254 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T14:15:58.406 INFO:teuthology.orchestra.run.smithi094.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T14:15:58.604 INFO:teuthology.orchestra.run.smithi149.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T14:15:59.928 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T14:16:02.574 INFO:teuthology.orchestra.run.smithi094.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T14:16:06.556 INFO:teuthology.orchestra.run.smithi149.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T14:16:06.558 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-09-19T14:16:06.558 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m16.193s 2024-09-19T14:16:06.558 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m41.580s 2024-09-19T14:16:06.558 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m1.578s 2024-09-19T14:16:11.599 INFO:teuthology.orchestra.run.smithi094.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T14:16:11.602 INFO:teuthology.orchestra.run.smithi094.stderr: 2024-09-19T14:16:11.602 INFO:teuthology.orchestra.run.smithi094.stderr:real 0m21.280s 2024-09-19T14:16:11.602 INFO:teuthology.orchestra.run.smithi094.stderr:user 0m52.255s 2024-09-19T14:16:11.602 INFO:teuthology.orchestra.run.smithi094.stderr:sys 0m2.027s 2024-09-19T14:16:11.602 INFO:tasks.ceph:Archiving logs... 2024-09-19T14:16:11.602 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/remote/smithi094/log 2024-09-19T14:16:11.603 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T14:16:19.148 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/remote/smithi149/log 2024-09-19T14:16:19.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T14:16:25.027 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T14:16:25.038 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T14:16:25.039 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T14:16:25.042 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T14:16:25.152 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T14:16:25.162 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T14:16:25.162 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T14:16:25.164 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T14:16:25.192 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-09-19T14:16:25.193 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-09-19T14:16:25.196 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T14:16:25.196 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-09-19T14:16:25.196 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv01.front.sepia.ceph.com 3 7 377 44 -287us[ -309us] +/- 40ms 2024-09-19T14:16:25.196 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +75us[ +75us] +/- 58ms 2024-09-19T14:16:25.196 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +372us[ +351us] +/- 63ms 2024-09-19T14:16:25.196 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T14:16:25.198 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T14:16:25.198 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-09-19T14:16:25.198 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 -302us[ -305us] +/- 40ms 2024-09-19T14:16:25.198 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 +99us[ +104us] +/- 58ms 2024-09-19T14:16:25.198 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +391us[ +396us] +/- 63ms 2024-09-19T14:16:25.198 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T14:16:25.199 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T14:16:25.209 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T14:16:25.210 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T14:16:25.219 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T14:16:25.321 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T14:16:25.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T14:16:25.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:16:25.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T14:16:25.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:16:25.480 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T14:16:25.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T14:16:25.499 INFO:teuthology.task.internal:Duration was 2869.690070 seconds 2024-09-19T14:16:25.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T14:16:25.509 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T14:16:25.509 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T14:16:25.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T14:16:25.562 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T14:16:25.572 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T14:16:25.926 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T14:16:25.926 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-09-19T14:16:25.926 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T14:16:25.959 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-19T14:16:25.959 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T14:16:25.998 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T14:16:25.999 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T14:16:26.002 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T14:16:26.078 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T14:16:26.079 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T14:16:26.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T14:16:26.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T14:16:26.244 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T14:16:26.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T14:16:26.282 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T14:16:26.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T14:16:26.333 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T14:16:26.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T14:16:26.370 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-09-19T14:16:26.398 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-19T14:16:26.440 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T14:16:26.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:16:26.469 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T14:16:26.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:16:26.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T14:16:26.520 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T14:16:26.521 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/remote/smithi094 2024-09-19T14:16:26.521 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T14:16:26.572 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912478/remote/smithi149 2024-09-19T14:16:26.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T14:16:26.618 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T14:16:26.618 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T14:16:26.621 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T14:16:26.682 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T14:16:26.694 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T14:16:26.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T14:16:26.703 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T14:16:26.704 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T14:16:26.706 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T14:16:26.732 INFO:teuthology.orchestra.run.smithi094.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 14:16 /home/ubuntu/cephtest 2024-09-19T14:16:26.750 INFO:teuthology.orchestra.run.smithi149.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 14:16 /home/ubuntu/cephtest 2024-09-19T14:16:26.751 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T14:16:26.762 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T14:16:26.786 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2869.6900701522827 flavor: default owner: scheduled_yuvalif@teuthology success: true 2024-09-19T14:16:26.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T14:16:26.876 INFO:teuthology.run:pass